There are restrictions on uploading more than 10,000 files to shinyapp.io.

My local data is very small but has 100,000 files. There is no problem with the capacity that Shinyapp is limiting, but there is a problem with the number of files. How can I upload all the local data?
Local data is a .csv file.

shiny app limit capacity/file count: 3GB/10,000
Local data capacity/file count: 100MB/100,000

Error text :
it contains too many files(the maximum number of files is 10000). Remove some files or adjust the rsconnect.max.bunfle.files option

Unhandled Exception: Child Task 993899356 failed: Error parsing manifest: Manifest file count (38062) greater than maximum allowed (6000)

Hi,

Welcome to the forum!

I don't know what is in the files, but 100,000 of them sounds like a lot :slight_smile: If the total size is very small, it seems that this might not be the best way of storing the data.

Here are two suggestions not knowing the actual data content:

  • Merge small csv files into one large file by adding a unique file id
  • Use a SQLite database to store and access the data instead.

Hope this helps,
PJ

1 Like

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.

If you have a query related to it or one of the replies, start a new topic and refer back with a link.