I’m testing a dataset exported from a drama app (includes show metadata, episode runtime, and subtitle timing).
The file is around 600MB, and Posit Cloud throws a memory error while importing it.
What’s the best practice for handling such large files — chunked reading or connecting directly via database?
Also, how much RAM allocation is typically enough for such workloads?
Tags: posit-cloud, data-upload, large-files, shiny