Not able to run Random Forest

mishabalyasin · November 26, 2019, 6:08pm

Unfortunately, the answer is probably to get a bigger machine. Or rent one from AWS/Google/Azure etc. One thing for sure - RStudio Cloud is not a good fit for you since, as I've said, it's limited to 1Gb of RAM.

There are some more suggestions here:

A general question about processing Big data (Size greater than available memory) in R General

It's a general question. I have to process Data size greater than memory. ~30-80 GBs. Mostly, data fails to read or system crashes. Processing involves (Data cleaning, manipulation and/or visualization). Work involved: - Data Cleaning = replacing, removing and editing strings. Manipulation = creating variables from strings and then passed to regression model. Or some basic function like count of words. Visualization = Plotting multiple variables in leaflet, or generating bar or pie charts. I generally use aws for these problems, but out of curiosity , if someone faces data size problem, what method(s) one would implement to tackle this problem, in low end …