How to read large data files?
I have a data file of 550MB. There are 60000 rows and 35 columns. Every time I read datasets it takes more time.
Are there any ways to read data from databases or anything like that.
Please help me with step-to-step for the problem.
After you read this data once, (I assume its a text based format...) save it out in a more efficient binary format. and subsequently read that data in future sessions putting the text original aside.
I find the fst package very good for this workflow.
Try vroom or fread.
@nirgrahamuk Thanks.