List Columns and Memory

Hi @davidhen, another option I like may be using sparklyr locally in your machine. You can create multiple tables and then relate them via dplyr joins, that way you won't need list columns. There a bit more detail in this reply: Limitations of R

3 Likes