Using sp::over, RStudio Session abnormally terminated due to an unexpected crash

[thisisdaryn]

I am reporting having a problem doing a computation in this project: Posit Cloud

Specifically I am getting a message The previous R session was abnormally terminated due to an unexpected crash. You may have lost workspace data as a result of this crash.

This has occurred on multiple occasions and the computation has yet to run to completion on any occasion. It is a computation that takes between 1 and 2 minutes on my own laptop. The output from one instance on my computer is at the end of this post.

In RStudio cloud, it crashes at the following line:

rainfall_interior_spdf <- rainfall_spdf[!is.na(sp::over(rainfall_spdf, aus_spdf)), ] 

Output when running on my laptop (object sizes of all objects in the environment printed first):

lobstr::obj_size(aus_rainfall)
11,488 B
lobstr::obj_size(australia)
4,420,664 B
lobstr::obj_size(rainfall_spdf)
17,147,800 B
lobstr::obj_size(aus_spdf)
4,419,176 B

t1 <- Sys.time()
rainfall_interior_spdf <- rainfall_spdf[!is.na(sp::over(rainfall_spdf, aus_spdf)), ]
t2 <- Sys.time()

t2 - t1
Time difference of 1.335538 mins

-thanks
Daryn

[andresrcs]

Very likely you are exceeding the 1GB RAM memory limit on RStudio Cloud and that hardly would be the case in your local system.

[thisisdaryn]

This is my hunch as well.

I am trying to figure out how to debug in this situation. In RStudio Cloud, I get the same error - eventually - upon entering the debug browser to step-through sp::over. (On my own machine, I keep getting an R Session Aborted message instantaneously upon trying to debug sp::over.)