Thanks for the added detail. ulimit
isn't something that can be set in R or RStudio, it comes from the operating system. I'm sorry I gave you an out-of-date-fix. Window's UNIX-like are now accessible through Powershell.
If your case if you have only 8GB of RAM, increasing ulimit
beyond 8067 will have no effect; your objects need to be able to fit in RAM and they obviously can't if you don't have enough.
The best alternative if adding memory to, say, 32GB isn't an option is to rent time on a heavy duty AWS EC2 instance using one of the provisioned R images that I've heard of, but I have no personal experience with that.
1 Like
Try
x <- data.frame(x = runif(1000000000*0.5))
This will show if R is using your available 8Gb correctly.
Thanks for the info. I'll look into cloud computing or simply add more ram to my computer. Thanks again!
I am able to run this code. However, I believe that my computer simply does not have enough memory to run the analysis. I may purchase additional ram or take Richard's advice and look into cloud computing. Thanks for all the help!
cderv
November 2, 2019, 8:34am
25
I am not sure where you are at on this issue but know that there is bug regarding memory.limit
, R 3.6 and RStudio IDE that has been resolved.
See
opened 02:54PM - 20 Jun 19 UTC
closed 09:07PM - 15 Oct 19 UTC
bug
reproducible
On Windows 10 64bit
Base R's memory.limit() function reports wildly different… results in (a) R Console and (b) RStudio 1.3.2xx's console for R 3.6.0.
R3.5.3 reports 16279, as expected on my system, in both RConsole and RStudio.
R3.6.0 reports 16279 (R Console) and erroneously reports 17592186044416 (RStudio console)
memory.limit() results:
. | R 3.5.3 | R 3.6.0
---|---|---
R Console | 16279 | 16279
RStudio 1.3.2xx | 16279 | 17592186044416
```
######################################################################################
# R 3.5.3 (R console)
######################################################################################
> Sys.info()
sysname release version machine
"Windows" "10 x64" "build 16299" "x86-64"
> R.version
_
platform x86_64-w64-mingw32
arch x86_64
os mingw32
system x86_64, mingw32
status
major 3
minor 5.3
year 2019
month 03
day 11
svn rev 76217
language R
version.string R version 3.5.3 (2019-03-11)
nickname Great Truth
> rstudioapi::getVersion()
Error: RStudio not running
> memory.limit()
[1] 16279
> memory.size()
[1] 41.87
######################################################################################
# R 3.6.0 (R console)
######################################################################################
> Sys.info()
sysname release version machine
"Windows" "10 x64" "build 16299" "x86-64"
> R.version
_
platform x86_64-w64-mingw32
arch x86_64
os mingw32
system x86_64, mingw32
status
major 3
minor 6.0
year 2019
month 04
day 26
svn rev 76424
language R
version.string R version 3.6.0 (2019-04-26)
nickname Planting of a Tree
> rstudioapi::getVersion()
Error: RStudio not running
> memory.limit()
[1] 16279
> memory.size()
[1] 42.77
######################################################################################
# R 3.5.3 (RStudio)
######################################################################################
> Sys.info()
sysname release version machine
"Windows" "10 x64" "build 16299" "x86-64"
> R.version
_
platform x86_64-w64-mingw32
arch x86_64
os mingw32
system x86_64, mingw32
status
major 3
minor 5.3
year 2019
month 03
day 11
svn rev 76217
language R
version.string R version 3.5.3 (2019-03-11)
nickname Great Truth
> rstudioapi::getVersion()
[1] ‘1.3.236’
> memory.limit()
[1] 16279
> memory.size()
[1] 74.1
######################################################################################
# R 3.6.0 (RStudio)
######################################################################################
> Sys.info()
sysname release version machine
"Windows" "10 x64" "build 16299" "x86-64"
> R.version
_
platform x86_64-w64-mingw32
arch x86_64
os mingw32
system x86_64, mingw32
status
major 3
minor 6.0
year 2019
month 04
day 26
svn rev 76424
language R
version.string R version 3.6.0 (2019-04-26)
nickname Planting of a Tree
> rstudioapi::getVersion()
[1] ‘1.3.236’
> memory.limit()
[1] 1.759219e+13
> memory.size()
[1] 43.41
######################################################################################
# R 3.5.3 (RStudio)
######################################################################################
> Sys.info()
sysname release version machine
"Windows" "10 x64" "build 16299" "x86-64"
> R.version
_
platform x86_64-w64-mingw32
arch x86_64
os mingw32
system x86_64, mingw32
status
major 3
minor 5.3
year 2019
month 03
day 11
svn rev 76217
language R
version.string R version 3.5.3 (2019-03-11)
nickname Great Truth
> rstudioapi::getVersion()
[1] ‘1.3.260’
> memory.limit()
[1] 16279
> memory.size()
[1] 74.43
######################################################################################
# R 3.6.0 (RStudio)
######################################################################################
> Sys.info()
sysname release version machine
"Windows" "10 x64" "build 16299" "x86-64"
> R.version
_
platform x86_64-w64-mingw32
arch x86_64
os mingw32
system x86_64, mingw32
status
major 3
minor 6.0
year 2019
month 04
day 26
svn rev 76424
language R
version.string R version 3.6.0 (2019-04-26)
nickname Planting of a Tree
> rstudioapi::getVersion()
[1] ‘1.3.260’
> memory.limit()
[1] 1.759219e+13
> memory.size()
[1] 55.22
```
And it is available in the preview release
See release Note
I really don't know if it is related (seems a bit different) but it worth a try just in case, and it is good to reference this here I guess.
3 Likes
It's been a while but I finally got it done.
Amazon cloud service's virtual computers did the trick. Turns out I needed at least 80Gbs of RAM. Thanks for the help!
2 Likes
system
Closed
November 23, 2019, 5:28am
28
This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.