CODEWITHSUNDEEP
r
symn28
symn28

Reputation: 13

Error: cannot allocate vector of size 1000.0 Mb R

I am trying to load a txt file into R and running into memory errors. When I checked the available memory it says 8072. I tried using fread and for some reason it shuts down. The file has 785,000,000 records, 2 columns (1 GB). I am using an 8 GB machine running 64 bit. I have loaded far larger data sets than this in the past. Any recommendations? 

memory.limit()

data<-read.table("volume.txt",sep="\t")[,c(ttl_units)]

require(data.table)
fread("shipped asin volume.txt",sep="\t", header= TRUE)-> pre

Upvotes: 0

Views: 1054

Answers (1)

Lunalo John
Lunalo John

Reputation: 325

One way to solve this is to restart R

Also, AWAY FROM THIS, it is not recommended to use require when calling libraries because this means you are trying to load and if it loads it is equivalent to TRUE...

Upvotes: 0

Related Questions