Steve Jorgensen
Steve Jorgensen

Reputation: 12361

Transient filesystem key/value store from Ruby on Heroku?

I need to run a process that deals with a large volume of data. Too large to reasonably work with in RAM. The data does not need to be preserved between process instances or shared between process instances though, so I was hoping to use some kind of disk-based database for the storage.

My first thought was SQLite, but Heroku explicitly does not support that. Te second thing that I tried was Ruby's PStore, but that turned out to be way too flakey for the job. The next thing that I tried was DBM, which Heroku does not seem to say that they don't support. When I tried to run the code after deploying it, however, I got "LoadError: cannot load such file -- dbm".

Given that I do not need data to be persisted between process instances, is there any way to work around Heroku's bias against support for file-based relational or key/value data stores?

Upvotes: 0

Views: 106

Answers (1)

Nathan Loyer
Nathan Loyer

Reputation: 1349

I'm not sure what the structure of the data is, but have you considered using Redis? There is an effective free tier on Heroku. The issue with file based solutions are that Heroku uses an ephemeral file system. It's not designed to scale disk space among computing units.

Upvotes: 1

Related Questions