CODEWITHSUNDEEP
pythonheroku
Sam Adams
Sam Adams

Reputation: 11

How to Access text files uploaded to Heroku that is running with Python Script

apologies upfront. I am an extreme newbie and this is probably a very easy question. After much trial and error, I set up an app on Heroku that runs a python script that scrapes data off of a website and stores it in a text file. (I may switch the output to a .csv file). The script and app are running on a Heroku Scheduler, so the scraping takes place on a schedule and the data automatically gets written to the file that is on the Heroku platform. I simply want to download the particular output file occasionally so that I can look at it. (Part of the data that is scraped is being tweeted on a twitter bot that is part of the script.)

(Not sure that this is relevant but I uploaded everything through Git.)

Many thank in advance.

Upvotes: 1

Views: 1849

Answers (2)

Nathan Loyer
Nathan Loyer

Reputation: 1349

Not just ephemeral, but immutable, which means you can't write to the file system. You'll have to put the file in something like S3, or just put the data into a database like Postgres.

Upvotes: 1

Michał Młoźniak
Michał Młoźniak

Reputation: 5556

You can run this command heroku run cat path/to/file.txt, but keep in mind that Heroku uses ephemeral storage, so you don't have any guarantee that your file will be there.

For example, Heroku restarts your dynos every 24 hours or so. After that you won't have that file anymore. The general practice is to store files on some external storage provider like Amazon S3.

Upvotes: 1

Related Questions