Reputation: 1811
I'm interested at looking at website usage, question types, and answers on stack overflow. Is there a way to download all of the content?
I've considered web scraping with beautiful soup or similar as an option, but thought that there are so many expert users the information might be readily available through an API.
Upvotes: 3
Views: 2143
Reputation: 185540
Yes, as you guess, there's a JSON API, check https://blog.stackoverflow.com/2012/09/stack-exchange-api-v2-1/
To get all the questions by example : https://api.stackexchange.com/docs/questions
It require a programmatic browser and a JSON parser. It's quite simple with perl, python or ruby.
Another solution proposed by fvu in the comments is to parse a full snapshot of any stackexchange site
Upvotes: 3