Reputation: 1756
I was developing a social media aggregator and was wondering if there was a way to crawl FaceBook, Twitter and other social media networking sites, by using Java Code. I want to crawl specific data from FaceBook Pages. Do I require specific permissions from FaceBook or any other requirement?
Upvotes: 2
Views: 2671
Reputation: 4908
Yes according to https://www.facebook.com/apps/site_scraping_tos_terms.php you need written permission from Facebook if you are going to crawl them.
Upvotes: 1
Reputation: 5867
Technically yes... #2 https://www.facebook.com/legal/terms
If you're building it in Java as a Robot, I've had more success using JS and a local/remote webserver. Though this in theory is more easily detected
If you're building it as an essentially automated web browser as long as you rate limit yourself and add in a little random wait there is no good way of detecting it.
Upvotes: 2