Viv
Viv

Reputation: 1756

FaceBook Page Crawling

I was developing a social media aggregator and was wondering if there was a way to crawl FaceBook, Twitter and other social media networking sites, by using Java Code. I want to crawl specific data from FaceBook Pages. Do I require specific permissions from FaceBook or any other requirement?

Upvotes: 2

Views: 2671

Answers (2)

WizKid
WizKid

Reputation: 4908

Yes according to https://www.facebook.com/apps/site_scraping_tos_terms.php you need written permission from Facebook if you are going to crawl them.

Upvotes: 1

Cheruvian
Cheruvian

Reputation: 5867

Technically yes... #2 https://www.facebook.com/legal/terms

If you're building it in Java as a Robot, I've had more success using JS and a local/remote webserver. Though this in theory is more easily detected

If you're building it as an essentially automated web browser as long as you rate limit yourself and add in a little random wait there is no good way of detecting it.

Upvotes: 2

Related Questions