CODEWITHSUNDEEP
data-miningweb-crawler
John
John

Reputation:

Which web language can be used for data mining or web crawling

if I want to build a complex webiste like google news , which gathers data from oher websites. like data mining , crawling. In which language should i build the website.

Currently i know only PHP. Can i do that in PHP

Upvotes: 1

Views: 1502

Answers (2)

Cerin
Cerin

Reputation: 64901

Python is a great language for both of these tasks. I can't easily name all the available packages out there, but the first that come to mind for web crawling are Mechanize and BeautifulSoup. Orange and NLTK implement several data mining algorithms.

Upvotes: 2

BG100
BG100

Reputation: 4531

It sounds like you need to build two apps, something to crawl the web and store the data in a database, then a website to display the collected data. I would use Perl to crawl the web for it's good string manipulation features.

Upvotes: 0

Related Questions