CODEWITHSUNDEEP
web-crawler
Some Guy
Some Guy

Reputation: 11

Do open source web indexes exist?

Is there a open source web index that is based on spiders that progressively search and index more and more pages from the entire internet (not just 1 site)? If such an index exists, what would I need in order to access it? Are there API calls for this?

Upvotes: 1

Views: 690

Answers (1)

user3188445
user3188445

Reputation: 4794

Yes, Gigablast is an open-source web search engine. The API is documented here. I believe this is the source code, so you can run your own instance.

Upvotes: 1

Related Questions