CODEWITHSUNDEEP
web-crawlerui-automationmozmill
Matthieu
Matthieu

Reputation: 361

Mozmill : list of keywords --> first result URLs in Google

I have a list of keywords. With Mozmill, I'd like to get the first result URL for each of those keyword when doing a search on Google

Upvotes: 0

Views: 140

Answers (1)

Kiril
Kiril

Reputation: 40385

You will have to provide MozMill with a list of URLs which it should crawl, so you have to generate the URLs of the pages you'd like to crawl. Google supports various queries, here is the format of the URL: http://www.google.com/search?q=keyword

You have to replace "keyword" with your actual keyword, so let's say your keywords include the words dentist, iphone, eye drops, you would generate the following 3 URLs:

http://www.google.com/search?q=dentist http://www.google.com/search?q=iphone http://www.google.com/search?q=eye%20drops (note: the space is URL encoded)

Here are a couple of more detailed explanations all the parameters you can have in Google URL:

From then on you're going to have to do some work in order to properly select the result URLs (i.e. you have to write some code). I don't think MozMill offers that functionality out of the box and I don't think there are any other crawlers that do.

Upvotes: 1

Related Questions