StackOverflow Questions for Tag: anemone

Hugo Sousa

Reputation: 916

How to handle 500 Internal Server Error and 404 Page Not Found with Anemone, Boilerpipe and Nokigiri

ruby-on-railsrubynokogirihttp-erroranemone

Score: 2

Answers: 2

Sergey Blohin

Reputation: 620

HTTP Basic Authentication with Anemone Web Spider

rubyweb-crawleranemone

Score: 2

Answers: 1

dbuss1

Reputation: 82

Heroku H12 Request timeout when running Ruby Anemone

rubyherokuanemonerequest-timed-out

Score: 1

Answers: 1

Cole Fichter

Reputation: 41

How to deserialize BSON::Binary back into ruby hash?

rubymongodbanemone

Score: 2

Answers: 1

tven

Reputation: 547

anemone print links on first page

rubyanemone

Score: 0

Answers: 1

lulalala

Reputation: 17991

Can Anemone keep previously stored pages when recrawling

rubyweb-crawleranemone

Score: 3

Answers: 0

Michael Emond

Reputation: 131

Rails Anemone and Postgres storing just the URL

ruby-on-railsrubypostgresqlanemone

Score: 2

Answers: 1

Aayush

Reputation: 1254

Regular expression in Ruby

rubyregexanemone

Score: 4

Answers: 2

Anu11

Reputation: 316

Error in fetching a list of urls from a website using anemone

rubyanemone

Score: 3

Answers: 1

Ghilas BELHADJ

Reputation: 14124

How to crawl only a subfolder with Anemone

rubyweb-crawleranemone

Score: 2

Answers: 1

Bhushan Lodha

Reputation: 6862

Crawling sub-domain with Anemone

rubyweb-crawleranemone

Score: 3

Answers: 2

viotech

Reputation: 105

Ruby, Mongodb, Anemone: web crawler with possible memory leak?

rubymongodbmemory-leaksweb-crawleranemone

Score: 8

Answers: 2

Micah Alcorn

Reputation: 2383

Anemone with Rails and MongoDB

mongodbruby-on-rails-3.1mongoidweb-crawleranemone

Score: 1

Answers: 1

sunnyrjuneja

Reputation: 6123

Ruby+Anemone Web Crawler: regex to match URLs ending in a series of digits

rubyregexruby-on-rails-3web-crawleranemone

Score: 3

Answers: 2

Bhushan Lodha

Reputation: 6862

Skipping web-pages with extension pdf, zip from crawling in Anemone

rubyruby-on-rails-3ruby-on-rails-3.1web-crawleranemone

Score: 3

Answers: 1

Jamie McCrindle

Reputation: 9204

Getting all the domains a page depends on using Nokogiri

rubynokogirianemone

Score: 2

Answers: 1

Benjamin

Reputation: 561

anemone ignore url links including a certain phrase

rubyweb-scrapinganemone

Score: 2

Answers: 1

PreviousPage 2Next