CODEWITHSUNDEEP
web-scraping
user2808117
user2808117

Reputation: 4877

Is there a scraper application like KimonoLabs?

I have used scrapy and beautiful soup many times, however find kimonolabs solution much easier and faster. The only problem is that sometimes jobs do need a bit of tweaking, which is not possible (e.g., crawling using a unique pattern).

Is there any other solution which combines the ease with optional complexity? Mainly I want to define a page scraping template using a WYSIWYG interface, and then programatically write the crawler.

Upvotes: 0

Views: 476

Answers (3)

Priyanka Rathee
Priyanka Rathee

Reputation: 1075

Try Agenty

Agenty has exact same feature to scrape websites, and the Chrome extension to setup the scraping agents. You can just install the extension and create agents to scrape any site.

enter image description here

FYI : We also have plan to launch hosted solution and REST API by April, 2016 (Update - API is available now)

You may see more details on website (www.datascraping.co) now Agenty.com

Disclosure : I'm one of the founding member

Upvotes: 1

Andrew Fogg
Andrew Fogg

Reputation: 695

Use an Import.io extractor.

  1. Download the Import.io browser
  2. Create an extractor (what you call a "scraping template")
  3. From your code use the extractor's REST API

Upvotes: 3

Sergiu Toarca
Sergiu Toarca

Reputation: 2749

Full disclosure: I'm one of the founders of ParseHub.

ParseHub tries to solve exactly this problem. It gives you a gui and powerful tools for defining templates visually, and falls back to a subset of javascript if you need more fine-grained control. All of the programming primitives that you're familiar with (if, for, break, recursion, etc.) are available.

You can find it at www.parsehub.com

Upvotes: 1

Related Questions