Chrome/Firefox Plugin to locally scrape data from multiple URLs

douchebag
2024-04-17T10:47:28Z

As the title suggests, I am looking for a free chrome or firefox plugin that can locally scrape data from multiple URLs. To be a bit more precise, what I mean by it:

A free chrome or firefox plugin

Local scraping: it runs in the browser itself. No cloud computing or "credits" required to run

Scrape data: Collects predefined data from certain data fields within a website such as https://www.dastelefonbuch.de/Suche/Test

Infinite scroll: to load data that only loads once the browser scrolls down (kind of like in the page I linked above)

I am not looking into programming my own scraper using python or anything similar. I have found plugins that "kind of" do what I am describing above, and about two weeks ago I found one that pretty much perfectly does what is described ("DataGrab"), but it starts asking to buy credits after running it a few times.

My own list:

DataGrab: Excellent, apart from asking to buy credits after a while

SimpleScraper: Excellent, but asks to buy credits pretty much immediately

Easy Scraper: Works well for single pages, but no possibility to feed in multiple URLs to crawl

Instant Data Scraper: Works well for single pages and infinite scroll pages, but no possibility to feed in multiple URLs to crawl

"Data Scraper - Easy Web Scraping" / dataminer.io: Doesn't work well

Scrapy.org: Too much programming, but looks quite neat and well documented

Any suggestions are highly welcome!

Edit: A locally run executable or cmd-line based program would be fine too, as long as it just needs to be configured (e.g., creating a list of URLs stored in a .txt or .csv file) instead of coded (e.g., coding an infinite scroll function from scratch).

Comments URL: https://tildes.net/~tech/1foe/chrome_firefox_plugin_to_locally_scrape_data_from_multiple_urls

Votes: 8

Comments: 7