I made a (very, very) basic Tildes scraper and CLI browser ruby gem

clone1
Sat, 05 Oct 2019 05:27:54 +0000

Here's the ruby gem page and here's the github. Right now it comes with a command line browser that can browse the front page and group pages with no sorting options, and you can view the contents of a topic (link or text) aswell as the comments. The methods defined in lib/tilde-scraper/api.rb can be used to scrape tildes pages into Group, Page, Topic, and Comment objects.

Right now it's super basic and messy, but I figured if anyone was interested in it it would be the people here.

Comments URL: https://tildes.net/~tildes/i4x/i_made_a_very_very_basic_tildes_scraper_and_cli_browser_ruby_gem

Votes: 9

Comments: 0