• Activity
  • Votes
  • Comments
  • New
  • All activity
    • Showing only topics with the tag "web scraping". Back to normal view

    9. I made a (very, very) basic Tildes scraper and cli browser ruby gem

      ~tildes Text 92 words
      Here's the ruby gem page and here's the github. Right now it comes with a command line browser that can browse the front page and group pages with no sorting options, and you can view the contents...

      Here's the ruby gem page and here's the github. Right now it comes with a command line browser that can browse the front page and group pages with no sorting options, and you can view the contents of a topic (link or text) aswell as the comments. The methods defined in lib/tilde-scraper/api.rb can be used to scrape tildes pages into Group, Page, Topic, and Comment objects.

      Right now it's super basic and messy, but I figured if anyone was interested in it it would be the people here.

      9 votes