50 votes

Announcing Tildes Stats, a website with Tildes Stats

Hey everyone, it's me, that guy that posts Tildes statistics every now and then. I've wanted to make a website that automatically updated the statistics I could generate for a while now. So I decided to start working on it and now a few days later, I've got something I think is worth sharing.

Located here at ts.bauke.xyz.

There's not much yet, I only just finished the user count chart 20 minutes ago, but it's a start and I've already got a few more charts in my head that I can get to work on with the current data.

Some key selling points:

  • SVG charts, no more pixelated messes. Crisp and scalable only!
  • No JavaScript, it's all back-end baby.
  • Light and Dark themes, selectable in the footer.

The way it works right now is: every day, once a day it will scrape a number of locations (currently /financials and /groups) and save the wanted data in the database. For the financials that's only the final numbers (income, expense, goal) and not all the individual income/expense entries. And for groups the name, description and the subscriber count is saved. Then when that's finished, it will generate the HTML and the charts, and finally go back to sleep.

The charts I'm planning on adding next are:

  1. The financial numbers over time. Now available in the Financials section.
  2. The group subscriber counts over time.

Once those are done, I'll be moving on to topics and comments, and probably recreate all the statistics I had available in the last time I did this. If you have any suggestions or anything else about the site, feel free to comment or message me them.

And I think that's it, thanks for reading and checking it out! :3 I hope there's not enough people on Tildes to hug the server to death, that'd be not so ideal. 😬

25 comments

  1. [2]
    Deimos
    Link
    Geez, Bauke, just when I think you're starting to slow down on Tildes projects a little, you turn around and launch yet another one. This looks great, thanks as always for working on things like...

    Geez, Bauke, just when I think you're starting to slow down on Tildes projects a little, you turn around and launch yet another one.

    This looks great, thanks as always for working on things like this. Maybe I can help pull out some historical data for topics/comments when you get that set up, so you can have the past filled in too.

    18 votes
    1. Bauke
      Link Parent
      Haha, sike? :P I'm still thinking of how I want to approach the topics/comments data, when I get around to it I'll probably end up doing a "full pass" to get all the posts up until now and then...

      Haha, sike? :P I'm still thinking of how I want to approach the topics/comments data, when I get around to it I'll probably end up doing a "full pass" to get all the posts up until now and then have it only scrape new stuff daily. And then maybe once a month do a full pass to update everything or something. I'm not entirely sure yet. Or maybe I'll just keep it simple and only do new stuff and ask you for the previous data, I'll let you know. :)

      11 votes
  2. [3]
    Turtle
    Link
    Unique users posting every day/week/month would be interesting to see how big the active user base actually is. It seems like only a small fraction post anything?

    If you have any suggestions or anything else about the site, feel free to comment or message me them.

    Unique users posting every day/week/month would be interesting to see how big the active user base actually is. It seems like only a small fraction post anything?

    10 votes
    1. [2]
      Kuromantis
      Link Parent
      According to this chart he made some time ago, and this statistic Deimos scraped a bit longer ago, ~200 posters and 1000 users.

      According to this chart he made some time ago, and this statistic Deimos scraped a bit longer ago, ~200 posters and 1000 users.

      6 votes
      1. Deimos
        Link Parent
        That's definitely low. There have been 538 different users that have posted at least one topic or comment in the last 30 days.

        That's definitely low. There have been 538 different users that have posted at least one topic or comment in the last 30 days.

        12 votes
  3. [2]
    Icarus
    Link
    Very cool @Bauke, you never cease to impress me! How often are you scraping?

    Very cool @Bauke, you never cease to impress me! How often are you scraping?

    6 votes
    1. Bauke
      Link Parent
      At the moment just once a day, I figured since there's not so much activity on Tildes right now that it should be any more than that.

      At the moment just once a day, I figured since there's not so much activity on Tildes right now that it should be any more than that.

      8 votes
  4. [2]
    Akir
    Link
    Anyone who uses SVG charts in their design gets my instant respect. There's literally no excuse to use anything else.

    Anyone who uses SVG charts in their design gets my instant respect. There's literally no excuse to use anything else.

    5 votes
    1. Bauke
      Link Parent
      Big shoutout to the Rust Plotters library for making it super easy to output a bunch of different formats (including SVG).

      Big shoutout to the Rust Plotters library for making it super easy to output a bunch of different formats (including SVG).

      4 votes
  5. Eabryt
    Link
    Very cool. I look forward to seeing how this goes.

    Very cool. I look forward to seeing how this goes.

    4 votes
  6. [2]
    Staross
    Link
    Nice but I have to say I can't really read this, the colors fuck me up.

    Nice but I have to say I can't really read this, the colors fuck me up.

    2 votes
    1. Bauke
      (edited )
      Link Parent
      I'll be adding a light theme soon, if that's the issue. In the meantime if you have Stylus or other CSS-changing capabilities you can change all the CSS custom properties as defined in :root and...

      I'll be adding a light theme soon, if that's the issue. In the meantime if you have Stylus or other CSS-changing capabilities you can change all the CSS custom properties as defined in :root and have it use any colors you like. Though unfortunately that won't change the SVG colors. Edit: Although maybe I can make SVG output with custom properties. :o

      Edit: a light theme has been added, you can select it in the footer.

      6 votes
  7. [7]
    guts
    Link
    This kind of projects is what put Tildes ahead to others Reddit like platforms. Great work!. Interesting Anime has the most subscribers but has little activity.

    This kind of projects is what put Tildes ahead to others Reddit like platforms. Great work!.

    Interesting Anime has the most subscribers but has little activity.

    2 votes
    1. [6]
      Kuromantis
      (edited )
      Link Parent
      It doesn't?

      Anime has the most subscribers but has little activity.

      Group Subscribers
      ~anime 10667
      ~arts 11897

      It doesn't?

      1 vote
      1. [5]
        guts
        Link Parent
        You are right my mistake :)

        You are right my mistake :)

        3 votes
        1. [4]
          Apos
          Link Parent
          It's sorted alphabetically by group. I made the same mistake when I read it the other day. It surprised me so much I spent a bit of time reading it carefully.

          It's sorted alphabetically by group. I made the same mistake when I read it the other day. It surprised me so much I spent a bit of time reading it carefully.

          4 votes
          1. [3]
            Bauke
            Link Parent
            I've added a little triangle to the table header indicating how it's sorted, hopefully that clears up any confusion. :) (cc. @guts)

            I've added a little triangle to the table header indicating how it's sorted, hopefully that clears up any confusion. :)

            (cc. @guts)

            5 votes
            1. [2]
              Apos
              Link Parent
              Oddly enough it renders as a square on my phone.

              Oddly enough it renders as a square on my phone.

              2 votes
              1. Bauke
                (edited )
                Link Parent
                Tested it on mine and I'm also getting a square, I guess I'll have to change it to a different triangle. Edit: should be fixed now. 😀

                Tested it on mine and I'm also getting a square, I guess I'll have to change it to a different triangle.

                Edit: should be fixed now. 😀

                3 votes
  8. [6]
    ThatFanficGuy
    Link
    Why is it hosted on your domain and not on Tildes'?

    Why is it hosted on your domain and not on Tildes'?

    1 vote
    1. [4]
      Bauke
      Link Parent
      Because it's a project by me and not an official Tildes one. :P

      Because it's a project by me and not an official Tildes one. :P

      8 votes
      1. [3]
        ThatFanficGuy
        Link Parent
        At this stage, is it worth making this distinction? @Deimos, have you given any thought to incorporating this, or any other Tildes-related, project under the official banner?

        At this stage, is it worth making this distinction?

        @Deimos, have you given any thought to incorporating this, or any other Tildes-related, project under the official banner?

        3 votes
        1. [2]
          Deimos
          Link Parent
          I don't really know what that would mean. I'd like to have some official stats available on the site itself, but I'm not going to like... let people upload projects to the Tildes domain with no...

          I don't really know what that would mean. I'd like to have some official stats available on the site itself, but I'm not going to like... let people upload projects to the Tildes domain with no oversight.

          People building related projects on their own is great, it means they can use whatever tools/tech/etc. that they're interested in. Trying to make it "official" means they'll probably have to deal with my restrictions on what I want to have on the Tildes server/domain, which isn't always something they'd want to do.

          6 votes
          1. ThatFanficGuy
            Link Parent
            I'm not proposing. That, and the second paragraph's presented obstacles, is averted when you give a badge of approval to a tool you deem valuable that isn't of Tildes itself. @Bauke sure as shit...

            but I'm not going to like... let people upload projects to the Tildes domain with no oversight

            I'm not proposing.

            That, and the second paragraph's presented obstacles, is averted when you give a badge of approval to a tool you deem valuable that isn't of Tildes itself. @Bauke sure as shit deserves one, given any single Tildes-related project.

            "I'm commander Deimos, and this is my favorite unofficial Tildes project on the Internet"

            2 votes
    2. Eabryt
      Link Parent
      Technically I don't think it's affiliated with Tildes in anyway.

      Technically I don't think it's affiliated with Tildes in anyway.

      4 votes