Collect and code, until it is done.

And now it is.

Ladies (the few that we have, I mean holy ^FUCK ), gents and everyone inbetween, welcome to the results of the 2020 Tildes census, which is only 34% less horrifying than 2020 itself. And you better believe I'm going to keep this up for the whole post, because fuck the responses this year, while greater in numbers, were occasionally still [REDACTED].^{thanks, thought police}

In the year of the lord, 2020^{CAN YOU PLEASE END ALREADY}, we got 350 responses in, which is a whopping 100 more than last year. I don't know how many accounts we have in total, no one does, and I'm too lazy to calculate the percentages right now because I'm calculating as we go so from the point of me writing this to clicking Post Topic an hour or two will probably pass.^{Update: I went to bed, so like 10 hours passed} Absolute numbers is all you're going to get here, so fuck me, fuck you and fuck off.^{I need some alcohol}

Anyway, let's go through the census. I let JotForms compile this nice graphical report that is pretty much useless because it completely breaks once either sexuality, gender or the myriad of various operating systems the people on here have get involved. But it's still funny seeing it struggle. Have a link to the PDF. So back to good Excel, my old nemesis.

Aggregated Data

Thankfully, this time around you'll have access to generate all this shit yourself, HERE YOU GO. The thing is in JSON, so easily deserializable, etc etc. I'm sure you people are skilled enough at typing the words into the IDEs to magic the data into your memory.

Important info: Empty answers are usually marked NO ANSWER, in case of numerical values it's usually -1 for age, -2 for the Kinsey scale (-1 is taken) and -69 for the 3 political values from the Sapply test, as these range from -10 to 10. Yes I made the default value -69. It's everyone's favourite number after all. Also, for some absolute FUCKED reason one of the values has 3 more entries than the other ones, I'm sure it has a totally VALID reason that has nothing to do with people entering bullshit. NOTHING.^{FuckingKILLME}

Also I can't be bothered to edit the "wrong" data out, i.e. typos in languages etc, so those are all in, maybe someone with more compassion than me can do that.

Kowalski, Analysis

First of all, I'm going to less graphs this year because it's fucking hard to aggregate things like ethnicity when you get responses ranging from black to a literal link of someone's You23AndMe results. Yes. I mean props to you for that but like, uh, FUCK, what am I going to do now? YOU ARE ALL MAKING THIS WAY TO FUCKING HARD. ლ(ಠ_ಠ ლ)

This propagates to basically all responses and next year I'm probably going to captain a way straighter course with less options, because I can't fucking MAKE FANCY GRAPHS WHEN YOU GIVE ME TOO MANY INDIVIDUAL RESPONSES^{FUCKINGKILLME}

Personal Shit

Geography

Not much has changed, the US still dominates, Canada second, though the British are catching up. I'm sure you'll have your tea party eventually. Though with good ol' Boris in charge I don't know if annexing the yanks is such a good idea. Also, as there are no invidual option here for everyone to FUCK IT UP it's the most sane graph of them all. No fucked colours this year, I promise, it's all scale.

Fancy Graph #1: Geography

Age

Fancy Graph #2: Age by decile For those wanting to repeat this, watch out, as the age by decile and specific age questions were exclusionary. You'll have to combine the results to get the same numbers. I hope. Unless I fucked up. Equal possibility.

Also whoever entered 28.9, because of you I had to make the age field in my code a double instead of an integer. Fuck you.

Gender etc.

I honestly thought this was going to be the wildest answer, but y'all are such a minority that it's fairly sane. The real clusterfuck starts after this question. Also whoever wrote prefer not to say, DID YOU NOT READ THE PART ABOUT THE OPTIONAL ANSWERS, [REDACTED] PLEASE [REDACTED] AAAHHHHHHHHHHHHHHHHHH-

Anyway as I said, fairly standard results.

Fancy Graph #3: Gender

Trans? Value
NO ANSWER 13
no 312
yes 23

Yeah I'm not gonna make a graph for a yes/no question, if that's bigoted you may scream at me in the comments.

Sexuality

I MADE THE SCREENSHOT BUT I FORGOT TO ADD IT FUCK FUCK FUCK FUCK

Kinsey

Also forgot about you. Average is 1,37, idk what else to do.

Ethnicity

This was a mistake. 124 wrote white. 23 wrote caucasian. One person wrote causcasion. One person wrote that it's illegal to ask this question in their country. Someone wrote I bleed red white and blue.

THIS WAS A MISTAKE.

Kill me. Safe to say, that Tildes is, as someone put it perfectly: white af. Yes this was also a reply. KILL ME.

Language

Fancy Graph #3,5: Language^{This was added later, and I'm really not updating the others.}

Religion

I'm just gonna let the graph speak for itself, I don't have it in me to keep the anger up.

Fancy Graph #4: Religion

Politics, Education, Work

This is where the fun begins. No, honestly not really.

Politics

If I average out our Sapply values, we get this compass result. Yeah we're all communists. So whoever said in their dislike the alt right people on this platform, I really don't know what you mean. If anything we need more to achieve PEAK CENTRISM. In all honesty, the people saying that this sub is a leftist echo chamber (there were a few), you may have a point.

When we get to the magical field of how everyone identifies themselves politically, well, let's just say^{ah, there's the rage again} I'M NOT GONNA REPEAT THIS NEXT YEAR, GREAT FUCKING IDEA. Whoever entered confused, I FUCKING AGREE. SINCE WHEN IS PINK A FUCKING POLITICAL AFFLIATION? We do have a pirate though.^Nice

You may wade through the rest OF [REDACTED] YOURSELF in the published data.

Education

Tildes is an educated lot, contrary to popular my belief after making this census. A good chunk of people have a Bachelors, Masters, PhD. Still only one MD though, so if you have a medical emergency take it up with... checks notes ^{Ah fuck I can't reveal anything.} ...Take up with them. ^{JK please call your local emergency line when you need help}

Fancy Graph #5: Education

Work

Actually fairly sensible results, except a few, like that one person that entered not STEM, thanks for not giving me any useful information. You have the ability TO NOT ENTER SOMETHING. THIS GOES FOR THE PERSON WHO ENTERED meh AS FUCKING WELL, [REDACTED].

Fancy Graph #6: Work

Technology

Fancy Graph #7: Computer Operating Systems

Fancy Graph #8: Mobile Operating Systems

Basically just like religions. You all have to many options, since we're all communists now according to average, and options are bad, you MAY ONLY USE WINDOWS VISTA FROM THIS POINT ON, OR THE GESTAPO WILL PAY YOU A VISIT ^{fuck, wrong mass murderers}

About Tildes

Have Acc? Value
NO ANSWER 7
yes 312
no 29

For consistency, and it didn't fit into the picture in a nice way.

Fancy Graph #9: Various Tildes Statistics

Most people migrated off reddit, followed by Hackernews. The rest is various random shit, include like 5 different ways of "I don't know", but the one person replying Gab surprised me. Didn't think people would hop on Tildes off Gab, since Gab is basically extreme rightwing Twitter and Tildes is like, the antithesis to that. Leftist userbase, longform discussion.

The long replies

Once again, can't graph the shit outta this, so here's the collection of them. One reply per line. Had to format some replies to fit this format, I know someone did bullet points, apologies.

What do you like about Tildes?

What do you dislike about Tildes?

What would you change about Tildes?

Final notes

To keep my sanity in check, although when I read this post, that probably didn't work out too well, I kept some notes.

1. Someone suggested to ban all Europeans off the platform. You now have the stats, so I'm going to let you guess from where they are. Fucking hilarious.

2. Someone very cordial managed to write an entire blog post into one of the final freeform boxes. I appreciate the feedback and I'm sure Deimos does as well, but why did you have to make so many empty lines? TBH it's more on Jotform for not removing linebreaks when giving you the CSV, it breaks the entire format.

3. We should have a prize for that person who fit a textbook into the box for ethnicity, also amazing, you mad fucking lad (or lass, but statistics are on my side, lol)

In closing, most answers were good and interesting, except for the part where I let you run wild with the politics question, holy fuck, but that's on me. To the people that reduced my IQ by a few points, well I took the piss outta you already, so I hope you have a great day. Everyone else, I hope you [REDACTED] on a few [REDACTED]. Wait, I think I mixed something up here.^{As you may have guessed, don't take this too seriously}

As always, see you all next year, same time?^{Unless I get banned, which seems like a good possibility when I proofread all this, so much angerI need to get laid, or drunkActually how high does this go?}

Cheers, I'm gonna go C͉̠̰͚͚͓ͪ̿̋̏̚O͓̯͕̙͕͎͈̫̦͐̊́Ṅ͕̮̣̺̖̣̖̈ͥͦ͊̽͒͠S̶̵̹̜͔͖͗͂̋̔̈̒͊̚Ú̷͔͍͇̪̥͍ͭͭ̔ͨ̄̇̅̕M̵͈̮͉̹͈͕̻̎̓E̛̯̝̭͉̼̍̎̐̋̑̎ ̷̵̮͔̬̙̠̣̬͉ͭ͒S̨͙̼̟̻̜̈̄͋̄̇ͨ͛́͟͞Ò̡̧͙̩̓̄͂̓͗́M̹̰̲̆̌E̴̡̲̟ͯ ̹͇̲̩͍ͨͨ͒̑͊̌͒͆̕͡F̵͊̊̾ͭ҉̘̲̝͎̥͔̠̺̙O̧̡̱̠̙ͤ͒ͪO̬̯̪͉͙̩̅͂̀̏ͫ̄̓͂D͎͓͍͔͙̰͕̒̒͒̓̃̍͂ͭ̀͢
Grzmot

I was inspired to make this thread after seeing the very interesting side-conversation going on here.

Guiding questions:

• Do you pirate media? If so, why? if not, why not?
• When, if ever, do you feel pirating something is ethical?
• Do you have a "code" that you follow for when it's right/not right to pirate something?
• In what ways is piracy damaging, and in what ways is it beneficial?
• If you used to pirate certain things and then stopped, what stopped you?
• If you used to pay for access to certain things and then went back to pirating them, why did you move back?

This is a very broad and deep topic with a lot of different avenues to explore (different types of media, different regions, archives, pre-release content, law, etc.), so I'm interested in seeing what Tildes thinks.

My mother is 65+ years old and loves everything Apple, but whenever I need to touch her computer I find myself questioning that choice.

The degree to which Apple abstract things from the user enables the most absurd behaviors. macOS gives little indication about which programs are open, and the red x on the top left corner just closes windows, not apps. Because the session persistence is so robust, the consequence is that my mother's Macbook Air keeps 12+ programs and their states open at all times literally for months. Every time she comes over from another continent, I close a bunch of stuff and get her an instant performance boost. Plus, she's never really sure if a program is open or not.

The concept of (work)Spaces, as well as the launchpad, spotlight, or even how Finder really works is beyond her. Because of her over-reliance on the dock, she never enabled autohiding, so her screen real state is always crowded.

Folders are entirely immaterial for her. Everything goes to "Downloads" with no organization whatsoever, and she's always looking for stuff "manually" by reading the filenames.

Her machine is running Mojave, and right now I can only see that finder displays two "Libraries": Documents and Downloads. Linux and Windows have Videos, Downloads, Music, etc. Those are easy to make sense of. What's the supposed Mac alternative? Buy stuff on iTunes. Well, if something is not on Amazon Video or Netflix my mother is a pirate like me (hehe), so she never made sense of it and I truly despise using iTunes for doing anything at all. She also downloads a bunch of media related to her job.

I'm not saying macOS is bad, I'm just asking: is it really the best choice for non-technical older people?

This is a British cookery show. They take a bunch of people who cook for a living but who have basic skills. These people are paired with a chef who has four Michelin stars and eighteen restaurants. They visit different restaurants around Europe to have competitions to cook that restaurant's own food.

Things I enjoy about it: it does a good job of showing that people who have somewhat fucked up lives will always find a place in cheffing. They could have stayed in the UK but they decided to go around Europe.[1] There's a couple of incidents of poor behaviour being corrected (some of the women chefs are ignored and spoken over by some men, the women stand up for themselves and get an apology).

Things I don't like: there's some cheffy bollocks around the pressure and discipline of a brigade; it's still a reality-show competition and that introduces some artificiallity; they send people home each week and I always hate that aspect of programmes.

It's available on Pirate Bay.

Here are some reviews which I think are fair.

https://www.theguardian.com/tv-and-radio/2019/jul/30/the-chefs-brigade-review-a-cookery-challenge-worthy-of-willy-wonka

https://inews.co.uk/culture/television/the-chefs-brigade-bbc2-episode-1-review-jason-atherton/

[1] I can't describe how pathologically awful Brexit has been for the UK. :-(

Project Gutenberg is a great resource for free books, but its 50,000+ titles are intimidating in number (if not outright impenetrable). The same goes for other free ebook aggregators/feeds, of which there are many. There are also lots of authors who offer up their books for free. And, of course, there are tons of free options available in, say, the Kindle store. While it's nice to have so many choices, it hinders discoverability. Individual books get lost in all the noise.

As such, I'd like to know: what are some standout, recommended books that are available to readers for free?

Obvious disclaimer: I am not interested in pirated content.

I miss music blogs. I mostly used them for piracy in the past but plenty of them (pirate and non-pirate) have been great sources for curated lists of new good music. I'd like to add some more variety to my music discovery methods for this new year, so what blogs do you still follow / respect?

Some previous semi-related threads that might be of interest:

How do you discover music?

How do you keep up with new music?

Music Blogs & Mini Station Rant

With Essen Spiel 2018 arriving tomorrow, I was wondering what boardgames you guys are most anticipating.

I've listened to a bunch of podcasts and watched a bunch of top-10 most anticipated videos and there are a bunch of games that are getting me excited.

For example, Treasure Island, which I only found out about yesterday, looks pretty interesting to me. It involves one player hiding some treasure and the other players trying to seek it out (Scotland Yard style). The pirate hiding the treasure has to give out clues that may involve drawing areas on the may in dry-erase marker with a compass, like a ship's navigator.

However I'm most eagerly awaiting more detail on the forthcoming Capstone game, Pipeline and some more details on the Splotter expansion to Food Chain Magnate (even though I don't think it needs an expansion).

Original here: https://old.reddit.com/r/europe/comments/8sizc8/danish_mep_jens_rohde_in_facebook_post_yesterday/

I posted this on reddit a couple of months ago as I felt (and still feel) like it's rather shocking how someone so ignorant can have any kind of power over something that they clearly know nothing about. Here's what Danish MEP Jens Rohde had to say about the public response to the directive in a Facebook post of his from ~2 months ago:

Always pleasant when the web communists hack and spam my PC in parliament. 50,000 e-mails just yesterday containing largely identical messages - in difference languages though.

This time because I tomorrow vote in favor of artist copyright is valid on the internet as well as everywhere else.

This is not about mass surveillance.

This is not about limiting freedom of speech unless you steal others' content for commercial use.

This is also not about the so-called link tax in article 11. Bloggers can calmly continue working.

This is simply about active commercial platforms which must pay to use people's content for commercial purposes. All passive platforms, marketplaces, wikis, clouds, closed networks are exempt from this proposition that I've helped create and vote for tomorrow.

Creators can themselves ask that their content is monitored, or they can upload it unprotected. That's their choice.

Technology has NOT been considered in the proposal. That will come later.

And let me repeat for the hundredth time: spam as well as hacking is especially counterproductive to me, if you want to promote your cause.

By the way, I will never subscribe to the communist pirate opinion that FREE internet is the same as internet for FREE - no matter how much you attack my PC.

The ethics of piracy have been discussed, with some coming down on the side that it's indefensible, and others coming down on the side that artists make their money via ticket sales/merch/donations, that sharing of culture should be a right, that the price of music is too expensive, etc.

I happen to mostly be in that latter group, but as we all know, the various industries in whose interest it is to keep old business models going wield incredible influence and will slaughter us with lawsuits. In the age of the internet, with information being instantly transmittable from pole to pole, is it time we collectively stood up and laugh at these ridiculous demands they have? How much clout can you really have? They can't arrest everyone. AFAIK, this is what Pirate Bay does. They just don't tolerate the intimidation.

So, I've been playing this campaign with some friends for a while where I am a crocodile-themed lizardfolk hick with a thunder cannon named Cletus Cornelius Crocodilius the 3rd. Much fun has been had so far, but today something extra special fun happened.

So a while back our party found a stone that basically makes whatever it's being wielded by as light as a feather. So naturally our undead pirate monk has been using it to fuck with Cletus by shoving it into his mouth and then pushing him great distances. I thought it was funny, the DM thought it was funny, and it'd give us all a great laugh. But, it did give me an idea.

See, we were all hunting down this nasty chimera, and after some scouting we knew it could fly. That was no bueno for us and we needed something to clip its wings. Suddenly, I remember that we have a stone that made me weigh about as much as a toddler. I also had several bear traps. And since I was a crocodile, I could grapple things with my mouth, leaving my hands, and my thunder cannon, free to attack.

So, we lure the flying chimera out with out bird-person bard, who lures it into range. We take all our ropes and strap the bear traps to Cletus and then an anchor line around his waist. We then have the sorcerer gnome cast enlarge upon himself, making him the massive size of a slightly larger than average human. He and the monk then chuck me as hard as they can at the chimera, which I proceed to stick to like a giant reptilian tick. I then spat the stone out onto the ground, and suddenly this tick weighed 800lb again.

I proceed to spend the entire combat session locked to this thing, blowing chunks off of it with my thunder cannon until it is grounded and no longer able to fly. It was still a tough fight, but we managed to prevail in the end.

It then became a desperate struggle to cut Cletus out of the bear traps before the dead Chimera fell off the bridge we were fighting it on. Thanks to a few lucky dex saves from myself and the bird person, Cletus managed to leap off the plummeting chimera at the last second.

I love this game.

Primarily I use spotify premium since I am a student and get the sweet sweet $5 discount. I also tend to by vinyl records of albums that I have been listening to a lot so that I can help the musician/band. It's pretty nice because most vinyl comes with a digital download, so I can have a pretty high quality version on my computer. What clients do you use to stream music? Do you buy music? What do you think is the best way of obtaining music that is not pirating?

Decided to drop down here and quickly ask what is Tildes' policy on piracy. Namely, should we be openly discussing, linking, directing users towards pirated content? Is it something that's strictly forbidden?

Apologies if I'm missing something, but if there isn't a statement on this already then what do you guys think the policy should be?

Sorry for the minor clickbait title

Let's talk about ISPs in USA. In my personal opinion, they do so much "bad" things to their clients, as opposed to, most noticeably, Europe (I guess it's because, (at least in my country, IDK about another European states) much bigger competition, even in village with 500 people, there are about 3-4 ISPs, but there are even more of them in bigger cities). They throttle websites (even before they destroyed Net Neutrality), they track that you use your network too much and throttle you because of it ("they may send you a warning for excessive internet usage and throttle your bandwidth for awhile.").

Now, they track that you download/upload too much and/or pirate movies and can throttle your account, downgrade your account, or completely refuse to provide you any service.

Why? Why are they allowed to do this? Why they can track users and throttle them just because they download too much (I've read article about it, downloading too much, ISPs slowing down internet for few hours, link soon) or they suspect you of pirating. How they dare intercept your packets, read them and throttle you because of this? Why is it wildly accepted as completely normal behaviour?

And I could continue on things like them publicly buying votes to remove Net Neutrality from the way, and so on.

I honestly do not know why so much people are OK with this. Could we start a discussion on this?

Throttling because of piracy sources: 1 2 3 4
Pre-NetNeutrality-End websites throttling: 1 2

Disclaimer: I'm a novice and this is a half baked idea

Recap

The Caesar cipher is fairly straight forward as it just shifts letters along by a set amount. This means that it's quite easy to brute force. There's only 25 offsets, after all. Try to decode this to see what i mean:

Plqfh 3 foryhv ri jduolf, dqg frpelqh lq d vpdoo erzo zlwk pdbrqqdlvh, dqfkrylhv, 2 wdeohvsrrqv ri wkh Sduphvdq fkhhvh, Zrufhvwhuvkluh vdxfh, pxvwdug dqg ohprq mxlfh. Vhdvrq wr wdvwh zlwk vdow dqg eodfn shsshu. Uhiuljhudwh xqwlo uhdgb wr xvh. Khdw rlo lq d odujh iublqj sdq ryhu phglxp khdw. Fxw wkh uhpdlqlqj 3 foryhv ri jduolf lqwr txduwhuv, dqg dgg wr krw rlo. Frrn dqg vwlu xqwlo eurzq, dqg wkhq uhpryh jduolf iurp sdq. Dgg euhdg fxehv wr wkh krw rlo. Frrn, wxuqlqj iuhtxhqwob, xqwlo oljkwob eurzqhg. Uhpryh euhdg fxehv iurp rlo, dqg vhdvrq zlwk vdow dqg shsshu. Sodfh ohwwxfh lq d odujh erzo. Wrvv zlwk guhvvlqj, uhpdlqlqj Sduphvdq fkhhvh, dqg vhdvrqhg euhdg fxehv.
bonus points for a program that takes the above text and outputs the shift I used without any human input

My dumb idea (didn't work, my bad. They're in normal Caeser cipher now)

I like the simplicity of the shifting characters but having it always be in one direction, and always being the same offset makes it easy to notice the pattern and decode.

If we have the shift value determined by the length of the current word, and the direction of it dependent on if it's a vowel or a consonant.
a pirate is nothing without his ship becomes
b jolgnk kq gvmapgz ppmavbm elp odml so we still have a visibly Caesar-y cipher, but we'll know it's not a true Caesar cipher.
The offset changes for every word and then is applied based on each letter in the word. If it's a vowel, then the encoded value is shifted upwards but if not, it slides down.

For the purposes of the below tomfoolery; prime numbers are consonants and the rest are vowels.

A Valley Without Wind 1 and 2 Steam Key:
B qjsbuf jt opuijoh xjuipvu ijt tijq
FWR0H-GQM7B-5344H

Aces Wild: Manic Brawling Action:
C rktcvg ku pqvjkpi ykvjqwv jku ujkr
K5R0H-29NPM-A3OTE

Age of Empires Legacy Bundle:
D sludwh lv qrwklqj zlwkrxw klv vkls
69PQW-UY3H7-7SQWT

AI War + 4 DLC packs & Tidalis Steam Key:
E tmvexi mw rsxlmrk amxlsyx lmw wlmt
KO99D-73JZ2-XNIK3

AI War: Vengeance Steam Key:
F unwfyj nx stymnsl bnymtzy mnx xmnu
7M2I8-I99N9-6E9F2

Alan Wake Collector's Edition Steam Key:
G voxgzk oy tuznotm coznuaz noy ynov
6ZNJ5-BIVFN-6ZSDZ

Alan Wake's American Nightmare Steam Key:
H wpyhal pz uvaopun dpaovba opz zopw
7RERD-4ACYN-TCDQ2

Amnesia: Dark Descent Steam Key:
I xqzibm qa vwbpqvo eqbpwcb pqa apqx
VGEO8-OU48X-MU7BL

Anachronox:
J yrajcn rb wxcqrwp frcqxdc qrb bqry
3589L-YGF9V-NKGW0

Anodyne:
K zsbkdo sc xydrsxq gsdryed rsc crsz
9HW7H-7Z73Z-6302D

Anomaly Defenders:
L atclep td yzestyr hteszfe std dsta
ICPIB-M63TI-9Y96V

Anomaly Korea:
M budmfq ue zaftuzs iuftagf tue etub
QMPZ2-JUK8B-JRK3V

Anomaly Korea:
N cvengr vf abguvat jvgubhg uvf fuvc
30R9T-C02AA-7DQLG

Anomaly Warzone Earth:
O dwfohs wg bchvwbu kwhvcih vwg gvwd
38UM9-Z26PH-Q4VAU

Anomaly Warzone Earth Mobile Campaign:
P exgpit xh cdiwxcv lxiwdji wxh hwxe
54TYN-AU26Q-5AGGY

Aquaria Steam key:
Q fyhqju yi dejxydw myjxekj xyi ixyf
3853A-YSB4J-6243A

Awesomenauts:
R gzirkv zj efkyzex nzkyflk yzj jyzg
DH9T5-BWOQC-KB6TB

Awesomenauts:
S hajslw ak fglzafy oalzgml zak kzah
RNRJ0-CPT4O-S9UHE

Awesomenauts Cluck Costume:
T ibktmx bl ghmabgz pbmahnm abl labi
VOWWW-QTR3Q-EAS9J

These are encoded using a Caeser shift. The line under the title is a fixed phrase (a pirate is nothing without his ship) for aid in the bonus points

I can post my code if it turns out to be unsolvable (like a bug https://trinket.io/python/dabf2b61f9), but if not; I can also keep going from letters A to Y (sans U) over the weeks with my humble bundle reserves (plaintext or not). I've had these keys for far too long and I'm never going to actually use them, but I also noticed a surge of keys being donated here so figured I might as well change it up.

Have fun

The book Code Complete changed me as a programmer and as a person. It is the best book I have ever read and if you're a programmer I highly recommend you read it.

The book was so good that after having read the pirated version of it I just had to give the author its money's worth. The problem was that almost nobody sells a PDF version of the book - Amazon sells it as a Kindle book, but I prefer PDFs (can use my chioce of software to read it). After searching for a short week I finally found a seller that sells a PDF version. I have never been so happy to find a legal PDF version of a book. Having been a pirate in my teens I'm proud of having gone to such lengths to the right thing. That's all. Just wanted to share this with you.

TL;DR: Instead of pirating a book because I didn't find a legal PDF version spent time searching for a seller and bought it legally.

I've been really enjoying Sea of Thieves lately, and I'm pretty enthusiastic about the new update coming on Tuesday. Anyone else feeling the same?
I've only got a couple people who I play with from time to time, so if anyone would like to crew up, just add me. My Xbox tag is the same as my Tildes username.

This discussion is old hat for the l2t mods, but I'd like to get it written down here on tildes so when the time comes to develop these features we've got a record of all the tricks ready to help whoever wants to code it all. It's surprisingly easy to do this now.

First, we're only going to concern ourselves with legal, legit streaming links. That limits the number of sites we need to support to the following...

1. Youtube 2. Bandcamp 3. Soundcloud 4. Spotify 5. Google Play

Sure, there are others, but they don't offer free streaming, so they aren't particularly useful for widespread music sharing on social media sites like reddit and tildes. Even on reddit, very little of the music shared ends up coming from pay-for services - it's almost entirely coming from youtube, bandcamp, and soundcloud, in that order. So those are the APIs we need to be dealing with in order to extract useful information. It's also worth noting that over time, some of these will die, and new ones will arise to take their place, and they will change their APIs from time to time breaking services built on top of them.

Yes, sometimes youtube has pirate streams of music. That's their problem to solve, not ours. The closest we could come to 'helping' in that regard would be verifying that the video posted is on the artist and/or label's official channels. This is not easy, but it is possible. Frankly, I don't think it's worth the effort. It's hard to code and will have a messy false positive rate. A lazier solution we've used in listentothis for years is simply having a blacklist for channels that spam/rip/repost artist's music without permission - and we can get you a copy of our blacklist and whitelist if you like, so that isn't starting from scratch.

Getting all the music information about an artist is a two-step process.

The first step is querying the metadata provided by the sites listed above through their API calls. The relevant information we need for this is simply the name of the artist and the name of the track (or album, if it's an album link). There's plenty of other information available (some of which we will want, like the youtube views and various popularity metrics such as plays, scrobbles, listens, monthly listeners, heat indexes) but that information isn't needed unless you intend to start dividing up the music into sub-categories using other ~tilds or #tags. Eventually we will want to do that (subs like listentothis can't really exist without the popularity numbers) but that's a problem for further in the future, once tildes is a lot more active. For now, let's just concentrate on making the sidebar of a music submission take people's breath away.

The second step is using the name of the artist and the name of the track (or album) to lookup information about that artist in public databases.

The motherlode of music data resides in Musicbrainz. This has become the de-facto open-source database of record - you might remember its humble beginnings when it was cddb and freedb, embedded in most cd-ripping tools to provide lookups of the artist/track information. It's grown into a wikipediesque monster since then. It knows almost everything there is to know about every artist who has ever released so much as a single or an EP, and does well even for obscure and new independent artists. It's also being updated by-the-minute with new artist information.

Musicbrainz has a public API, and they allow dozens of queries per minute, so it would be possible to use their free service - but I think that's the wrong way to do this. Musicbrainz does allow you to set up your own copy of their database, and provides scripts to download nightly updates of the data, so it's possible to run this locally. For a hassle-free setup, they do provide a virtual machine that's ready to go, just download and boot it up on your network. The VM also has their full API and web services (looks exactly like their official site), so with the VM you can query it locally through the API just like you would using the remote site (and you could have a failover between the local copy and the official site). Running just a local copy of the database rather than the VM, you won't get the API. The database is around 30GB right now and grows very slowly. Musicbrainz local copies also provide the option of querying their SQL directly, without the need to use the API.

What data can we get out of this monster database?

1. Artist search with a confidence rating for best match
2. Complete discography and artist bio in excruciating detail
3. A fantastic collection of every relevant link to other sites
4. The most relevant collection of 'genre tags' available anywhere

Let's also not forget they come with an army of developers and a great support forum. I think the case for using musicbrainz as tildes' prime music authority kinda makes itself. :P

There's really no need for another data source. Musicbrainz doesn't do popularity numbers yet but they are planning to do it soon. The Listenbrainz project is, basically, an attempt to reinvent last.fm as an open-source service. Last.fm itself isn't likely to survive, they've been struggling financially for several years. Listenbrainz hopes to allow people to import that data before the site goes under.

So what do we build out of this mountain of data? Easy - the laziest submission process for music anywhere on the internet.

I think the goal here for the users is to be simply pasting a music link into the submission form, and letting tildes do all of the rest of the work for them. The tags and the title can be auto-populated by the lookup, and then tweaked by the user. That'll give a sense of uniformity to the titles, and it makes submitting on mobile almost effortless.

Once the submission is created, the sidebar can be populated with the musicbrainz information. I think a good start would be to show the name of the artist, the name of the album, the name of the track (if applicable), and the release year - possibly even the record label and genre tags (big bucket generic tags like rock, jazz, folk, nothing overly specific). I'd follow that up with the relevant artist links to their own website, their official bandcamp/youtube/twitter/facebook, and possibly the links to discogz and lyric wiki if present. I'd close it with the artist's bio - just a blurb, that ends with a 'read more on wikipedia' link.

If/when we have all of this working, we can worry about the next step - finding a way to determine the relative popularity of any given submission. That's a far, far harder problem to solve.

Here's a quick link listing to all of the relevant APIs and their documentation for easy reference.

1. Musicbrainz XML API
2. Youtube API
3. Bandcamp API
4. Soundcloud API
5. Spotify / Echonest API (second only to musicbrainz for raw amount of data)
6. Google Play API

Edit: Also, we can run a local copy of the Discogs database which will give us even more. If we have Musicbrainz and Discogs local, that's almost everything without the need to have Tildes connecting to other sites.