Ponderings on unicode support on the site, re: punycode, tags, etc

pseudolobster
2026-02-20T23:46:33Z

So here's a dilemma I'm not sure what to do about. It's really minor, and in the long run who cares, but here's the thing:

Today a link was posted whose link is a URL in Japanese katakana characters. Since DNS only supports ASCII characters, those URLs get encoded as punycode. So, the site's URL gets translated from https://マリウス.com/hold-on-to-your-hardware/ into https://xn--gckvb8fzb.com/hold-on-to-your-hardware/.

This is a hacky solution from 20 years ago. It works, but nowadays browsers automatically translate "マリウス" into "xn--gckvb8fzb" transparently, so you never really see the "xn--gckvb8fzb". Unfortunately, Tildes' tag system is one of the parts of the site that only accepts roman characters, so there's no way to tag something with like source.マリウス.

So what do we do here? Tagging something with source.xn_gckvb8fzb is obviously not ideal.

In this case, Japanese in particular has a neat and tidy solution. Romanji. Every katakana character is a syllable, and each syllable has another character or pair or characters using English glyphs. So, マ, リ, ウ, ス is: Ma, Ri, U, Su, or "mariusu", the Japanese pronunciation of the Roman name Marius.

So, if we want to transliterate the word phonetically (ie: in Japanese at least, converting the katakana glyphs directly into their romanji equivalents), we should tag it source.mariusu, or if we want to translate it, it should be source.marius.

A lot of other languages with non-roman letters are not going to be as clean since they don't have a clear transliteration of their character set into ASCII, but in the case of Japanese, I dunno, it seems like it's begging to be converted into romanji. I really just don't know though. It's a dilly of a pickle.

ANYTHING must be better than linking to source.xn_gckvb8fzb since that's literally encoded gibberish not meant to be read by humans. Not quite sure what the alternative should be though.

Anyway, thank you for coming to my TED talk.

Comments URL: https://tildes.net/~tildes/1st5/ponderings_on_unicode_support_on_the_site_re_punycode_tags_etc

Votes: 29

Comments: 10