Duck Duck Go search AI curiously cited Tildes
I was trying to find out why Lidarr wasn't matching my copy of The Cure's Greatest Hits. Found out I've got some bootleg Russian release that's catalogued on discogs (I eventually found the musicbrainz release and updated my profile to include bootlegs). So I search "Lidarr use specific discogs release" and the duck duck go search assist spat out some text about Lidarr not using discogs and cited this Tildes post.
It's curious because that post is 3yrs old and doesn't talk about discogs integration in Lidarr, just one mention of discogs in the post and some folks talking about Lidarr in the comments (It did cite a relevant GitHub issue about it though). The AI response mentioned that some users track new releases with Lidarr and downloads disabled, while covered in the post, it seems fairly tangential to my query.
I'm curious why it decided to check or cite a tildes post. No tildes posts came up in the first couple pages of search results. I use tildes from the same location, though on my phone where this query was on my desktop, and have done a couple DDG queries using "site:tildes.net" on my phone.
Has anyone else seen a search assist cite an unexpected site? Not unexpected as in irrelevant, that's all too common, but small and specific sources.
On Kagi they tend to cite Titles and will bring it up much higher in the results, even without my personal setting to always raise Titles posts higher in search results.
High quality and genuine. I don't see why it wouldn't. With the Reddit API being locked tight and searching cornered by Google, and the general decline in quality posts on Reddit there is bound to be an alternative. Since Tildes functions similarly as old reddit in that regard, quality long shelf life posts, it's only natural it comes up more.
Kagi also did the thing where they'll downgrade AI responses as search results. This boosts human posts too.
Of course, the size of Tildes will keep the amount of results low but I can imagine we'll see more of that over time.
Wow, really? I don't think I've ever seen Tildes in search results on Kagi. Can you give some example of query for which it shows up?
Funny enough, I actually learned about Tildes from the Kagi Feedback forum, from seeing this post:
https://kagifeedback.org/d/1879-when-summarising-tildesnet-it-should-take-into-account-the-comments-as-well
I've had Kagi present ask posts from Tildes before, when there have been troubleshooting/diagnostic questions. Particularily if they're ones that don't readily appear on stackoverflow.
Tildes does block a number of AI crawlers via their robots.txt. I had trouble, for instance, using ChatGPT to collate pages when I was compiling data for the Book Club retrospective.
I don't see any specific mention of DDG's crawler, though, so their tools may be given the green light.
It doesn't seem like it blocks ChatGPT's search functionality though. It blocks
GPTBot, which is their crawler for collecting training data, but web search inside of ChatGPT uses a separate bot namedOAI-SearchBot, which is not blocked here.https://platform.openai.com/docs/bots
You're right. I just tested it now and it worked fine. Last year, I got a request error when trying the same thing.
Perhaps the user agent has been split in two then to address this situation.
edit: It does look like their search tool became generally available shortly after I finished writing the post.