15 votes

What tips or tricks do you use when researching a topic to find actually useful information?

Stop me if you've heard this one before:

  • You get an idea for something you'd like to learn more about. (Maybe you have a question, maybe you want to explore a new hobby, or maybe you want to make a more informed decision.)
  • You type something into a search engine.
  • You click a result, only to realize that what you're reading is poorly written. It seems rushed, surface-level, and ill-informed. "This doesn't answer my question at all!" you think to yourself.
  • You go back, and try another one, and another one, only to give up and put the idea back in your head.

I don't think these webpages are written to be useful in the first place. They seem to be written to attract attention to the website for other reasons (ad revenue, affiliate links, to draw attention to a product or service). Regardless of why it's happening, though, I want to find a better way to search.

The sort of content I'm looking for is written by someone who really cares about the topic. I want to learn from dorks and nerds and passionate people. Once I stumbled across this blog about extra virgin olive oil. The website isn't pretty, and it goes way more in depth than I'll ever need, but I trust the author, and there are some really interesting nuggets of insight on these pages. (e.g. "Another myth debunked: Heating EVOO makes it ‘toxic’")

Do you have any tips or tricks to more reliably find these sorts of sources (whether online or in-person)?

20 comments

  1. [13]
    dredmorbius
    (edited )
    Link
    This falls generally under "research methods". In theory, the web is a wealth of information. In practice it's increasingly a cesspit of disinformation. This doesn't make it useless, though it's...
    • Exemplary

    This falls generally under "research methods".

    In theory, the web is a wealth of information. In practice it's increasingly a cesspit of disinformation. This doesn't make it useless, though it's necessary to tread with caution.

    The same issue applies, of course, to other media. The Web is not unique, though its scale and response time are.

    Methods differ both by topical recency and domain.

    Methods by item recency

    • For immediate breaking issues: within the past minute to hour, Twitter or its front-ends (I prefer Nitter) are highly responsive. It's best to use these to establish that something has happened rather than trying to establish just what has occurred: first reports are often inaccurate, speculate (usually inaccurately) as to cause or responsibility, and lack context. Emergency alert services may provide reports, but are often disappointingly ineffective. For natural disasters, weather, earthquakes, etc., online notification dashboards provide near-realtime updates on initial events & magnitudes. Sometimes local news services.

    • Hour to day: News media, supplemented by other sources. This is the news's job, and shortcomings notwithstanding, they're reasonably good at it. Hitting a few sources (and checking to confirm they're not merely parroting some common source) tends to give a reasonable picture. WNYC's On the Media produces a number of Breaking News Consumer Handbooks which are excellent. Mainstream sources (Reuters, AP, AFP, national dailies, national broadcasters (PBS, NPR, BBC, CBC, ABC (Australia), Deutsche Welle) are good starting points / checks. Financial news outlets (Financial Times, Wall Street Journal (despite Murdoch), Bloomberg, The Economist), whilst conservative, are pretty good with getting facts and maximising information-to-hype ratios. Be aware of reputation and bias. And check against debunking sites.

    • Day to month: Wikipedia. For stories which are complex and develop over time, it's extremely hard to beat. I first noticed this following the 2004 Boxing Day Quake and Tsunami. Where traditional media were dribbling out decontextualised facts or retreading background, Wikipedia assembled these into a coherent whole. Some long-form journalism pieces can approach this, but they're much harder to find. The 2011 Tohoku quake & tsunami, Russian interference in the 2016 United States elections, the Oroville Dam Crisis, and ongoing COVID-19 crisis are other excellent Wikipedia topics. Again, not perfect or immune from distortion or influence, but remarkably resilient. Follow up on sources. An expert and highly reputable blog or social media source may be useful. Also various reporting dashboards (e.g., ongoing Covid statistics).

    • Month to year: Also a Wikipedia strength (most of the examples I listed above span this range), but add in detailed survey coverage, long-form magazine treatments, official reports and investigations, journal (academic rather than commercial press) sources. In some cases, books. Lectures, podcasts, online video, speeches, and presentations are often useful in this timespan (and longer). For technical (computing) topics, blogs, good online discussions, conference proceedings, etc.

    • Year to decade: if possible start looking for published sources in books or academic journals. This will vary by topic, but the process of compiling, structuring, researching, editing, and publishing such works tends to shake off a lot of cruft. You're also starting to reach the point where tracking references and citations starts to pay off. If a document (blog, journal, article) is mentioned, or an authority is namedropped, track it down. One of my more useful research digressions (a half dozen books) grew from a five second reference within a conference seminar I'd found on YouTube. Good books and articles have bibliographies which are often more valuable than the texts themselves. Conversely, a book lacking an index or bibliography loses half or more its value compared to one that does.

    • Decade to millennia: Again, books, but strongly emphasizing both primary sources and compendia, surveys, and digests. Topics here tend to be science, literature, culture, philosophy, and religion. Primary sources give the unvarnished original (all the more so if you can read the original language), surveys reveal the larger landscape and highlights. At this level, if you've not already begun one, a knowledge-capture tool becomes essential. I use a mix of index cards, online blogs and comments (backed up!), notebooks, and unpublished drafts and notes.

    Methods by topic

    For basic facts and figures: some authority tasked with providing them. Often government agencies which can be excellent, if difficult to navigate.

    For technical topics, especially geared at accomplishing some task; domain experts, or the communities in which they hang out. Beware imposters. Despite the appearance of constant change and churn, underlying concepts often have lasting value, and evolve slowly.

    For news and political analysis: sources not directly engaged in the matter, at least for general background. Commentary of direct participants may have points for immediacy, but is virtually always biased or distorted. A disinterested foreign source (and both qualifications matter) is often best. Know the biases of various sources.

    For "low-tech" topics, such as your olive oil example, you'll have to hunt. Here, searching based on author (etymological root, authority), is often best. Ask people who know their shit who they'd turn to, and if the same names keep coming up, prioritise those.

    Hi-tech or low, you'll have to practice the methods directly. That, and explaining yourself to others, is the best learning method.

    For conceptual and academic topics: books, texts, journal articles, bibliographic search. I'll contact authors directly in cases, with specific questions I can't otherwise resolve.

    Developing a framework of a domain, whether from existing models or your own personal organisation, off which to hang newvconcepts and methods, is also useful. New facts don't simply pile up but interrelate.

    On assessing expertise

    It can be hard to tell true experts from charlatans, and many methods aren't entirely reliable. An expert may not have a deep humility, though many do, and most (at least the ones you'd want to have teach) are genuinely appreciative of an interested student. Cross this with a disdain for flakes and casuals. The huckster is virtually always trying to sell you something, usually directly, sometimes indirectly. The best experts not only explain simply and clearly, but those explanations produce results.

    Another fairly reliable guide: average (or worse) instructors will show what or how, often providing a simple cookbook recipe. True masters will explain why, show variants, risks, pitfalls, rescue or troubleshooting procedures, and side effects --- useful or otherwise. This may strike many people as TMI, and there's a knack to delivering this information without overwhelming students. I (looks guiltily at length of this respose...) ... generally appreciate this.

    TL;DR:

    For online search, increasingly I bypass general Web search for:

    • Wikipedia.
    • Specific domain-based searches.
    • Google Scholar / Google Books.

    As noted, bibliographies and references tracking is powerful, as is some simple, maintainable, and useful knowledge capture system.

    14 votes
    1. [12]
      unknown user
      Link Parent
      I think this is a habit I want to try and break. It's so ingrained, though, in both my default behaviors and in the tech I use. If I need to look something up, the reflex is to Ctrl+L to the...

      For online search, increasingly I bypass general Web search

      I think this is a habit I want to try and break. It's so ingrained, though, in both my default behaviors and in the tech I use. If I need to look something up, the reflex is to Ctrl+L to the address bar and type something in. The whole concept of a "default search engine" points you towards a single provider of search results.

      I wish web browsers and new tab pages were built to nudge me to be more deliberate.

      3 votes
      1. [11]
        dredmorbius
        (edited )
        Link Parent
        DuckDuckGo's Bang Search is useful for this, as specialised search is a keyword away. !w: Wikipedia !etym: Online etymological dictionary (see also !dict and !define) !gbooks: Google Books search...

        DuckDuckGo's Bang Search is useful for this, as specialised search is a keyword away.

        • !w: Wikipedia
        • !etym: Online etymological dictionary (see also !dict and !define)
        • !gbooks: Google Books search
        • !scholar: Google Scholar search
        • !ngram: Google Ngram Viewer
        • !worldcat: Worldcat union library catalogue (books, articles, and other records)
        • !wikisource: Wikisource full text search (public domain works)
        • !gutenberg: Project Gutenberg full text search (public domain works)
        • !archive: Internet Archive search --- non-Web collections: books, texts, audio, video, etc.
        • !hn: Hacker news search, generally for my own previous posts & comments.
        • !so / !se: Stack overflow / Stack exchange.

        There are both reddit and oldreddit searches, though I much prefer my own subreddit's styling for search results: https://old.reddit.com/r/dredmorbius/search?q=&sort=relevance&t=all

        I'll note that there's a trade-off between very large collections, where quality and relevance drown in crap (the Web, much commercial serial and book publishing), and small curated collections or archives which are too small to be independently searched whilst being too small or obscure to stand out in general Web search. The general comprehensive collections of curated works, with useful and accurate metadata provide real value. Small offline collections are almost wholly useless. Hathi Trust and Pinterest are equally blights on the Universe, ranking with essaay-mill and blogspam sites.

        I'd done some work a few years ago looking for significantly useful online sources. Interestingly, Metafilter, Wordpress, and Reddit performed comparatively well. Other social media considerably less so. Also examined, news and journalism sites, various TLDs, academic institutions, and a few other miscellaneous categories. See: "Tracking the Conversation: FP Global 100 Thinkers on the Web".

        4 votes
        1. [10]
          cfabbro
          Link Parent
          Firefox also has something similar built into the address bar as well, you just have to enable them in Options -> Search -> One-Click Search Engines.

          Firefox also has something similar built into the address bar as well, you just have to enable them in Options -> Search -> One-Click Search Engines.

          1 vote
          1. [9]
            dredmorbius
            Link Parent
            The advantage of Firefox searches is that you can define your own, and your searches are between you, your browser, and the third-party site. The disadvantages are that they're specific to that...

            The advantage of Firefox searches is that you can define your own, and your searches are between you, your browser, and the third-party site.

            The disadvantages are that they're specific to that specific browser install, and aren't common between users, as the DDG bangs I've listed above are, though they also transit DDG. These are trade-offs.

            I find the DDG bangs useful.

            2 votes
            1. [4]
              unknown user
              (edited )
              Link Parent
              I did this a lot! I had a whole host of custom search engines. The Mycroft Project is amazing for this. I used to submit all kinds of new search engines to there. I also like creating my own...

              The advantage of Firefox searches is that you can define your own, and your searches are between you, your browser, and the third-party site.

              I did this a lot! I had a whole host of custom search engines. The Mycroft Project is amazing for this. I used to submit all kinds of new search engines to there.

              I also like creating my own custom bangs using Chrome's "keyword" feature. If you start typing the keyword then your search query in the omnibox then it will search using just that search engine. It's great for pure keyboard navigation.... not sure if Firefox has an equivalent. (cc: @cfabbro)

              2 votes
              1. [3]
                cfabbro
                (edited )
                Link Parent
                Similar to Chrome there are "keywords" you can set up in FF too. However between DDG's bangs and the FF 1 click searches, I honestly don't really see the point in spending the time configuring any...

                Similar to Chrome there are "keywords" you can set up in FF too. However between DDG's bangs and the FF 1 click searches, I honestly don't really see the point in spending the time configuring any keywords.

                The only one I had set up in FF for a long time was when I typed re + space it would autofill reddit.com, and when I typed /r/ + space it would autofill reddit.com/r/ so I could easily navigate to or search within any subreddits using just my keyboard... but since I barely use reddit anymore I never bothered to set those up again after I reformatted last.

                1 vote
                1. [2]
                  unknown user
                  Link Parent
                  I tagged ya because you mentioned "The FF 1-click searches are also a bit of a PITA to use with pure keyboard navigation too" ;p

                  However between DDG's bangs and the FF 1 click searches, I honestly don't really see the point in spending the time configuring any keywords.

                  I tagged ya because you mentioned "The FF 1-click searches are also a bit of a PITA to use with pure keyboard navigation too" ;p

                  1 vote
                  1. cfabbro
                    Link Parent
                    Fair enough, but even so, I use the 1 click searches so infrequently that I just can't be bothered to set up keywords instead. https://xkcd.com/1205/ applies here. That and I'm super lazy. :P

                    Fair enough, but even so, I use the 1 click searches so infrequently that I just can't be bothered to set up keywords instead. https://xkcd.com/1205/ applies here. That and I'm super lazy. :P

                    1 vote
            2. [4]
              cfabbro
              (edited )
              Link Parent
              The FF 1-click searches are also a bit of a PITA to use with pure keyboard navigation too... so yeah there are definitely trade offs, and it's why I use DDG's bangs more often than not too. But...

              The FF 1-click searches are also a bit of a PITA to use with pure keyboard navigation too... so yeah there are definitely trade offs, and it's why I use DDG's bangs more often than not too. But occasionally the FF feature is still pretty handy, especially for searching sites not supported by DDG.

              1 vote
              1. [3]
                dredmorbius
                Link Parent
                Agreed. DDG does take suggestions, BTW.

                Agreed.

                DDG does take suggestions, BTW.

                1 vote
                1. [2]
                  cfabbro
                  (edited )
                  Link Parent
                  Cool, I didn't know they were open to suggestions... although I very much doubt DDG will want add official bang support for a lot of the sites I am using FF 1-click search for (e.g. the various...

                  Cool, I didn't know they were open to suggestions... although I very much doubt DDG will want add official bang support for a lot of the sites I am using FF 1-click search for (e.g. the various torrent sites I frequent that support opensearch so are easy to add to FF). ;)

                  1. dredmorbius
                    Link Parent
                    Yeah, likely not. LibGen and SciHub were removed a ways back.

                    Yeah, likely not. LibGen and SciHub were removed a ways back.

                    1 vote
  2. [2]
    Comment deleted by author
    Link
    1. acdw
      Link Parent
      As a library worker, can confirm 😊 also most libraries have access to scholarly databases.

      As a library worker, can confirm 😊 also most libraries have access to scholarly databases.

      7 votes
  3. [4]
    Akir
    Link
    I generally have pretty good luck with my searching, but I do have a hint that might help you out. Instead of searching for the topic, look for an authority on that topic. Generally they will have...

    I generally have pretty good luck with my searching, but I do have a hint that might help you out. Instead of searching for the topic, look for an authority on that topic. Generally they will have some pretty in-depth information, or at least links to some of it.

    9 votes
    1. [3]
      Gyrfalcon
      Link Parent
      Another thing that helps is to find a community around the topic. One of the things that keeps me on reddit is that I know that if I get interested in something, I can find a community that will...

      Another thing that helps is to find a community around the topic. One of the things that keeps me on reddit is that I know that if I get interested in something, I can find a community that will probably have a semi decent wiki and will maybe even answer some of my questions to get me started.

      12 votes
      1. Omnicrola
        Link Parent
        I will heartily endorse this. Even if you prefer to learn solo, nothing beats talking to people who have already taken the same learning journey you're about to take. At and absolute minimum they...

        I will heartily endorse this. Even if you prefer to learn solo, nothing beats talking to people who have already taken the same learning journey you're about to take. At and absolute minimum they will use a bunch of words you don't know that will give you better Google results. At best you find people who know how to mentor well and can guide you when you need it, encourage you when you feel frustrated, and celebrate with you as you discover the corners of a new area of knowledge.

        6 votes
      2. schwartz
        Link Parent
        Yes! 90% of reddit is cancer, but it's pretty great for niche subreddits that often have great wikis / sidebars.

        Yes! 90% of reddit is cancer, but it's pretty great for niche subreddits that often have great wikis / sidebars.

        6 votes
  4. mrbig
    Link
    For general subject, first I hit Wikipedia. It’s not a reliable source for academic research but it gives useful overviews and external links. If I’m researching a philosophical subject,...

    For general subject, first I hit Wikipedia. It’s not a reliable source for academic research but it gives useful overviews and external links.

    If I’m researching a philosophical subject, Stanford’s Encyclopedia of Philosophy is a stellar, comprehensive, and reliable resource, but it’s also highly technical at times. The Internet Encyclopedia of Philosophy is more layman friendly, I use it when Stanford is more than I can handle.

    For everything else, I just Google stuff, and use my trained intuition (after years 20+ years using the internet) to set aside the crap. I’m good at Google fu, it’s like persuading the algorithm to give me what I want hahaha

    8 votes
  5. skybrian
    Link
    One trick is to think of words that would probably appear in an in-depth article. For example, looking for reviews of a novel by searching on a character name. For nonfiction, what jargon can you...

    One trick is to think of words that would probably appear in an in-depth article. For example, looking for reviews of a novel by searching on a character name. For nonfiction, what jargon can you find that people in that field seem to use?

    But to find these words itself requires research. It’s an iterative process.

    6 votes