psi's recent activity

  1. Comment on What is your pet peeve with language acquisition? in ~humanities.languages

    psi
    Link Parent
    Oh, those are some good anecdotes! I might be underestimating the ability of kids then.

    Oh, those are some good anecdotes! I might be underestimating the ability of kids then.

  2. Comment on What is your pet peeve with language acquisition? in ~humanities.languages

    psi
    (edited )
    Link Parent
    I think you and @Narry already discussed the matter to death, so no need to repeat yourself, but maybe it's worth considering a more concrete example. Take German. In German there are three...

    I think you and @Narry already discussed the matter to death, so no need to repeat yourself, but maybe it's worth considering a more concrete example.

    Take German. In German there are three genders and four cases, so (for a language learner) determining which article to use requires mentally loading a 3x4 matrix into your head. Except German also differentiates between weak and strong endings, so there are actually two of these 3x4 matrices you have to memorize -- unless you insert an adjective between the article and noun, in which case there are additional rules at play.

    In contrast, in English we can just say "a/the cute cat". Japanese takes it even further by doing away with articles altogether.

    3 votes

  3. Comment on What is your pet peeve with language acquisition? in ~humanities.languages

    psi
    Link Parent
    Right, and just to elaborate a bit: Adults have much greater autonomy and better access to resources, which allows them to learn more efficiently. Children start from no language whatsoever...

    Right, and just to elaborate a bit:

    1. Adults have much greater autonomy and better access to resources, which allows them to learn more efficiently.

    2. Children start from no language whatsoever (except maybe a language module), whereas adults usually use a known language to bootstrap a second language. As a consequence, the "learning to learn" phase for children is significantly restricted.

    3. Children are forced to use a language out of necessity. The alternative is to massively hinder their ability to communicate at all.

    4. Despite this, it still takes years for children to become proficient in a language, whereas an adult can become proficient (in business situational speech) in a second language in only a couple years with dedicated study.

    Although there might be real physiological differences between the way children and adult learn languages, the importance of those differences is (in my opinion) largely washed out by other factors.

    2 votes

  4. Comment on What is your pet peeve with language acquisition? in ~humanities.languages

    psi
    (edited )
    Link Parent
    I've found that there are two phases to language learning: "learning to learn" and "actual learning". Textbooks, anki, duolingo, and so on mostly fall into the first category, but you don't really...

    I've found that there are two phases to language learning: "learning to learn" and "actual learning". Textbooks, anki, duolingo, and so on mostly fall into the first category, but you don't really start understanding the language until you begin engaging with native content (the second category). However, it would be highly inefficient to learn a second language by trying to parse native content without any other context.

    In that sense, language learning is a bit of an optimization problem: the "learning to learn" resources will help you learn more efficiently, but if you spend too much time on these resources, you will never actually learn the language. I think language learners often fall into the trap of never feeling confident enough to attempt the transition from the first to the second phase. But ironically the first phase of language learning will never get you over that hump; only by attempting to engage with native content can you actually learn to engage with native content.

    10 votes

  5. Comment on Googlebook revealed and ready for pre-order in ~tech

    psi
    Link Parent
    If I'm writing more than two paragraphs, I pretty much always write my comment in obsidian, usually starting on mobile and finishing on my desktop.

    If I'm writing more than two paragraphs, I pretty much always write my comment in obsidian, usually starting on mobile and finishing on my desktop.

  6. Comment on What is your pet peeve with language acquisition? in ~humanities.languages

    psi
    Link
    German: declension rules for definite articles are weirdly inconsistent. Why should der denote the nominative case for masculine nouns but also the dative case for feminine nouns? Better to drop...

    German: declension rules for definite articles are weirdly inconsistent. Why should der denote the nominative case for masculine nouns but also the dative case for feminine nouns? Better to drop the genders and decline everything as if it were masculine, the gender that distinguishes the most between cases. Maybe have separate declension rules for plural nouns, but die/die/den/der ain't gonna cut it.

    Japanese: kanji are cool and all, but given that most languages are primarily spoken, kanji are not as dense as they ought to be -- usually the furigana has fewer strokes than the kanji. Moreover, if the purpose of mixing kanji and kana is to improve readability, then why not just drop kanji altogether and simply use spaces, as in Korean and Japanese children's books?

    2 votes

  7. Comment on Paramount settles with California, other states over Warner Bros merger in ~movies

    psi
    Link Parent
    It's too soon to know for sure, but history suggests it probably won't be very effective. "David Ellison Will Get Control of CNN After All." The Atlantic.

    It's too soon to know for sure, but history suggests it probably won't be very effective.

    So although another major national news outlet will be under the control of a major Trump ally, at least there’ll be “a board of journalists to ensure the editorial independence”! (That this is happening while the president Ellison supports is banning all CNN reporters from the White House adds a tragicomic veneer to the story.)

    If this particular move sounds familiar, that’s because such “boards” have been a part of other news-company acquisitions that have raised similar concerns about antitrust or editorial control. These boards’ effectiveness has been, to be generous, extremely limited. Two of the most prominent examples—both involving Rupert Murdoch—offer little reason for optimism.

    [...]

    In practice, this did not work out. As the legendary editor Harold Evans put it in his 1983 book, Good Times, Bad Times:

    [Murdoch had] guaranteed that the editors would have control of the political policy of their newspapers; that they would have freedom within fixed annual budgets; that the editors would not be subject to instruction from either the proprietor or management on the selection and balance of news and opinion; that instructions to journalists would be given only by their editor; and that any future sale of the titles would require the agreement of a majority of the independent national directors. In my year as editor of The Times, Murdoch broke all these guarantees. He put his point of view very simply to the home editor of The Times, Fred Emery, when he summoned him from holiday on 4 March to his office shortly before asking for my resignation: ‘I give instructions to my editors all round the world, why shouldn’t I in London?’

    2 votes

  8. Comment on The American religion of self-storage facilities in ~life

    psi
    (edited )
    Link Parent
    When my wife and I moved to Germany, we packed all of our things into dozens of boxes and stored them with our parents. We labeled the boxes with descriptions (books, kitchenware, board games) as...

    When my wife and I moved to Germany, we packed all of our things into dozens of boxes and stored them with our parents. We labeled the boxes with descriptions (books, kitchenware, board games) as well as relative importance (ship now!, ship later, ship eventually). Then we flew over with four suitcases, a couple carry-ons, and one cat.

    The parents never did ship over any of the boxes. We never felt the need to ask. Once we were there, we found that we didn't need most of the stuff we had packed away; instead we just acquired the things we needed as we needed them. Then, when we would visit our families back in the states, we picked up the few things that we missed.

    So I would say a storage unit is probably mostly pointless. You likely have a few things worth stashing away somewhere, but that somewhere probably shouldn't be a storage unit. For the most part you're better off radically downsizing and giving away things to friends, where at least you know your items will have a good home.

    (That said, moving back to the States was a real nightmare.)

    6 votes

  9. Comment on Weekly US politics news and updates thread - week of September 14 in ~society

    psi
    Link Parent
    To quote Andy Weir, "I'm pretty much fucked. That's my considered opinion. Fucked."

    The only control or “guardrails” that AI needs is a STRONG AND SMART (High IQ!) PRESIDENT, and the U.S.A. has that, in spades! The Trump Administration has stopped AI “people” from doing bad, or potentially bad, “things,“ like Dario (Anthropic!), who is now pretending to be a “perfect little angel” - and we will continue to do so! We already have tremendous CRIMINAL and REGULATORY power over these companies! There is a SICK conspiracy going on against AI and Data Centers, and the only one that is happy about it is China. WHOEVER WINS AI, WINS! We are leading China, and all others, and will continue to do so. Conspiracy Theorists, Treasonists, Traitors, and Leakers, BEWARE! Thank you for your attention to this matter! President DONALD J. TRUMP

    To quote Andy Weir, "I'm pretty much fucked. That's my considered opinion. Fucked."

    5 votes

  10. Comment on Overview of the proofs behind the Navier-Stokes $1 million millennium prize problem in ~science

    psi
    Link
    A couple dozen Fields Medal recipients have since issued a statement spurred by this development. "A Severe Misalignment of AI in Mathematics"

    A couple dozen Fields Medal recipients have since issued a statement spurred by this development.

    Over the last few months, the mathematical capabilities of LLMs have improved dramatically, to the point that they can solve major outstanding problems in many fields of mathematics. However, the push by AI companies to solve mathematical problems as a benchmark is detrimental to the science of mathematics, and to the mathematical community. The goals of the AI companies and the goals of the mathematical community are severely misaligned. We see these as part of broader alignment issues impacting other scientific and creative professions, as well as the whole of society.

    4 votes

  11. Comment on Overview of the proofs behind the Navier-Stokes $1 million millennium prize problem in ~science

    psi
    (edited )
    Link Parent
    But most people wouldn't know "the right inputs". That's almost entirely the controversy. Buckman and Alpöge allege (in short) that OpenAI stole their research program and scaled it up 10000 times.

    But most people wouldn't know "the right inputs". That's almost entirely the controversy. Buckman and Alpöge allege (in short) that OpenAI stole their research program and scaled it up 10000 times.

    6 votes

  12. Comment on Overview of the proofs behind the Navier-Stokes $1 million millennium prize problem in ~science

    psi
    Link Parent
    There are no other computed-based tools comparable to an LLM. It's a totally different paradigm. Probably the previous largest technological breakthrough for mathematics was the internet, but the...

    There are no other computed-based tools comparable to an LLM. It's a totally different paradigm. Probably the previous largest technological breakthrough for mathematics was the internet, but the internet encouraged collaboration, not hoarding. I also wouldn't agree that simply having a solution is necessarily good for mathematics as a whole. As Terence Tao puts it:

    [...] The incentives may now be pointing in the direction of no longer sharing any promising research directions with the broader community, which would reverse centuries of traditions of open science and do serious long-term damage to the future of the field.

    In short, the indiscriminate use of powerful solution-extraction tools can achieve the immediate short-term goal of solving problems at hand, but at the cost of sustaining the ecosystem for the next wave of progress, or in understanding the progress already obtained. [...]

    There is much more to doing mathematics than just having the answer. Indeed, in mathematics the journey is usually at least as important as the destination. However, LLM-steered mathematics tends towards inelegant and clunky intermediate results, meaning that one loses much of the value that would normally be gained from having a solution to a difficult problem.

    14 votes

  13. Comment on Overview of the proofs behind the Navier-Stokes $1 million millennium prize problem in ~science

    psi
    Link Parent
    These are good points, but I think you risk underselling the importance of the universal approximation theorem. For a small neural network (e.g. reproducing a 1-dimensional function), you don't...

    These are good points, but I think you risk underselling the importance of the universal approximation theorem. For a small neural network (e.g. reproducing a 1-dimensional function), you don't even need backpropagation; you can use whatever minimizer you'd like.

    1 vote

  14. Comment on Overview of the proofs behind the Navier-Stokes $1 million millennium prize problem in ~science

    psi
    Link Parent
    The larger issue is that OpenAI used millions of dollars of compute to scoop the researchers who were honing in on a solution. Admittedly those researchers were potentially still years away, but...

    The larger issue is that OpenAI used millions of dollars of compute to scoop the researchers who were honing in on a solution. Admittedly those researchers were potentially still years away, but OpenAI's behavior must be massively demotivating for mathematicians. Why spend your career working on a difficult problem if a lab will just throw 10,000 agents at that problem and solve it over the weekend? The entire episode shows that these labs are extremely capable but also not responsible stewards of their own technology.

    Also, regarding the citations: even in OpenAI's most recent draft of the proof, Levent Alpöge (Buckman's collaborator) still hasn't been cited.

    16 votes

  15. Comment on US judge to baby: file an asylum application in ~society

    psi
    (edited )
    Link Parent
    Consider this today's daily reminder that immigration judges are executive branch employees, not Article III judges. (Or as I've heard one immigration lawyer put it: immigration court is just...

    Consider this today's daily reminder that immigration judges are executive branch employees, not Article III judges. (Or as I've heard one immigration lawyer put it: immigration court is just traffic court but with life and death consequences.)

    To be more generous than @gryfft's read (albeit perhaps less generous than yours, @skybrian), the Board of Immigration Appeals comprises almost exclusively Trump appointees (the Biden appointees having been purged), so terrible rulings like these are permitted and championed, and when immigration judges try to resist, they are often fired. (For another example of unjust policy, see the BIA's ruling on mandatory detention.) More likely, the judge either supports this administration's immigration objectives or feels obligated to rule as if they do, lest they lose their job.

    11 votes

  16. Comment on What's happening in Kansas should alarm us all in ~lgbt

    psi
    Link Parent
    The article mentions trans folk who tried to have their markers changed to the new legal requirement but were denied because they didn't bring the notice letter with them. (Indeed, many never even...

    The article mentions trans folk who tried to have their markers changed to the new legal requirement but were denied because they didn't bring the notice letter with them. (Indeed, many never even received the notice.)

    But then there's also this:

    On May 5, Kris Ripper, a trans woman, was stopped while driving home from work for failing to turn on her headlights in the rain. The police officer repeatedly asked her why her license indicated that she was male; she explained that the law required it. Almost two months later she found out that she had been charged with a misdemeanor for driving without a valid license. (Ripper talked to another trans reporter about her predicament, but declined to speak with me.) The charge was eventually dropped, but not before she was threatened with a $1,000 fine and jail time.

    6 votes

  17. Comment on What happened: OpenAI and Hugging Face in ~comp

    psi
    Link Parent
    "15 attorneys general have instructed OpenAI to preserve all materials related to the Hugging Face hack." Business Insider. No consequences yet, but hacking into other people's computers is a...

    "OpenAI's unprecedented and alarming misconduct demands an immediate and significant response," the group wrote, adding that the company may have violated state and federal law, including consumer protection and data privacy statutes.

    They instructed OpenAI to immediately preserve all materials related to the Hugging Face hacking incident, as well as any prior instances in which its agents similarly engaged in unauthorized intrusions into computer systems or databases.

    No consequences yet, but hacking into other people's computers is a crime. It will at least be interesting to see how this plays out (even if, like you, I'm not optimistic much of anything will come from it).

    3 votes

  18. Comment on Share your favourite dal recipe! in ~food

    psi
    Link Parent
    My recipe is similar to yours, so I'll just post mine here (as well as the video I stole it from). There is a fair amount of flexibility in how one prepares the tadka: like you, usually I leave...

    My recipe is similar to yours, so I'll just post mine here (as well as the video I stole it from). There is a fair amount of flexibility in how one prepares the tadka: like you, usually I leave out the curry leaves and add smoked paprika instead, though I use butter instead of ghee (as I always have butter lying around). Also a warning: it's rather easy to burn the tadka if you aren't being careful.

    Ingredients

    For the dal

    Amount Item
    1 cup toor (split pea) lentils
    2 medium potatoes
    5 cups water
    2 tsp tumeric
    1/2 tsp fenugreek leaves
    1 clove grated garlic
    1 tsp grated ginger
    to taste salt

    For the tadka

    Amount Item
    a handful curry leaves
    half medium onion
    1/2 tsp mustard seeds
    1/2 tsp cumin seeds
    3 cloves garlic
    2-3 small peppers
    small piece cinnamon
    blob butter
    some oil

    Instructions

    For dal

    1. Wash lentils and set aside.
    2. Heat oil in (lentil) pot at medium heat.
    3. Chop garlic and ginger, setting aside a smaller portions for dal and a larger portion for tadka
    4. If using, dice potatoes.
    5. Add smaller portions of garlic & ginger to oil.
    6. After a minute, add dal to toast. If using, add potatoes, too.
    7. Add tumeric.
    8. Add water and salt. Cover lid.
    9. Let cook for ~30 minutes.
    10. Add tadka (see below).
    11. Add fenugreek leaves.

    For tadka

    1. Remove curry leaves from stem.
    2. Cut peppers at an angle
    3. In a separate pan, set to medium heat and add blob of butter + oil (to prevent burning)
    4. Add mustard seeds, cumin seeds, and cinnamon. Cover lid.
    5. After the popping begins to subside, add curry leaves and onion. Add more butter if needed.
    6. After a couple minutes, add garlic, ginger, peppers, and a bit of oil (to prevent burning).
    7. Just before the garlic starts to brown, pour tadka into dal. Add a little bit of dal to tadka pan then pour back into dal bowl to ensure that none of the buttery tadka goodness is lost.

    References

    1 vote

  19. Comment on A skeptical overview of AI and consciousness in ~humanities

    psi
    Link Parent
    Chapter 11 has a section on "strange intelligence" that is very much worth a read, if you haven't read it yet. In particular, we can imagine that in order for an entity to be conscious, it should...

    Chapter 11 has a section on "strange intelligence" that is very much worth a read, if you haven't read it yet. In particular, we can imagine that in order for an entity to be conscious, it should have a set of essential properties, but that we could in principle build machines that contain only a subset of those properties. They wouldn't technically be conscious, but they would be almost conscious -- what the author calls a form of strange intelligence.

    Unfortunately, rather than resolving the ethical implications, it just raises a host of new ones. For instance, is it moral to intentionally lobotomize a machine that would otherwise be conscious? Certainly nobody would think it moral to intentionally lobotomize an otherwise viable embryo. Similarly, perhaps consciousness is not a necessary condition for feeling, and despite not being conscious such machines would still feel suffering when being forced to do their user's bidding. Probably comparisons to anesthesia are appropriate here. I once read a particularly harrowing account of a colonoscopy in which a patient screamed bloody murder the whole time, but as soon as the operation was done (and the anesthesia stopped), the patient calmly thanked the doctor and said it was the easiest colonoscopy of his life; I don't think people would be okay with the digital equivalent of that.

    1 vote

  20. Comment on A skeptical overview of AI and consciousness in ~humanities

    psi
    Link Parent
    I assume the author discusses LLMs because it's concrete, existing technology, and it truly does make the philosophical implications more pressing compared to, say, 15 years ago when something...

    I assume the author discusses LLMs because it's concrete, existing technology, and it truly does make the philosophical implications more pressing compared to, say, 15 years ago when something like ChatGPT would have sounded like a lazy plot device. However, most of the author's arguments concern AI in the abstract, not LLMs in particular.

    It's a little risky to assume what the author thinks, given that the central tenet of his book is that we should practice epistemic modesty with respect to AI consciousness. Nevertheless, if we read between the lines, it seems pretty likely to me that the author does not believe LLMs are conscious, but rather that future AI models where LLMs are a component potentially could be.