skybrian's recent activity
-
Comment on LLM users: how do you feel about it? in ~comp
-
Comment on LLM users: how do you feel about it? in ~comp
skybrian Link ParentHave you tried OpenAI recently? Sol seems pretty solid in my experience and it works with any coding harness. (I'm not one-shotting anything, though. We have a conversation.)Have you tried OpenAI recently? Sol seems pretty solid in my experience and it works with any coding harness.
(I'm not one-shotting anything, though. We have a conversation.)
-
Comment on Pill to treat pancreatic cancer hailed as ‘biggest breakthrough in decades’ in ~health
skybrian LinkFrom the article: [...] [...] [...] [...] Previously posted but they have another six months of results.From the article:
A pill that can shrink and potentially eliminate pancreas tumours is being hailed as the biggest breakthrough treatment for the cancer in decades.
In one in 12 of the patients given the drug, daraxonrasib, during a trial, the cancer became undetectable, and the tumours stopped growing in almost all of the 61 patients. The trial participants had recently been diagnosed with advanced pancreatic cancer that had spread to other parts of the body.
[...]
Though doctors have said the pill cannot yet be considered a cure, and they do not know how long it can keep the disease at bay, they have said it is encouraging news because it appears it will offer patients more time, even if it does not cause full remission.
[...]
Half of all people diagnosed with pancreatic cancer die within three months, and only about 3% of patients survive for five years when the disease spreads to other organs. It has the lowest survival rate of all common cancers in the UK and has a similarly poor prognosis globally.
[...]
A year after starting treatment, 76.6% of patients were alive; usually 40-45% of patients given chemotherapy alone survive a year.
Dr Wungki Park, a gastrointestinal medical oncologist at Memorial Sloan Kettering Cancer Center in New York, who presented the findings, said “this is the closest to cure”, adding that he had never seen so many tumours disappear in patients whose cancer had spread.
[...]
There are hopes the treatment could work for dozens of other cancers because they can have similar mutations.
Previously posted but they have another six months of results.
-
Pill to treat pancreatic cancer hailed as ‘biggest breakthrough in decades’
20 votes -
Comment on LLM users: how do you feel about it? in ~comp
skybrian LinkThe gold rush is a problem, but I think AI's downsides are fixable, provided that society takes the time to fix them. I'm still somewhat optimistic about that, though it's not anything I can...The gold rush is a problem, but I think AI's downsides are fixable, provided that society takes the time to fix them. I'm still somewhat optimistic about that, though it's not anything I can prove.
Often the objections people make about AI aren't very good as arguments, because they're based on bad premises or bad reasoning. But a political bottleneck on building more data centers might not be a bad thing overall if it slows things down a bit. Anti-AI populism might be "directionally accurate," as they say.
Nvidia getting caught cheating on chip exports might slow things down a bit too.
Similarly, the main thing wrong with vibe-coding is doing things in a rush. In theory, being able to work faster on things like prototyping can free up time to do more cleanup and checking. Quality could improve if we're willing to do it. I still expect a lot of slop, though.
It could still go badly in all sorts of ways. For example, the gold rush turning into a military arms race (drones and more!) and destabilizing the political situation further, resulting in more war.
-
Comment on Using Anthropic AI, mathematician claims to have solved Riemann hypothesis in ~science
skybrian Link ParentYes, everyone expects P != NP. (Just to clarify.) I think the unsurprising results so far are examples showing how superintelligence isn’t magic. It can do a really good search, better than we...Yes, everyone expects P != NP. (Just to clarify.)
I think the unsurprising results so far are examples showing how superintelligence isn’t magic. It can do a really good search, better than we can, but it can’t find things that aren’t there.
Mathematicians do expect to learn many interesting techniques based on how the new results were proved, but this is insider knowledge that we are unlikely to understand.
-
Comment on How interaction nets could be used to design more efficient hardware in ~comp
skybrian LinkFrom the article: [...] [...] [...] Apparently this has been used to design a new CPU architecture. But it's unclear to me whether they actually manufactured the chip. It sounds like they might...From the article:
Understanding the potential of our novel general-purpose architecture requires understanding the underlying model of computation: interaction nets. So we will introduce interaction nets and their unique properties (specifically locality, parallelism, and linearity) and how they help to overcome some of the hardest challenges in hardware architecture design.
[...]
Having an efficient implementation is one thing, but programming in raw interaction nets is not really feasible. For this, we’ll talk about the third property we haven’t mentioned yet: linearity. This property refers to the fact that things get used exactly once. As a matter of fact, we’ve seen this property in action already when we defined specific nodes to explicitly erase and duplicate numbers. This property is interesting because, as it turns out, a normal programming language with a linear type system can be compiled down to a linear model of computation, such as interaction nets, perfectly. Specifically, Rust has popularized a kind of linear type system with its concept of ownership.
While there are a couple of big caveats as to why Rust specifically can’t easily be compiled to interaction nets, we’re able to create a language (Vine) that is similar to Rust but compiles directly to interaction nets.
[...]
The way the Vine compiler does this is not by magically extracting parallelism out of the program; it simply preserves dependency information all the way down to the hardware (or runtime, in this case). We can find very similar patterns of parallelism in e.g. option pricing algorithms.
Normal compilers already track these dependencies internally and use them to make optimizations. However, this information is then thrown away and the entire program is linearized into a sequence of instructions. Ironically, modern CPUs then try to extract this parallelism to a limited degree in silicon with out-of-order buffers and superscalar execution. Instead of that, with interaction nets, we can keep and exploit this information at the lowest level.
[...]
Earlier, we claimed that the properties of interaction nets can help us overcome some of the hardest challenges in hardware architecture design. To see why, let’s look at some of the modern challenges in architecture design.
One of the key design choices of CPUs is having one unified memory space. This has become a problem in recent years, because since the early 2000s, single-core CPU performance has stagnated. We’ve thus seen a stark rise in multi-core CPUs, but when all processors work on a single memory space, every load and store instruction is technically a global operation. Of course, modern caches hide most of this, but cache coherency protocols are the price for it. They typically scale poorly and limit the number of cores. With interaction nets, operations are local and cores can store the relevant data in local SRAM, which does not require any cache coherence. Moreover, for the same reason that Rust’s type system allows automatic memory management without a garbage collector, the linearity of interaction nets also makes memory management on the chip feasible. With these properties, we can scale to thousands of cores.
Another issue with multi-core CPUs is the difficulty of programming them. Debuggability is a major issue, and entirely new classes of issues arise, such as race conditions. However, in interaction nets, all active pairs are independent, and so can actually be executed in any order. This property is known as confluence, and means that no matter the order in which things are executed, the result will be the same. This makes debugging straightforward and eliminates issues like race conditions. This allows Vine to be parallel out of the box; the programmer does not have to do anything special with threads, processes, CUDA kernels, etc. to get parallel execution.
Apparently this has been used to design a new CPU architecture.
We synthesized Frostbite on a 7 nm process, reaching 800 MHz timing at synthesis and 500 MHz in the final GDS. Each Frostbite quad (a two-by-two grid of tiles) paired with four L3 nodes is 0.792 mm². We benchmark one Quad+L3 cluster against a single core of a modern superscalar (dual-issue, in-order) CPU, which we refer to as TCPU (“Traditional CPU”). This TCPU is 0.895 mm² at the same process.
But it's unclear to me whether they actually manufactured the chip. It sounds like they might have benchmarked a simulation somehow?
They do plan to release a version that runs on FPGAs.
-
How interaction nets could be used to design more efficient hardware
6 votes -
Comment on Signal is attempting to block AI screenshots on mobile phones in ~tech
skybrian LinkFrom the article: [...]From the article:
The problem is similar to Microsoft Recall on Windows: Google and Apple are integrating agentic capabilities like Gemini Intelligence with Google Gemini and Onscreen Awareness with Siri AI deep into their operating systems. This is a significant move. Google (Android), Apple (iOS/macOS), and Microsoft (Windows) produce the three major consumer operating systems (OS), which comprise the environment that third-party developers – like Signal – build their apps to function and operate within. To put it differently, these three operating systems are the oceans in which Signal, and other applications, must swim; they dictate the conditions of life for the application ecosystem. Right now, these agentic AI integrations are changing this environment in a way that’s making it increasingly hostile to privacy. This is an existential threat to Signal, and our ability to responsibly uphold our mission.
In order to gain access to information about you, these OS AI agents “scan” the information that’s on your screen. In doing so, your Signal data is captured, then made available to these agentic systems in order to allow them to answer your questions and do your bidding.
The net result is that these AI capabilities in the operating system are undermining Signal’s ability to independently guarantee privacy. For over a decade, this guarantee has been backed by our tried and trusted open source code base and our formally verified encryption protocol. These have been scrutinized by some of the best security experts and hackers across the world, and shown to be robust. Now, in service of AI agentic capabilities, your sensitive data is being captured, stored, and made accessible to whatever local database or remote server an OS-level AI agent is using at that moment. All of this is outside of Signal’s control once the data has been captured, and imperils the privacy of all the participants in a conversation.
So, we are blocking such capture by preventing screenshots in the app on iOS 27 and when AI assistants attempt to capture screen data on Android.
People who want the ability to take screenshots can disable this protection within the Signal app’s settings. However, doing so will potentially expose your (and your contacts’) Signal content to these AI agents, and break our privacy guarantees. Our remedy is also incomplete – while we are doing everything we can, restricting screenshots does not address other more sneaky ways AI agents could potentially access application data, such as retrieving content already present on a user’s device via the filesystem.
[...]
We continue to call on the major consumer operating system companies – Apple, Google, and Microsoft – to provide simple technical tools and accurate documentation that give developers like Signal ways to prevent AI agents from accessing sensitive application data. In particular, we are calling on these companies to provide two common-sense remedies that can protect the privacy so many millions of people rely on:
-
Developers should have an easy and well-documented way to opt their app out of AI data access and processing, including (but not limited to) screen reading, filesystem access, notifications, APIs, and other OS frameworks, all without undermining the core utility of an application.
-
Operating system companies should create better documentation and technical specifications around how these AI agents function, particularly regarding data access and processing. Confidential computing approaches are not a complete solution, and do not address these core concerns. In particular, these approaches still leave the power to determine the extent of privacy guarantees (if any) in the hands of these providers.
-
-
Signal is attempting to block AI screenshots on mobile phones
36 votes -
Comment on I spent a year talking to Anthropic employees. Here’s what they believe. (gifted link) in ~tech
skybrian Link ParentCharity Navigator can be useful for avoiding the worst choices, but they have a large catalog and I don't think they're all that selective? If you want someone to pick the best recommendations...Charity Navigator can be useful for avoiding the worst choices, but they have a large catalog and I don't think they're all that selective?
If you want someone to pick the best recommendations that are still very safe bets, GiveWell has a short list of top charities. They are sort of like Wirecutter's reviews in that they will straight up tell you which ones they will think are the best.
Although, nowadays GiveWell recommends that people donate to their fund instead and let them redistribute it.
-
Comment on Using Anthropic AI, mathematician claims to have solved Riemann hypothesis in ~science
skybrian LinkFrom the article: [...] [...] [...] [...]From the article:
Another domino of mathematics appears to have fallen after a mathematician at artificial intelligence company Anthropic claimed an AI-powered proof to the Riemann hypothesis — the latest remarkable discovery in a tide of findings generated by AI that have left human mathematicians reeling about being bested by machines.
[...]
The Riemann hypothesis concerns the mysterious, unpredictable structure of the prime numbers (numbers that can be divided only by one and themselves). It was viewed as one of the field’s deepest mysteries and is one of the seven Millennium Prize problems for which an accepted solution comes with a $1 million prize.
[...]
For mathematicians, the allure of the Riemann hypothesis, and others like it, is not the prize money but its ability to motivate useful and profound new discoveries. Hundreds of other questions of interest have been felled in recent months by powerful AI tools, and the field is still reckoning on what to do without these North Stars for direction.
“It is natural to feel that this is an end, in my case a loss of a principal guiding light,” wrote Levent Alpöge, the Anthropic mathematician who claimed the solution. “But what I saw during the course of progress so amazed me that I believe it is one dawn across science of something far greater.”
In a lengthy statement accompanying the solution, Alpöge said he had seen Claude, Anthropic’s name for its AI models, rapidly outpace him as they neared the conclusion of the argument. Alpöge said he had helped guide the AI to an initial idea, and then “Claude began to leave me in awe.”
Anthropic did not immediately respond to a request for comment.
Now, mathematicians will need to pick through the proof to understand it; some may use AI tools to help. Alpöge released a certificate of 17 million lines of code that he said formally verified the correctness of the argument, but did not have a typed-up paper, which would have run at least 250,000 pages.
“It being obviously inappropriate to attempt to post some massive unreadable travesty of ‘slop,’” he wrote, alluding to the fact that any write-up would have been principally generated by AI.
[...]
Alpöge said he had consulted Anthropic’s leadership about announcing the problem, and that they ultimately decided releasing it was the right thing to do.
“This problem has been the sacred object in mathematics for me since my childhood, and I am very touchy about the treatment of great intellectual goals, though seriously imperfect,” he said. “I just could not live if I waited even longer.”
[...]
Now, the mathematics community will have to absorb the discovery. In the hours after Alpöge’s claim began circulating online, mathematicians rushed to online forums to begin discussing his work.
“If it turns out to be correct, it will be a memorable moment,” in mathematics, said Cornell professor Steven Strogatz in a message. “A very skilled AI jockey riding a very fast AI horse.”
-
Using Anthropic AI, mathematician claims to have solved Riemann hypothesis
25 votes -
Comment on I spent a year talking to Anthropic employees. Here’s what they believe. (gifted link) in ~tech
skybrian Link ParentThere has been at least one dangerous cult associated with Rationalism (the Zizians). I’m not aware of any for EA. It’s more of a loose movement than a coherent organization that you can make...There has been at least one dangerous cult associated with Rationalism (the Zizians). I’m not aware of any for EA. It’s more of a loose movement than a coherent organization that you can make claims like that about.
But I think we can say that Anthropic is a coherent organization that aims to be culturally distinct from the mainstream. They are selecting for particular beliefs with their hiring practices. Groupthink does seems like a danger. That’s what they’re trying for, because they think it’s an advantage!
But it’s hard for companies to grow without losing whatever culture made them distinctive. People don’t change all that much when they join a company. They bring their beliefs with them.
-
Comment on I spent a year talking to Anthropic employees. Here’s what they believe. (gifted link) in ~tech
skybrian (edited )Link ParentI think Anthropic has a good chance to be the next Google; they might grow enough to justify their valuation. This doesn’t require an insane amount of progress. I don’t think that necessarily...I think Anthropic has a good chance to be the next Google; they might grow enough to justify their valuation. This doesn’t require an insane amount of progress. I don’t think that necessarily means that the robots take over and AI puts everyone out of work. It could be a “normal technology,” and yet, the rapid growth we’ve seen so far might still have a few more years left before reaching some kind of natural limit.
How many years? Who knows? It’s like predicting the end of Moore’s law. Some people seem to be thinking that AI progress might stop in 2027 and that results in a crash, but I don’t think general cynicism about AI is enough to justify that belief.
I don’t have any idea what the natural limit would be. It’s just a hunch that intelligence is not magic and other things matter too.
One way to think about AI is that it’s really good at searching in a variety of domains. For example, for computer security, if there are security bugs to be found, it will find them. It’s not going to magically find bugs that aren’t there. So when thinking about whether AI could be used to break in to a system, it’s a question of what bugs are there. Unfortunately it’s quite difficult to predict what it will find. It seems a safe bet that most software has security bugs, but for at least some carefully designed and relatively simple systems, it’s possible to remove all the security bugs.
Similarly in math, if there’s a proof to be found, it’s likely to find one. But it doesn’t determine which mathematical statements are true or whether they can be proven.
In many scientific fields, we don’t know what a really good search will find so it’s a bit scary. Before the 1930’s, nobody knew that nuclear fission was waiting to be discovered. I’m doubtful that in physics there are any similarly scary discoveries waiting to be found, because physics seems too well understood. But what is it possible to find in biology?
-
Comment on I spent a year talking to Anthropic employees. Here’s what they believe. (gifted link) in ~tech
skybrian Link ParentFrom the other article I shared: "we can estimate that employees have pledged $23 billion of donations." It doesn't seem fake? The "earn to give" thing seems to have worked out spectacularly well...From the other article I shared: "we can estimate that employees have pledged $23 billion of donations."
It doesn't seem fake? The "earn to give" thing seems to have worked out spectacularly well for Anthropic employees. Also, once you donate to a fund, you can't change your mind and get the money back.
-
Comment on I spent a year talking to Anthropic employees. Here’s what they believe. (gifted link) in ~tech
skybrian Link ParentSorry for misunderstanding. I didn't know what you meant to say about valuation. Yes, I imagine Anthropic employees do expect rapid technological improvement. It's what they've experienced so far...Sorry for misunderstanding. I didn't know what you meant to say about valuation.
Yes, I imagine Anthropic employees do expect rapid technological improvement. It's what they've experienced so far with AI and it would make sense for the trend to continue.
-
Comment on I spent a year talking to Anthropic employees. Here’s what they believe. (gifted link) in ~tech
skybrian LinkAnother journalist posted on X about what Anthropic was like in 2023: ...Another journalist posted on X about what Anthropic was like in 2023:
-- Anthropic was very small, very recently. When I visited, they had 160 employees in a small office on Sansome, a chatbot nobody had ever heard of, and seemed to have no interest in running a business. I wrote in my notebook that they seemed like "ambivalent capitalists"; their newly hired sales guy told me that the only reason he needed to make money at all was so that the safety researchers could save the world.
-- Things were not going well for them: their biggest shareholder (SBF) had been arrested for fraud, and OpenAI was eating their lunch with ChatGPT. (I later learned that they also had an expensive model training failure in 2023.) This was 3.5 years before they went public as one of the most valuable companies in the world, with 5,300 employees and 14x annual revenue growth. I guess they figured out the capitalism thing!
-- They were obviously and sincerely terrified of AI. Claude 2 was a very dumb model by today's standards, but every discussion I had there revolved around existential risk. Researchers told me they lost sleep over their fears of AI takeover, and made terrifying predictions of how soon AGI would arrive. It didn't seem fake or manufactured, but I didn't really get it! I wrote in my notebook: "I have never encountered a company that so badly needs a Klonopin." (I stand behind this, although I also need one now.)
...
-- The Ants I talked to mostly struck me as sharp and thoughtful, although I did end up wondering whether they were too safety-obsessed to run an actual business. (I jotted down: "I do not know why you would invest in a company like this.") But I was struck by their earnestness, especially because I'd just spent several years covering social networks that didn't worry about the harms of their products at all.
-
Comment on I spent a year talking to Anthropic employees. Here’s what they believe. (gifted link) in ~tech
skybrian Link Parent"Effective Altruism" is a particular movement that's concerned about how best to give money to charitable causes. There's plenty of evidence that people at Anthropic are interested in charitable..."Effective Altruism" is a particular movement that's concerned about how best to give money to charitable causes. There's plenty of evidence that people at Anthropic are interested in charitable giving, such what people at Anthropic have themselves written (often before Anthropic existed), the foundation they set up, and the way they structured the company to strongly encourage charitable donations by employees:
More:
Anthropic’s IPO could deliver $156B to charity (Tech Crunch)
First, the company’s Public Benefit Fund, or PBF (analogous to OpenAI’s foundation), was allotted 5% of the company’s shares, almost 850 million. At the current trading price of about $95, that will leave it with an endowment of $80 billion. And if the company continues its astonishing growth rate, Anthropic could add further 2% increases every time the company’s valuation grows more than 50% over the IPO price of $83, or about $124.50 per share for the next threshold.
The PBF’s money will be focused on research and activities related to increasing the benefit of artificial intelligence to humanity. The first commitment of the PBF was $200 million to study the impact of AI on workers; Anthropic has said it will consider donations to philanthropic organizations or “direct distributions to specific populations” — perhaps a hint of future UBI plans.
Anthropic also donated $50 million to the city of San Francisco last week. A company spokesperson tells TechCrunch the donation did not come from the PBF.
Next, Anthropic’s employees have pledged shares to philanthropic causes of their choice, and the company will match those donations 3-to-1 for longer tenured employees and 1-to-1 for newer ones. In its S-1 filing, the company said that it had reserved more than 550 million shares to fulfill pledges made before September 30.
Working backwards from that figure, and based on the disclosure that 84% of the shares were reserved for early employee matches, we can estimate that employees have pledged $23 billion of donations; the company’s match on those would be roughly $53 billion, depending on the stock price when those matches are delivered.
All told, it adds up to $156 billion — a huge amount of potential philanthropy. For context, Americans donated $617 billion to charity in 2025; if all of the pledged funds resulting from today’s transactions get to do-gooders, that will be equal to about a quarter of all U.S. donations made last year.
Another point of comparison: the Gates Foundation has given away $110 billion since inception.
-
Comment on I spent a year talking to Anthropic employees. Here’s what they believe. (gifted link) in ~tech
skybrian Link ParentAnthropic's valuation comes from investors who want to own the stock, so Anthropic's internal beliefs aren't directly related. In particular, many investors are impressed by Anthropic's rapidly...Anthropic's valuation comes from investors who want to own the stock, so Anthropic's internal beliefs aren't directly related.
In particular, many investors are impressed by Anthropic's rapidly increasing revenue.
Whenever I ask an LLM to review its own work (for example, a design doc), it finds issues too. After I fix them, it will find more issues, but with repeated reviews, they become less serious and then just nitpicky or inapplicable.
If you generated something with Claude and asked ChatGPT to review it, I expect that it would also find issues. They try to give you what you asked for.