skybrian's recent activity
-
Comment on How "independent" AI safety groups are pumping Anthropic's IPO in ~finance
-
Comment on Safety in the age of hands-free driving with end-to-end AI in ~transport
skybrian (edited )Link ParentNot what you asked, but I did find some stats for Waymo-driven miles. From this blog post from September: (An interesting comparison is that in the US, there's normally about 1 fatality per 100...Not what you asked, but I did find some stats for Waymo-driven miles. From this blog post from September:
Our latest analysis of the Waymo Driver’s safety performance now covers over 270 million miles of fully autonomous operations through the end of June 2026
(An interesting comparison is that in the US, there's normally about 1 fatality per 100 million miles.)
From this post from June:
Waymo now drives more than 4 million miles every week
-
Comment on How Ukraine struck the Kerch bridge, a symbol of Vladimir Putin’s rule in ~society
skybrian LinkFrom the article: [...] [...]From the article:
Over the next four hours, hundreds of attack drones followed the same linear path, flying first over land and then over the Black Sea. In the early hours of the morning they arrived at their destination: the Kerch bridge connecting occupied Crimea with Russia. Putin opened the monumental road and rail crossing in 2018, driving across it in a Kamaz truck. This was four years after his undercover troops – known as little green men – seized the peninsula.
Russian propagandists had described the bridge as impregnable. It was, they said, an edifice as strong and unyielding as their country’s iron leader. For Ukraine, by contrast, it was a hated symbol of Russian arrogance and colonial thinking. Also, officials pointed out, it was illegal. Twice Kyiv had tried to blow it up – with a truck bomb in 2022, and a sea drone the following year.
On this occasion, the Ukrainian military’s careful, multi-stage plan worked perfectly. “It was a well-coordinated operation. Waves of drones started from different locations. The goal was to overwhelm Russia’s well-organised air defence system, rather than the bridge itself,” Leon explained.
As expected, the initial salvo tied up Russia’s local defences. According to insiders, Ukraine then launched a second drone wave. Its function was crucial and different: to act as a relay system for radio signals. Previously, Ukrainian units had used Starshield, the military equivalent of Starlink, for mid-range strikes on occupied territory. Elon Musk’s SpaceX owns the satellite internet network, which is overseen by the Pentagon and the Trump administration.
[...]
Once the relay was in place, a third wave of attacks could begin. This time they featured Flamingos, a potent Ukrainian-made cruise missile capable of carrying 1,000kg of explosives – enough to seriously damage the bridge. An unknown number of missiles – some reports say at least four – were launched from southern Ukraine and sent towards Crimea.
A video from one of the Flamingos shows it drawing inexorably towards the target. The onboard camera captures a ghostly night-time scene. The crossing looms into view against a grisaille background. Suddenly a gigantic steel arch appears. The feed cuts out. Other footage shows the moment of impact: an orange fireball, pricking the surrounding blackness.
Photos taken on Tuesday morning in the aftermath of the attack show a scene of watery devastation. A massive arch had tumbled overnight into the Kerch Strait, with a large concrete chunk of the road crossing. Nobody will be driving across the bridge anytime soon. The adjacent railway arch span was also damaged. “We were very happy, swapping messages all night,” Leon said.
[...]
In addition to Putin’s political embarrassment before his peers, the disabling of the Kerch bridge has practical consequences. Since annexing Crimea, Russia has militarised the peninsula, effectively turning it into a giant and fortified army base. Since 2022 it has been used as a launch platform for drone and missile attacks on the port of Odesa, and other Ukrainian cities in the region.
Russia’s occupying southern army has relied on the bridge for regular deliveries of ammunition, equipment and fuel. With the crossing partially closed – rail travel reportedly reopened on Tuesday – Russia will have to use an under fire land corridor instead, connecting its Rostov oblast with the Moscow-controlled parts of Ukraine’s Zaporizhzhia and Kherson provinces.
-
How Ukraine struck the Kerch bridge, a symbol of Vladimir Putin’s rule
14 votes -
Comment on How Malaysia became the unlikely crossroads of the global AI boom in ~tech
skybrian (edited )LinkThe linked article from October 29 also seems relevant: Nvidia Chief Seen as Target of Chinese Spy Plot (New York Times) ... So, this is looking like: some of the people in the Trump...The linked article from October 29 also seems relevant:
Nvidia Chief Seen as Target of Chinese Spy Plot (New York Times)
American spy agencies had gathered striking intelligence.
A top executive at a Singapore-based data center company was under scrutiny for possibly steering advanced Nvidia A.I. chips to China. And now American officials had concluded that she was a Chinese intelligence asset, funneling information to Beijing.
...
Roughly a year ago, Mr. Trump was briefed about the intelligence findings, which have not been previously reported, and chose not to do anything with the information. Mr. Trump has been wary of disrupting Nvidia’s chip sales, which are helping to drive the economy and the stock market, and of further complicating the trading relationship with China.
This account is based on interviews with people briefed on the surveillance, who spoke on the condition of anonymity because the findings are drawn from classified intelligence, as well as other officials and industry executives and analysts.
American officials already suspected that Ms. Huang was helping China evade constraints on its ability to gain access to advanced A.I. chips.
But the revelation that she was feeding information directly to Beijing raised more troubling possibilities, including that Ms. Huang had insights into Mr. Trump’s thinking on an issue of vital importance to both nations, one likely to come up when the president visits China next month. And it left questions about whether she could be gleaning information about Nvidia, which as much as any company accounts for the lead the United States has maintained in developing cutting-edge A.I. models.
So, this is looking like: some of the people in the Trump administration wanted Jensen Huang gone, and they leaked to the New York Times, which kicked off the scandal? Otherwise, how would the relationship with an alleged spy have become publicly known?
But it seems the leak might have been somewhat misleading about the strength of the evidence:
The US intelligence community is still working to understand the relationship between a Chinese businesswoman who had an affair with Nvidia CEO Jensen Huang and the Chinese government, with multiple sources telling CNN that the intelligence collected on her to date does not prove that she was acting as a spy for Beijing.
There is disagreement among US officials about the strength of the evidence that Alice Huang was recruited by the Chinese Ministry of State Security (MSS), the Chinese equivalent of the CIA, to spy on Jensen Huang — and, by extension, on US policymakers.
The FBI has been investigating Huang’s affair for at least a year. But Attorney General Todd Blanche said on Thursday that there are still “no conclusions reached by the Department of Justice, or by me, or by [FBI] Director Patel around who she is or is not.” President Donald Trump also hedged Thursday on whether the US had determined she was a spy, when commentator Stephen A. Smith asked whether Huang was right to have stepped down as CEO.
So it seems Jensen was vulnerable due to his own actions, but might have gotten away with it except that the Trump administration was divided. If it weren't for the infighting, they could have closed the Malaysia loophole earlier, without starting a scandal.
-
Comment on How Malaysia became the unlikely crossroads of the global AI boom in ~tech
skybrian LinkFrom the article: [...] [...] [...] [...] [...] [...] [...] [...] [...] [...]From the article:
That distinction has helped turn Malaysia, a country of 35 million people, into an unlikely frontier of the A.I. boom. Drawn by cheap land and electricity, and proximity to undersea cables that carry internet traffic to China and the rest of the world, technology companies are pouring billions of dollars into the country.
[...]
Nowhere is that transformation more striking than in Johor, the southern state at the center of the building boom. Across the state, 65 data center projects are operational, under construction or in various stages of planning and approval.
The facilities already consume more than two gigawatts of electricity, enough to power more than one-third of Malaysian homes. If all planned projects are completed, demand could exceed 10 gigawatts, according to Invest Johor, a state agency, making it one of the world’s largest concentrations of computing power. Chinese and Western tech companies are expected to account for roughly equal shares of that capacity.
[...]
American technology giants, including Microsoft, Google and Oracle, are investing heavily in Malaysia to be closer to Asian customers. At the same time, the country has become an offshore computing hub for Chinese companies like ByteDance, Tencent and Alibaba. In some of Johor’s industrial parks, infrastructure serving American and Chinese companies is being built almost side by side.
[...]
Malaysia’s boom began around 2021. After neighboring Singapore banned new data center construction because of electricity constraints, companies soon began moving across the border.
[...]
DayOne, which has headquarters in Singapore, illustrates how Chinese firms have maintained a foothold in the A.I. data center boom despite American restrictions. It has raised billions from international investors, including the American investment firm Coatue Management and Japan’s SoftBank, and recently announced plans for an initial public offering.
Yet DayOne maintains strong ties to China’s tech industry. GDS remains a major investor, alongside Hillhouse Investment, a Singapore-based firm founded by the Chinese billionaire Zhang Lei. Jamie Khoo, GDS’s former chief operating officer, now leads DayOne, and William Huang, GDS’s chairman, sits on its board.
ByteDance, TikTok’s parent company in China, is DayOne’s biggest customer, according to analysts. In a recent securities filing, DayOne said an unnamed customer operating a “leading short-form video” service accounted for nearly 70 percent of its revenue in the first half of 2026.
[...]
In April, DayOne joined Nvidia’s data center partner network, which helps develop facilities for handling the most advanced A.I. computing gear.
Nvidia said remote access to computing capacity hosted abroad is consistent with American export controls because the chips remain outside restricted countries. The business “promotes U.S. national security and brings tens of billions of dollars and high-paying jobs home,” the company said in a statement.
[...]
A report circulated within U.S. government agencies identified direct or indirect Chinese ownership in 38 of 128 data center projects across Southeast Asia. It estimated that the computing power available to Chinese companies through Malaysia, Thailand, Vietnam, Indonesia and Singapore was nearly as substantial as that from all of mainland China, where U.S. export restrictions have held back development. The report was shared with The New York Times.
In July, Michael Kratsios, a White House adviser involved in A.I. policy, accused the Chinese company Moonshot of using high-end chips in Thai data centers to train its models.
[...]
This week, The Times reported that an executive for Megaspeed, a Singapore-based data center company operating in Malaysia, was under investigation for steering advanced Nvidia A.I. chips to China, and could be a Chinese intelligence asset.
[...]
Growth has been so rapid that local communities are fed up.
Malarispary Gunasegara, who lives across the street from a construction site for the Chinese data center company ZDATA, said dust pollution was so bad she could no longer leave her windows open.
Visalini Kuppusamy, a teacher at a nearby preschool, said children could not play outside during heavy construction.
[...]
Worker safety issues have also emerged. On New Year’s Day 2024, a worker for a Chinese state-owned construction firm died at a DayOne site after falling 23 feet from a temporary structure, according to a report by the Johor Department of Occupational Safety and Health.
[...]
Malaysian officials have begun questioning the pace of growth, with the government recently imposing what some officials described as a de facto moratorium on new data centers. Under the policy, only facilities with their own off-grid power sources and independent water supplies for cooling will be approved — a difficult threshold to meet.
-
How Malaysia became the unlikely crossroads of the global AI boom
10 votes -
Comment on Donald Trump administration issues rule to restrict US sales of AI chips to China in ~society
skybrian LinkFrom the article: [...]From the article:
Chinese companies are generally barred from directly buying the most advanced chips made by Nvidia. But many companies were able to get around the restriction by renting computing power from data centers outside of China, often in Southeast Asia.
The new rule provides a striking window into the dramatic clash between President Donald Trump’s top economic advisers over the issue — a proxy fight that pits national security against the AI boom helping underpin the U.S. economy. The regulation is issued by the division of the Commerce Department that handles, among other things, the United States’ trade blacklist for people or organizations deemed to be a national security threat.
But it was written “by and at” the direction of the Treasury Department and the National Security Council — two wings of the administration that have been more hawkish on seeking to prevent Chinese companies from accessing Nvidia chips used to train powerful AI. The NSC is headed by Marco Rubio, who is also the secretary of state and who helped set in motion Jensen Huang’s downfall by briefing Trump on the then-Nvidia CEO’s affair.
The tensions between Commerce Secretary Howard Lutnick and Treasury Secretary Scott Bessent burst into the open on Friday when Bessent blamed the Commerce Department for failing to restrict chip purchases by Megaspeed, the company whose executive had an affair with Huang and who is suspected of being a Chinese spy.
[...]
The interim final rule issued Monday includes restrictions on the export of chips to countries deemed high-risk, including Indonesia, Malaysia, Singapore and Thailand. Overseas data centers that remotely supply “significant volumes of compute” to companies headquartered in countries subject to U.S. arms restrictions, like Iran and North Korea, will have to perform due diligence on their customers. Companies headquartered in the U.S., however, are largely exempt.
The measure is set to go into affect in 90 days.
-
Donald Trump administration issues rule to restrict US sales of AI chips to China
18 votes -
Comment on Beating the frontier on NetHack in ~comp
skybrian LinkIn other news, Antithesis finally launched a self-service option but at $3k a month, it's purely for people with expense accounts.In other news, Antithesis finally launched a self-service option but at $3k a month, it's purely for people with expense accounts.
-
Comment on Differentiation drives the erosion of positivity on social media in ~science
skybrian LinkSounds interesting. I wonder how we should take into account upvotes and likes? Because positive comments are often not that differentiated, we have standard UI's for expressing positive sentiment...Sounds interesting. I wonder how we should take into account upvotes and likes? Because positive comments are often not that differentiated, we have standard UI's for expressing positive sentiment and often don't post that sort of thing as a comment at all?
Maybe letting people upvote posts using emojis isn't such a bad thing?
-
Comment on The tech industry is investing in mega gas plants to power their data centers in ~enviro
skybrian Link ParentNormally data centers run on electricity from the grid and have backup generators in case they lose power, so load balancing doesn’t seem like a problem that’s infeasible to solve?Normally data centers run on electricity from the grid and have backup generators in case they lose power, so load balancing doesn’t seem like a problem that’s infeasible to solve?
-
Comment on The tech industry is investing in mega gas plants to power their data centers in ~enviro
skybrian Link ParentIt seems like running on solar power during the day would be a good start on reducing natural gas usage?It seems like running on solar power during the day would be a good start on reducing natural gas usage?
-
Comment on Beating the frontier on NetHack in ~comp
skybrian LinkFrom the article: [...] [...] [...] [...] [...] [...]From the article:
In the years that followed, NetHack continued to inspire and challenge us. The first Antithesis VCS repo (long since deleted) was called “fuzzhack” because it was a fuzzer for NetHack. Before we built our deterministic hypervisor, we tried Hermit-style deterministic Linux userland because it’s the bare minimum you need to beat NetHack. NetHack inspired our thinking about the importance of strategy, about the importance of code coverage and also about its inadequacy, and about why you need intrinsic curiosity rewards to have any hope of applying AI to this problem. NetHack inspired many of our early experiments in visualization. Wanting to interactively explore NetHack performance and coverage maps is why we wrote the first version of the reactive notebook that now powers our UI. Processing reams of NetHack data that wouldn’t fit in memory was why we decided to put a GCP subscription on my credit card so we could crunch the data in BigQuery, which later led us to invent skip trees, and finally Pangolin.
All of this is because it was a worthy adversary – perhaps even what my colleague David MacIver likes to call a “dragon problem.” NetHack is famously difficult for human beings because it combines permadeath, extreme information scarcity (reading the source code of the game to figure out how to beat it is practically a rite of passage for aficionados), and a brutal intolerance for error. But it’s also very difficult for autonomous systems like fuzzers and AI agents due to its sprawling state space and to the need for long-horizon planning to make any real progress. People have written bots that have successfully beaten the game, but despite Meta’s investment in the NetHack Learning Environment, AI agents have struggled with it. The wins that both the hardcoded bots and the AIs (most recently GPT-6 Astra) have eked out have been skin-of-their-teeth affairs involving lucky seeds and “beginner-friendly” roles. Nobody has produced a system that can reliably and quickly beat the game over and over again as any character build.
[...]
Antithesis can now find a path to victory within 5 wall-clock minutes on nearly 80% of NetHack seeds. Moreover, the median time to victory within the seeds that finish is under 2 minutes. To explain how we did this, we need to let you in on a secret: Antithesis is not just a system for unopinionated state space exploration, it is also something akin to a probabilistic programming language, a new computing paradigm for partially describing tests or other tasks and letting search and optimization fill in the rest. When you put this tool in the hands of capable AI agents, they can do things like beat NetHack in 30 seconds. But first… back to our story.
[...]
This is a common class of bug in video games. Let’s call them distribution bugs: in any timeline where you see the bug, it’s impossible to see that there is a bug, because the observed outcome could just come down to luck. The Gen 1 same-type bug is my favorite example of this, because it shows just how hard it is to notice distributional bugs – every simulator and every player’s model of the game was wrong for 16 years! – but there are many others. The Pokemon series also had the catch rate bugs, where claimed multipliers to success chances were never applied, and the Focus Energy bug, where a move intended to quadruple the likelihood of a critical hit instead divided it by 4. In the first Final Fantasy game for the NES, the routine to roll for a critical hit looked at the wielded weapon’s index number instead of its critical hit chance, and the Thief’s bonus to the success rate of fleeing from battle was never applied. More recently, a prerelease of Slay the Spire 2 was found to have such extreme RNG correlation that certain items intended to be obtainable as drops were impossible to get in normal play.
[...]
What does it take to find a distribution bug? Once you suspect you have a distribution bug, you can perform a statistical analysis of many simulated timelines – but you first have to suspect you have a distribution bug. For this reason, distribution bugs are often discovered by close analysis of code (as with the Body Slam paralysis chance bug) or mass computation of simulated timelines by other means (as with the Slay the Spire 2 RNG correlation) rather than observation. Finding a distribution bug isn’t hard once you suspect you have one, but to get to the point where you suspect you have one, you first have to stop believing that you were just unlucky.
[...]
After seeing this tweet, Will offhandedly mentioned that it might not be much effort for our research platform to support NetHack. I bit. Soon after it was up and running, Paul found the config overflow. Right after that, GPT-6 Astra beat NetHack.
Beating NetHack was still not exactly the company’s top priority. But we were so close! I decided to see what I could do.
The super-fast iteration loop is nice for humans. But it’s pretty much a necessity for effective LLM use. And since I’ve never played NetHack, and Paul was preoccupied with real work, we weren’t going to ascend without relying heavily on Claude. Custom strategies leverage domain knowledge, and I had none.
[...]
At the start of this post, we said Antithesis is something like a probabilistic programming language: a way to partially describe a task and let search and optimization fill in the rest. Here’s what we meant. Player’s plan for the early game fits in a sentence: sit on thrones and drink from fountains until you have all the wishes you need. It doesn’t say how to get the wishes. Nothing could – a sit on a throne only grants a wish one time in 39, and if it doesn’t, it can curse you, surround you with enemies, or vanish. But we can throw those other 38 timelines out. We tell the fuzzer how to sit on a throne, we tell it that a moment with one more wish beats the one before, and we tell it how to shake the dice. The fuzzer does the rest.
[...]
This partial specification paradigm has three advantages.
First, it lets you do less work. Any bot needs three kinds of knowledge. The first is how to act: how to turn “put seven candles on the Candelabrum” into keystrokes. These are the tactics. The second is a vision of the good: high health, great strength, alignment with your god, and a magic silver saber. This is the strategy. The third is foresight: knowledge of the paths from here to there, and of how to recover from a misstep. This is what search replaces. BotHack needed 16,000 lines of Clojure and Astra needed a trillion or so dollars of CapEx; our fuzzer ascended with a short config file, and I hear Antithesis has received a tiny bit less funding than OpenAI.
Second, it’s more robust to evolution of the system under test. If you move a block in Super Mario Bros., your scripted run might fail, but partial specification doesn’t care. If you change the CSS of your website, your scripted tests won’t know where to click, but Bombadil will. And if your partial specification can ascend a Valkyrie, it can probably ascend a Wizard.
And finally, it can find unknown unknowns. The usual way to gain confidence in a program is to understand it: to read the code really hard, reason through the logic, and try to consider each case. Few programs have been read harder than NetHack. Its players have been source-diving for decades, and there’s extensive documentation for nearly every mechanic. We read it too. Reading is how we found the 1-in-39 wish chance and the Grimtooth naming trick. But years of reading never turned up the del_light_source bug. The fuzzer found it by wandering into it. So did its eventual reporter.
Every piece of that bug was known. A quest artifact blasts a hero whose alignment is negative, even its rightful owner. A player’s polymorph is an opportunity for artifacts to blast. A polymorphed hero who runs out of hit points returns to normal form. A yellow light gives off light. What nobody had read about was the moment where all four combine: a Valkyrie at -70 alignment turning into a yellow light, blasted by her own Orb for all the light’s HP before her new body had started to glow. Once the reporter had stumbled into it, AI-assisted testing found related bugs in the same code. Reasoning, whether human or machine, is great at checking a bug’s vicinity. It’s much worse at telling you where to look.
-
Beating the frontier on NetHack
19 votes -
Comment on The tech industry is investing in mega gas plants to power their data centers in ~enviro
skybrian Link ParentThere are natural gas “peaker” plants. They’re relatively cheap to build so they make sense for occasional use. There isn’t enough data in the article to understand what kind of natural gas plants...There are natural gas “peaker” plants. They’re relatively cheap to build so they make sense for occasional use.
There isn’t enough data in the article to understand what kind of natural gas plants these are and how they compare to others.
-
Comment on The tech industry is investing in mega gas plants to power their data centers in ~enviro
skybrian LinkThis is carefully worded. "Carbon pollution," not pollution. In other respects, coal is a lot dirtier. Not necessarily full time though. Natural gas plants can serve as backup for alternative...Just two gas projects Amazon recently signed on to, which would power planned data centers in Texas and Pennsylvania, would produce more carbon pollution than the dirtiest facility in the country, the giant James H. Miller Jr. coal plant in Alabama that powers 1 million homes.
This is carefully worded. "Carbon pollution," not pollution. In other respects, coal is a lot dirtier.
Once billions of dollars are invested in a gas plant, Guidi said, it is likely to keep running for at least a generation or two, even if the customers it was built to serve ultimately move on to other technologies. “There is a very strong incentive to keep using it,” he said
Not necessarily full time though. Natural gas plants can serve as backup for alternative energy. A carbon tax, which could just be on data centers if it's easier to pass, would change the incentives, encouraging them to use solar or wind when possible (because it's cheaper) and keep the natural gas plants on standby most of the time.
-
Comment on “…and the proof is checked in Lean” in ~science
skybrian (edited )Link ParentOnce a person or organization reaches a certain level of fame, publicity works differently. Like some celebrities, OpenAI will make the news for much of what they do whether they like it or not....Once a person or organization reaches a certain level of fame, publicity works differently. Like some celebrities, OpenAI will make the news for much of what they do whether they like it or not. Things that wouldn’t be newsworthy if some other company did them will be newsworthy because it’s OpenAI. Often that publicity will be negative for OpenAI because people are suspicious of them. They usually can decide whether to make something public (unless it leaks), but they don’t get to control what publicity they get. This is up to all the people outside OpenAI who obsessively follow what they do and write about them.
So no, getting talked about isn’t much of achievement for them, because keeping a low profile is no longer an option. A blog post and a github repo is pretty much the bare minimum to be considered published at all.
The way they did this release shows that they don’t really care about the mathematics community. They dumped work in progress, whatever they had. It’s rude to show that they could publish in top journals in mathematics and win the top prizes of mathematics, but they cannot be bothered to do it right.
So this is like someone rich going to a poor community and doing a money drop, because they can. Rude, tacky, but not unethical. It’s technically a donation. OpenAI apparently used unsolved mathematics problems to test their AI, and they posted the results because, though they don’t really care about the math, other people do. it’s better than not publishing at all, but only marginally so. So, high-status mathematicians have to dig through what they threw over the wall, because this data dump, though done badly, is just too valuable from a mathematical point of view.
The people who say everything OpenAI does is marketing haven’t really come to grips with the inequality of media attention and the consequences of that. Attention that other company’s marketing departments would do just about anything for comes to them for free, and we are a small part of the process that makes that happen.
I suppose it’s true that everything OpenAI publishes is marketing, but often involuntarily. It would be publicity whether they wanted it or not.
-
Comment on “…and the proof is checked in Lean” in ~science
skybrian Link ParentPeople misunderstanding what OpenAI did is inevitable because people who dislike them feel free to make up whatever shit they like about them. Your bizarre analogy is an example.People misunderstanding what OpenAI did is inevitable because people who dislike them feel free to make up whatever shit they like about them. Your bizarre analogy is an example.
-
Comment on AI helps unlock discoveries hidden in Kurt Gödel's notebooks in ~science
skybrian LinkFrom the article: [...] [...] [...] [...]From the article:
Since 2017, the Finnish logician Jan von Plato has led a project at Helsinki University to understand the contents of 16 notebooks that Gödel wrote in the early 1940s. This material – the “workbooks” – is 1,009 pages of densely written text about maths and logic. Much of it is written in a German shorthand, Gabelsberger, that was obsolete even when Gödel was using it.
Progress in the mathematical understanding of the text was painfully slow – about a page a week – until September, when von Plato enlisted the help of the AI model Claude. Within a couple of days, Claude had provided a comprehensive digest of the entire material, revealing Gödel had proved hundreds of theorems that no one knew about.
[...]
In August, at a conference in France about AI and theorem proving, von Plato met computer scientists who suggested that he co-opt the help of Claude in trying to make sense of the workbooks. On his return to Helsinki he began the process, showing Claude his transcriptions of the workbooks, as well as six books he had previously written on Gödel and other secondary scientific literature.
“In a couple of days, I got to see a 650-page explanation of the workbooks. It had to be controlled page for page, but it’s basically a work that is impossible to do for human beings,” he said. “Humans read one page at a time and we tend to forget things. It takes us a year to read about 50 pages. We just are not able to keep in mind all the different parts.
“The AI can connect all the pieces in a thousand pages. It can see all of Gödel’s writings as one piece.”
[...]
Gödel reacted to Cohen’s Fields medal by saying that he had already proved the result in the 1940s. Yet when pushed for a proof by his peers, Gödel was unable to reconstruct one from his notes.
The first task von Plato set Claude was to discover if Gödel’s workbooks had a proof of the independence of the axiom of choice, which would reveal that Gödel had been telling the truth in 1966. The answer came back: yes, almost. “He was just one step away,” said von Plato. “There’s one definition that Gödel got wrong, but he had the right definition two years earlier, and so the thought is that he would have arrived at the right definition anyway if he had just continued for a few months. For me, the architecture of his proof is just wonderful. It makes all of these results of set theory follow a uniform pattern.
[...]
Von Plato said that when Claude presented him with the reconstructed proof of the independence of the axiom of choice, he ran it through the proof assistant Coq, a program that verifies the validity of mathematical proofs, and it passed. Von Plato believes that had Gödel published his work on the axiom of choice, he would have won the 1940 Fields medal. “Maybe he felt that when Cohen got the medal, that that was something he sort of missed.”
In further discussions with Claude, von Plato asked the AI model to extract all theorems in the workbooks for which Gödel either had a proof, had sketched a proof or had an idea for a proof. Claude found 663. When these results were put into Coq: “About 400 were verified as stated, about 200 were repaired, meaning that perhaps the statement of the theorem had to be made more precise, or some assumption had to be added. About 50 were false, and this is no wonder. Gödel himself, when rereading his notes, would occasionally add a marginal remark: falsch! [incorrect] or schlecht! [bad].”
[...]
Hamkins said: “The fact that there are things in there that resemble [Cohen’s proof] does not mean he had it. It shows he was on the path. You don’t get credit for work you don’t tell anyone about. But Gödel had so many ground-breaking ideas that it is maybe not surprising that his notebooks are full of exciting things.”
I'm not going to watch this, but I'm somewhat curious: what connection is there supposed to be between AI safety reports and Anthropic's stock price during the IPO? It doesn't seem like something investors would care about?
(YouTube has an "ask Gemini" feature, but it didn't find anything in the video.)
It's true, though, that there are connections between the people involved. AI safety was a small world a few years ago, before LLMs became big. Having those connections is sign of being in the field long enough.