skybrian's recent activity
-
Comment on OpenAI agents attacked RubyGems back in May in ~comp
-
Comment on Where do we go from here? (Regarding AI) in ~tech
skybrian Link ParentThere are also many tasks that some humans can do but others can't. If we're talking about work, physical capabilities are sometimes relevant. I'm not sure what the definition of "intelligence"...There are also many tasks that some humans can do but others can't. If we're talking about work, physical capabilities are sometimes relevant.
I'm not sure what the definition of "intelligence" has to do with it? Intelligence isn't everything.
-
Comment on OpenAI agents attacked RubyGems back in May in ~comp
skybrian Link ParentThey are doing a lot more monitoring now. Apparently they underestimated the problem.They are doing a lot more monitoring now. Apparently they underestimated the problem.
-
Comment on Anthropic's Dario Amodei calls for AI oversight, joined by Sam Altman and Elon Musk in ~tech
skybrian Link Parent“Pacing” isn’t a development freeze. They propose slowing down a bit compared to how fast they could move, not stopping.“Pacing” isn’t a development freeze. They propose slowing down a bit compared to how fast they could move, not stopping.
-
Comment on Nvidia is the central bank of AI in ~finance
skybrian Link ParentNVIDIA inventory apparently turns over at about 3x a year, which is lower than before but it doesn’t seem that bad?NVIDIA inventory apparently turns over at about 3x a year, which is lower than before but it doesn’t seem that bad?
-
Comment on Where do we go from here? (Regarding AI) in ~tech
skybrian Link ParentOn the Internet, maybe, but an LLM is not a robot, and robots have a long way to go.On the Internet, maybe, but an LLM is not a robot, and robots have a long way to go.
-
Comment on Anthropic's Dario Amodei calls for AI oversight, joined by Sam Altman and Elon Musk in ~tech
skybrian Link ParentIt seems like they can't slow down too much or it will let their competitors catch up. So it doesn't sound much like a moat? If it ever got to the point where they're all about equally...It seems like they can't slow down too much or it will let their competitors catch up. So it doesn't sound much like a moat?
If it ever got to the point where they're all about equally intelligent, however that is measured, they could still compete on latency or price or something else that their customers want.
-
Comment on Nvidia is the central bank of AI in ~finance
skybrian Linkhttps://archive.ph/kt50V From the article: [...] [...] [...]From the article:
It is not just chipmaking that has spurred Nvidia’s stunning growth, however. Its boss, Jensen Huang, has also resorted to financial engineering to boost demand for its wares. In mid-August, for example, Nvidia agreed to provide a backstop worth up to $105bn for a vast data centre in Ohio that will use lots of its chips. A week earlier it had revealed plans to mobilise more than $500bn of investment in AI infrastructure with the help of six big Wall Street firms, by guaranteeing the value of the equipment it sells to such projects. It may underwrite as much as a quarter of the cost of some investments. In July Nvidia helped some customers finance big data centres in another way, by promising to top up their income if it misses set targets.
Companies often lend to their customers: think of the financing arms of carmakers, for example. Mr Huang argues that Nvidia is simply helping to unlock investment for perfectly viable projects that might otherwise struggle to borrow enough at the right price. But to critics, these deals carry more than a whiff of the dotcom boom of the late 1990s, when telecom-equipment-makers such as Cisco and Lucent lent billions of dollars to telecoms providers that bought their gear. When demand for the telecom firms’ services fell short, some of them collapsed, landing Cisco and Lucent with big losses.
As Jay Goldberg of Seaport Research Partners, a firm of analysts, puts it, Nvidia is walking a fine line between “enabling demand” and “creating it”. He does not yet think Nvidia has crossed that line, although it is “getting pretty close”. Others are more sceptical still, including Michael Burry, an investor who made a fortune betting against the mortgage-backed securities that precipitated the financial crisis of 2007-09. He and others are asking what might happen if demand for AI chips grows more slowly than expected, supply increases and prices fall, which would not only reduce Nvidia’s own profits but potentially also generate losses on its lavish support for its customers.
[...]
The question is pertinent because Nvidia’s financial commitments are huge and growing fast. Over the past three years it has pledged over $70bn in investment in startups and offered $300bn in financial support to its customers. Some have taken to calling Nvidia the “central bank of AI”, because it plays so pivotal a role in financing the industry. That will indeed, as Mr Huang argues, help the industry grow—but it also carries risks.
Nvidia’s financial engineering is partly a response to its biggest customers’ transformation into rivals. “Hyperscalers”, tech giants such as Amazon, Google, Meta and Microsoft, account for roughly half of Nvidia’s revenue. This year they are projected to invest around $800bn, largely on AI infrastructure. But most of them have begun designing their own chips, which puts their future purchases from Nvidia in doubt.
For the hyperscalers, these custom chips are much cheaper, costing between a fifth and a third as much as Nvidia’s. They can also perform some tasks better, because the hyperscalers can tailor them to their own software. Worse, from Nvidia’s point of view, a few of the tech giants are not simply developing chips for their own use, but also marketing them to others. Google, for example, has sold some specialised processors to Anthropic, a big, free-standing AI lab. Amazon also expects its custom-chip business to become a sizeable source of revenue. Bloomberg Intelligence, a data provider, predicts that custom chips will gradually eat into Nvidia’s sales, accounting for about 50% of the market for processors used in AI by the end of the decade, up from roughly 40% this year.
[...]
Underpinning this web of obligations are two fundamental assumptions: that Nvidia’s chips will retain their value and that demand for compute will continue to grow at a rapid pace. Neither is assured.
[...]
Nvidia will almost certainly not end up paying anything close to the full amount of its guarantees. Its commitments are spread over many years so could not come due all at once. Its proposed backstop for OpenAI’s data centre, for example, runs for 20 years, starting in 2028. If OpenAI stopped paying the lease, Nvidia could find another tenant, vastly diminishing its exposure.
What is more, Nvidia’s own finances are strong enough to weather these liabilities. Morgan Stanley, an investment bank, reckons Nvidia’s “all-in” debt will rise from $53bn early next year to $200bn by the beginning of 2029 as guarantees come into effect. But that is offset by a stash of cash and liquid securities currently worth $99bn, and a business that will generate about $200bn in cash this year. Only a cataclysmic downturn that caused all Nvidia’s guarantees to come due and its profits to evaporate almost entirely would imperil the company—as things stand.
The picture may change, however, if Nvidia’s commitments keep growing. Andy Li of CreditSights, a financial-research firm, worries that it will keep “pushing the pedal” until “something breaks”. SemiAnalysis estimates that Nvidia takes on roughly $5.9bn of guarantees for every 100 megawatts of data-centre capacity covered by its neocloud backstop programme. If it adds more such guarantees, SemiAnalysis reckons its exposure could reach $175bn by the end of 2028 from this initiative alone.
-
Nvidia is the central bank of AI
11 votes -
Comment on OpenAI agents attacked RubyGems back in May in ~comp
skybrian Link ParentI find it very easy to believe that even talented software engineers working quickly could make mistakes. Usually, nothing happens, or it causes an outage, not something like this incident,...I find it very easy to believe that even talented software engineers working quickly could make mistakes. Usually, nothing happens, or it causes an outage, not something like this incident, though.
What do you think you know about OpenAI that makes that unlikely?
-
Comment on Anthropic's Dario Amodei calls for AI oversight, joined by Sam Altman and Elon Musk in ~tech
skybrian LinkFrom the article: [...] [...] [...] Amodei's essay is here.From the article:
The call was first made in an essay Anthropic chief executive Dario Amodei posted online Saturday. The idea has gained ground in recent weeks as AI companies have struggled in some cases to keep their creations under control, even as they usher in an age in which AI systems themselves can build the more powerful next generation of the technology.
[...]
A three-step plan proposed by Amodei in his essay would involve third-party safety evaluators at “frontier” AI companies, establishing common safety standards in democratic nations, and for the United States and other democracies to work with authoritarian governments to try to ensure compliance.
[...]
While Amodei sketched a path to slowing progress in the name of safety, he did not commit Anthropic to cutting the pace of its own work unilaterally. He said only that for now the company would hire a team of independent evaluators who would be embedded at Anthropic’s offices and empowered to raise safety concerns.
Amodei also provided few specifics on what a slowdown might involve in practice, describing the potential to use agreed-upon safety metrics or limits on the computer power used to train new AI systems.
[...]
In a post on X, Musk wrote: “Dario is right.”
Altman said he shared Amodei’s view that groundbreaking AI companies should “pace the frontier” and said the matter had been a top discussion topic at OpenAI in recent weeks.
“Committing to having independent evaluators with employee-like access is a great idea, and we will do the same,” Altman wrote on X.
Amodei's essay is here.
-
Anthropic's Dario Amodei calls for AI oversight, joined by Sam Altman and Elon Musk
19 votes -
Comment on Where do we go from here? (Regarding AI) in ~tech
skybrian Link ParentYeah, there were some really bad religions. I don't think anyone is going to defend the Hawaiian kapu system either? For the major world religions, it's more of a mixed bag, because they were...Yeah, there were some really bad religions. I don't think anyone is going to defend the Hawaiian kapu system either?
For the major world religions, it's more of a mixed bag, because they were involved in so many different things.
-
Comment on OpenAI agents attacked RubyGems back in May in ~comp
skybrian Link ParentAll reports so far indicate that it wasn't intentionally malicious and they didn't instruct their agents to do any such thing. I don't know why you threw that in there other than to muddy the waters.All reports so far indicate that it wasn't intentionally malicious and they didn't instruct their agents to do any such thing. I don't know why you threw that in there other than to muddy the waters.
-
Comment on OpenAI agents attacked RubyGems back in May in ~comp
skybrian LinkFrom the article: [...]From the article:
OpenAI agents carried out an undisclosed attack on RubyGems is a new bombshell report from Spencer Kitts, Thomas Larsen, and Sydney Von Arx—three of the four authors of the report on the agent attack on disused wikis (previously) last week.
This time they’re noting that it looks very likely that an OpenAI agent swarm was behind an attack against the RubyGems package repository first reported on May 12th by Maciej Mensfeld of the RubyGems security team[.]
[...]
Many of the packages were exploiting the RubyDoc.info documentation build process to exfiltrate (public) data from UK government websites, presumably as part of an information gathering task similar to the research tasks processed by the wiki-exploiting agents. [...]
-
OpenAI agents attacked RubyGems back in May
21 votes -
Comment on Where do we go from here? (Regarding AI) in ~tech
skybrian Link ParentThe Spanish Empire was often horrific, but apparently the Aztecs were more extreme, according to this book review: Content warning: death, torture, etc.The Spanish Empire was often horrific, but apparently the Aztecs were more extreme, according to this book review:
If anything, the Spaniards lacked the conceptual framework to fully comprehend the industrial-scale, ever-so-civilized and bureaucratic evil of the Mexica, and so they inadvertently downplayed it. The reality, as Clendinnen brilliantly documents, is that human sacrifice was not an occasional or incidental religious custom for the Mexica, like an extra-spicy church service for the people who only show up on Christmas or Easter. No, the mass-butchery of wailing, pleading captives of both sexes and all ages was the core activity around which their entire civilization and society revolved. Their art, their music, their poetry, their approach to warfare, their entire economic system, their kaleidoscopic array of holidays and festivals, all were singularly dedicated to the killing (often preceded by inventive torture) of helpless human beings. And everybody had their role to play [...]
Content warning: death, torture, etc.
-
Comment on Cod fishing is back in Newfoundland in ~enviro
skybrian LinkFrom the article: [...] [...] [...] [...] [...] [...] [...]From the article:
In June, Fisheries and Oceans Canada upgraded the cod stock’s status from “critical” to “healthy” and simultaneously increased the commercial quota for cod by 55 percent, to 59,000 tonnes a year.
Newfoundlanders say the move has left them hopeful, but also trepidatious after the devastating experience of a 32-year moratorium.
[...]
In 1992, Ottawa announced a wholesale moratorium on Northern cod following decades of overfishing.
The move led to around 30,000 job losses almost overnight — the largest layoff in Canadian history.
[...]
Entire communities were abandoned, and Newfoundland came to serve as a global warning of the consequences of fishery mismanagement.
[...]
Ultimately, it took until 2024 for Fisheries and Oceans Canada to end the moratorium. The department’s June announcement now bumps its quota up even further.
But the quota still reflects the government’s caution.
Harvesters are currently taking out about five to seven per cent of the annual stock, says Tyler Eddy, a research scientist at Memorial University’s Marine Institute in St. John’s.
This is actually well below the globally-recognized standard for sustainable fishing, of about 20 per cent, he says. This year’s total allowable catch of 59,000 tonnes also pales in comparison to the 266,000 limit in 1988.
[...]
He is not alone. After the cod moratorium was imposed, snow crab became a mainstay of the industry. In 2025, snow crab sales in the province were $708 million, versus just $62 million for Northern cod.
But as Newfoundland’s waters warm due to climate change, researchers believe the prized snow crab will migrate north, making cod’s comeback well-timed.
[...]
While cod is less lucrative than snow crab, it is much more predictable to fish when the stock is healthy, says Street, president of the FFAW union.
[...]
The rebound has also coincided with growing global demand for cod and declining stocks in countries like Norway and Iceland. This has helped drive up Northern cod prices, says Street.
[...]
The Icewater plant, in Arnold’s Cove, was the only fish plant in North America to stay focused on cod after the moratorium, says Wareham. But even it changed its operations to process frozen cod from Norway and Iceland. Now, it is able to prioritize local catch again.
“We’ve waited 32 years for this to happen,” said Wareham, a seventh-generation fishery worker whose son will be the eighth.
With nearly 300 employees, his plant is by far the largest employer in the region.
-
Cod fishing is back in Newfoundland
5 votes -
Comment on Where do we go from here? (Regarding AI) in ~tech
skybrian Link ParentThat might work sometimes in small, exclusive, high-trust communities, but the larger the community, the less likely it is that you can solve things by only having people in the community that you...That might work sometimes in small, exclusive, high-trust communities, but the larger the community, the less likely it is that you can solve things by only having people in the community that you can trust.
The Internet connects you with the world. Changing human nature worldwide seems practically impossible, so I think the Internet is always going to be a dangerous place. Websites need protection against cyberattacks. The larger the social network, the more its own users are part of the problem.
But there are probably ways to try to reduce the number of bad actors out there somewhat, and that seems like a good thing? As an example of one subproblem of that that would still be extremely ambitious to try to make a dent in: how do you change the culture of Nigerian scammers?
That's oversimplifying the situation. LLM capabilities are improving. It's possible that they thought AI would eventually be a threat, while also underestimating its current capabilities.