7 votes

Inflection AI develops supercomputer equipped with 22,000 NVIDIA H100 AI GPUs

2 comments

  1. BitsMcBytes
    Link
    Interesting tweet on this: https://twitter.com/rowancheung/status/1676688399623757824

    Interesting tweet on this:
    https://twitter.com/rowancheung/status/1676688399623757824

    Inflection AI just created a $880,000,000 AI supercomputer.

    The supercomputer is equipped with 22,000 NVIDIA H100 AI GPUs (currently worth ~$40,000 each).

    Details:
    -Inflection AI has raised $1.5 billion ($4 billion valuation) and anticipates that its new supercomputer will significantly enhance the capabilities of its Inflection-1 model

    -The supercomputer will contain 700 four-node racks of Intel Xeon CPUs

    -Despite the high demand and scarcity of H100 GPUs, Inflection AI was able to acquire 22,000 units

    -NVIDIA, a potential investor in Inflection AI, possibly facilitated the company's access to such a large number of GPUs

    -Inflection AI recently raised $1.3B a week ago

    Inflection anticipates that through this supercomputer, the AI model "Inflection 1" is expected to improve significantly, especially in coding.

    1 vote
  2. delphi
    Link
    I’ve been playing around with Pi, the chatbot/personal journal/bonsai buddy that uses Inflection-1. It’s a bit repetitive at times but does seem very capable in terms of recalling and...

    I’ve been playing around with Pi, the chatbot/personal journal/bonsai buddy that uses Inflection-1. It’s a bit repetitive at times but does seem very capable in terms of recalling and understanding information you tell it. Inflection pitches it as a “personal AI” that you can use as a tool for bouncing ideas off of, a friend to talk to, a journal that can talk back, that sorta thing. It’s still very basic and only has chat capabilities, no internet access, no “knowledge book” you can look at, but I feel it’s very measured and friendly. It’s no GPT-4, but I can see something like… I dunno, Jibo powered by this to be kinda cute and fun.