17 votes

xAI has open sourced Grok 2.5

6 comments

  1. cuteFox
    Link

    The @xAI Grok 2.5 model, which was our best model last year, is now open source.

    Grok 3 will be made open source in about 6 months.

    huggingface.co/xai-org/grok-2

    9 votes
  2. [5]
    zenen
    Link
    What kinds of specs are required to run a model like this?

    What kinds of specs are required to run a model like this?

    7 votes
    1. [4]
      DistractionRectangle
      (edited )
      Link Parent
      So $$$$ even after people work on quantizing it. Edit: oops, forgot to cite my source. Quote yanked from the hugging face release: https://huggingface.co/xai-org/grok-2

      This checkpoint is TP=8, so you will need 8 GPUs (each with > 40GB of memory).

      So $$$$ even after people work on quantizing it.

      Edit: oops, forgot to cite my source. Quote yanked from the hugging face release:

      https://huggingface.co/xai-org/grok-2

      15 votes
      1. [3]
        zenen
        Link Parent
        Yea, "open-source" really doesn't mean much to me when the hardware resources are prohibitively expensive. I think it's cool that I can run gemma3 on my laptop but I'm happy to keep my LLM use...

        Yea, "open-source" really doesn't mean much to me when the hardware resources are prohibitively expensive. I think it's cool that I can run gemma3 on my laptop but I'm happy to keep my LLM use localised to my own PC.

        11 votes
        1. [2]
          tauon
          Link Parent
          To me, talking about open-source (rather than, say, open-weights for example) also feels disingenuous because while it’s there now, it’s not exactly reproducible. But since sooo much more goes...

          To me, talking about open-source (rather than, say, open-weights for example) also feels disingenuous because while it’s there now, it’s not exactly reproducible.

          But since sooo much more goes into that, it’d be much harder for anyone to publish. Probably impossible if they want to avoid getting sued into oblivion for publishing exactly which data went into the model’s training, too.

          This doesn’t mean I think open-source means “free” or reproducible either, just saying… it’d be nice to have a not-big-player entity be able to come up with a good model on their own, and not just rely on competitors leaking/publishing training strategies sometimes here and there.

          8 votes
          1. Crestwave
            Link Parent
            Agreed. This feels like a SaaS provider releasing their server as an executable and calling it open source. An executable would arguably be much more useful for reverse engineering, even. Not to...

            Agreed. This feels like a SaaS provider releasing their server as an executable and calling it open source. An executable would arguably be much more useful for reverse engineering, even.

            Not to mention that the license seems pretty restrictive as well, including stipulations like:

            You may not use the Materials, derivatives, or outputs (including generated data) to train, create, or improve any foundational, large language, or general-purpose AI models, except for modifications or fine-tuning of Grok 2 permitted under and in accordance with the terms of this Agreement.

            12 votes