Anyone using a DGX Spark?
The prices have increased, and even before people called it too expensive.
I am just wondering - do you have one? What do you use it for? I've been thinking of getting one (as a business expense, I guess the price is high, but then again - what other option do you have for compute? renting GPUs is quite expensive, any comparable amount of VRAM is very expensive - ok if you have space and mostly want to do inference, I guess you have better options (3090 or 5090)
For me, I have just been considering having some more compute available for robotics, finetuning, trying out selfhosted and fine tuned LLMs, among other things. My other setup (M1Pro 32GB and a 1070 Mini) could work for some stuff, but especially for the robotics part it's mostly about NVIDIA...
Curious about any experiences.
It seems like the CUDA monopoly is slowly breaking, but it will still have the best software support for the moment.
If you're pricing it out versus hosted options like OpenRouter, make sure to factor in electricity costs as well. I've not run the numbers myself, but it will likely take at least 5–10 years to pay for itself at current rates. For that reason, it's probably only worth it if you value privacy and independence from cloud providers.
That said, open weight models are excellent, and continue to get better. Everybody is very excited for Qwen 3.8 right now, but there's always something new on the horizon. New models come in all different sizes and quants. Kimi K3 was a whopping 2.8T parameters.
The /r/LocalLLaMA community has a lot of resources on local hosting, and though it's less serious than it used to be, a lot of people there have put down real money on testing different hardware setups. I'm sure you can find more information there.