Just got an Nvidia 4090 GPU, looking for local LLM + general generative AI software recommendations

LGUG2Z
Tue, 19 Sep 2023 16:52:42 +0000

I was fortunate enough to grab a discounted 4090 while on my travels and just got everything installed. Already having a lot of fun pumping all my games to max settings, but I'm also interested in running generative AI stuff locally to really take advantage of all that VRAM.

Do you have any newbie-friendly Windows 11 software to recommend for getting started? Thanks!

Comments URL: https://tildes.net/~comp/1akc/just_got_an_nvidia_4090_gpu_looking_for_local_llm_general_generative_ai_software_recommendations

Votes: 20

Comments: 23