Every company is trying to shoehorn AI into every product, and many online materials provide a general snake oil vibe, making it increasingly difficult to parse. So far, my primary sources have been GitHub, Medium, and some YouTube.

My goal is to better understand the underlying technology so that I can manipulate it better, train models, and use it most effectively. This goes beyond just experimenting with prompts and trying to overcome guardrails. It includes running local, like Ollama on my M1 Max, which I'm not opposed to.

I'm working on an AI chat portal for teams, think Perplexity but trained on a company's knowledgebase (prosgpt dot com for the curious) and i wanted to talk to some people who are successfully using LLMs in their teams or jobs to improve productivity

Are you using free or paid LLMs? Which ones?

What kind of tasks do you get an LLM to do for you?

What is the workflow for accomplishing those tasks?

Cheers,
nmn

Has anyone out there hooked HomeAssistant up to a local LLM? I'm very tempted:

• Alexa integrations fail often. HomeAssistant integrations tend to be rock solid.
• Alexa is rule/pattern matching based. LLMs can understand natural language fairly well. The "magical incantations" required by Alexa are awkward.

Other than the software, the device side seems challenging. There are $50 fully-baked POP devices. I'm less sure on the DIY front.

Also, I desperately want my house to speak to me in the voice of the NCC-1701D computer. I've read enough now to know this should be achievable with a modicum of effort via OSS voice cloning tools or training a new model (same difference except "voice cloning" seems to often refer to doing this without training a whole new model?).

Thoughts? Experiences?

I've seen several pages that have led me to conclude this is tenable:

https://github.com/myshell-ai/OpenVoice

https://github.com/domesticatedviking/TextyMcSpeechy

https://github.com/mezbaul-h/june

https://www.home-assistant.io/voice_control/voice_remote_local_assistant/

https://heywillow.io/hardware/#esp32-s3-box-lite

I am interested in how people are using ChatGPT, especially in a professional context. Any tips, tricks or pointers?

I would appreciate if the discussion didn't revolve around the technology's negative aspects or future perspectives.