• Activity
  • Votes
  • Comments
  • New
  • All activity
    • Showing only topics in ~tech with the tag "language models". Back to normal view / Search all groups

    2. Experiences using a local voice assistant with LLM with HomeAssistant?

      Ask (advice)
      Has anyone out there hooked HomeAssistant up to a local LLM? I'm very tempted: Alexa integrations fail often. HomeAssistant integrations tend to be rock solid. Alexa is rule/pattern matching...

      Has anyone out there hooked HomeAssistant up to a local LLM? I'm very tempted:

      • Alexa integrations fail often. HomeAssistant integrations tend to be rock solid.
      • Alexa is rule/pattern matching based. LLMs can understand natural language fairly well. The "magical incantations" required by Alexa are awkward.

      Other than the software, the device side seems challenging. There are $50 fully-baked POP devices. I'm less sure on the DIY front.

      Also, I desperately want my house to speak to me in the voice of the NCC-1701D computer. I've read enough now to know this should be achievable with a modicum of effort via OSS voice cloning tools or training a new model (same difference except "voice cloning" seems to often refer to doing this without training a whole new model?).

      Thoughts? Experiences?

      I've seen several pages that have led me to conclude this is tenable:

      https://github.com/myshell-ai/OpenVoice

      https://github.com/domesticatedviking/TextyMcSpeechy

      https://github.com/mezbaul-h/june

      https://www.home-assistant.io/voice_control/voice_remote_local_assistant/

      https://heywillow.io/hardware/#esp32-s3-box-lite

      14 votes

    22. If you use ChatGPT or other LLM, how do you use it?

      Ask (survey)
      I am interested in how people are using ChatGPT, especially in a professional context. Any tips, tricks or pointers? I would appreciate if the discussion didn't revolve around the technology's...

      I am interested in how people are using ChatGPT, especially in a professional context. Any tips, tricks or pointers?

      I would appreciate if the discussion didn't revolve around the technology's negative aspects or future perspectives.

      43 votes

    43. Let's talk Local LLMs - So many questions

      Ask
      Hello there (oh god, I am opening my first thread here - so exciting) I'd love to ask the people here about local LLMs. To be honest, I got interested in this topic, but am leaving reddit, where a...

      Hello there
      (oh god, I am opening my first thread here - so exciting)

      I'd love to ask the people here about local LLMs.
      To be honest, I got interested in this topic, but am leaving reddit, where a sub r/locallama exists.
      I don't want to interact with that site anymore, so I am taking this here.

      My questions, to start us off:

      • Models are available on huggingface (among other places), but where do I get the underlying software? I read "oogabooga" somewhere, but honestly, I am lost.
      • If I only want to USE a local model, what are the requirements, and how do I judge if I can use something from the values of "4bit / 8 bit" and "30B, 7B"??
      • If I get crazy and want to TRAIN a LorA ... what then?
      • Good resources / wiki pages, tutorials, etc?
      21 votes