• Activity
  • Votes
  • Comments
  • New
  • All activity
    • Showing only topics in ~tech with the tag "language models.large". Back to normal view / Search all groups

    2. How are AI and LLMs used in your company (if at all)?

      Ask (survey)
      I'm working on an AI chat portal for teams, think Perplexity but trained on a company's knowledgebase (prosgpt dot com for the curious) and i wanted to talk to some people who are successfully...

      I'm working on an AI chat portal for teams, think Perplexity but trained on a company's knowledgebase (prosgpt dot com for the curious) and i wanted to talk to some people who are successfully using LLMs in their teams or jobs to improve productivity

      Are you using free or paid LLMs? Which ones?

      What kind of tasks do you get an LLM to do for you?

      What is the workflow for accomplishing those tasks?

      Cheers,
      nmn

      12 votes

    5. Experiences using a local voice assistant with LLM with HomeAssistant?

      Ask (advice)
      Has anyone out there hooked HomeAssistant up to a local LLM? I'm very tempted: Alexa integrations fail often. HomeAssistant integrations tend to be rock solid. Alexa is rule/pattern matching...

      Has anyone out there hooked HomeAssistant up to a local LLM? I'm very tempted:

      • Alexa integrations fail often. HomeAssistant integrations tend to be rock solid.
      • Alexa is rule/pattern matching based. LLMs can understand natural language fairly well. The "magical incantations" required by Alexa are awkward.

      Other than the software, the device side seems challenging. There are $50 fully-baked POP devices. I'm less sure on the DIY front.

      Also, I desperately want my house to speak to me in the voice of the NCC-1701D computer. I've read enough now to know this should be achievable with a modicum of effort via OSS voice cloning tools or training a new model (same difference except "voice cloning" seems to often refer to doing this without training a whole new model?).

      Thoughts? Experiences?

      I've seen several pages that have led me to conclude this is tenable:

      https://github.com/myshell-ai/OpenVoice

      https://github.com/domesticatedviking/TextyMcSpeechy

      https://github.com/mezbaul-h/june

      https://www.home-assistant.io/voice_control/voice_remote_local_assistant/

      https://heywillow.io/hardware/#esp32-s3-box-lite

      14 votes

    27. If you use ChatGPT or other LLM, how do you use it?

      Ask (survey)
      I am interested in how people are using ChatGPT, especially in a professional context. Any tips, tricks or pointers? I would appreciate if the discussion didn't revolve around the technology's...

      I am interested in how people are using ChatGPT, especially in a professional context. Any tips, tricks or pointers?

      I would appreciate if the discussion didn't revolve around the technology's negative aspects or future perspectives.

      43 votes

    47. Let's talk Local LLMs - So many questions

      Ask
      Hello there (oh god, I am opening my first thread here - so exciting) I'd love to ask the people here about local LLMs. To be honest, I got interested in this topic, but am leaving reddit, where a...

      Hello there
      (oh god, I am opening my first thread here - so exciting)

      I'd love to ask the people here about local LLMs.
      To be honest, I got interested in this topic, but am leaving reddit, where a sub r/locallama exists.
      I don't want to interact with that site anymore, so I am taking this here.

      My questions, to start us off:

      • Models are available on huggingface (among other places), but where do I get the underlying software? I read "oogabooga" somewhere, but honestly, I am lost.
      • If I only want to USE a local model, what are the requirements, and how do I judge if I can use something from the values of "4bit / 8 bit" and "30B, 7B"??
      • If I get crazy and want to TRAIN a LorA ... what then?
      • Good resources / wiki pages, tutorials, etc?
      21 votes