iotempower icon indicating copy to clipboard operation
iotempower copied to clipboard

IoT assistant w/ LMs [NodeRED]

Open mbz4 opened this issue 9 months ago • 1 comments

IDEA: use NodeRED w/ ollama... and build an IoT assistant

minimally require 3 components in the flow:

something to handle speech to text (STT), another thing for text to speech (TTS) and a language model (LM) inference on the local gateway; a few possible packages listed here:

  • Ollama node: https://flows.nodered.org/node/node-red-contrib-ollama

  • STT node: https://www.npmjs.com/package/node-red-contrib-streaming-stt

  • TTS node: https://flows.nodered.org/node/node-red-contrib-tts-ultimate

  • OpenAI node: https://github.com/rozek/node-red-flow-openai-api

  • OpenAI node: https://flows.nodered.org/node/@technithusiast/node-red-contrib-ai-intent

  • chatGPT node: https://flows.nodered.org/node/node-red-contrib-custom-chatgpt

    • https://www.youtube.com/watch?v=97NyAxG8uY8

Need also:

  • Mic input node
  • speaker output node
  • optional sensors, actuators for custom context feeds

mbz4 avatar May 25 '24 22:05 mbz4