Real-time speech-to-speech translation

DaveJarvis
2024-10-25T06:30:07Z

Has anyone used a free, offline, open-source, real-time speech-to-speech translation app on under-powered devices (i.e., older smart phones)? There are a few libraries that written that purportedly can do or help with local speech-to-speech:

https://github.com/ictnlp/StreamSpeech

https://github.com/k2-fsa/sherpa-onnx

https://github.com/openai/whisper

I'm looking for a simple app that can listen for English, translate into Korean (and other languages), then perform speech synthesis on the translation. Although real-time would be great, a short delay would work.

RTranslator is awkward (couldn't get it to perform speech-to-speech using a single phone). 3PO sprouts errors like dandelions and requires an online connection.

Any suggestions?

Comments URL: https://tildes.net/~comp/1jny/real_time_speech_to_speech_translation

Votes: 6

Comments: 8