whisper.unity
Automatic speech recognition (ASR) model for Unity3d running on your local machine
Open-source Unity3d bindings for the whisper.cpp. It provides high-performance inference of OpenAI’s Whisper automatic speech recognition (ASR) model running on your local machine.
Main features:
- Multilingual, supports around 60 languages
- Can translate one language to another (e.g. German speech to English text)
- Different models sizes offering speed and accuracy tradeoffs
- Runs on local users device without Internet connection
- Free and open source, can be used in commercial projects
Here is some samples of whisper.unity:
"whisper-small.bin" model tested in English, German and Russian from microphone
"whisper.tiny" in subtitles demo, color shows confidence level for each token