A faster Whisper large-v3 derivative whose decoder is cut from 32 layers to 4, giving multilingual transcription in roughly 100 languages at a small accuracy cost (it was not fine-tuned for translation).
fixie-ai/ultravox-v0_5-llama-3_2-1b
Indexed from Hugging FaceLinked to its home on Hugging Face. FrontierOS indexes it; nothing is hosted or mirrored here.ModelSpeech to textEst. Edge GPUEstimated minimum compute for inference: Jetson Orin class, 8–16 GB shared memory. Not a benchmark.MIT
About
A speech-input LLM that feeds Whisper encoder features through a learned projector into Llama 3.2 1B Instruct, so it can respond to spoken input without a separate transcription step. It replies in text, so pair it with a TTS voice.
Why it matters for physical AI
Skipping the ASR-to-text hop cuts voice-agent latency, and the 1B variant is small enough for an edge GPU or a laptop host.
Summary written by FrontierOS in our own words. The upstream card and license govern use. Metadata checked 27 Sep 2026. Read the full card on Hugging Face
Files, weights and version history live on Hugging Face. FrontierOS indexes this repo; it does not host or mirror it.
hf download fixie-ai/ultravox-v0_5-llama-3_2-1bUses the Hugging Face CLI (pip install -U huggingface_hub). This downloads the whole repo; add --include "<pattern>" to fetch only the files you need.
Full-duplex or cascaded voice for robots?
Full-duplex models such as Moshi can listen while they talk, which makes interruptions and backchannels feel natural. Cascaded stacks are easier to debug and swap piece by piece.
More speech to text
Browse allThe small size of the Moonshine Streaming family, an English-only encoder-decoder recognizer that uses a sliding-window encoder so it can transcribe live audio with low latency on edge hardware.
A FastConformer encoder with a token-and-duration transducer decoder that transcribes 25 European languages with punctuation, capitalization and word-level timestamps.