Transcriber
AssemblyAI logo

AssemblyAI speech-to-text for Bolna AI voice agents

AssemblyAI Universal-3.6 Pro transcribes callers for your Bolna voice agent in 32 languages, with code-switching and keyword plus context biasing.

stttranscribermultilingualassemblyaicode-switchingkeywordsreal-time
At a glance

How AssemblyAI fits in the stack

Best for

Turning noisy phone audio into text the agent can reason over.

Use this layer when

Recognition accuracy, language coverage, and latency matter most.

Connects to

Telephony audio upstream and your LLM downstream.

Voice Stack

Speech-to-text is the listening layer

Speech-to-text is the listening layer

This provider converts raw audio into text in real time. It shapes how accurately the agent hears the caller and how natural the back-and-forth feels.

TelephonyPhone Network
→
STTListener
→
LLMReasoning
→
TTSVoice
→
ToolsActions

Last updated

What is AssemblyAI used for in a Bolna voice agent?

AssemblyAI is a streaming speech-to-text provider that turns your caller's speech into text for the Bolna agent's LLM, using the universal-3-6-pro model trained on real voice-agent and phone audio. It is built for the turns that break voice agents: one-word answers, background voices and callers who switch language mid-sentence. Pick it when your calls are full of brand names or product codes, since it takes both a keyword list and a free-form description of the call.

How do I set up AssemblyAI with Bolna?

  1. Open your agent in the Bolna dashboard at platform.bolna.ai and go to the Languages tab.
  2. Under Transcription, set Provider to assembly and Model to universal-3-6-pro.
  3. Add your product and brand names in Keywords, and a sentence or two about the call in Context.
  4. If callers pause while reading out numbers or addresses, open Advanced settings and raise Longest pause in a turn. Mode and VAD threshold sit there too.
  5. Save the agent and place a test call.

For every setting, see the AssemblyAI setup guide in the Bolna docs.

Which AssemblyAI models and languages does Bolna support?

ModelLanguagesStatus
universal-3-6-pro32: Afrikaans, Arabic, Cantonese, Catalan, Danish, Dutch, English, Estonian, Finnish, French, Galician, German, Hebrew, Hindi, Italian, Japanese, Korean, Mandarin, Marathi, Norwegian, Norwegian Nynorsk, Persian, Portuguese, Romanian, Russian, Spanish, Swedish, Turkish, Urdu, Vietnamese, Xhosa, ZuluRecommended default
universal-3-5-pro19 of the above. It does not cover Afrikaans, Cantonese, Estonian, Galician, Korean, Marathi, Norwegian Nynorsk, Persian, Romanian, Russian, Urdu, Xhosa or ZuluPrevious generation, still supported
universalEnglish onlyDeprecated, not selectable on new agents

Need an Indian language AssemblyAI does not cover? The docs point to Sarvam or Deepgram.

What can you build with AssemblyAI and Bolna?

Lead qualification and confirmations. Outbound calls that hinge on a short yes or no. universal-3-6-pro makes 52% fewer errors on short answers in heavy background noise than the previous model.

Multilingual support lines. One agent that code-switches across 32 languages, with 74% fewer sessions transcribed in the wrong language than universal-3-5-pro.

Calls taken in noisy places. Shops, households and open offices, where 22% less background speech leaks into the transcript. Set voice_focus to suppress other voices further.

Spelled names and card digits. Bolna passes the agent's last spoken reply to AssemblyAI as context, so when the agent asks for the last four digits, AssemblyAI knows a number is coming.

FAQ

AssemblyAI on Bolna: frequently asked questions

Use universal-3-6-pro. It covers 32 languages against 19 on universal-3-5-pro, makes 45% fewer errors on short answers like "yes" or "no thanks", and AssemblyAI charges the same rate for both.

Yes. Hindi (hi) is one of the 32 languages on universal-3-6-pro, along with Marathi (mr) and Urdu (ur). Send the plain language code, not a locale like hi-IN.

Yes. Bolna sends your keywords as AssemblyAI's keyterms prompt, up to 100 terms, and your context field as its prompt, up to 1,750 characters. Context works on the Universal-3 models only.

No. Existing agents keep running on the legacy English-only engine, but it is no longer selectable on new agents. Move them to universal-3-6-pro when you next edit them.

Browse this layer

Keep exploring the voice stack

Browse

Speech-to-Text

Speech-to-text converts what callers say into text that your LLM can process. Transcription accuracy and latency directly affect how natural a conversation feels. Bolna supports streaming STT providers optimized for telephony audio, including specialized models for Indian languages.

Browse

Telephony

Telephony providers connect your voice agents to the phone network so they can make and receive real calls. Bolna supports managed integrations with major carriers as well as bring-your-own-carrier via SIP trunking, giving you full control over call routing, number provisioning, and cost.

Browse

Large Language Models

The LLM is the brain of your voice agent. It understands what callers say and decides how to respond. Bolna lets you switch between models like GPT-5.4 mini, Claude and DeepSeek by changing the provider and model in your agent LLM settings, so you can tune for speed, cost or reasoning depth.

Browse

Text-to-Speech

Text-to-speech turns your agent responses into spoken audio. Voice quality shapes how callers perceive your brand. Flat, robotic speech kills trust while natural, expressive voices build it. Bolna integrates with the fastest TTS providers so responses sound human and arrive without awkward pauses.

Browse

Tools & Workflows

Tools let your voice agents take action during a call, not just talk. Book a calendar slot, look up an order through your own API, push a lead into your CRM, or trigger a multi-step automation in Zapier. These integrations turn voice agents from answering machines into workflow engines.

See where AssemblyAI fits in your production workflow

Use the demo to walk through provider selection, stack tradeoffs, and the exact workflow you want Bolna to automate.