Try the defaults
Use the same server and browser playground:- Say a complete question and pause. The assistant should take its turn.
- Start a phrase, pause briefly, then finish it. Listen for a premature answer.
- While the assistant speaks, ask a different question. Playback should stop and the next turn should respond to your new words.
- Repeat with a short acknowledgement such as “yes” and with a longer request.
metadata["interrupted"] = True (metadata is not sent to model providers). A cancelled tool may already have performed work; stopping speech does not undo external side effects.
Greetings have their own interruptible setting, which defaults to false; see Greetings.
How the boundary is chosen
Voice activity detection (VAD) identifies speech and silence. End-of-utterance detection decides whether a pause ends a thought. With Deepgram Flux, the default transcription provider, Flux makes that decision. With other providers, the server uses local audio detection when its dependencies are installed, otherwise lexical detection. The local path combines Smart Turn audio scoring, Namo text scoring, and Silero VAD endpointing. Inspectsession_started.turn_detector for the resolved detector. That field is the class name (ProviderTurnDetector, LocalAudioTurnDetector, …), not the mode string you configured. A requested mode can be changed by the server: STT adapters with native utterance boundaries, currently Flux and Munsit, force provider mode unless you explicitly set heuristic, raw, or provider, and they disable local VAD endpointing. OpenAI and ElevenLabs transcription do not have that native boundary, so they keep local or lexical. semantic is accepted as an alias of lexical. Opt-in detectors can hold a transcript; the default hold timeout is 1.5 seconds (hold_timeout_secs on VoiceSession).
Choose another mode
For a controlled comparison, add to the dict-based config:local: combines audio and text evidence and can hold an unfinished thought. Install the voice extra; explicitly choosing this mode without its dependencies loses audio detection.lexical: uses punctuation and unfinished phrases to decide whether to hold a committed transcript.provider: trusts the provider’s committed transcript as the boundary.heuristic: lightweight text filtering without holding unfinished thoughts.raw: accepts committed transcripts with minimal policy; useful for debugging.
vad_endpointing=None enables the local fast path when supported. Set it to False to disable it. A Python declaration may also supply a TurnDetector instance or zero-argument factory; clients may send supported mode names, and sessions own detector clones.
Custom clients
WebSocket clients must report cumulative milliseconds of audio actually played and discard queued audio oninterrupted. Reporting received bytes as played can preserve words the caller never heard. WebRTC and LiveKit use the server’s paced media clock. See Transports for the wire contract and Events and usage for interruption metrics.
Continue to Silence and timeouts.