Unsteered 2m25s slice of Dessa AI conversing directly with OpenAI's GPT-Live-1—highlighting interruption yielding (38.8s), patience (100.8s), and fast backchanneling (128.8s).
Dessa AI vs GPT Live · Direct AI-to-AI Acoustic Showdown
Dessa AI vs GPT Live (GPT-Live-1): Live Audio & Architecture Breakdown
What happens when you put Block’s pure-audio Dessa AI in a live voice conversation with OpenAI’s GPT-Live-1? Listen to both official unsteered recordings—in a clean studio feed and over a noisy room speakerphone—and inspect how full-duplex speech-only training handles interruptions, patience, and sub-second backchanneling.
Recording #1: Studio Line Feed — Dessa AI Talking to GPT-Live-1 (2:25)
Extracted from a longer unsteered session (100.2s–246.0s), this clip captures Dessa AI and GPT-Live-1 planning a chaotic movie heist. Watch the Moment markers at 38.8s (Interruption), 100.8s (Patience), and 128.8s (Fast backchanneling).
Recording #2: Acoustic Stress Test — Noisy Room Speakerphone (4:17)
Recorded over an open speakerphone in a reverberant room, testing how Dessa AI and GPT-Live-1 handle room echo, crosstalk, overlapping laughter, and mid-sentence turn collisions.
4m17s unedited speakerphone conversation between Dessa AI and GPT-Live-1 in a noisy room with echo and overlapping speech.
Synchronized Transcript (139)
Forensic Timestamp Breakdown: Why Full-Duplex Native Audio Wins
Instantaneous Mid-Sentence Yielding
When both models begin speaking simultaneously after a pause, Dessa AI immediately detects the acoustic collision, drops its vocal energy within milliseconds, and yields the floor naturally.
Holding Silence Without Premature Turn Stealing
As GPT-Live-1 delivers a multi-clause riff about escaping in a flashy convertible, Dessa AI tracks the prosodic contour of the sentence rather than relying on a fixed silence timer.
Sub-Second Affirmative Cues & Shared Laughter
Dessa AI interjects natural backchannels ('yeah', 'right', chuckles) while listening without hijacking the turn.
Room Reverb & Crosstalk Resilience
In the 4-minute noisy speakerphone recording, Dessa AI adapts its cadence to acoustic reflections without hallucinating phantom words.
Architecture Comparison: Dessa AI vs. GPT-Live-1 / GPT-4o Realtime
A technical side-by-side of Block’s speech-only approach against text-pretrained multimodal voice models.
| Dimension | Dessa AI (Block) | GPT-Live-1 / Text-Pretrained Voice Models |
|---|---|---|
| Core Training Modality | 100% raw human conversation audio from scratch (0% text) | Pretrained on trillions of text tokens + multimodal audio post-training |
| Word Sample Efficiency | Learns language from 100× fewer words than text LLMs | Requires web-scale text corpora (trillions of tokens) |
| Duplex Turn-Taking | Continuous full-duplex waveform modeling; native overlap & yielding | Hybrid token streaming; often relies on turn-detection heuristics |
| Backchanneling | Sub-second acoustic backchannels ('mm-hmm', laughter) without stealing turn | Rarely backchannels while listening; tends to wait or interrupt fully |
| Non-Speech Acoustic Awareness | Directly reacts to environmental sounds (e.g., coffee machine ding) | Often filters out non-speech sounds or transcribes them as noise |
| Emotional Prosody & Laughter | Emergent from raw conversational audio; shifts tone mid-sentence | Controlled via style prompts or synthetic voice conditioning |
| Training Compute Footprint | 1× NVIDIA GB200 NVL72 rack | Massive multi-rack hyperscale GPU clusters |
| Local On-Device Inference | Runs faster-than-real-time locally on MacBook Pro (M4 Max+) | Cloud API only; requires datacenter GPU inference |
| Release Status | Research preview (21 unsteered recordings; safety review ongoing) | Commercial cloud API & consumer voice mode |
Dessa AI vs GPT Live FAQ
What is GPT-Live-1 in Block’s Dessa AI recordings?
In Block’s official research release (block.xyz/dessa), GPT-Live-1 refers to OpenAI’s live voice model placed in direct unsteered audio conversation with Dessa AI.
Why does Dessa AI sound more natural during interruptions than GPT Live?
Because Dessa AI never converts speech into text tokens and continuously models both speakers’ audio streams simultaneously.