Automatically verified and published · Generated and evidence-checked automatically; not reviewed by a human.
Voice Arena says @smallest_AI’s Pulse ranks first among seven systems that return transcripts with speaker labels, with a 24.4% diarization error rate versus 40.7% for the next system, ElevenLabs Scribe v2. The benchmark uses a strict 0 ms collar that forgives no speaker boundary error; Pulse ranks fifth on the full board, which also includes dedicated diarization models.
The article text is unavailable in this language; an existing version is shown.
@voicearena_ai @smallest_AI This is so interesting because most diarization scoring forgives a little error at speaker boundaries. A 0 ms collar forgives none.
Pulse by @smallest_AI currently ranks #1 in the Diarization + ASR track by DER, as the newest entry on the Voice Arena Diarization Bench.
The Diarization + ASR track ranks Speaker-Attributed ASR systems that return speaker labels together with the transcript. Seven systems are in it today. Pulse scores 24.4% DER at a strict 0 ms collar. The next system, ElevenLabs Scribe v2, scores 40.7%. That is 1.7x lower error than the next best in the track.
Most of the gap is missed speech. For every other system in the track, missed speech is the largest part of the error, above 30% for each of them. Pulse misses 4.4% of reference speech, the lowest in the track.
On the full board of 13 systems, dedicated diarization models and Speaker-Attributed ASR systems together, Pulse places 5th. It is the highest-ranked Speaker-Attributed ASR system on the board and sits ahead of two dedicated diarization models.
The result holds across settings:
In-person recordings : 24.7% DER
In online calls : 22.4% DER
Congratulations to @smallest_AI 👏
View full results, per track and per condition: https://t.co/T9H6hLEUxR
View replied-to post on X