Article · Original
The article text is unavailable in this language; an existing version is shown.
@shobhitbanga Whisper Medium sitting at 85% word error rate on Bengali shows how badly the region was underserved,
语音 人工智能 发布 API
Automatically verified and published · Generated and evidence-checked automatically; not reviewed by a human.
Voice Arena says Monsoon ASR contains more than 100,000 hours of speech across 50 languages, most of them long-tail languages. It reports that fine-tuning Whisper Medium on the dataset reduced word error rate from 85.27% to 7.65% on Bengali FLEURS; interested labs can use its model API to test against their own internal benchmarks.
The article text is unavailable in this language; an existing version is shown.
@shobhitbanga Whisper Medium sitting at 85% word error rate on Bengali shows how badly the region was underserved,
Crazy week for Voice Arena at Interspeech in Sydney.
80+ organisations have asked to license Monsoon ASR corpus since we launched it seven days ago.
The most common reason why labs are interested: Monsoon promises results.
When we decided to build datasets at Voice Arena, we set one rule. Either the dataset promises results, or we don't build it.
Monsoon promises results. On Bengali FLEURS, fine-tuning Whisper Medium on Monsoon took its LLM word error rate from 85.27% down to 7.65%. The other thing labs like is that we give them access to our model API. They can test it on their own internal benchmarks and see for themselves whether it will improve their models.
You can see the detailed results and get API access here: https://t.co/m6RSiF9tWP
Monsoon is 100,000 hours across 50 languages from around the world, and most of them are long-tail languages. 100 languages by February, 1,000 by the end of 2027.
It's only the first dataset Voice Arena has launched. We are excited to keep working on the key problems that get us closer to the dream of machines that talk like humans.
View replied-to post on X
Introducing Monsoon ASR ⚡️ @voicearena_ai
Speech recognition does not have a model problem anymore. It has a data problem.
The best ASR systems are approaching human-level performance in English. But move into the long tail of the world's languages, especially real, conversational speech and error rates can still be 5-10X higher.
Today, we're releasing Monsoon ASR: a new generation of training data built specifically to close that gap.
50 languages. 100,000+ hours. Dense spontaneous speech.
And one goal: Single-digit WER across the world's languages.🧵
View context on X