Skip to main content

Tag

dataset

3 post s

DevelopmentAI

Fine-tuning made it worse, and I still do not know why

What I learned fine-tuning speech models locally · Part 2

I fine-tuned whisper-small on 7.7 hours of real spontaneous speech and made it 2.6 times worse. I had a tidy explanation for it, so I tested the explanation, and the test said I was wrong.

The four stages of a fine-tuning pipeline: data collection, data processing, fine-tuning, testing.

AIResearch

Good speech data is the hard part

Locally fine-tuning Whisper and ASR models with Listenr · Part 1

Whisper is impressive and its vocabulary stopped in 2023. Fine-tuning fixes that, but only if you have high quality data, and getting that is the part nobody wants to do.

← All tags