Automatic Speech Recognition
Transformers
Safetensors
PyTorch
arkasr
text-generation
speech
audio
ark-asr
custom_code
Eval Results
Instructions to use Edge0/ARK-ASR-0.6B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Edge0/ARK-ASR-0.6B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="Edge0/ARK-ASR-0.6B", trust_remote_code=True)# Load model directly from transformers import AutoModelForCausalLM model = AutoModelForCausalLM.from_pretrained("Edge0/ARK-ASR-0.6B", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Upload README.md
Browse files
README.md
CHANGED
|
@@ -59,19 +59,15 @@ The model should be loaded with `trust_remote_code=True`. The official inference
|
|
| 59 |
|
| 60 |
## Performance
|
| 61 |
|
| 62 |
-
The following results are from the `open-audio-opd` evaluation. Lower CER/WER is better.
|
| 63 |
-
|
| 64 |
-
| Model |
|
| 65 |
-
| --- | ---: | ---: | ---: | ---: | ---: |
|
| 66 |
-
|
|
| 67 |
-
|
|
| 68 |
-
|
|
| 69 |
-
|
| 70 |
-
|
| 71 |
-
| *Larger reference model* | | | | | |
|
| 72 |
-
| Qwen3-ASR-1.7B | 1.50% | 4.69% | 4.55% | 2.20% | 4.05% |
|
| 73 |
-
|
| 74 |
-
`Ark-Base` is the 0.6B supervised ASR checkpoint trained on 100k hours of ASR audio. `TD` denotes teacher-data adaptation using 2,000 hours of teacher-generated ASR data. `OPD` denotes on-policy distillation with a Qwen-ASR teacher.
|
| 75 |
|
| 76 |
## Inference
|
| 77 |
|
|
|
|
| 59 |
|
| 60 |
## Performance
|
| 61 |
|
| 62 |
+
The following results are from the `open-audio-opd` evaluation. Lower CER/WER is better.
|
| 63 |
+
|
| 64 |
+
| Model | AMI WER | Earnings22 WER | GigaSpeech WER | LS Clean WER | LS Other WER | SPGISpeech WER | VoxPopuli WER | English Avg WER | AISHELL-1 CER | Wenet-meeting CER | Wenet-net CER | Chinese Avg CER |
|
| 65 |
+
| --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
|
| 66 |
+
| Ark-ASR | 11.67% | 10.11% | 8.93% | 1.93% | 4.00% | 2.89% | 6.96% | 6.64% | 2.02% | 5.92% | 4.96% | 4.30% |
|
| 67 |
+
| Qwen3-ASR-1.7B | 10.56% | 10.25% | 8.74% | 1.63% | 3.40% | 2.84% | 6.35% | 6.25% | 1.50% | 4.69% | 4.55% | 3.58% |
|
| 68 |
+
| Qwen3-ASR-0.6B | 11.66% | 11.06% | 9.14% | 2.13% | 4.45% | 3.03% | 7.07% | 6.93% | 2.07% | 5.57% | 5.45% | 4.36% |
|
| 69 |
+
|
| 70 |
+
`Ark-ASR` is the 0.6B ASR checkpoint trained with teacher-data adaptation and on-policy distillation from `open-audio-opd`.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 71 |
|
| 72 |
## Inference
|
| 73 |
|