bupalinyu commited on
Commit
da63042
·
verified ·
1 Parent(s): 6009308

Upload README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -13
README.md CHANGED
@@ -59,19 +59,15 @@ The model should be loaded with `trust_remote_code=True`. The official inference
59
 
60
  ## Performance
61
 
62
- The following results are from the `open-audio-opd` evaluation. Lower CER/WER is better. Bold numbers mark the best result within the 0.6B group.
63
-
64
- | Model | aishell-1 (CER) | Wenet-meeting (CER) | Wenet-net (CER) | Libri-clean (WER) | Libri-other (WER) |
65
- | --- | ---: | ---: | ---: | ---: | ---: |
66
- | *0.6B models* | | | | | |
67
- | Ark-Base (0.6B) | 3.48% | 10.22% | 7.74% | 3.75% | 7.17% |
68
- | Ark-Base+OPD (0.6B) | 3.00% | 7.18% | 6.13% | 2.88% | 5.50% |
69
- | **Ark-Base+TD+OPD (0.6B)** | **1.95%** | 5.92% | **5.39%** | **2.45%** | **4.56%** |
70
- | Qwen3-ASR-0.6B | 2.07% | **5.57%** | 5.45% | 2.81% | 5.05% |
71
- | *Larger reference model* | | | | | |
72
- | Qwen3-ASR-1.7B | 1.50% | 4.69% | 4.55% | 2.20% | 4.05% |
73
-
74
- `Ark-Base` is the 0.6B supervised ASR checkpoint trained on 100k hours of ASR audio. `TD` denotes teacher-data adaptation using 2,000 hours of teacher-generated ASR data. `OPD` denotes on-policy distillation with a Qwen-ASR teacher.
75
 
76
  ## Inference
77
 
 
59
 
60
  ## Performance
61
 
62
+ The following results are from the `open-audio-opd` evaluation. Lower CER/WER is better.
63
+
64
+ | Model | AMI WER | Earnings22 WER | GigaSpeech WER | LS Clean WER | LS Other WER | SPGISpeech WER | VoxPopuli WER | English Avg WER | AISHELL-1 CER | Wenet-meeting CER | Wenet-net CER | Chinese Avg CER |
65
+ | --- | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: | ---: |
66
+ | Ark-ASR | 11.67% | 10.11% | 8.93% | 1.93% | 4.00% | 2.89% | 6.96% | 6.64% | 2.02% | 5.92% | 4.96% | 4.30% |
67
+ | Qwen3-ASR-1.7B | 10.56% | 10.25% | 8.74% | 1.63% | 3.40% | 2.84% | 6.35% | 6.25% | 1.50% | 4.69% | 4.55% | 3.58% |
68
+ | Qwen3-ASR-0.6B | 11.66% | 11.06% | 9.14% | 2.13% | 4.45% | 3.03% | 7.07% | 6.93% | 2.07% | 5.57% | 5.45% | 4.36% |
69
+
70
+ `Ark-ASR` is the 0.6B ASR checkpoint trained with teacher-data adaptation and on-policy distillation from `open-audio-opd`.
 
 
 
 
71
 
72
  ## Inference
73