erik-at-boson commited on
Commit
8c48903
·
verified ·
1 Parent(s): c3aa70a

Add ESB benchmark eval results (model-index) for Open ASR Leaderboard

Browse files
Files changed (1) hide show
  1. README.md +114 -0
README.md CHANGED
@@ -4,9 +4,123 @@ language:
4
  - en
5
  tags:
6
  - automatic-speech-recognition
 
7
  - whisper
8
  - qwen
9
  pipeline_tag: automatic-speech-recognition
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
10
  ---
11
 
12
  # Higgs Audio v3 STT
 
4
  - en
5
  tags:
6
  - automatic-speech-recognition
7
+ - hf-asr-leaderboard
8
  - whisper
9
  - qwen
10
  pipeline_tag: automatic-speech-recognition
11
+ model-index:
12
+ - name: higgs-audio-v3-stt
13
+ results:
14
+ - task:
15
+ name: Automatic Speech Recognition
16
+ type: automatic-speech-recognition
17
+ dataset:
18
+ name: AMI (Meetings test)
19
+ type: edinburghcstr/ami
20
+ config: ihm
21
+ split: test
22
+ args:
23
+ language: en
24
+ metrics:
25
+ - name: Test WER
26
+ type: wer
27
+ value: 10.49
28
+ - task:
29
+ name: Automatic Speech Recognition
30
+ type: automatic-speech-recognition
31
+ dataset:
32
+ name: Earnings-22
33
+ type: revdotcom/earnings22
34
+ split: test
35
+ args:
36
+ language: en
37
+ metrics:
38
+ - name: Test WER
39
+ type: wer
40
+ value: 11.48
41
+ - task:
42
+ name: Automatic Speech Recognition
43
+ type: automatic-speech-recognition
44
+ dataset:
45
+ name: GigaSpeech
46
+ type: speechcolab/gigaspeech
47
+ split: test
48
+ args:
49
+ language: en
50
+ metrics:
51
+ - name: Test WER
52
+ type: wer
53
+ value: 7.71
54
+ - task:
55
+ name: Automatic Speech Recognition
56
+ type: automatic-speech-recognition
57
+ dataset:
58
+ name: LibriSpeech (clean)
59
+ type: librispeech_asr
60
+ config: clean
61
+ split: test
62
+ args:
63
+ language: en
64
+ metrics:
65
+ - name: Test WER
66
+ type: wer
67
+ value: 1.07
68
+ - task:
69
+ name: Automatic Speech Recognition
70
+ type: automatic-speech-recognition
71
+ dataset:
72
+ name: LibriSpeech (other)
73
+ type: librispeech_asr
74
+ config: other
75
+ split: test
76
+ args:
77
+ language: en
78
+ metrics:
79
+ - name: Test WER
80
+ type: wer
81
+ value: 2.03
82
+ - task:
83
+ name: Automatic Speech Recognition
84
+ type: automatic-speech-recognition
85
+ dataset:
86
+ name: SPGI Speech
87
+ type: kensho/spgispeech
88
+ config: test
89
+ split: test
90
+ args:
91
+ language: en
92
+ metrics:
93
+ - name: Test WER
94
+ type: wer
95
+ value: 2.81
96
+ - task:
97
+ name: Automatic Speech Recognition
98
+ type: automatic-speech-recognition
99
+ dataset:
100
+ name: tedlium-v3
101
+ type: LIUM/tedlium
102
+ config: release1
103
+ split: test
104
+ args:
105
+ language: en
106
+ metrics:
107
+ - name: Test WER
108
+ type: wer
109
+ value: 2.81
110
+ - task:
111
+ name: Automatic Speech Recognition
112
+ type: automatic-speech-recognition
113
+ dataset:
114
+ name: Vox Populi
115
+ type: facebook/voxpopuli
116
+ config: en
117
+ split: test
118
+ args:
119
+ language: en
120
+ metrics:
121
+ - name: Test WER
122
+ type: wer
123
+ value: 6.93
124
  ---
125
 
126
  # Higgs Audio v3 STT