tristanripke commited on
Commit
9ecc3a5
·
verified ·
1 Parent(s): 66ea1a8

Fix README: remove fp32 references, flatten file paths

Browse files
Files changed (1) hide show
  1. README.md +12 -11
README.md CHANGED
@@ -36,16 +36,17 @@ Runs locally with [ONNX Runtime](https://onnxruntime.ai/) in Python, C#, C++, Ja
36
 
37
  ## What's Included
38
 
39
- Two precision variants, both fully functional:
40
 
41
- | Variant | Encoder | Decoder | Total | Use Case |
42
- |---------|---------|---------|-------|----------|
43
- | **int8/** (recommended) | 2.6 GB | 147 MB | **2.75 GB** | Best balance of size and accuracy |
44
- | **fp32/** | 7.3 GB | 581 MB | **7.8 GB** | Maximum accuracy, larger footprint |
 
 
45
 
46
  Plus:
47
- - `tokens.txt` -- 16,384-entry vocabulary for decoding
48
- - Export and quantization scripts (reproduce from the original model)
49
  - C# inference example
50
  - Complete porting guide with all concepts explained
51
 
@@ -63,13 +64,13 @@ import librosa
63
  # Load audio (must be 16kHz mono)
64
  audio, sr = librosa.load("your_audio.wav", sr=16000, mono=True)
65
 
66
- # Load models (use int8 for smaller size, fp32 for max accuracy)
67
- enc = ort.InferenceSession("int8/cohere-encoder.int8.onnx")
68
- dec = ort.InferenceSession("int8/cohere-decoder.int8.onnx")
69
 
70
  # Load tokens
71
  tokens = {}
72
- with open("int8/tokens.txt", "r", encoding="utf-8") as f:
73
  for line in f:
74
  parts = line.strip().rsplit(" ", 1)
75
  if len(parts) == 2:
 
36
 
37
  ## What's Included
38
 
39
+ INT8 dynamically quantized ONNX model (2.75 GB total):
40
 
41
+ | File | Size | Description |
42
+ |------|------|-------------|
43
+ | `cohere-encoder.int8.onnx` | 3 MB | Encoder graph (weights in .data file) |
44
+ | `cohere-encoder.int8.onnx.data` | 2.6 GB | Encoder weights |
45
+ | `cohere-decoder.int8.onnx` | 147 MB | Decoder (self-contained) |
46
+ | `tokens.txt` | 219 KB | 16,384-entry vocabulary |
47
 
48
  Plus:
49
+ - Export and quantization scripts (reproduce FP32 or re-quantize from the [original model](https://huggingface.co/CohereLabs/cohere-transcribe-03-2026))
 
50
  - C# inference example
51
  - Complete porting guide with all concepts explained
52
 
 
64
  # Load audio (must be 16kHz mono)
65
  audio, sr = librosa.load("your_audio.wav", sr=16000, mono=True)
66
 
67
+ # Load models
68
+ enc = ort.InferenceSession("cohere-encoder.int8.onnx")
69
+ dec = ort.InferenceSession("cohere-decoder.int8.onnx")
70
 
71
  # Load tokens
72
  tokens = {}
73
+ with open("tokens.txt", "r", encoding="utf-8") as f:
74
  for line in f:
75
  parts = line.strip().rsplit(" ", 1)
76
  if len(parts) == 2: