Fix README: remove fp32 references, flatten file paths
Browse files
README.md
CHANGED
|
@@ -36,16 +36,17 @@ Runs locally with [ONNX Runtime](https://onnxruntime.ai/) in Python, C#, C++, Ja
|
|
| 36 |
|
| 37 |
## What's Included
|
| 38 |
|
| 39 |
-
|
| 40 |
|
| 41 |
-
|
|
| 42 |
-
|------
|
| 43 |
-
|
|
| 44 |
-
|
|
|
|
|
|
|
|
| 45 |
|
| 46 |
Plus:
|
| 47 |
-
-
|
| 48 |
-
- Export and quantization scripts (reproduce from the original model)
|
| 49 |
- C# inference example
|
| 50 |
- Complete porting guide with all concepts explained
|
| 51 |
|
|
@@ -63,13 +64,13 @@ import librosa
|
|
| 63 |
# Load audio (must be 16kHz mono)
|
| 64 |
audio, sr = librosa.load("your_audio.wav", sr=16000, mono=True)
|
| 65 |
|
| 66 |
-
# Load models
|
| 67 |
-
enc = ort.InferenceSession("
|
| 68 |
-
dec = ort.InferenceSession("
|
| 69 |
|
| 70 |
# Load tokens
|
| 71 |
tokens = {}
|
| 72 |
-
with open("
|
| 73 |
for line in f:
|
| 74 |
parts = line.strip().rsplit(" ", 1)
|
| 75 |
if len(parts) == 2:
|
|
|
|
| 36 |
|
| 37 |
## What's Included
|
| 38 |
|
| 39 |
+
INT8 dynamically quantized ONNX model (2.75 GB total):
|
| 40 |
|
| 41 |
+
| File | Size | Description |
|
| 42 |
+
|------|------|-------------|
|
| 43 |
+
| `cohere-encoder.int8.onnx` | 3 MB | Encoder graph (weights in .data file) |
|
| 44 |
+
| `cohere-encoder.int8.onnx.data` | 2.6 GB | Encoder weights |
|
| 45 |
+
| `cohere-decoder.int8.onnx` | 147 MB | Decoder (self-contained) |
|
| 46 |
+
| `tokens.txt` | 219 KB | 16,384-entry vocabulary |
|
| 47 |
|
| 48 |
Plus:
|
| 49 |
+
- Export and quantization scripts (reproduce FP32 or re-quantize from the [original model](https://huggingface.co/CohereLabs/cohere-transcribe-03-2026))
|
|
|
|
| 50 |
- C# inference example
|
| 51 |
- Complete porting guide with all concepts explained
|
| 52 |
|
|
|
|
| 64 |
# Load audio (must be 16kHz mono)
|
| 65 |
audio, sr = librosa.load("your_audio.wav", sr=16000, mono=True)
|
| 66 |
|
| 67 |
+
# Load models
|
| 68 |
+
enc = ort.InferenceSession("cohere-encoder.int8.onnx")
|
| 69 |
+
dec = ort.InferenceSession("cohere-decoder.int8.onnx")
|
| 70 |
|
| 71 |
# Load tokens
|
| 72 |
tokens = {}
|
| 73 |
+
with open("tokens.txt", "r", encoding="utf-8") as f:
|
| 74 |
for line in f:
|
| 75 |
parts = line.strip().rsplit(" ", 1)
|
| 76 |
if len(parts) == 2:
|