Remove internal maintainer-warning comment from model card
Browse files
README.md
CHANGED
|
@@ -44,23 +44,6 @@ model-index:
|
|
| 44 |
|
| 45 |
This is an INT8-quantized version of [openai/whisper-small](https://huggingface.co/openai/whisper-small) optimized for edge deployment on ARM devices using [ExecuTorch](https://github.com/pytorch/executorch) with the XNNPACK backend. The model uses 8da8w dynamic quantization for the 192 encoder/decoder Transformer-stack Linear weights via Optimum-ExecuTorch, plus a manual weight-only INT8 quantization pass on `decoder.embed_tokens`, and is exported to the `.pte` format for efficient inference on ARM Cortex-A processors (AWS Graviton, mobile ARM, embedded). The final output projection (`proj_out` / `lm_head`), positional embeddings, and encoder convolutional stem remain FP32.
|
| 46 |
|
| 47 |
-
<!--
|
| 48 |
-
MAINTAINER WARNING: both Whisper Small model weights are NOT in git.
|
| 49 |
-
|
| 50 |
-
The optimized INT8 `whisper-small-int8-executorch.pte` (395.0460 MB), FP32
|
| 51 |
-
baseline `whisper-small-fp32-executorch.pte` (1074.6592 MB), and matching
|
| 52 |
-
preprocessor `.pte` files are gitignored and kept only in local working copies
|
| 53 |
-
until the large-weight publishing path is fixed. The model card, config,
|
| 54 |
-
benchmarks, and sample audio are tracked.
|
| 55 |
-
|
| 56 |
-
CRITICAL: `.github/workflows/publish.yml` uses `hf upload --delete '*'`. The
|
| 57 |
-
workflow now fails fast for Whisper when these ignored files are missing, because
|
| 58 |
-
a publish from git alone cannot upload the two model weights. If that guard is
|
| 59 |
-
bypassed, manually uploaded copies can still be deleted from the HF repo. Re-upload
|
| 60 |
-
both files by hand after any successful publish until the permanent large-file
|
| 61 |
-
solution replaces this stopgap.
|
| 62 |
-
-->
|
| 63 |
-
|
| 64 |
## Key Highlights
|
| 65 |
|
| 66 |
Compared to the FP32 baseline:
|
|
|
|
| 44 |
|
| 45 |
This is an INT8-quantized version of [openai/whisper-small](https://huggingface.co/openai/whisper-small) optimized for edge deployment on ARM devices using [ExecuTorch](https://github.com/pytorch/executorch) with the XNNPACK backend. The model uses 8da8w dynamic quantization for the 192 encoder/decoder Transformer-stack Linear weights via Optimum-ExecuTorch, plus a manual weight-only INT8 quantization pass on `decoder.embed_tokens`, and is exported to the `.pte` format for efficient inference on ARM Cortex-A processors (AWS Graviton, mobile ARM, embedded). The final output projection (`proj_out` / `lm_head`), positional embeddings, and encoder convolutional stem remain FP32.
|
| 46 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 47 |
## Key Highlights
|
| 48 |
|
| 49 |
Compared to the FP32 baseline:
|