Automatic Speech Recognition
TensorRT
Safetensors
qwen3_asr
asr
speech
quantization
int4
awq
jetson
nvidia-modelopt
Instructions to use vrfai/Qwen3-ASR-1.7B-int4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- TensorRT
How to use vrfai/Qwen3-ASR-1.7B-int4 with TensorRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Upload quantized checkpoint via upload_hf.sh
Browse files
README.md
CHANGED
|
@@ -75,7 +75,7 @@ BF16 baseline WER: 7.34% (measured on x86; not runnable on Nano due to memory).
|
|
| 75 |
|
| 76 |
This checkpoint is the **input to the TRT-EdgeLLM export pipeline**.
|
| 77 |
It is **not** directly loadable by standard `transformers` inference —
|
| 78 |
-
use it with [
|
| 79 |
to export to ONNX and build TRT engines.
|
| 80 |
|
| 81 |
```
|
|
@@ -109,13 +109,13 @@ to export to ONNX and build TRT engines.
|
|
| 109 |
## Deployment
|
| 110 |
|
| 111 |
Full pipeline documentation:
|
| 112 |
-
[trt-edgellm/README.md](https://github.com/VLAOpt/
|
| 113 |
|
| 114 |
### Quick start
|
| 115 |
|
| 116 |
```bash
|
| 117 |
-
git clone https://github.com/VLAOpt/
|
| 118 |
-
cd
|
| 119 |
|
| 120 |
# Download this checkpoint
|
| 121 |
huggingface-cli download vrfai/qwen3asr-int4 --local-dir ./Qwen3-ASR-1.7B-int4
|
|
@@ -152,4 +152,4 @@ python trt-edgellm/inference.py \
|
|
| 152 |
- [Qwen3-ASR Technical Report](https://arxiv.org/abs/2601.21337)
|
| 153 |
- [NVIDIA ModelOpt](https://nvidia.github.io/TensorRT-Model-Optimizer/)
|
| 154 |
- [TensorRT-Edge-LLM v0.6.0](https://nvidia.github.io/TensorRT-Edge-LLM/0.6.0/)
|
| 155 |
-
- [
|
|
|
|
| 75 |
|
| 76 |
This checkpoint is the **input to the TRT-EdgeLLM export pipeline**.
|
| 77 |
It is **not** directly loadable by standard `transformers` inference —
|
| 78 |
+
use it with [qwen-asr-optimization](https://github.com/VLAOpt/qwen-asr-optimization)
|
| 79 |
to export to ONNX and build TRT engines.
|
| 80 |
|
| 81 |
```
|
|
|
|
| 109 |
## Deployment
|
| 110 |
|
| 111 |
Full pipeline documentation:
|
| 112 |
+
[trt-edgellm/README.md](https://github.com/VLAOpt/qwen-asr-optimization/blob/main/trt-edgellm/README.md)
|
| 113 |
|
| 114 |
### Quick start
|
| 115 |
|
| 116 |
```bash
|
| 117 |
+
git clone https://github.com/VLAOpt/qwen-asr-optimization.git
|
| 118 |
+
cd qwen-asr-optimization
|
| 119 |
|
| 120 |
# Download this checkpoint
|
| 121 |
huggingface-cli download vrfai/qwen3asr-int4 --local-dir ./Qwen3-ASR-1.7B-int4
|
|
|
|
| 152 |
- [Qwen3-ASR Technical Report](https://arxiv.org/abs/2601.21337)
|
| 153 |
- [NVIDIA ModelOpt](https://nvidia.github.io/TensorRT-Model-Optimizer/)
|
| 154 |
- [TensorRT-Edge-LLM v0.6.0](https://nvidia.github.io/TensorRT-Edge-LLM/0.6.0/)
|
| 155 |
+
- [qwen-asr-optimization repo](https://github.com/VLAOpt/qwen-asr-optimization)
|