PEFT
Safetensors
English
audio-language-model
audio-question-answering
lora
mizar
rt-opd
knowledge-distillation
Instructions to use KaiyangLi/Mizar-3B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use KaiyangLi/Mizar-3B with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("KE-Team/Ke-Omni-R-3B") model = PeftModel.from_pretrained(base_model, "KaiyangLi/Mizar-3B") - Notebooks
- Google Colab
- Kaggle
Link Mizar family collection and corresponding GitHub code
Browse files- README.md +2 -0
- SHA256SUMS.json +2 -2
README.md
CHANGED
|
@@ -14,6 +14,8 @@ language:
|
|
| 14 |
---
|
| 15 |
# Mizar-3B: Audio Understanding with RT-OPD
|
| 16 |
|
|
|
|
|
|
|
| 17 |
**Mizar-3B** is the Ke-based 3B member of the Mizar audio-language model family.
|
| 18 |
This repository contains its **LoRA adapter** from the main experiment in
|
| 19 |
*RT-OPD: Reward-Tilted On-Policy Distillation for Compact Audio-Language Models*.
|
|
|
|
| 14 |
---
|
| 15 |
# Mizar-3B: Audio Understanding with RT-OPD
|
| 16 |
|
| 17 |
+
**[Mizar family](https://huggingface.co/collections/KaiyangLi/mizar-audio-language-model-family-6aa96a97630d4868ab979b4d)** 路 **[GitHub code](https://github.com/KaiyangLi1992/RT-OPD)** 路 **[Mizar-159M](https://huggingface.co/KaiyangLi/Mizar-159M)** 路 **[Mizar-3B](https://huggingface.co/KaiyangLi/Mizar-3B)**
|
| 18 |
+
|
| 19 |
**Mizar-3B** is the Ke-based 3B member of the Mizar audio-language model family.
|
| 20 |
This repository contains its **LoRA adapter** from the main experiment in
|
| 21 |
*RT-OPD: Reward-Tilted On-Policy Distillation for Compact Audio-Language Models*.
|
SHA256SUMS.json
CHANGED
|
@@ -4,8 +4,8 @@
|
|
| 4 |
"sha256": "e4e5de972981c5f832e2e599f2422a8946c63309a1c55bfa64a2e3b18340f7ac"
|
| 5 |
},
|
| 6 |
"README.md": {
|
| 7 |
-
"bytes":
|
| 8 |
-
"sha256": "
|
| 9 |
},
|
| 10 |
"adapter_config.json": {
|
| 11 |
"bytes": 8368,
|
|
|
|
| 4 |
"sha256": "e4e5de972981c5f832e2e599f2422a8946c63309a1c55bfa64a2e3b18340f7ac"
|
| 5 |
},
|
| 6 |
"README.md": {
|
| 7 |
+
"bytes": 5316,
|
| 8 |
+
"sha256": "f7f0741260c28a6f4448baf7f638454e5a79cdb3bc7026f20cfeb8b92869bf3a"
|
| 9 |
},
|
| 10 |
"adapter_config.json": {
|
| 11 |
"bytes": 8368,
|