Audio-to-Audio
PEFT
Safetensors
Moshi
Turkish
Hindi
speech-to-speech-translation
simultaneous-translation
mimi
lora
tpu
turkish
hindi
Eval Results (legacy)
Instructions to use tiny-aya-translate/tr-hi-s2st-v0.3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use tiny-aya-translate/tr-hi-s2st-v0.3 with PEFT:
Task type is invalid.
- Moshi
How to use tiny-aya-translate/tr-hi-s2st-v0.3 with Moshi:
# pip install moshi # Run the interactive web server python -m moshi.server --hf-repo "tiny-aya-translate/tr-hi-s2st-v0.3" # Then open https://localhost:8998 in your browser
# pip install moshi import torch from moshi.models import loaders # Load checkpoint info from HuggingFace checkpoint = loaders.CheckpointInfo.from_hf_repo("tiny-aya-translate/tr-hi-s2st-v0.3") # Load the Mimi audio codec mimi = checkpoint.get_mimi(device="cuda") mimi.set_num_codebooks(8) # Encode audio (24kHz, mono) wav = torch.randn(1, 1, 24000 * 10) # [batch, channels, samples] with torch.no_grad(): codes = mimi.encode(wav.cuda()) decoded = mimi.decode(codes) - Notebooks
- Google Colab
- Kaggle
model card: light emoji pass on section headers
Browse files
README.md
CHANGED
|
@@ -26,7 +26,7 @@ model-index:
|
|
| 26 |
# eval/subsets/* -- procedure in docs/evals-runbook.md
|
| 27 |
---
|
| 28 |
|
| 29 |
-
# TinyAya — Turkish⇄Hindi Speech-to-Speech Translation (v0.3)
|
| 30 |
|
| 31 |
> ✅ **Training complete (2026-07-19).** The long-horizon run
|
| 32 |
> ([`v0.3-long-horizon-mh-r2`](https://wandb.ai/cataluna84/tinyaya-stage2-tpu/runs/xzcb60bl))
|
|
@@ -51,7 +51,7 @@ earlier versions trained audio-only due to a loader bug, disclosed below.
|
|
| 51 |
- **Languages:** Turkish (`tr`), Hindi (`hi`)
|
| 52 |
- **Previous version:** [`tr-hi-s2st-v0.2`](https://huggingface.co/tiny-aya-translate/tr-hi-s2st-v0.2)
|
| 53 |
|
| 54 |
-
## Training run
|
| 55 |
|
| 56 |
**Run:** [`v0.3-long-horizon-mh-r2` (xzcb60bl)](https://wandb.ai/cataluna84/tinyaya-stage2-tpu/runs/xzcb60bl)
|
| 57 |
— TPU **v6e-16** (4 hosts × 4 chips, multi-host data-parallel), global batch 32,
|
|
@@ -80,7 +80,7 @@ notes: `train/audio_loss` shows upward steps at the curriculum onsets
|
|
| 80 |
`train/audio_loss_full` (unweighted all-codebook mean, logged natively) for the
|
| 81 |
jump-free audio learning curve.
|
| 82 |
|
| 83 |
-
## Listen: audio samples (click ▶ to play)
|
| 84 |
|
| 85 |
Inline audio demos generated **on the TPU during training** every 5,000 steps —
|
| 86 |
4 s, greedy, free-running audio (text stream teacher-forced). Final milestone,
|
|
@@ -118,7 +118,7 @@ The same clips are browsable with a step slider in the
|
|
| 118 |
[W&B run's](https://wandb.ai/cataluna84/tinyaya-stage2-tpu/runs/xzcb60bl)
|
| 119 |
`audio/` media panels.
|
| 120 |
|
| 121 |
-
## Checkpoints
|
| 122 |
|
| 123 |
All released checkpoints are browsable **directly in this repo's file tree**
|
| 124 |
under [`checkpoints/`](https://huggingface.co/tiny-aya-translate/tr-hi-s2st-v0.3/tree/main/checkpoints)
|
|
@@ -128,7 +128,7 @@ under [`checkpoints/`](https://huggingface.co/tiny-aya-translate/tr-hi-s2st-v0.3
|
|
| 128 |
|
| 129 |
| checkpoint | val composite ↓ | browse |
|
| 130 |
|---|---|---|
|
| 131 |
-
| **`best` (step 62,750)** | **2.9048** | [checkpoints/best](https://huggingface.co/tiny-aya-translate/tr-hi-s2st-v0.3/tree/main/checkpoints/best) |
|
| 132 |
| `step-65250` (final) | 2.9084 | [checkpoints/step-65250](https://huggingface.co/tiny-aya-translate/tr-hi-s2st-v0.3/tree/main/checkpoints/step-65250) |
|
| 133 |
| `step-60000` | 2.9191 | [checkpoints/step-60000](https://huggingface.co/tiny-aya-translate/tr-hi-s2st-v0.3/tree/main/checkpoints/step-60000) |
|
| 134 |
| `step-54000` | 2.9307 | [checkpoints/step-54000](https://huggingface.co/tiny-aya-translate/tr-hi-s2st-v0.3/tree/main/checkpoints/step-54000) |
|
|
@@ -146,7 +146,7 @@ programmatic loading — `revision="best"`, `revision="step-60000"`, etc. This
|
|
| 146 |
is the interim ladder; the **full per-1,000 suite (78 checkpoints)** is
|
| 147 |
published at the public flip.
|
| 148 |
|
| 149 |
-
## Evaluation
|
| 150 |
|
| 151 |
**Published so far: training-time validation metrics only** (the table above —
|
| 152 |
teacher-forced, fixed 3,200-sample gate, synthetic references). The end-task
|
|
@@ -313,7 +313,7 @@ for earlier versions (v0.2 included) used the broken decoding and understate AR
|
|
| 313 |
quality**. Fixed in `scripts/eval_checkpoint.py`; all v0.3 release numbers use the
|
| 314 |
corrected loop.
|
| 315 |
|
| 316 |
-
## Release design: the checkpoint suite you will get
|
| 317 |
|
| 318 |
This repo (**`tiny-aya-translate/tr-hi-s2st-v0.3`**, private during training,
|
| 319 |
public at release) follows the Pythia/OLMo one-branch-per-checkpoint convention,
|
|
@@ -360,7 +360,7 @@ checkpoint gains teacher-forced text **chrF/BLEU** backfilled at its own step
|
|
| 360 |
| Release evals (ASR-chrF++ / MOS / BLASER) | ☐ pending — harness ready (`scripts/eval_release.py`) |
|
| 361 |
| Optional WSD anneal leg from best checkpoint | ☐ decision pending |
|
| 362 |
|
| 363 |
-
## Acknowledgements
|
| 364 |
|
| 365 |
Trained on Cloud TPU **v6e-16** provided by **Google's TPU Research Cloud (TRC)**.
|
| 366 |
|
|
|
|
| 26 |
# eval/subsets/* -- procedure in docs/evals-runbook.md
|
| 27 |
---
|
| 28 |
|
| 29 |
+
# 🗣️🔁 TinyAya — Turkish⇄Hindi Speech-to-Speech Translation (v0.3)
|
| 30 |
|
| 31 |
> ✅ **Training complete (2026-07-19).** The long-horizon run
|
| 32 |
> ([`v0.3-long-horizon-mh-r2`](https://wandb.ai/cataluna84/tinyaya-stage2-tpu/runs/xzcb60bl))
|
|
|
|
| 51 |
- **Languages:** Turkish (`tr`), Hindi (`hi`)
|
| 52 |
- **Previous version:** [`tr-hi-s2st-v0.2`](https://huggingface.co/tiny-aya-translate/tr-hi-s2st-v0.2)
|
| 53 |
|
| 54 |
+
## ⚡ Training run
|
| 55 |
|
| 56 |
**Run:** [`v0.3-long-horizon-mh-r2` (xzcb60bl)](https://wandb.ai/cataluna84/tinyaya-stage2-tpu/runs/xzcb60bl)
|
| 57 |
— TPU **v6e-16** (4 hosts × 4 chips, multi-host data-parallel), global batch 32,
|
|
|
|
| 80 |
`train/audio_loss_full` (unweighted all-codebook mean, logged natively) for the
|
| 81 |
jump-free audio learning curve.
|
| 82 |
|
| 83 |
+
## 🎧 Listen: audio samples (click ▶ to play)
|
| 84 |
|
| 85 |
Inline audio demos generated **on the TPU during training** every 5,000 steps —
|
| 86 |
4 s, greedy, free-running audio (text stream teacher-forced). Final milestone,
|
|
|
|
| 118 |
[W&B run's](https://wandb.ai/cataluna84/tinyaya-stage2-tpu/runs/xzcb60bl)
|
| 119 |
`audio/` media panels.
|
| 120 |
|
| 121 |
+
## 📦 Checkpoints
|
| 122 |
|
| 123 |
All released checkpoints are browsable **directly in this repo's file tree**
|
| 124 |
under [`checkpoints/`](https://huggingface.co/tiny-aya-translate/tr-hi-s2st-v0.3/tree/main/checkpoints)
|
|
|
|
| 128 |
|
| 129 |
| checkpoint | val composite ↓ | browse |
|
| 130 |
|---|---|---|
|
| 131 |
+
| 🏆 **`best` (step 62,750)** | **2.9048** | [checkpoints/best](https://huggingface.co/tiny-aya-translate/tr-hi-s2st-v0.3/tree/main/checkpoints/best) |
|
| 132 |
| `step-65250` (final) | 2.9084 | [checkpoints/step-65250](https://huggingface.co/tiny-aya-translate/tr-hi-s2st-v0.3/tree/main/checkpoints/step-65250) |
|
| 133 |
| `step-60000` | 2.9191 | [checkpoints/step-60000](https://huggingface.co/tiny-aya-translate/tr-hi-s2st-v0.3/tree/main/checkpoints/step-60000) |
|
| 134 |
| `step-54000` | 2.9307 | [checkpoints/step-54000](https://huggingface.co/tiny-aya-translate/tr-hi-s2st-v0.3/tree/main/checkpoints/step-54000) |
|
|
|
|
| 146 |
is the interim ladder; the **full per-1,000 suite (78 checkpoints)** is
|
| 147 |
published at the public flip.
|
| 148 |
|
| 149 |
+
## 📊 Evaluation
|
| 150 |
|
| 151 |
**Published so far: training-time validation metrics only** (the table above —
|
| 152 |
teacher-forced, fixed 3,200-sample gate, synthetic references). The end-task
|
|
|
|
| 313 |
quality**. Fixed in `scripts/eval_checkpoint.py`; all v0.3 release numbers use the
|
| 314 |
corrected loop.
|
| 315 |
|
| 316 |
+
## 🚀 Release design: the checkpoint suite you will get
|
| 317 |
|
| 318 |
This repo (**`tiny-aya-translate/tr-hi-s2st-v0.3`**, private during training,
|
| 319 |
public at release) follows the Pythia/OLMo one-branch-per-checkpoint convention,
|
|
|
|
| 360 |
| Release evals (ASR-chrF++ / MOS / BLASER) | ☐ pending — harness ready (`scripts/eval_release.py`) |
|
| 361 |
| Optional WSD anneal leg from best checkpoint | ☐ decision pending |
|
| 362 |
|
| 363 |
+
## 🙏 Acknowledgements
|
| 364 |
|
| 365 |
Trained on Cloud TPU **v6e-16** provided by **Google's TPU Research Cloud (TRC)**.
|
| 366 |
|