Add complete model with Dia-1.6B weights

README.md

@@ -0,0 +1,51 @@
+---
+license: apache-2.0
+language:
+  - it
+  - en
+  - pl
+  - de
+  - fr
+base_model:
+  - nari-labs/Dia-1.6B
+pipeline_tag: text-to-speech
+tags:
+  - speech
+  - dia
+  - text-to-speech
+  - vocal
+  - voice
+---
+
+# Aurora-1.6B: Multilingual Emotion and Singing TTS Model
+
+A fine-tuned version of Dia-1.6B trained on multilingual and singing datasets, with full emotion control and zero-shot voice cloning.
+
+## Features
+
+- **Multilingual Support**  
+  Natural speech in Italian, English, Polish, German, French, and more.  
+- **Emotion Control**  
+  Use speaker tags or emotion tokens (e.g. `[S1]`, `[happy]`, `[sad]`) to modulate expressiveness.  
+- **Singing Capabilities**  
+  Generate melodic vocals by providing singing prompts or style references.  
+- **Zero-Shot Voice Cloning**  
+  Clone any speaker’s voice from a short audio sample.  
+- **Nonverbal Vocalizations**  
+  Embed realistic effects like `(laughs)`, `(coughs)`, or `(sighs)` inline.
+
+## Usage
+
+```python
+from dia.model import Dia
+import soundfile as sf
+
+# Load the Aurora-1.6B model
+model = Dia.from_pretrained("Lorenzob/aurora-1.6b")
+
+# Generate a happy spoken line followed by singing
+text = "[S1][happy] Hello world! Now sing 'Happy Birthday to You'"
+audio = model.generate(text)
+
+# Save output at 44.1 kHz
+sf.write("output.wav", audio, 44100)

config.json

@@ -0,0 +1,50 @@
+{
+  "data": {
+    "audio_bos_value": 1026,
+    "audio_eos_value": 1024,
+    "audio_length": 3072,
+    "audio_pad_value": 1025,
+    "channels": 9,
+    "delay_pattern": [
+      0,
+      8,
+      9,
+      10,
+      11,
+      12,
+      13,
+      14,
+      15
+    ],
+    "text_length": 1024,
+    "text_pad_value": 0
+  },
+  "model": {
+    "decoder": {
+      "cross_head_dim": 128,
+      "cross_query_heads": 16,
+      "gqa_head_dim": 128,
+      "gqa_query_heads": 16,
+      "kv_heads": 4,
+      "n_embd": 2048,
+      "n_hidden": 8192,
+      "n_layer": 18
+    },
+    "dropout": 0.0,
+    "encoder": {
+      "head_dim": 128,
+      "n_embd": 1024,
+      "n_head": 16,
+      "n_hidden": 4096,
+      "n_layer": 12
+    },
+    "normalization_layer_epsilon": 1e-05,
+    "rope_max_timescale": 10000,
+    "rope_min_timescale": 1,
+    "src_vocab_size": 256,
+    "tgt_vocab_size": 1028,
+    "weight_dtype": "float32"
+  },
+  "training": {},
+  "version": "0.1"
+}

dia_multilingual_model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0a0c6599886863c6135855bf33b8e884eda4ed717e66f0b4fa228b54e7d17c6b
+size 3222742169

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:caba289b60f6d7d1e58fc744f4dc25aae88995fcca46be3d05e220b971486a26
+size 6444682848

model_info.json

@@ -0,0 +1,4 @@
+{
+  "description": "Fine-tuned Dia-1.6B model for multilingual TTS",
+  "base_model": "nari-labs/Dia-1.6B"
+}

model_state_dict.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c11035b70ed3142d63f5717c6d0c28de97da3e259639745c616d11235c6c2a70
+size 3222740023

special_tokens_map.json

@@ -0,0 +1,4 @@
+{
+  "bos_token": "<s>",
+  "eos_token": "</s>"
+}

tokenizer_config.json

@@ -0,0 +1,7 @@
+{
+  "bos_token": "<s>",
+  "eos_token": "</s>",
+  "model_max_length": 512,
+  "padding_side": "right",
+  "special_tokens_map_file": "special_tokens_map.json"
+}