Update README
Browse files
README.md
CHANGED
|
@@ -17,15 +17,6 @@ BayLing-Duplex is a native full-duplex speech dialogue model. It listens and spe
|
|
| 17 |
|
| 18 |
BayLing-Duplex represents user speech, assistant text, and assistant speech as a single multi-channel interleaved autoregressive sequence. Turn-taking, interruption handling, text planning, and speech-token generation are all expressed as next-token prediction.
|
| 19 |
|
| 20 |
-
The default released layout uses a `10:5:10` interleave ratio:
|
| 21 |
-
|
| 22 |
-
```text
|
| 23 |
-
Block b:
|
| 24 |
-
user speech tokens x[bN : (b+1)N]
|
| 25 |
-
assistant text tokens z[bM : (b+1)M]
|
| 26 |
-
assistant speech tokens y[bN : (b+1)N]
|
| 27 |
-
```
|
| 28 |
-
|
| 29 |
The text channel carries dialogue-state tokens such as `[SILENCE]`, `<|assistant|>`, `[PAD]`, and `[EPAD]`, so no extra classifier head, VAD, scheduler, or finite-state turn-taking controller is required at inference time.
|
| 30 |
|
| 31 |
## Highlights
|
|
@@ -33,7 +24,6 @@ The text channel carries dialogue-state tokens such as `[SILENCE]`, `<|assistant
|
|
| 33 |
- Native full-duplex speech dialogue: the model can listen while speaking.
|
| 34 |
- Single autoregressive decoding path for timing decisions, text, and speech tokens.
|
| 35 |
- Block-wise multi-channel interleaving that preserves contiguous assistant text.
|
| 36 |
-
- Minimal `BayLingDuplex` Python API and CLI for model loading, tokenization, decoding, and audio synthesis.
|
| 37 |
|
| 38 |
## Model Weights
|
| 39 |
|
|
@@ -46,13 +36,13 @@ pip install -U huggingface_hub
|
|
| 46 |
hf auth login
|
| 47 |
|
| 48 |
mkdir -p models
|
| 49 |
-
|
| 50 |
--repo-type model \
|
| 51 |
--local-dir models/bayling_duplex_model
|
| 52 |
-
|
| 53 |
--repo-type model \
|
| 54 |
--local-dir models/speech_tokenizer
|
| 55 |
-
|
| 56 |
--repo-type model \
|
| 57 |
--local-dir models/speech_decoder
|
| 58 |
```
|
|
@@ -162,7 +152,7 @@ See [LICENSE](LICENSE) and [NOTICE.md](NOTICE.md).
|
|
| 162 |
```bibtex
|
| 163 |
@misc{baylingduplextbd,
|
| 164 |
title = {BayLing-Duplex: Native Full-Duplex Speech Dialogue with a Single Autoregressive LLM},
|
| 165 |
-
author = {
|
| 166 |
year = {2026},
|
| 167 |
note = {Manuscript}
|
| 168 |
}
|
|
|
|
| 17 |
|
| 18 |
BayLing-Duplex represents user speech, assistant text, and assistant speech as a single multi-channel interleaved autoregressive sequence. Turn-taking, interruption handling, text planning, and speech-token generation are all expressed as next-token prediction.
|
| 19 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 20 |
The text channel carries dialogue-state tokens such as `[SILENCE]`, `<|assistant|>`, `[PAD]`, and `[EPAD]`, so no extra classifier head, VAD, scheduler, or finite-state turn-taking controller is required at inference time.
|
| 21 |
|
| 22 |
## Highlights
|
|
|
|
| 24 |
- Native full-duplex speech dialogue: the model can listen while speaking.
|
| 25 |
- Single autoregressive decoding path for timing decisions, text, and speech tokens.
|
| 26 |
- Block-wise multi-channel interleaving that preserves contiguous assistant text.
|
|
|
|
| 27 |
|
| 28 |
## Model Weights
|
| 29 |
|
|
|
|
| 36 |
hf auth login
|
| 37 |
|
| 38 |
mkdir -p models
|
| 39 |
+
hf download BayLing-Models/BayLing-Duplex \
|
| 40 |
--repo-type model \
|
| 41 |
--local-dir models/bayling_duplex_model
|
| 42 |
+
hf download zai-org/glm-4-voice-tokenizer \
|
| 43 |
--repo-type model \
|
| 44 |
--local-dir models/speech_tokenizer
|
| 45 |
+
hf download zai-org/glm-4-voice-decoder \
|
| 46 |
--repo-type model \
|
| 47 |
--local-dir models/speech_decoder
|
| 48 |
```
|
|
|
|
| 152 |
```bibtex
|
| 153 |
@misc{baylingduplextbd,
|
| 154 |
title = {BayLing-Duplex: Native Full-Duplex Speech Dialogue with a Single Autoregressive LLM},
|
| 155 |
+
author = {Qingkai Fang and Shoutao Guo and Yang Feng},
|
| 156 |
year = {2026},
|
| 157 |
note = {Manuscript}
|
| 158 |
}
|