poeroz commited on
Commit
f75d4e8
·
verified ·
1 Parent(s): 284a06e

Update README

Browse files
Files changed (1) hide show
  1. README.md +4 -14
README.md CHANGED
@@ -17,15 +17,6 @@ BayLing-Duplex is a native full-duplex speech dialogue model. It listens and spe
17
 
18
  BayLing-Duplex represents user speech, assistant text, and assistant speech as a single multi-channel interleaved autoregressive sequence. Turn-taking, interruption handling, text planning, and speech-token generation are all expressed as next-token prediction.
19
 
20
- The default released layout uses a `10:5:10` interleave ratio:
21
-
22
- ```text
23
- Block b:
24
- user speech tokens x[bN : (b+1)N]
25
- assistant text tokens z[bM : (b+1)M]
26
- assistant speech tokens y[bN : (b+1)N]
27
- ```
28
-
29
  The text channel carries dialogue-state tokens such as `[SILENCE]`, `<|assistant|>`, `[PAD]`, and `[EPAD]`, so no extra classifier head, VAD, scheduler, or finite-state turn-taking controller is required at inference time.
30
 
31
  ## Highlights
@@ -33,7 +24,6 @@ The text channel carries dialogue-state tokens such as `[SILENCE]`, `<|assistant
33
  - Native full-duplex speech dialogue: the model can listen while speaking.
34
  - Single autoregressive decoding path for timing decisions, text, and speech tokens.
35
  - Block-wise multi-channel interleaving that preserves contiguous assistant text.
36
- - Minimal `BayLingDuplex` Python API and CLI for model loading, tokenization, decoding, and audio synthesis.
37
 
38
  ## Model Weights
39
 
@@ -46,13 +36,13 @@ pip install -U huggingface_hub
46
  hf auth login
47
 
48
  mkdir -p models
49
- HF_ENDPOINT=https://huggingface.co hf download BayLing-Models/BayLing-Duplex \
50
  --repo-type model \
51
  --local-dir models/bayling_duplex_model
52
- HF_ENDPOINT=https://huggingface.co hf download zai-org/glm-4-voice-tokenizer \
53
  --repo-type model \
54
  --local-dir models/speech_tokenizer
55
- HF_ENDPOINT=https://huggingface.co hf download zai-org/glm-4-voice-decoder \
56
  --repo-type model \
57
  --local-dir models/speech_decoder
58
  ```
@@ -162,7 +152,7 @@ See [LICENSE](LICENSE) and [NOTICE.md](NOTICE.md).
162
  ```bibtex
163
  @misc{baylingduplextbd,
164
  title = {BayLing-Duplex: Native Full-Duplex Speech Dialogue with a Single Autoregressive LLM},
165
- author = {{BayLing-Duplex Team}},
166
  year = {2026},
167
  note = {Manuscript}
168
  }
 
17
 
18
  BayLing-Duplex represents user speech, assistant text, and assistant speech as a single multi-channel interleaved autoregressive sequence. Turn-taking, interruption handling, text planning, and speech-token generation are all expressed as next-token prediction.
19
 
 
 
 
 
 
 
 
 
 
20
  The text channel carries dialogue-state tokens such as `[SILENCE]`, `<|assistant|>`, `[PAD]`, and `[EPAD]`, so no extra classifier head, VAD, scheduler, or finite-state turn-taking controller is required at inference time.
21
 
22
  ## Highlights
 
24
  - Native full-duplex speech dialogue: the model can listen while speaking.
25
  - Single autoregressive decoding path for timing decisions, text, and speech tokens.
26
  - Block-wise multi-channel interleaving that preserves contiguous assistant text.
 
27
 
28
  ## Model Weights
29
 
 
36
  hf auth login
37
 
38
  mkdir -p models
39
+ hf download BayLing-Models/BayLing-Duplex \
40
  --repo-type model \
41
  --local-dir models/bayling_duplex_model
42
+ hf download zai-org/glm-4-voice-tokenizer \
43
  --repo-type model \
44
  --local-dir models/speech_tokenizer
45
+ hf download zai-org/glm-4-voice-decoder \
46
  --repo-type model \
47
  --local-dir models/speech_decoder
48
  ```
 
152
  ```bibtex
153
  @misc{baylingduplextbd,
154
  title = {BayLing-Duplex: Native Full-Duplex Speech Dialogue with a Single Autoregressive LLM},
155
+ author = {Qingkai Fang and Shoutao Guo and Yang Feng},
156
  year = {2026},
157
  note = {Manuscript}
158
  }