hans00 commited on
Commit
2cc7d35
·
verified ·
1 Parent(s): 4c15213

T3: speech tokens as CONTROL (special) vocab; BOS/EOS = start/stop_speech_token

Browse files
Files changed (6) hide show
  1. README.md +5 -3
  2. t3-f16.gguf +2 -2
  3. t3-f32.gguf +2 -2
  4. t3-q4_k_m.gguf +2 -2
  5. t3-q5_k_m.gguf +2 -2
  6. t3-q8_0.gguf +2 -2
README.md CHANGED
@@ -32,9 +32,11 @@ two runtimes.
32
  `t3-<quant>.gguf` is a stock `llama` arch GGUF holding only T3's
33
  30-layer Llama backbone (hidden 1024, MLP 4096, 16 heads, RoPE θ=10000)
34
  plus the speech-side embedding/head (`speech_emb` → `token_embd`,
35
- `speech_head` → `output`). Vocabulary is `no_vocab` speech tokens are
36
- integer IDs `0..8193`, fed to the model directly via the API rather than
37
- through a text tokenizer.
 
 
38
 
39
  | File | Size |
40
  | ----------------- | ------- |
 
32
  `t3-<quant>.gguf` is a stock `llama` arch GGUF holding only T3's
33
  30-layer Llama backbone (hidden 1024, MLP 4096, 16 heads, RoPE θ=10000)
34
  plus the speech-side embedding/head (`speech_emb` → `token_embd`,
35
+ `speech_head` → `output`). The vocabulary contains 8194 entries
36
+ (`<|speech_0|>` `<|speech_8193|>`), every one marked as a `CONTROL`
37
+ (special) token so llama.cpp's sampler / stop / grammar paths recognise
38
+ each speech ID. `BOS = 6561` (`start_speech_token`), `EOS = 6562`
39
+ (`stop_speech_token`); add_bos / add_eos default to false.
40
 
41
  | File | Size |
42
  | ----------------- | ------- |
t3-f16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:495d1a833a261e766c42eb2db43a76b1ebad203196a3052d3797b5a489c404ef
3
- size 1040462304
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2409e253de350c3f47d59dbfa9b2a27aab9a9f1c834e96e1048ba73a55127ac3
3
+ size 1040715552
t3-f32.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6d36fd0280c382c86954c3a152bee0e768d45a92c08e10f57e71f6f2812738ab
3
- size 2080657888
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:977f8d0770d511f65ec73e3cf8c48750dd0c6a1ed894c11f3e15a15de362b4fe
3
+ size 2080911136
t3-q4_k_m.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:70fd54c6c0916e4718d261ca8c54b79eeb48860d8cb4c9a7f5b41ed4a035ef87
3
- size 313908544
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cca0ae4361e10d38f7efe81d21de95961ade96ef5851113e170b15c6d60e5dc1
3
+ size 314161792
t3-q5_k_m.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8bf781919a52333b7c1b120032aaec5c416d6a76a23d8bea4c8e79315731bf98
3
- size 368696896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b53f36aa71a9e9c5aa25a1cea93273c235f22b21deaf12d200762d978e5c207b
3
+ size 368950144
t3-q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:60ca95725ba83954bad7414554a11c2f0f43f637c477da2584ea0d50203332d3
3
- size 552870688
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed6e6a967b62b77d6f4850851553d851159e3e052fe31b17df4a3666ac2f02e6
3
+ size 553123936