Attribute as quantised child of Adobe Joint SpeakerID; drop GitHub fork links
Browse files
README.md
CHANGED
|
@@ -3,6 +3,7 @@ license: other
|
|
| 3 |
license_name: adobe-research-license
|
| 4 |
license_link: https://github.com/adobe-research/speaker-identification/blob/main/LICENSE.md
|
| 5 |
library_name: pytorch
|
|
|
|
| 6 |
tags:
|
| 7 |
- speaker-identification
|
| 8 |
- quantization
|
|
@@ -13,26 +14,37 @@ tags:
|
|
| 13 |
|
| 14 |
# Joint SpeakerID INT4 (weight-only)
|
| 15 |
|
| 16 |
-
4-bit group-wise weight-only quantisation of the Joint Speaker Identifier
|
| 17 |
-
|
| 18 |
-
([Interspeech 2024](https://arxiv.org/abs/2407.12094))
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19 |
|
| 20 |
| Metric | Value |
|
| 21 |
|---|---|
|
| 22 |
| Precision | **83.33** |
|
| 23 |
-
| Δ vs FP32 | **+4.46** |
|
| 24 |
| F1 | 60.24 |
|
| 25 |
| Accuracy | 63.87 |
|
| 26 |
| Throughput | 12.09 examples/s (Apple M3 Pro, MPS, batch 2) |
|
| 27 |
-
| In-memory size | 294 MB (FP32: 1633 MB) |
|
|
|
|
|
|
|
| 28 |
|
| 29 |
-
|
| 30 |
|
| 31 |
-
|
| 32 |
-
([hmarchant/speaker-id-joint-int8](https://huggingface.co/hmarchant/speaker-id-joint-int8)),
|
| 33 |
-
which matches FP32 precision/F1/accuracy.
|
| 34 |
|
| 35 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
|
| 37 |
## Files
|
| 38 |
|
|
@@ -43,16 +55,10 @@ Code and eval tables: [HugoMarchant/speaker-identification-quantisation](https:/
|
|
| 43 |
|
| 44 |
```python
|
| 45 |
from huggingface_hub import hf_hub_download
|
| 46 |
-
from device_utils import apply_cuda_shims
|
| 47 |
-
apply_cuda_shims()
|
| 48 |
-
from model_io import load_quantized_bundle
|
| 49 |
|
| 50 |
path = hf_hub_download("hmarchant/speaker-id-joint-int4", "model.pt")
|
| 51 |
-
model, config, tokenizer, qcfg, info, device = load_quantized_bundle(path)
|
| 52 |
```
|
| 53 |
|
| 54 |
-
Requires the companion GitHub repo.
|
| 55 |
-
|
| 56 |
## License
|
| 57 |
|
| 58 |
Derived from Adobe Research Speaker Identification. The
|
|
|
|
| 3 |
license_name: adobe-research-license
|
| 4 |
license_link: https://github.com/adobe-research/speaker-identification/blob/main/LICENSE.md
|
| 5 |
library_name: pytorch
|
| 6 |
+
base_model: FacebookAI/roberta-large
|
| 7 |
tags:
|
| 8 |
- speaker-identification
|
| 9 |
- quantization
|
|
|
|
| 14 |
|
| 15 |
# Joint SpeakerID INT4 (weight-only)
|
| 16 |
|
| 17 |
+
4-bit group-wise weight-only quantisation of the Joint Speaker Identifier from
|
| 18 |
+
[adobe-research/speaker-identification](https://github.com/adobe-research/speaker-identification)
|
| 19 |
+
([Interspeech 2024](https://arxiv.org/abs/2407.12094)).
|
| 20 |
+
|
| 21 |
+
This checkpoint is a **quantised child** of Adobe Research’s original Joint
|
| 22 |
+
Speaker Identifier (FP32). The architecture and trained weights are Adobe’s;
|
| 23 |
+
only the Linear weights were packed to INT4 (group size 64). No additional
|
| 24 |
+
training.
|
| 25 |
|
| 26 |
| Metric | Value |
|
| 27 |
|---|---|
|
| 28 |
| Precision | **83.33** |
|
| 29 |
+
| Δ vs FP32 parent | **+4.46** |
|
| 30 |
| F1 | 60.24 |
|
| 31 |
| Accuracy | 63.87 |
|
| 32 |
| Throughput | 12.09 examples/s (Apple M3 Pro, MPS, batch 2) |
|
| 33 |
+
| In-memory size | 294 MB (FP32 parent: 1633 MB) |
|
| 34 |
+
|
| 35 |
+
Smallest Joint checkpoint (~5.6× vs the FP32 parent). Precision rises because the model becomes more conservative; recall, F1, and accuracy drop versus the FP32/INT8 parent. Unpack-on-MPS is slower than FP16/INT8.
|
| 36 |
|
| 37 |
+
The INT8 sibling ([hmarchant/speaker-id-joint-int8](https://huggingface.co/hmarchant/speaker-id-joint-int8)) matches the FP32 parent on precision/F1/accuracy.
|
| 38 |
|
| 39 |
+
## Parent model
|
|
|
|
|
|
|
| 40 |
|
| 41 |
+
| | |
|
| 42 |
+
|---|---|
|
| 43 |
+
| Parent | Joint Speaker Identifier (FP32), Adobe Research |
|
| 44 |
+
| Original weights | `logs/mediasum-joint/best-model.mdl` in [adobe-research/speaker-identification](https://github.com/adobe-research/speaker-identification) |
|
| 45 |
+
| Paper | [Identifying Speakers in Dialogue Transcripts: A Text-based Approach Using Pretrained Language Models](https://arxiv.org/abs/2407.12094) (Interspeech 2024) |
|
| 46 |
+
| Backbone | [FacebookAI/roberta-large](https://huggingface.co/FacebookAI/roberta-large) |
|
| 47 |
+
| Relation | weight-only INT4 quantisation of the Adobe Joint checkpoint |
|
| 48 |
|
| 49 |
## Files
|
| 50 |
|
|
|
|
| 55 |
|
| 56 |
```python
|
| 57 |
from huggingface_hub import hf_hub_download
|
|
|
|
|
|
|
|
|
|
| 58 |
|
| 59 |
path = hf_hub_download("hmarchant/speaker-id-joint-int4", "model.pt")
|
|
|
|
| 60 |
```
|
| 61 |
|
|
|
|
|
|
|
| 62 |
## License
|
| 63 |
|
| 64 |
Derived from Adobe Research Speaker Identification. The
|