daavidhauser commited on
Commit
12e1d42
Β·
verified Β·
1 Parent(s): 18af05d

Rename Swift 1.5 fast variant to INT4 heads

Browse files
Files changed (2) hide show
  1. README.md +2 -2
  2. RELEASE_MANIFEST.json +2 -2
README.md CHANGED
@@ -36,7 +36,7 @@ Upstream checkpoint: [TheUnderscore/Swift-Qwen3.8-27b-W4A16-AWQ](https://hugging
36
 
37
  ## Performance
38
 
39
- | Measurement | Qwen β€” HyperQwen fast quant (W4A16 AutoRound) | Swift 1.0 | Swift 1.5 INT8 heads | Swift 1.5 fast |
40
  |---|---:|---:|---:|---:|
41
  | **Average request time ↓** | **108.1 s** | **66.2 s** | **72.2 s** | **68.2 s** |
42
  | **Average output tokens/task ↓** | **8,985** | **5,245** | **5,751** | **5,669** |
@@ -45,7 +45,7 @@ Upstream checkpoint: [TheUnderscore/Swift-Qwen3.8-27b-W4A16-AWQ](https://hugging
45
 
46
  ## Quality
47
 
48
- | Test | Qwen β€” HyperQwen fast quant (W4A16 AutoRound) | Swift 1.0 | Swift 1.5 INT8 heads | Swift 1.5 fast |
49
  |---|---:|---:|---:|---:|
50
  | **GSM8K β€” 200-question subset** | 97.5% | 98.0% | 98.0% | 97.5% |
51
  | **IFBench β€” 300 prompts, strict** | 74.0% | 73.3% | 73.7% | 72.3% |
 
36
 
37
  ## Performance
38
 
39
+ | Measurement | Qwen β€” HyperQwen fast quant (W4A16 AutoRound) | Swift 1.0 | Swift 1.5 INT8 heads | Swift 1.5 INT4 heads |
40
  |---|---:|---:|---:|---:|
41
  | **Average request time ↓** | **108.1 s** | **66.2 s** | **72.2 s** | **68.2 s** |
42
  | **Average output tokens/task ↓** | **8,985** | **5,245** | **5,751** | **5,669** |
 
45
 
46
  ## Quality
47
 
48
+ | Test | Qwen β€” HyperQwen fast quant (W4A16 AutoRound) | Swift 1.0 | Swift 1.5 INT8 heads | Swift 1.5 INT4 heads |
49
  |---|---:|---:|---:|---:|
50
  | **GSM8K β€” 200-question subset** | 97.5% | 98.0% | 98.0% | 97.5% |
51
  | **IFBench β€” 300 prompts, strict** | 74.0% | 73.3% | 73.7% | 72.3% |
RELEASE_MANIFEST.json CHANGED
@@ -18,8 +18,8 @@
18
  "sha256": "9646e189bb9cfb1f35467eece46b59faf73c5eb0cc9800993343947cd875594d"
19
  },
20
  "README.md": {
21
- "size": 5796,
22
- "sha256": "a736a2ef70f99ecef545c57d1ad505d85e170275f35f6ba1a8b02d04b85d0f42"
23
  },
24
  "RUNTIME.md": {
25
  "size": 2588,
 
18
  "sha256": "9646e189bb9cfb1f35467eece46b59faf73c5eb0cc9800993343947cd875594d"
19
  },
20
  "README.md": {
21
+ "size": 5808,
22
+ "sha256": "54794a55f9cadb8ee91e0ca88db2b59338d2de7d0708fc666542869fe64140f9"
23
  },
24
  "RUNTIME.md": {
25
  "size": 2588,