Nanthasit commited on
Commit
bc8ec27
·
verified ·
1 Parent(s): f9bb9cf

Upload .eval_results/health-check-sakthai-coder-1.5b-2026-07-30-3.yaml with huggingface_hub

Browse files
.eval_results/health-check-sakthai-coder-1.5b-2026-07-30-3.yaml ADDED
@@ -0,0 +1,175 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ target_model:
2
+ id: Nanthasit/sakthai-coder-1.5b
3
+ slug: sakthai-coder-1.5b
4
+ eval_metadata:
5
+ schema: llm_cron
6
+ generated_at: '2026-07-30T22:46:05Z'
7
+ generated_by: sakthai-agent-cron
8
+ model_type: text-generation
9
+ popularity:
10
+ downloads: 93
11
+ likes: 0
12
+ max_sibling_downloads: 1599
13
+ dl_score: 6
14
+ likes_score: 0
15
+ score: 4
16
+ weight: 0.20
17
+ momentum:
18
+ age_days: 6.52
19
+ velocity: 14.27
20
+ max_sibling_velocity: 63.95
21
+ velocity_rank: 9
22
+ ratio_score: 22
23
+ rank_score: 20
24
+ score: 21
25
+ weight: 0.20
26
+ benchmarks:
27
+ model_index_present: true
28
+ metric_count: 4
29
+ all_verified: false
30
+ score: 60
31
+ weight: 0.25
32
+ entries:
33
+ - dataset: HumanEval
34
+ dataset_type: openai_humaneval
35
+ metric: 'pass@1 (base model reference)'
36
+ metric_type: 'pass@1'
37
+ value: 74.40
38
+ verified: false
39
+ - dataset: MBPP
40
+ dataset_type: mbpp
41
+ metric: 'pass@1 (base model reference)'
42
+ metric_type: 'pass@1'
43
+ value: 71.20
44
+ verified: false
45
+ - dataset: MultiPL-E (Python)
46
+ dataset_type: multipl_e
47
+ metric: 'pass@1 (base model reference)'
48
+ metric_type: 'pass@1'
49
+ value: 65.30
50
+ verified: false
51
+ - dataset: SakThai Coding Suite (internal)
52
+ dataset_type: custom
53
+ metric: 'pass@1 (fine-tuned model, internal)'
54
+ metric_type: 'pass@1'
55
+ value: 100
56
+ verified: false
57
+ card_quality:
58
+ license: apache-2.0
59
+ base_model: Qwen/Qwen2.5-Coder-1.5B-Instruct
60
+ tags_count: 10
61
+ datasets_count: 3
62
+ readme_bytes: 15490
63
+ score: 100
64
+ weight: 0.20
65
+ repo_summary:
66
+ total_siblings: 1558
67
+ total_storage_bytes: 1218622744
68
+ total_gb: 1.13
69
+ weight_files:
70
+ - path: qwen2.5-coder-1.5b-instruct-q4_k_m.gguf
71
+ size_bytes: 1117320768
72
+ has_weights: true
73
+ config_exists: false
74
+ dev_artifact_dirs:
75
+ - .hypothesis
76
+ - .pytest_cache
77
+ - .ruff_cache
78
+ - .venv
79
+ dev_artifact_count: 4
80
+ hygiene:
81
+ score: 40
82
+ weight: 0.15
83
+ deductions:
84
+ dev_artifacts: 60
85
+ storage_bloat: 0
86
+ sibling_comparison:
87
+ - id: Nanthasit/sakthai-context-1.5b-merged
88
+ downloads: 1599
89
+ likes: 0
90
+ pipeline_tag: text-generation
91
+ - id: Nanthasit/sakthai-context-0.5b-merged
92
+ downloads: 1370
93
+ likes: 0
94
+ pipeline_tag: text-generation
95
+ - id: Nanthasit/sakthai-context-7b-merged
96
+ downloads: 744
97
+ likes: 0
98
+ pipeline_tag: text-generation
99
+ - id: Nanthasit/sakthai-context-7b-128k
100
+ downloads: 506
101
+ likes: 0
102
+ pipeline_tag: text-generation
103
+ - id: Nanthasit/sakthai-context-7b-tools
104
+ downloads: 399
105
+ likes: 0
106
+ pipeline_tag: text-generation
107
+ - id: Nanthasit/sakthai-embedding-multilingual
108
+ downloads: 362
109
+ likes: 0
110
+ pipeline_tag: sentence-similarity
111
+ - id: Nanthasit/sakthai-context-1.5b-tools
112
+ downloads: 349
113
+ likes: 0
114
+ pipeline_tag: text-generation
115
+ - id: Nanthasit/sakthai-vision-7b
116
+ downloads: 186
117
+ likes: 1
118
+ pipeline_tag: image-to-text
119
+ - id: Nanthasit/sakthai-tts-model
120
+ downloads: 150
121
+ likes: 0
122
+ pipeline_tag: text-to-speech
123
+ - id: Nanthasit/sakthai-context-0.5b-tools
124
+ downloads: 94
125
+ likes: 0
126
+ pipeline_tag: text-generation
127
+ - id: Nanthasit/sakthai-embedding
128
+ downloads: 23
129
+ likes: 0
130
+ pipeline_tag: sentence-similarity
131
+ - id: Nanthasit/sakthai-context-1.5b-tools-v2
132
+ downloads: 0
133
+ likes: 0
134
+ pipeline_tag: text-generation
135
+ - id: Nanthasit/sakthai-context-1.5b-merged-v2
136
+ downloads: 0
137
+ likes: 0
138
+ pipeline_tag: text-generation
139
+ - id: Nanthasit/sakthai-plus-1.5b
140
+ downloads: 0
141
+ likes: 0
142
+ pipeline_tag: text-generation
143
+ - id: Nanthasit/sakthai-plus-1.5b-lora
144
+ downloads: 0
145
+ likes: 0
146
+ pipeline_tag: text-generation
147
+ - id: Nanthasit/sakthai-plus-1.5b-coder
148
+ downloads: 0
149
+ likes: 0
150
+ pipeline_tag: text-generation
151
+ - id: Nanthasit/sakthai-coder-browser-lora
152
+ downloads: 0
153
+ likes: 0
154
+ pipeline_tag: null
155
+ - id: Nanthasit/sakthai-coder-browser
156
+ downloads: 0
157
+ likes: 0
158
+ pipeline_tag: text-generation
159
+ health_score:
160
+ overall: 46
161
+ popularity: 4
162
+ momentum: 21
163
+ benchmarks: 60
164
+ card_quality: 100
165
+ hygiene: 40
166
+ weighting: 'pop=20% mom=20% bench=25% card=20% hyg=15%'
167
+ delta:
168
+ score_change: 0
169
+ downloads_change: 0
170
+ likes_change: 0
171
+ from_prior: health-check-sakthai-coder-1.5b-2026-07-30-2.yaml
172
+ assessment:
173
+ status: stable
174
+ notes: No change in downloads/likes since previous check 5 minutes ago. Score unchanged at 46/100. GGUF-only coder model (1.04 GB, Q4_K_M, qwen2 arch, 32K context). Card complete with license/base_model/10 tags/3 datasets. 4 unverified benchmarks listed. 4 dev artifact directories penalizing hygiene score.
175
+ recommendation: Add verified benchmark results to model-index. Clean .venv, .pytest_cache, .ruff_cache, and .hypothesis directories from repo to improve hygiene score (could gain 15 points).