Nanthasit commited on
Commit
a4adbac
·
verified ·
1 Parent(s): 316ae0a

cron-eval: add metadata eval result for sakthai-coder-1.5b

Browse files
.eval_results/cron-eval-Nanthasit_sakthai-coder-1.5b-20260801T072854Z.yaml ADDED
@@ -0,0 +1,63 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ eval_run_id: cron-sakthai-coder-1.5b-20260801T072854Z
2
+ model_id: Nanthasit/sakthai-coder-1.5b
3
+ result_type: metadata
4
+ type: metadata_cron
5
+ timestamp: '2026-08-01T07:28:54.949262+00:00'
6
+ metrics:
7
+ - name: pass@1 (HumanEval, base ref)
8
+ value: 74.4
9
+ dataset: HumanEval
10
+ task: text-generation
11
+ verified: false
12
+ - name: pass@1 (MBPP, base ref)
13
+ value: 71.2
14
+ dataset: MBPP
15
+ task: text-generation
16
+ verified: false
17
+ - name: pass@1 (MultiPL-E Python, base ref)
18
+ value: 65.3
19
+ dataset: MultiPL-E
20
+ task: text-generation
21
+ verified: false
22
+ - name: downloads
23
+ value: 151
24
+ dataset: Hugging Face Hub
25
+ task: popularity
26
+ verified: true
27
+ summary:
28
+ pipeline_tag: text-generation
29
+ license: apache-2.0
30
+ base_model: Qwen/Qwen2.5-Coder-1.5B-Instruct
31
+ languages:
32
+ - en
33
+ datasets:
34
+ - Nanthasit/sakthai-combined-v6
35
+ - Nanthasit/sakthai-combined-v7
36
+ - Nanthasit/sakthai-bench-v2
37
+ - Nanthasit/sakthai-irrelevance-supplement
38
+ downloads: 151
39
+ likes: 0
40
+ commit: 316ae0a1e058b1e92286fa7721bde529aee2ba08
41
+ last_modified: '2026-08-01T05:28:15+00:00'
42
+ tags:
43
+ - gguf
44
+ - code
45
+ - coder
46
+ - qwen2.5
47
+ - qwen2.5-coder
48
+ - llama-cpp
49
+ - llama.cpp
50
+ - ollama
51
+ - code-generation
52
+ - tool-calling
53
+ - conversational
54
+ - cpu-inference
55
+ - small-language-model
56
+ - offline
57
+ - sakthai
58
+ - house-of-sak
59
+ - text-generation
60
+ - en
61
+ - dataset:Nanthasit/sakthai-combined-v6
62
+ - dataset:Nanthasit/sakthai-combined-v7
63
+ notes: Metadata eval snapshot; no live inference run performed in cron job.