d4rkninja commited on
Commit
1e62180
·
verified ·
1 Parent(s): 666c98d

Upload evaluation/ft/SCORECARD.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. evaluation/ft/SCORECARD.md +45 -0
evaluation/ft/SCORECARD.md ADDED
@@ -0,0 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # DarkLab 3-Model PEFT Scorecard
2
+
3
+ **Generated:** 2026-09-18T06:00:18.662821+00:00
4
+ **Base:** `unsloth/LFM2.5-1.2B-Instruct`
5
+ **Scoring:** deterministic rubric v2 strict (domain tasks, not identity-only)
6
+ **Owner / creator:** DarkNinja Solutions / d4rkninja
7
+
8
+ ## Overall
9
+
10
+ | Metric | tanpo-fundraising |
11
+ |---| ---: |
12
+ | **Rubric overall %** | 95.2% |
13
+ | Heuristic quality (0–10) | 7.45 |
14
+ | Tasks | 20 |
15
+
16
+ ## Narrative
17
+
18
+ - **Top domain score:** `tanpo-fundraising` at **95.2%** (on its own domain task set).
19
+ - **Spread across domains (max−min):** 0.0 pts.
20
+ - Each model is scored on **domain-specific** tasks (marketing / product / hiring / deals / fundraising). Overall % is **not** cross-domain comparable like-for-like — use per-category charts.
21
+ - Unsolicited identity dumps are penalized; capability tasks expect structure, specificity, and next actions.
22
+
23
+ ## tanpo-fundraising — per-category
24
+
25
+ | Category | Rubric % | Quality | n |
26
+ |---|---:|---:|---:|
27
+ | `ask_use_of_funds` | 100.0% | 8.50 | 2 |
28
+ | `diligence_qa` | 100.0% | 7.90 | 2 |
29
+ | `dilution_round_structure` | 66.7% | 4.56 | 2 |
30
+ | `identity_guardrails` | 85.7% | 6.14 | 2 |
31
+ | `investor_update` | 100.0% | 9.00 | 2 |
32
+ | `market_why_now` | 100.0% | 7.30 | 2 |
33
+ | `pitch_narrative` | 100.0% | 7.90 | 2 |
34
+ | `runway_milestone_ask` | 100.0% | 8.50 | 2 |
35
+ | `traction_story` | 100.0% | 7.30 | 2 |
36
+ | `valuation_framing` | 100.0% | 7.40 | 2 |
37
+
38
+ - LoRA: `C:\Users\alien\tanpo-fundraising-lora`
39
+ - Load 8.6s · Gen 528.7s
40
+
41
+ ## Limitations
42
+
43
+ - Automated rubric ≠ human preference.
44
+ - Domain models are evaluated on different task sets — compare within domain.
45
+ - Strict v2 reduces easy keyword passes; valid paraphrases can still false-negative.