Polish model card and add leaderboard status

README.md

@@ -33,23 +33,25 @@ model-index:
 
 # Jumini-Ko-1.2B
 
-Jumini-Ko-1.2B is a Korean decoder-only language model trained from scratch for a university HW2 project. The checkpoint in this repository is the current best public refresh as of 2026-06-09: it replaces an earlier public upload after improving broad local Korean generation diagnostics.
+Jumini-Ko-1.2B is a Korean decoder-only language model trained from scratch for a university HW2 project. This repository hosts the current best public refresh as of 2026-06-09, replacing an earlier public checkpoint after measurable gains on local Korean generation diagnostics.
 
-This is a research checkpoint, not a production assistant. It is released to make the training artifact inspectable and reproducible, including known limitations and diagnostic results.
+This is a research checkpoint. It is released for inspection, reproduction, and course evaluation, with both strengths and failure modes documented.
 
-## Model Details
+## Release Snapshot
 
 | Field | Value |
 |---|---|
+| Model | `properly59/Jumini-Ko-1.2B` |
+| Public checkpoint | `clean7020` |
 | Parameters | 1,260,505,088 |
 | Architecture | Decoder-only Transformer, RoPE, RMSNorm, SwiGLU, GQA |
 | Layers / hidden size | 28 / 2048 |
 | Vocabulary | 128,000 tokens |
-| Export class | `LlamaForCausalLM`-compatible Transformers layout |
+| Export format | `LlamaForCausalLM`-compatible Transformers + Safetensors |
 | Primary language | Korean |
-| Training status | From-scratch pretraining + project SFT/probe stages |
-| Current public checkpoint | `clean7020` best-so-far refresh |
-| Replacement date | 2026-06-09 |
+| License | Apache-2.0 |
+| Release date | 2026-06-09 |
+| HF revision for current score appendix | `aec6d67bf3ce37e5845e0fcd8f05ad1deb322f50` |
 
 Source checkpoint:
 
@@ -57,7 +59,15 @@ Source checkpoint:
 jumini-ko-1.2b-firsttok7000-argmax-boundary-layernormshock-v1-last16-4gpu0123-mb8-probe25-rerun20260608 / step_00007020
 ```
 
-## How to Use
+## Highlights
+
+- From-scratch Korean 1.2B-class decoder-only model; not a fine-tune of Llama, Qwen, EXAONE, TinyLlama, or Gemma.
+- Replaced the original public HF upload after broad local Korean semantic pass@k improved from `0 / 240` to `21 / 240`.
+- Wins a size-adjacent local Korean specialization comparison against `TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T` on Korean semantic pass@33.
+- Ships with machine-readable validation, benchmark, replacement, and score appendix files.
+- Known weak point: greedy decoding remains unreliable, and strict heldout performance is still limited.
+
+## Quickstart
 
 ```python
 import torch
@@ -84,17 +94,17 @@ outputs = model.generate(
 print(tokenizer.decode(outputs[0], skip_special_tokens=True))
 ```
 
-The model does not currently ship with a polished chat template. Plain Korean prompts are recommended. Sampling is often more useful than greedy decoding for this checkpoint.
+Plain Korean prompts are recommended. The model does not currently ship with a polished chat template. Sampling is usually more useful than greedy decoding for this checkpoint.
 
-## Evaluation
+## Evaluation Summary
 
-The following results are local project diagnostics, not official leaderboard scores. They use deterministic rule-based verifiers on train-only Korean semantic sentinel prompts. No external teacher, model judge, or heldout prompt text is used for these diagnostics.
+The following numbers are local project diagnostics, not official leaderboard scores. They use deterministic rule-based verifiers on Korean sentinel prompts and public/proxy Korean multiple-choice subsets. No external teacher model or model-judge score is used for these local diagnostics.
 
 ### Public Refresh Evidence
 
 This upload replaced the earlier public `v3a6200` checkpoint because the broader local Korean sentinel improved from zero semantic hits to measurable pass@k behavior.
 
-| Diagnostic | Previous HF `v3a6200` | Current `clean7020` | Score Delta |
+| Diagnostic | Previous HF `v3a6200` | Current `clean7020` | Delta |
 |---|---:|---:|---:|
 | Stratified Korean semantic pass@k | 0 / 240 = 0.0 | 21 / 240 = 8.8 | +8.8 |
 | Stratified rollout pass rate | 0 / 2094 = 0.0 | 29 / 2105 = 1.4 | +1.4 |
@@ -102,7 +112,7 @@ This upload replaced the earlier public `v3a6200` checkpoint because the broader
 
 ### Jumini Score Appendix
 
-The comparison table below is intentionally compact. The fuller Jumini-only score record for the current public `clean7020` checkpoint is included in `jumini_internal_scores_20260609.json`. It includes completed score summaries for the current public model while omitting row-level prompt text, completions, and non-exported descendant checkpoints.
+The compact comparison table is not the full score record. A fuller Jumini-only score appendix for the current public `clean7020` checkpoint is included in `jumini_internal_scores_20260609.json`. It contains completed score summaries while omitting row-level prompt text, completions, and non-exported descendant checkpoints.
 
 Core clean7020 diagnostics:
 
@@ -130,11 +140,11 @@ Korean public/proxy stagegate scores:
 | HRM8K subset | 2 / 60 = 3.3 |
 | GSM8K-Ko subset | 0 / 100 = 0.0 |
 
-Additional diagnostic scores in `jumini_internal_scores_20260609.json` include category breakdowns, strict heldout hit IDs, boundary-pair logit margins, and train-only generation forensics. The key boundary diagnostics were `327 / 418 = 78.2` target-in-top-k on accepted pass@k boundary pairs, but only `1 / 418 = 0.2` target margin >= 0; this matches the observed weakness that useful sampled behavior does not reliably become greedy behavior.
+Additional diagnostic scores in `jumini_internal_scores_20260609.json` include category breakdowns, strict heldout hit IDs, boundary-pair logit margins, and train-only generation forensics. The key boundary diagnostic was `327 / 418 = 78.2` target-in-top-k on accepted pass@k boundary pairs, but only `1 / 418 = 0.2` target margin >= 0. This matches the observed weakness that useful sampled behavior does not reliably become greedy behavior.
 
 ### 1B-Class Public Baseline Comparison
 
-For a size-adjacent open baseline, we compare against `TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T`, a widely used 1.1B English base model. This is intentionally a Korean-specialization diagnostic: it should be read as "Jumini is better on this Korean local sentinel", not as a claim that Jumini is globally stronger.
+For a size-adjacent open baseline, we compare against `TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T`, a widely used 1.1B English base model. This is a Korean-specialization diagnostic: it should be read as "Jumini is better on this Korean local sentinel", not as a claim that Jumini is globally stronger.
 
 Both models were evaluated on the same 90-prompt Korean sentinel using greedy + 32 sampled rollouts per prompt (`temperature=0.7`, `top_p=0.95`, `top_k=50`, `max_new_tokens=64`).
 
@@ -152,7 +162,18 @@ Category breakdown:
 
 Interpretation: Jumini does not dominate every subcategory, but it wins the overall Korean semantic pass@33 score and covers math/reasoning cases that the English-only base model misses.
 
-### Validation Artifacts
+## Leaderboard Submission Status
+
+Leaderboard requests have been submitted through public Hugging Face requests-dataset PR flows. They are pending maintainer merge/evaluation; no official leaderboard score is claimed here before completion.
+
+| Leaderboard | Request | Status checked | Revision | Precision | Model type |
+|---|---|---|---|---|---|
+| Open Ko-LLM Leaderboard | `https://huggingface.co/datasets/open-ko-llm-leaderboard/requests/discussions/2` | `open`, pending maintainer merge/evaluation | `aec6d67bf3ce37e5845e0fcd8f05ad1deb322f50` | `float16` | `pretrained model` / `Original` |
+| Open LLM Leaderboard | `https://huggingface.co/datasets/open-llm-leaderboard/requests/discussions/92` | `open`, pending maintainer merge/evaluation | `aec6d67bf3ce37e5845e0fcd8f05ad1deb322f50` | `float16` | `pretrained` / `Original` |
+
+The submitted revision is pinned to the model-card and score-appendix refresh in this repository. The Open Ko request commit is `942fc56e6fdb68cc80658527e3f96e98c92f21f9`; the Open LLM request commit is `a570c5fc07c763ef4b06995870066d14c440a87e`.
+
+## Validation Artifacts
 
 | Check | Result |
 |---|---|
@@ -161,7 +182,15 @@ Interpretation: Jumini does not dominate every subcategory, but it wins the over
 | Argmax mismatch rate vs native checkpoint | 0.0 |
 | Max absolute logit diff | 1.478e-5 |
 
-See `load_smoke.json`, `hf_equivalence_atol2e-5.json`, `replacement_evidence_20260609.json`, `benchmark_results_20260609.json`, and `jumini_internal_scores_20260609.json` in this repository for machine-readable details.
+Machine-readable artifacts:
+
+| File | Purpose |
+|---|---|
+| `load_smoke.json` | Transformers load and parameter smoke check |
+| `hf_equivalence_atol2e-5.json` | Native-to-HF export equivalence |
+| `replacement_evidence_20260609.json` | Previous HF checkpoint vs clean7020 replacement evidence |
+| `benchmark_results_20260609.json` | Public comparison summary |
+| `jumini_internal_scores_20260609.json` | Fuller clean7020 score appendix |
 
 ## Intended Use
 
@@ -170,32 +199,30 @@ This model is intended for:
 - Korean language modeling and generation experiments.
 - Course/project reproducibility.
 - Studying from-scratch small-LLM training behavior under limited compute.
-- Diagnostic comparison against other compact open models on Korean prompts.
+- Diagnostic comparison against compact open models on Korean prompts.
 
 It is not intended for:
 
 - Safety-critical, medical, legal, or financial advice.
 - Production deployment without additional safety evaluation.
-- Claims of official leaderboard performance without running the relevant public benchmark suite.
+- Claims of official leaderboard performance before the relevant public benchmark has completed.
 
 ## Limitations
 
-- Greedy decoding remains weak on the internal Korean semantic sentinel (`0/90` greedy hits in the K32 run).
-- The strict heldout project gate remains limited at `2/12`; this refresh is a best-so-far public update, not a final breakthrough checkpoint.
+- Greedy decoding remains weak on the internal Korean semantic sentinel (`0 / 90` greedy hits in the K32 run).
+- The strict heldout project gate remains limited at `2 / 12`; this refresh is a best-so-far public update, not a final breakthrough checkpoint.
 - The model can repeat, terminate poorly, or produce malformed outputs.
 - The comparison above is a Korean local diagnostic. It does not imply superiority over strong Korean-specialized models such as EXAONE-4.0-1.2B.
 - The model has not undergone full safety alignment or red-team evaluation.
 
 ## Training and Provenance
 
-The model implementation, tokenizer pipeline, data filtering, training loop, checkpointing, evaluation scripts, and HF export scripts were implemented within the HW2 project. The released checkpoint is not a fine-tune of TinyLlama, Llama, EXAONE, Qwen, or another public model.
+The model implementation, tokenizer pipeline, data filtering, training loop, checkpointing, evaluation scripts, and HF export scripts were implemented within the HW2 project. The released checkpoint is not a fine-tune of TinyLlama, Llama, EXAONE, Qwen, Gemma, or another public model.
 
 Project reports and manifests document data provenance, filtering, and evaluation decisions. The public artifact is provided under Apache-2.0.
 
 ## Citation
 
-If you reference this model, please cite the repository and checkpoint name:
-
 ```text
 Jumini-Ko-1.2B clean7020, properly59/Jumini-Ko-1.2B, 2026-06-09 public refresh.
 ```