File size: 2,663 Bytes
2cdc6b0 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 | ---
license: apache-2.0
base_model: Qwen/Qwen2.5-Coder-1.5B
library_name: peft
tags:
- sounio
- code
- peft
- lora
- qwen2.5-coder
language:
- en
pipeline_tag: text-generation
---
# Sounio Qwen2.5-Coder-1.5B LoRA Adapter
Experimental LoRA adapter for generating complete Sounio source files.
This is not a general-purpose production code model. It is a research adapter
trained for the Sounio dataset-expansion lane, where the target is complete,
compiler-checkable `.sio` programs rather than prose continuations.
## Base Model
`Qwen/Qwen2.5-Coder-1.5B`
## Training Snapshot
| Field | Value |
|---|---:|
| Dataset branch commit | `aa5f9218e` |
| Training rows requested | 4,800 |
| Training rows used | 4,769 |
| Optimiser steps | 120 |
| Repair-pair rows | 480 |
| Run-expected rows | 435 |
| Prompt style | `sounio-compact-completion` |
| LoRA rank | 16 |
| LoRA alpha | 32 |
## Evaluation
Held-out split: `datasets/hf_examples/instruction_pairs_eval.jsonl`, 200 rows.
| Model/objective | Compile pass | Compile + contract-clean | Exact runtime pass |
|---|---:|---:|---:|
| Base model, zero training | 111/200 (55.5%) | not recorded | 25/65 (38.5%) |
| Adapter candidate | 192/200 (96.0%) | 192/200 (96.0%) | 58/65 (89.2%) |
| Adapter + structural repair layer | 199/200 (99.5%) | 198/200 (99.0%) | 59/65 (90.8%) |
The 98%+ result uses the saved adapter plus the deterministic structural repair
layer in the Sounio repository. The repair layer catches outputs that are still
outside the complete-file objective, such as Rust-shaped `String`/`Vec`
surfaces, invalid synthetic declarations, algebra blocks used as structs, and
one observed scalar typo. It does not retrain model weights.
## Artefacts Included
- `adapter_model.safetensors`
- `adapter_config.json`
- tokenizer files copied with the adapter
- `train_summary.json`
- `lora_smoke_eval_report.json`
- `adapter_eval_summary.json`
- `adapter_eval_report.json`
- `ADAPTER_CANDIDATE_QWEN15.md`
## Reproducibility Notes
Primary adapter training run:
```text
/orangefs/training/sounio/hf-examples/lora-smoke/sounio-qwen15-lora-full200-surgical-repair-20260522T021535/results
```
98%+ adapter-only evaluation run:
```text
/orangefs/training/sounio/hf-examples/lora-smoke/sounio-qwen15-adapter-eval-98plus-20260522T083913/results
```
Key checksum:
```text
9d8540e218439bb28026115fbe8d4be5fe18162a0a1c07474d9850579ee36c4a adapter_model.safetensors
```
## Intended Use
Use this adapter to generate or repair small Sounio examples under the
`sounio-compact-completion` prompt format. Outputs should still be validated
with `souc check` and, when applicable, runtime checks.
|