chiuratto-AIgourakis/sounio-qwen25-coder-1p5b-lora

Sounio Qwen2.5-Coder-1.5B LoRA Adapter

Experimental LoRA adapter for generating complete Sounio source files.

This is not a general-purpose production code model. It is a research adapter trained for the Sounio dataset-expansion lane, where the target is complete, compiler-checkable .sio programs rather than prose continuations.

Base Model

Qwen/Qwen2.5-Coder-1.5B

Training Snapshot

Field	Value
Dataset branch commit	aa5f9218e
Training rows requested	4,800
Training rows used	4,769
Optimiser steps	120
Repair-pair rows	480
Run-expected rows	435
Prompt style	sounio-compact-completion
LoRA rank	16
LoRA alpha	32

Evaluation

Held-out split: datasets/hf_examples/instruction_pairs_eval.jsonl, 200 rows.

Model/objective	Compile pass	Compile + contract-clean	Exact runtime pass
Base model, zero training	111/200 (55.5%)	not recorded	25/65 (38.5%)
Adapter candidate	192/200 (96.0%)	192/200 (96.0%)	58/65 (89.2%)
Adapter + structural repair layer	199/200 (99.5%)	198/200 (99.0%)	59/65 (90.8%)

The 98%+ result uses the saved adapter plus the deterministic structural repair layer in the Sounio repository. The repair layer catches outputs that are still outside the complete-file objective, such as Rust-shaped String/Vec surfaces, invalid synthetic declarations, algebra blocks used as structs, and one observed scalar typo. It does not retrain model weights.

Artefacts Included

• adapter_model.safetensors
• adapter_config.json
• tokenizer files copied with the adapter
• train_summary.json
• lora_smoke_eval_report.json
• adapter_eval_summary.json
• adapter_eval_report.json
• ADAPTER_CANDIDATE_QWEN15.md

Reproducibility Notes

Primary adapter training run:

/orangefs/training/sounio/hf-examples/lora-smoke/sounio-qwen15-lora-full200-surgical-repair-20260522T021535/results

98%+ adapter-only evaluation run:

/orangefs/training/sounio/hf-examples/lora-smoke/sounio-qwen15-adapter-eval-98plus-20260522T083913/results

Key checksum:

9d8540e218439bb28026115fbe8d4be5fe18162a0a1c07474d9850579ee36c4a  adapter_model.safetensors

Intended Use

Use this adapter to generate or repair small Sounio examples under the sounio-compact-completion prompt format. Outputs should still be validated with souc check and, when applicable, runtime checks.