File size: 1,456 Bytes
bec88c5
 
 
6922abb
 
 
 
 
 
bec88c5
 
6922abb
bec88c5
6922abb
bec88c5
6922abb
 
 
 
 
 
 
 
bec88c5
6922abb
 
bec88c5
6922abb
bec88c5
6922abb
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
---
base_model: google/gemma-2-9b-it
library_name: peft
tags:
- ruby-3.4
- slm
- lora
- code-generation
- synthetic-data
---

# ruby3.4-gemma-2-9b-1k-all-16bit-gemini

This model is a part of the **RubyCraft-3.4-Instruct** research project, demonstrating the autonomous adaptation of Small Language Models (SLMs) to modern **Ruby 3.4** syntax.

## 🏆 Model Details
* **Experiment ID:** `exp-113`
* **Base Model:** `google/gemma-2-9b-it`
* **Model Tier:** `Big`
* **Training Data:** 1K samples (Split: `ALL`) from the [RubyCraft-3.4-Instruct Dataset](https://huggingface.co/datasets/mehmetdavut/RubyCraft-3.4-Instruct)
* **Teacher Model:** `Gemini-2.5-Flash`
* **Quantization Strategy:** 16-bit
* **Adapter Type:** LoRA (Low-Rank Adaptation)

## 🧪 Performance & Evaluation
In our comprehensive evaluation covering 164 unique configurations, base models frequently suffered from "Formatting Hallucinations" (e.g., wrapping outputs in Markdown tags), resulting in zero scores within strict execution environments. 

By applying our **Diagnostic Sanitization Procedure (DSP)** and fine-tuning on high-quality synthetic data, this adapter successfully recovers the model's Intrinsic Capability (IC) and achieves Extrinsic Compliance (EC) with Ruby 3.4 standards.

For detailed evaluation logs, pass rates, and the full experimental matrix, please refer to our [Evaluation Logs Dataset](https://huggingface.co/datasets/mehmetdavut/RubyCraft-3.4-Eval-Logs).