Hugging Face's logo

mrs83
/
Kurtis-SmolLM2-360M-Instruct-DPO-PEFT

Text Generation
PEFT
Safetensors
English
text-generation-inference
Model card Files
xet
 Community
How to use from the
Use from the
PEFT library
from peft import PeftModel
from transformers import AutoModelForCausalLM

base_model = AutoModelForCausalLM.from_pretrained("mrs83/Kurtis-SmolLM2-360M-Instruct")
model = PeftModel.from_pretrained(base_model, "mrs83/Kurtis-SmolLM2-360M-Instruct-DPO-PEFT")

Model Card

This repository contains experimental models designed strictly for academic evaluation and research purposes.

Critical Constraints:

  • No Production Deployment: Experimental models must not be deployed in commercial, enterprise, or mission-critical environments under any circumstances.
  • No Liability: Experimental models are provided "as-is" without warranties of any kind. The developers assume zero liability for downstream consequences, system integration failures, or regulatory non-compliance resulting from unauthorized deployment.
Downloads last month
14
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for mrs83/Kurtis-SmolLM2-360M-Instruct-DPO-PEFT

Base model

HuggingFaceTB/SmolLM2-360M
Quantized
HuggingFaceTB/SmolLM2-360M-Instruct
Finetuned
mrs83/Kurtis-SmolLM2-360M-Instruct
Adapter
(1)
this model

Dataset used to train mrs83/Kurtis-SmolLM2-360M-Instruct-DPO-PEFT

Collection including mrs83/Kurtis-SmolLM2-360M-Instruct-DPO-PEFT