Text Generation
PEFT
Safetensors
lora
spectral-surgery
training-seed-replication
b300
code
seed-44
conversational
Instructions to use tianzl66/Qwen3-8B-Magicoder-50K-LoRA-E1-Seed44 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use tianzl66/Qwen3-8B-Magicoder-50K-LoRA-E1-Seed44 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-8B") model = PeftModel.from_pretrained(base_model, "tianzl66/Qwen3-8B-Magicoder-50K-LoRA-E1-Seed44") - Notebooks
- Google Colab
- Kaggle
Download run_config.json from tianzl66/Qwen3-8B-Magicoder-50K-LoRA-E1-Seed44: direct link, hf CLI and curl.
- Browser
- Download file 959 Bytes
-
https://huggingface.co/tianzl66/Qwen3-8B-Magicoder-50K-LoRA-E1-Seed44/resolve/main/run_config.json
- Command line
-
hf download hf://tianzl66/Qwen3-8B-Magicoder-50K-LoRA-E1-Seed44/run_config.json
-
curl -L -o run_config.json https://huggingface.co/tianzl66/Qwen3-8B-Magicoder-50K-LoRA-E1-Seed44/resolve/main/run_config.json
959 Bytes
| { | |
| "base_model": "<LOCAL_PATH>/Qwen3-8B", | |
| "task": "magicoder", | |
| "peft_method": "lora", | |
| "train_profile": "none", | |
| "num_train_epochs": 1.0, | |
| "max_steps": null, | |
| "stop_at_step": null, | |
| "stop_at_epoch": null, | |
| "resume_from_checkpoint": null, | |
| "training_budget": "epochs", | |
| "per_device_train_batch_size": 16, | |
| "gradient_accumulation_steps": 2, | |
| "global_train_batch_size": 32, | |
| "world_size": 1, | |
| "effective_global_batch_size": 32, | |
| "steps_per_epoch": 1563, | |
| "total_steps": 1563, | |
| "lr": 2e-05, | |
| "warmup_ratio": 0.05, | |
| "weight_decay": 0.0, | |
| "lr_scheduler_type": "cosine", | |
| "min_lr_ratio": null, | |
| "max_seq_len": 4096, | |
| "dataset_size": 50000, | |
| "dataset_path": "<LOCAL_PATH>/magicoder-train.parquet", | |
| "max_train_samples": 50000, | |
| "dataset_seed": 42, | |
| "sft_format": "chat", | |
| "chat_template_mode": "non_thinking", | |
| "save_strategy": "epoch", | |
| "save_steps": 500, | |
| "save_total_limit": 1, | |
| "logging_steps": 25, | |
| "adalora_schedule": null | |
| } | |