File size: 2,976 Bytes
51b5079 952b389 934147e 952b389 934147e aa7e359 934147e 51b5079 952b389 934147e 952b389 934147e 952b389 aa7e359 934147e 952b389 934147e 952b389 934147e 952b389 934147e 952b389 934147e 952b389 934147e 952b389 aa7e359 934147e 952b389 aa7e359 934147e 952b389 934147e | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 | ---
base_model: Qwen/Qwen2.5-1.5B-Instruct
library_name: peft
pipeline_tag: text-generation
tags:
- base_model:adapter:Qwen/Qwen2.5-1.5B-Instruct
- lora
- sft
- transformers
- trl
- german
- english
- aether
- gguf
license: apache-2.0
language:
- de
- en
---
# Aether 2.2 Pro
Aether 2.2 Pro is an upgraded, fine-tuned language model based on **Qwen2.5-1.5B-Instruct**. Trained using TRL and PEFT (LoRA), the Pro edition delivers enhanced reasoning, improved response structure, and refined multilingual performance in German and English while maintaining efficient local execution.
> 🚀 **Looking for GGUF versions?**
> If you want to run Aether 2.2 Pro locally via **LM Studio**, **Ollama**, or **llama.cpp**, check out the pre-quantized GGUF repository:
> 👉 **[Maxilicious20/Aether-2.2-Pro-GGUF](https://huggingface.co/Maxilicious20/Aether-2.2-Pro-GGUF)**
## Model Details
### Model Description
- **Developed by:** Maxilicious20
- **Model type:** Causal Language Model (LoRA Adapter)
- **Language(s) (NLP):** German, English
- **License:** Apache-2.0
- **Finetuned from model:** Qwen/Qwen2.5-1.5B-Instruct
## Uses
### Direct Use
This model is designed for advanced conversational AI, instruction following, and text generation tasks requiring higher precision than standard builds.
### Quantized & GGUF Models
For standalone, CPU/GPU local execution without Python/Transformers dependencies, use the quantized GGUF binaries:
* 📦 **GGUF Repository:** [Maxilicious20/Aether-2.2-Pro-GGUF](https://huggingface.co/Maxilicious20/Aether-2.2-Pro-GGUF)
* **Available Quantizations:**
* `aether_2_2_pro_f16.gguf` (Uncompressed / Full Precision)
* `aether_2_2_pro_q8_0.gguf` (High Quality / 8-bit)
* `aether_2_2_pro_q4_k_m.gguf` (Recommended / Balanced Performance & VRAM)
### How to Get Started with the Model
#### Python (Transformers & PEFT)
Use the following Python code to load Aether 2.2 Pro with `transformers` and `peft`:
```python
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel
base_model_id = "Qwen/Qwen2.5-1.5B-Instruct"
adapter_id = "Maxilicious20/Aether-2.2-Pro"
# Load Tokenizer and Base Model
tokenizer = AutoTokenizer.from_pretrained(base_model_id)
base_model = AutoModelForCausalLM.from_pretrained(
base_model_id,
torch_dtype=torch.bfloat16,
device_map="auto"
)
# Load Aether 2.2 Pro LoRA Adapter
model = PeftModel.from_pretrained(base_model, adapter_id)
# Example Prompt
messages = [
{"role": "system", "content": "You are Aether Pro, an advanced AI assistant."},
{"role": "user", "content": "Explain the concept of quantum computing in simple terms."}
]
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][inputs.input_ids.shape[1]:], skip_special_tokens=True)) |