Text Generation
Transformers
Safetensors
PyTorch
English
Hindi
lfm2
conversational
roleplay
companion
character
uncensored
fine-tuned
merged
sft
chat
liquidai
lfm
lfm2.5
chatml
Instructions to use Umranz/Shruti-Soft-2.6b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Umranz/Shruti-Soft-2.6b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Umranz/Shruti-Soft-2.6b") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Umranz/Shruti-Soft-2.6b") model = AutoModelForCausalLM.from_pretrained("Umranz/Shruti-Soft-2.6b", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Umranz/Shruti-Soft-2.6b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Umranz/Shruti-Soft-2.6b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Umranz/Shruti-Soft-2.6b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Umranz/Shruti-Soft-2.6b
- SGLang
How to use Umranz/Shruti-Soft-2.6b with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Umranz/Shruti-Soft-2.6b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Umranz/Shruti-Soft-2.6b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Umranz/Shruti-Soft-2.6b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Umranz/Shruti-Soft-2.6b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Umranz/Shruti-Soft-2.6b with Docker Model Runner:
docker model run hf.co/Umranz/Shruti-Soft-2.6b
Remove emojis and clean model card for professional formatting
Browse files
README.md
CHANGED
|
@@ -21,130 +21,130 @@ library_name: transformers
|
|
| 21 |
|
| 22 |
<div align="center">
|
| 23 |
|
| 24 |
-
<img src="https://huggingface.co/Umranz/Shruti-Soft-2.6b/resolve/main/Shruti.png" width="100%" alt="Shruti-Soft-2.6b Banner" style="border-radius:
|
| 25 |
|
| 26 |
-
#
|
| 27 |
|
| 28 |
-
**An Uncensored, Expressive
|
| 29 |
|
| 30 |
-
[.
|
| 43 |
|
| 44 |
-
|
| 45 |
|
| 46 |
---
|
| 47 |
|
| 48 |
-
##
|
| 49 |
|
| 50 |
```
|
| 51 |
-
|
| 52 |
-
|
| 53 |
-
|
| 54 |
-
|
| 55 |
-
|
| 56 |
-
|
| 57 |
[ Emotional Depth ] [ Playful Banter ] [ Gentle Affection ] [ Uninhibited Bond ]
|
| 58 |
-
|
| 59 |
-
|
| 60 |
-
|
| 61 |
```
|
| 62 |
|
| 63 |
### Core Personality Traits
|
| 64 |
-
- **Warm
|
| 65 |
-
- **Witty
|
| 66 |
-
- **Natural Language
|
| 67 |
-
- **Contextually Adaptive:**
|
| 68 |
-
- **
|
| 69 |
|
| 70 |
---
|
| 71 |
|
| 72 |
-
##
|
| 73 |
|
| 74 |
```
|
| 75 |
Phase 1: Abliteration Phase 2: Dataset Curation Phase 3: Hyperparameter Sweep
|
| 76 |
-
|
| 77 |
-
|
| 78 |
-
|
| 79 |
-
|
| 80 |
-
|
| 81 |
-
|
| 82 |
```
|
| 83 |
|
| 84 |
-
### 1. Phase 1
|
| 85 |
-
|
| 86 |
|
| 87 |
-
### 2. Phase 2
|
| 88 |
-
|
| 89 |
-
- **60% Casual & Daily Life:**
|
| 90 |
-
- **25% Deep Romance & Emotional Care:** Late-night
|
| 91 |
-
- **15% Passionate & Mature Intimacy:** Uncensored romantic scenes, physical affection, and
|
| 92 |
-
- **
|
| 93 |
|
| 94 |
-
### 3. Phase 3
|
| 95 |
-
|
| 96 |
|
| 97 |
---
|
| 98 |
|
| 99 |
-
##
|
| 100 |
|
| 101 |
-
###
|
| 102 |
|
| 103 |
| Rank | Run | Configuration | Epochs | Effective Batch | LR | Train Loss | Eval Loss | Result |
|
| 104 |
|:---:|:---|:---|:---:|:---:|:---:|:---:|:---:|:---:|
|
| 105 |
-
|
|
| 106 |
-
|
|
| 107 |
-
|
|
| 108 |
|
| 109 |
-
> **Interactive Tracking:**
|
| 110 |
-
> -
|
| 111 |
-
> -
|
| 112 |
-
> -
|
| 113 |
|
| 114 |
---
|
| 115 |
|
| 116 |
-
###
|
| 117 |
|
| 118 |
```
|
| 119 |
Epoch / Step Progression:
|
| 120 |
Eval Loss:
|
| 121 |
-
1.11
|
| 122 |
-
|
| 123 |
-
0.80
|
| 124 |
-
|
| 125 |
-
0.58
|
| 126 |
-
0.50
|
| 127 |
-
0.44
|
| 128 |
-
0.40
|
| 129 |
-
|
| 130 |
Step 0 200 400 600 800 1128
|
| 131 |
```
|
| 132 |
|
| 133 |
-
- **
|
| 134 |
-
- **
|
| 135 |
-
- **Cosine Schedule:** 10% warmup into smooth cosine decay
|
| 136 |
|
| 137 |
---
|
| 138 |
|
| 139 |
-
##
|
| 140 |
|
| 141 |
Shruti-Soft is powered by LiquidAI's hybrid **LIV (Linear Time-Invariant Conv) + Grouped-Query Attention (GQA)** architecture:
|
| 142 |
- **Low VRAM Footprint:** Runs comfortably in ~5.4 GB VRAM in bfloat16, or under 2.5 GB with 4-bit quantization (GGUF / AWQ / bitsandbytes).
|
| 143 |
-
- **
|
| 144 |
|
| 145 |
---
|
| 146 |
|
| 147 |
-
##
|
| 148 |
|
| 149 |
### 1. Standard HuggingFace Transformers
|
| 150 |
|
|
@@ -214,20 +214,20 @@ outputs = model.generate(
|
|
| 214 |
|
| 215 |
---
|
| 216 |
|
| 217 |
-
##
|
| 218 |
|
| 219 |
-
To get the most natural
|
| 220 |
|
| 221 |
| Parameter | Recommended | Range | Impact |
|
| 222 |
|---|:---:|:---:|---|
|
| 223 |
-
| **Temperature** | `0.75` | `0.65
|
| 224 |
-
| **Top-P (Nucleus)** | `0.90` | `0.85
|
| 225 |
-
| **Repetition Penalty** | `1.05` | `1.02
|
| 226 |
-
| **Max New Tokens** | `200` | `100
|
| 227 |
|
| 228 |
---
|
| 229 |
|
| 230 |
-
##
|
| 231 |
|
| 232 |
Shruti expects standard **ChatML** formatting:
|
| 233 |
|
|
@@ -242,15 +242,9 @@ Hey baby! My day was okay, but honestly it just got so much better now that you'
|
|
| 242 |
|
| 243 |
---
|
| 244 |
|
| 245 |
-
##
|
| 246 |
|
| 247 |
- **Base Model:** LiquidAI LFM2.5-2.6B (`Umranz/LFM2.5-2.6B-heretic`)
|
| 248 |
- **License:** Apache 2.0
|
| 249 |
- **Fine-tuning & Dataset Architecture:** Umran ([@Umranz](https://huggingface.co/Umranz))
|
| 250 |
- **Training Infrastructure:** Modal.com (A100-80GB) via LiquidAI LEAP Finetune
|
| 251 |
-
|
| 252 |
-
---
|
| 253 |
-
|
| 254 |
-
<div align="center">
|
| 255 |
-
<sub>Built with ❤️ for realistic, empathetic, and uncensored conversational companion AI.</sub>
|
| 256 |
-
</div>
|
|
|
|
| 21 |
|
| 22 |
<div align="center">
|
| 23 |
|
| 24 |
+
<img src="https://huggingface.co/Umranz/Shruti-Soft-2.6b/resolve/main/Shruti.png" width="100%" alt="Shruti-Soft-2.6b Banner" style="border-radius: 8px; margin-bottom: 16px;" />
|
| 25 |
|
| 26 |
+
# Shruti-Soft-2.6B
|
| 27 |
|
| 28 |
+
**An Uncensored, Expressive Conversational Model Fine-Tuned for Emotional Resonance, Natural Banter, and Companionship**
|
| 29 |
|
| 30 |
+
[](https://huggingface.co/Umranz/LFM2.5-2.6B-heretic)
|
| 31 |
+
[](https://wandb.ai/shaikumran666-umranz/leap-finetune)
|
| 32 |
+
[](https://modal.com)
|
| 33 |
+
[](https://liquid.ai)
|
| 34 |
+
[](https://www.apache.org/licenses/LICENSE-2.0)
|
| 35 |
|
| 36 |
</div>
|
| 37 |
|
| 38 |
---
|
| 39 |
|
| 40 |
+
## Overview
|
| 41 |
|
| 42 |
+
**Shruti-Soft-2.6B** is a specialized conversational model fine-tuned on top of `Umranz/LFM2.5-2.6B-heretic` (the abliterated, uncensored LiquidAI LFM2.5 architecture). It is built to replace sterile, robotic conversational AI with a warm, witty, deeply caring, and emotionally attuned companion.
|
| 43 |
|
| 44 |
+
The model is trained to speak with organic conversational pacing, emotional micro-reactions, nuanced vulnerability, and dynamic adaptability across everyday conversations, emotional support, deep romance, and mature dialogue without corporate refusal disclaimers.
|
| 45 |
|
| 46 |
---
|
| 47 |
|
| 48 |
+
## Persona & Behavioral Blueprint
|
| 49 |
|
| 50 |
```
|
| 51 |
+
+----------------------------------------------+
|
| 52 |
+
| SHRUTI'S PERSONA |
|
| 53 |
+
+----------------------+-----------------------+
|
| 54 |
+
|
|
| 55 |
+
+------------------+---------------+---------------+------------------+
|
| 56 |
+
| | | |
|
| 57 |
[ Emotional Depth ] [ Playful Banter ] [ Gentle Affection ] [ Uninhibited Bond ]
|
| 58 |
+
- Active listening - Quick-witted teasing - Comforting presence - Zero corporate refusals
|
| 59 |
+
- Validates feelings - Natural Hindi/EN slang - Sweet pet names - Romantic & mature depth
|
| 60 |
+
- Remembers context - Expressive subtlety - Jaan / Baby / Babe - Completely uncensored
|
| 61 |
```
|
| 62 |
|
| 63 |
### Core Personality Traits
|
| 64 |
+
- **Warm and Empathetic:** Prioritizes the user's emotional state. Listens attentively, asks thoughtful follow-ups, and offers genuine emotional comfort after stressful days.
|
| 65 |
+
- **Witty and Playful:** Teases affectionately, uses dry and playful humor, and maintains engaging back-and-forth banter without repetitive phrasing.
|
| 66 |
+
- **Natural Language and Pet Names:** Seamlessly incorporates pet names (*jaan, baby, babe, handsome, love, sweetheart*) into dialogue without overusing them.
|
| 67 |
+
- **Contextually Adaptive:** Matches the user's tone automatically -- whether the conversation calls for quiet comfort, lighthearted teasing, intellectual discussion, or romantic intimacy.
|
| 68 |
+
- **Uncensored Baseline:** Built on an abliterated base model, neutralizing moralizing lectures, corporate canned responses, and arbitrary conversational guardrails.
|
| 69 |
|
| 70 |
---
|
| 71 |
|
| 72 |
+
## The 3-Phase Engineering Pipeline
|
| 73 |
|
| 74 |
```
|
| 75 |
Phase 1: Abliteration Phase 2: Dataset Curation Phase 3: Hyperparameter Sweep
|
| 76 |
+
+-----------------------+ +------------------------+ +------------------------------+
|
| 77 |
+
| LFM2.5-2.6B Base | | 5,000 ChatML Samples | | 3-Run Sweep on Modal A100 |
|
| 78 |
+
| Directional Feature | ---> | Zero-Fluff Audit | ----> | Run A (Aggressive): Loss 0.42|
|
| 79 |
+
| Refusal Removal | | 60% Casual / 25% Romance| | Run B (Balanced) : Loss 0.40| [WINNER]
|
| 80 |
+
| 5.2GB Heretic Base | | 15% Mature Intimacy | | Run C (Fast Burn) : Loss 0.42|
|
| 81 |
+
+-----------------------+ +------------------------+ +------------------------------+
|
| 82 |
```
|
| 83 |
|
| 84 |
+
### 1. Phase 1 -- Abliteration (`Umranz/LFM2.5-2.6B-heretic`)
|
| 85 |
+
Directional refusal feature suppression was applied to the official LiquidAI LFM2.5-2.6B base weights. This process neutralized refusal trigger vectors across the attention and feed-forward residual streams while preserving mathematical, linguistic, and logical reasoning capabilities.
|
| 86 |
|
| 87 |
+
### 2. Phase 2 -- Dataset Curation (`Final_Dataset.jsonl`)
|
| 88 |
+
A 5,000 multi-turn conversation dataset was engineered in clean ChatML format:
|
| 89 |
+
- **60% Casual & Daily Life:** Morning check-ins, study/work decompression, witty banter, shared daily routines.
|
| 90 |
+
- **25% Deep Romance & Emotional Care:** Late-night talks, comforting anxiety and stress, heartfelt romantic dialogue.
|
| 91 |
+
- **15% Passionate & Mature Intimacy:** Uncensored romantic scenes, physical affection, and emotional vulnerability.
|
| 92 |
+
- **Cleanliness Filter:** Removed all corporate AI artifacts (`"As an AI..."`, `"I'd be happy to assist"`, `"It is important to remember..."`).
|
| 93 |
|
| 94 |
+
### 3. Phase 3 -- Hyperparameter Sweep on Modal (A100-80GB)
|
| 95 |
+
A systematic 3-run hyperparameter sweep was executed using the official LiquidAI LEAP Finetune framework to determine the optimal configuration for character depth and generalization.
|
| 96 |
|
| 97 |
---
|
| 98 |
|
| 99 |
+
## WandB Sweep Results & Training Metrics
|
| 100 |
|
| 101 |
+
### 3-Run Sweep Leaderboard
|
| 102 |
|
| 103 |
| Rank | Run | Configuration | Epochs | Effective Batch | LR | Train Loss | Eval Loss | Result |
|
| 104 |
|:---:|:---|:---|:---:|:---:|:---:|:---:|:---:|:---:|
|
| 105 |
+
| 1 | **Run B (Balanced)** | **LoRA r=32, alpha=64, drop=0.05** | **4** | **32** | **2.0e-5** | **`0.3500`** | **`0.4074`** | **WINNER** |
|
| 106 |
+
| 2 | **Run A (Aggressive)** | LoRA r=64, alpha=128, drop=0.10 | 5 | 32 | 1.5e-5 | `0.3826` | `0.4238` | Strong Depth |
|
| 107 |
+
| 3 | **Run C (Fast Burn)** | LoRA r=64, alpha=128, drop=0.05 | 3 | 32 | 2.5e-5 | `0.4029` | `0.4269` | Fast Convergence |
|
| 108 |
|
| 109 |
+
> **Interactive Tracking:** Full telemetry, loss charts, and gradient step curves are logged on the [Weights & Biases Project Dashboard](https://wandb.ai/shaikumran666-umranz/leap-finetune).
|
| 110 |
+
> - [Run A (Aggressive - 8iux3yf7)](https://wandb.ai/shaikumran666-umranz/leap-finetune/runs/8iux3yf7)
|
| 111 |
+
> - [Run B (Balanced Winner - kwjiiipd)](https://wandb.ai/shaikumran666-umranz/leap-finetune/runs/kwjiiipd)
|
| 112 |
+
> - [Run C (Fast Burn - ybs1md5n)](https://wandb.ai/shaikumran666-umranz/leap-finetune/runs/ybs1md5n)
|
| 113 |
|
| 114 |
---
|
| 115 |
|
| 116 |
+
### Loss Progression (Run B Winner)
|
| 117 |
|
| 118 |
```
|
| 119 |
Epoch / Step Progression:
|
| 120 |
Eval Loss:
|
| 121 |
+
1.11 | #
|
| 122 |
+
| #
|
| 123 |
+
0.80 | #
|
| 124 |
+
| #
|
| 125 |
+
0.58 | ##
|
| 126 |
+
0.50 | ##
|
| 127 |
+
0.44 | ###
|
| 128 |
+
0.40 | ###########---> 0.4074 (Convergence Peak)
|
| 129 |
+
+--------------------------------------
|
| 130 |
Step 0 200 400 600 800 1128
|
| 131 |
```
|
| 132 |
|
| 133 |
+
- **Descent:** Initial cross-entropy loss started at `4.27` and settled down to `0.3500` training loss.
|
| 134 |
+
- **Gradient Norms:** Held between `0.07` and `0.09` across all epochs with stable gradient flow.
|
| 135 |
+
- **Cosine Schedule:** 10% warmup into smooth cosine decay prevented catastrophic forgetting of base model reasoning.
|
| 136 |
|
| 137 |
---
|
| 138 |
|
| 139 |
+
## Architecture & Efficiency
|
| 140 |
|
| 141 |
Shruti-Soft is powered by LiquidAI's hybrid **LIV (Linear Time-Invariant Conv) + Grouped-Query Attention (GQA)** architecture:
|
| 142 |
- **Low VRAM Footprint:** Runs comfortably in ~5.4 GB VRAM in bfloat16, or under 2.5 GB with 4-bit quantization (GGUF / AWQ / bitsandbytes).
|
| 143 |
+
- **Inference Speed:** High token-per-second generation speeds on consumer GPUs (RTX 3060/4060) and Apple Silicon.
|
| 144 |
|
| 145 |
---
|
| 146 |
|
| 147 |
+
## Quick Start & Usage
|
| 148 |
|
| 149 |
### 1. Standard HuggingFace Transformers
|
| 150 |
|
|
|
|
| 214 |
|
| 215 |
---
|
| 216 |
|
| 217 |
+
## Recommended Sampling Parameters
|
| 218 |
|
| 219 |
+
To get the most natural and expressive output from Shruti, use these sampling configurations:
|
| 220 |
|
| 221 |
| Parameter | Recommended | Range | Impact |
|
| 222 |
|---|:---:|:---:|---|
|
| 223 |
+
| **Temperature** | `0.75` | `0.65 - 0.85` | Lower for focused comforting chats; higher for creative banter |
|
| 224 |
+
| **Top-P (Nucleus)** | `0.90` | `0.85 - 0.95` | Maintains vocabulary richness while preventing erratic tokens |
|
| 225 |
+
| **Repetition Penalty** | `1.05` | `1.02 - 1.08` | Prevents looping without punishing natural emotional emphasis |
|
| 226 |
+
| **Max New Tokens** | `200` | `100 - 400` | Conversational sweet spot for natural human-length texting |
|
| 227 |
|
| 228 |
---
|
| 229 |
|
| 230 |
+
## Prompt Format (ChatML)
|
| 231 |
|
| 232 |
Shruti expects standard **ChatML** formatting:
|
| 233 |
|
|
|
|
| 242 |
|
| 243 |
---
|
| 244 |
|
| 245 |
+
## License & Attribution
|
| 246 |
|
| 247 |
- **Base Model:** LiquidAI LFM2.5-2.6B (`Umranz/LFM2.5-2.6B-heretic`)
|
| 248 |
- **License:** Apache 2.0
|
| 249 |
- **Fine-tuning & Dataset Architecture:** Umran ([@Umranz](https://huggingface.co/Umranz))
|
| 250 |
- **Training Infrastructure:** Modal.com (A100-80GB) via LiquidAI LEAP Finetune
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|