Instructions to use Mawdistical/Mawnia-12B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Mawdistical/Mawnia-12B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Mawdistical/Mawnia-12B") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("Mawdistical/Mawnia-12B") model = AutoModelForMultimodalLM.from_pretrained("Mawdistical/Mawnia-12B", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Mawdistical/Mawnia-12B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Mawdistical/Mawnia-12B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Mawdistical/Mawnia-12B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Mawdistical/Mawnia-12B
- SGLang
How to use Mawdistical/Mawnia-12B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Mawdistical/Mawnia-12B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Mawdistical/Mawnia-12B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Mawdistical/Mawnia-12B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Mawdistical/Mawnia-12B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Mawdistical/Mawnia-12B with Docker Model Runner:
docker model run hf.co/Mawdistical/Mawnia-12B
D1 Mawnipulatine Mansplainer Maxxing
✧ Browse the Mawnia-12B Collection
✧ Recommended Settings
Temp: 1.35, min_p: 0.05
Experiment to find your taste.
✧ Finetuned Set Info
↳ 2.2K Unique Set Scenarios
Entry Composition
↳ Heavy Violence
↳ Dark Themes
↳ Extensive NSFL
↳ Non-lethal but enough to scare people.
↳ Heavy NSFW
↳ Triggered on user action or passively wherever RP is seen
↳ Modern City Scenes
↳ Dystopia Scenes
↳ Grey Line Consent Scenes
↳ Note: Grey line consent is where consent may be mutual but unspoken at times or considered to be accepted by actions either by character or user. May lead to over-possessiveness in some instances.
Creation Composition
↳ Hybrid Organic-Synthetic mix
Token Count
↳ 13.5 M
↳ Note: token count calculated solely on outputs.
Type
↳ Private In-House
Focus
↳ Male Leaning
↳ Anthro
↳ Xeno-Likeness
↳ Passive Negative Bias with mild narcissistic tendencies, matches energy with subtle languidness.
✧ Technical Details
↳ allura-org/Gemma-3-Glitter-12B
↳ A creative writing model based on Gemma 3 12B IT
↳ 50/50 merge of two separate trains
↳ Vision capabilities restored
ToastyPigeon
↳ g3-12b-rp-system-v0.1
↳ ~13.5M tokens of instruct-based RP training (2:1 human to synthetic) with system prompt examples
↳ g3-12b-storyteller-v0.2-textonly
↳ ~20M tokens of completion training on long-form creative writing (1.6M synthetic from R1, remainder human-created)
✧ Credits
↳ @Mawnipulator
Government Bodies
↳ @ArtusDev
↳ @SaisExperiments
↳ ALLURA-ORG
License: CC BY-NC 4.0
Services such as Arli AI and Featherless AI are granted a CC BY-ND 4.0 license for use of this model.
- Downloads last month
- 27
