Text Generation
Transformers
Safetensors
glm4
mergekit
Merge
rolelplay
creative_writing
conversational
Instructions to use Delta-Vector/Plesio-32B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Delta-Vector/Plesio-32B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Delta-Vector/Plesio-32B") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Delta-Vector/Plesio-32B") model = AutoModelForCausalLM.from_pretrained("Delta-Vector/Plesio-32B", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Delta-Vector/Plesio-32B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Delta-Vector/Plesio-32B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Delta-Vector/Plesio-32B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Delta-Vector/Plesio-32B
- SGLang
How to use Delta-Vector/Plesio-32B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Delta-Vector/Plesio-32B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Delta-Vector/Plesio-32B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Delta-Vector/Plesio-32B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Delta-Vector/Plesio-32B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Delta-Vector/Plesio-32B with Docker Model Runner:
docker model run hf.co/Delta-Vector/Plesio-32B
| base_model: | |
| - Delta-Vector/Rei-V1-32B-Base | |
| - allura-org/GLM4-32B-Neon-v2 | |
| library_name: transformers | |
| tags: | |
| - mergekit | |
| - merge | |
| - rolelplay | |
| - creative_writing | |
| <!DOCTYPE html> | |
| <html lang="en"> | |
| <head> | |
| <meta charset="UTF-8"> | |
| <meta name="viewport" content="width=device-width, initial-scale=1.0"> | |
| <title>Plesio-32B</title> | |
| <link href="https://fonts.googleapis.com/css2?family=Quicksand:wght@400;500;600&display=swap" rel="stylesheet"> | |
| <style> | |
| body { | |
| font-family: 'Quicksand', sans-serif; | |
| background: linear-gradient(135deg, #e6f3ff 0%, #cce7ff 50%, #b3daff 100%); | |
| color: #1e3a5f; | |
| margin: 0; | |
| padding: 0; | |
| font-size: 16px; | |
| min-height: 100vh; | |
| } | |
| .container { | |
| margin: 20px; | |
| background: linear-gradient(145deg, rgba(255, 255, 255, 0.9), rgba(240, 248, 255, 0.95)); | |
| padding: 30px; | |
| border-radius: 20px; | |
| box-shadow: 0 8px 32px rgba(70, 130, 180, 0.3), 0 4px 16px rgba(0, 123, 191, 0.2); | |
| border: 2px solid rgba(70, 130, 180, 0.4); | |
| position: relative; | |
| backdrop-filter: blur(10px); | |
| } | |
| .container::before { | |
| content: ''; | |
| position: absolute; | |
| top: 0; | |
| left: 0; | |
| right: 0; | |
| bottom: 0; | |
| background: linear-gradient(45deg, rgba(135, 206, 235, 0.1), rgba(0, 191, 255, 0.1), rgba(70, 130, 180, 0.1)); | |
| border-radius: 20px; | |
| z-index: -1; | |
| } | |
| .header h1 { | |
| font-size: 32px; | |
| background: linear-gradient(45deg, #0066cc, #007bff, #4169e1); | |
| -webkit-background-clip: text; | |
| -webkit-text-fill-color: transparent; | |
| background-clip: text; | |
| margin: 0 0 20px 0; | |
| text-align: center; | |
| font-weight: 600; | |
| text-shadow: 0 2px 4px rgba(70, 130, 180, 0.3); | |
| } | |
| .section { | |
| margin-top: 30px; | |
| } | |
| .section h2 { | |
| font-size: 24px; | |
| background: linear-gradient(45deg, #0066cc, #007bff); | |
| -webkit-background-clip: text; | |
| -webkit-text-fill-color: transparent; | |
| background-clip: text; | |
| text-align: center; | |
| font-weight: 600; | |
| margin-bottom: 20px; | |
| } | |
| .info p { | |
| color: #1e3a5f; | |
| line-height: 1.8; | |
| font-size: 16px; | |
| } | |
| .info img { | |
| width: 85%; | |
| border-radius: 15px; | |
| margin: 0 auto 15px; | |
| display: block; | |
| box-shadow: 0 8px 25px rgba(70, 130, 180, 0.4); | |
| border: 2px solid rgba(135, 206, 235, 0.5); | |
| } | |
| a { | |
| color: #0066cc; | |
| text-decoration: none; | |
| transition: all 0.3s ease; | |
| font-weight: 500; | |
| } | |
| a:hover { | |
| color: #007bff; | |
| text-shadow: 0 0 8px rgba(0, 191, 255, 0.6); | |
| } | |
| .button { | |
| display: inline-block; | |
| background: linear-gradient(45deg, #87ceeb, #00bfff); | |
| color: #1e3a5f; | |
| padding: 12px 24px; | |
| border-radius: 25px; | |
| cursor: pointer; | |
| text-decoration: none; | |
| transition: all 0.3s ease; | |
| border: 1px solid rgba(70, 130, 180, 0.5); | |
| font-weight: 500; | |
| } | |
| .button:hover { | |
| background: linear-gradient(45deg, #5fb3d4, #0099e6); | |
| box-shadow: 0 4px 15px rgba(70, 130, 180, 0.6); | |
| transform: translateY(-2px); | |
| } | |
| pre { | |
| background: linear-gradient(135deg, rgba(240, 248, 255, 0.8), rgba(230, 243, 255, 0.8)); | |
| padding: 20px; | |
| border-radius: 12px; | |
| overflow-x: auto; | |
| border: 1px solid rgba(70, 130, 180, 0.3); | |
| box-shadow: inset 0 2px 4px rgba(70, 130, 180, 0.2); | |
| } | |
| code { | |
| font-family: 'Courier New', monospace; | |
| color: #1e3a5f; | |
| } | |
| .info-card { | |
| background: linear-gradient(145deg, rgba(240, 248, 255, 0.9), rgba(230, 243, 255, 0.9)); | |
| border: 2px solid rgba(70, 130, 180, 0.4); | |
| border-radius: 15px; | |
| overflow: hidden; | |
| box-shadow: 0 4px 20px rgba(70, 130, 180, 0.3); | |
| } | |
| .info-header { | |
| background: linear-gradient(135deg, rgba(135, 206, 235, 0.3), rgba(0, 191, 255, 0.2)); | |
| padding: 25px; | |
| border-bottom: 1px solid rgba(70, 130, 180, 0.3); | |
| } | |
| .info-header h3 { | |
| background: linear-gradient(45deg, #0066cc, #007bff); | |
| -webkit-background-clip: text; | |
| -webkit-text-fill-color: transparent; | |
| background-clip: text; | |
| margin: 0 0 15px 0; | |
| font-size: 22px; | |
| text-align: center; | |
| font-weight: 600; | |
| } | |
| .model-tags { | |
| display: flex; | |
| gap: 10px; | |
| flex-wrap: wrap; | |
| justify-content: center; | |
| } | |
| .model-tag { | |
| background: linear-gradient(45deg, rgba(70, 130, 180, 0.4), rgba(0, 191, 255, 0.3)); | |
| color: #1e3a5f; | |
| padding: 8px 16px; | |
| border-radius: 20px; | |
| font-size: 13px; | |
| border: 1px solid rgba(70, 130, 180, 0.5); | |
| font-weight: 500; | |
| box-shadow: 0 2px 8px rgba(70, 130, 180, 0.2); | |
| } | |
| .model-composition { | |
| padding: 25px; | |
| border-bottom: 1px solid rgba(70, 130, 180, 0.3); | |
| } | |
| .model-composition h4 { | |
| background: linear-gradient(45deg, #0066cc, #007bff); | |
| -webkit-background-clip: text; | |
| -webkit-text-fill-color: transparent; | |
| background-clip: text; | |
| margin: 0 0 20px 0; | |
| font-size: 18px; | |
| text-align: center; | |
| font-weight: 600; | |
| } | |
| .composition-list { | |
| list-style: none; | |
| padding: 0; | |
| margin: 0; | |
| display: grid; | |
| gap: 15px; | |
| } | |
| .composition-list li { | |
| color: #1e3a5f; | |
| display: flex; | |
| align-items: baseline; | |
| gap: 12px; | |
| padding: 10px; | |
| background: rgba(240, 248, 255, 0.5); | |
| border-radius: 8px; | |
| border-left: 4px solid #87ceeb; | |
| } | |
| .model-component { | |
| font-weight: 600; | |
| min-width: 120px; | |
| } | |
| .model-description { | |
| padding: 25px; | |
| background: linear-gradient(135deg, rgba(255, 255, 255, 0.7), rgba(240, 248, 255, 0.8)); | |
| } | |
| .metrics-section { | |
| margin-bottom: 30px; | |
| } | |
| .metrics-section details { | |
| background: linear-gradient(145deg, rgba(240, 248, 255, 0.9), rgba(230, 243, 255, 0.9)); | |
| border: 2px solid rgba(70, 130, 180, 0.4); | |
| border-radius: 12px; | |
| padding: 20px; | |
| margin-bottom: 20px; | |
| box-shadow: 0 4px 15px rgba(70, 130, 180, 0.2); | |
| } | |
| .metrics-section summary { | |
| background: linear-gradient(45deg, #0066cc, #007bff); | |
| -webkit-background-clip: text; | |
| -webkit-text-fill-color: transparent; | |
| background-clip: text; | |
| font-size: 18px; | |
| cursor: pointer; | |
| outline: none; | |
| padding: 8px 0; | |
| text-align: center; | |
| font-weight: 600; | |
| transition: all 0.3s ease; | |
| } | |
| .metrics-section summary:hover { | |
| text-shadow: 0 0 8px rgba(0, 191, 255, 0.6); | |
| } | |
| .creator-section { | |
| margin: 20px 0; | |
| text-align: center; | |
| } | |
| .creator-badge { | |
| display: inline-flex; | |
| align-items: center; | |
| background: linear-gradient(145deg, rgba(240, 248, 255, 0.9), rgba(230, 243, 255, 0.9)); | |
| border: 2px solid rgba(70, 130, 180, 0.4); | |
| border-radius: 25px; | |
| padding: 15px 20px; | |
| box-shadow: 0 4px 15px rgba(70, 130, 180, 0.3); | |
| } | |
| .creator-label { | |
| color: #1e3a5f; | |
| font-size: 14px; | |
| margin-right: 10px; | |
| font-weight: 500; | |
| } | |
| .creator-link { | |
| display: flex; | |
| align-items: center; | |
| gap: 8px; | |
| color: #0066cc; | |
| text-decoration: none; | |
| transition: all 0.3s ease; | |
| } | |
| .creator-name { | |
| font-weight: 600; | |
| } | |
| .creator-arrow { | |
| font-size: 16px; | |
| transition: transform 0.3s ease; | |
| } | |
| .creator-link:hover .creator-arrow { | |
| transform: translateX(4px); | |
| color: #007bff; | |
| } | |
| .creator-link:hover { | |
| color: #007bff; | |
| text-shadow: 0 0 8px rgba(0, 191, 255, 0.6); | |
| } | |
| .link-arrow { | |
| display: inline-block; | |
| transition: transform 0.3s ease; | |
| } | |
| a:hover .link-arrow { | |
| transform: translateX(3px); | |
| } | |
| .axolotl-container { | |
| display: flex; | |
| text-align: center; | |
| justify-content: center; | |
| margin: 30px 0; | |
| } | |
| .axolotl-container img { | |
| max-width: 300px; | |
| border-radius: 15px; | |
| box-shadow: 0 6px 20px rgba(70, 130, 180, 0.4); | |
| border: 2px solid rgba(135, 206, 235, 0.5); | |
| transition: transform 0.3s ease; | |
| display: block; | |
| margin: 0 auto; | |
| } | |
| .axolotl-container img:hover { | |
| transform: scale(1.05); | |
| } | |
| </style> | |
| </head> | |
| <body> | |
| <div class="container"> | |
| <div class="header"> | |
| <h1>Plesio-32B</h1> | |
| </div> | |
| <div class="info"> | |
| <img src="https://files.catbox.moe/opd2nm.jpg" alt="Model banner"> | |
| <div style="text-align: center;"> | |
| <div class="creator-section"> | |
| <div class="creator-badge"> | |
| <span class="creator-label">Created by</span> | |
| <a href="https://huggingface.co/Delta-Vector" target="_blank" class="creator-link"> | |
| <span class="creator-name">Delta-Vector</span> | |
| <span class="creator-arrow">→</span> | |
| </a> | |
| </div> | |
| </div> | |
| <div class="model-info"> | |
| <h2>Model Information</h2> | |
| <div class="info-card"> | |
| <div class="info-header"> | |
| <h3>Plesio-32B</h3> | |
| <div class="model-tags"> | |
| <span class="model-tag">32B parameters</span> | |
| <span class="model-tag">GLM-4 32B</span> | |
| <span class="model-tag">Creative / Fresh Prose</span> | |
| <span class="model-tag">Co-writing/Roleplay/Adventure Generalist</span> | |
| </div> | |
| </div> | |
| <div class="model-description"> | |
| <p>Another Series of Merges! Since i could never beat Archaeo-32B-KTO! This time starting off with a GLM merge between Rei and Neon (thanks auri!!!)</p> | |
| <p>Using the Oh-so-great 0.2 Slerp merge weight with Neon as the Base.</p> | |
| <p>Support me on Ko-Fi: https://ko-fi.com/deltavector</p> | |
| </div> | |
| </div> | |
| </div> | |
| <div class="section"> | |
| <h2>Quantized Versions</h2> | |
| <div class="info-card"> | |
| <div class="model-composition"> | |
| <h4>Available Downloads</h4> | |
| <ul class="composition-list"> | |
| <li><span class="model-component"><a href="" target="_blank">GGUF Format</a></span>For use with LLama.cpp & Forks(Coming Soon!)</li> | |
| <li><span class="model-component"><a href="" target="_blank">EXL2 Format</a></span>For use with TabbyAPI (Coming Soon!)</li> | |
| <li><span class="model-component"><a href="https://huggingface.co/Delta-Vector/Plesio-32B-exl3" target="_blank">EXL3 Format</a></span>For use with TabbyAPI (Slower on Ampere))</li> | |
| </ul> | |
| </div> | |
| </div> | |
| </div> | |
| <div class="section"> | |
| <h2>Prompting</h2> | |
| <p>Model has been tuned with the GLM-4 formatting.</p> | |
| </div> | |
| <div class="section"> | |
| <h2>Samplers</h2> | |
| <p>For testing of this model, I used Temp=1, 0.1 Min-P.</p> | |
| <div class="metrics-section"> | |
| <details> | |
| <summary>See Merging Config</summary> | |
| <pre>https://files.catbox.moe/j9kyfy.yml<code> | |
| </code></pre> | |
| </details> | |
| </div> | |
| </div> | |
| <div class="section"> | |
| <h2>Credits</h2> | |
| <p>Thank you to <a href="https://huggingface.co/lucyknada">Lucy Knada</a>, <a href="https://huggingface.co/AuriAetherwiing">Auri</a>, <a href="https://huggingface.co/Ateron">Ateron</a>, <a href="https://huggingface.co/AliCat2">Alicat</a>, <a href="https://huggingface.co/intervitens">Intervitens</a>, <a href="https://huggingface.co/cgato">Cgato</a>, <a href="https://huggingface.co/kubernetes-bad">Kubernetes Bad</a> and the rest of <a href="https://huggingface.co/anthracite-org">Anthracite</a>.</p> | |
| </div> | |
| </div> | |
| </div> | |
| </body> | |
| </html> |