Text Generation
Transformers
Safetensors
English
qwen3_5
image-text-to-text
unsloth
lora
rewriting
style-transfer
unslop
conversational
Instructions to use Oysiyl/qwen3.5-9b-unslop-good-lora-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Oysiyl/qwen3.5-9b-unslop-good-lora-v1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Oysiyl/qwen3.5-9b-unslop-good-lora-v1") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("Oysiyl/qwen3.5-9b-unslop-good-lora-v1") model = AutoModelForMultimodalLM.from_pretrained("Oysiyl/qwen3.5-9b-unslop-good-lora-v1", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Oysiyl/qwen3.5-9b-unslop-good-lora-v1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Oysiyl/qwen3.5-9b-unslop-good-lora-v1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Oysiyl/qwen3.5-9b-unslop-good-lora-v1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Oysiyl/qwen3.5-9b-unslop-good-lora-v1
- SGLang
How to use Oysiyl/qwen3.5-9b-unslop-good-lora-v1 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Oysiyl/qwen3.5-9b-unslop-good-lora-v1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Oysiyl/qwen3.5-9b-unslop-good-lora-v1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Oysiyl/qwen3.5-9b-unslop-good-lora-v1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Oysiyl/qwen3.5-9b-unslop-good-lora-v1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Unsloth Desktop
- Docker Model Runner
How to use Oysiyl/qwen3.5-9b-unslop-good-lora-v1 with Docker Model Runner:
docker model run hf.co/Oysiyl/qwen3.5-9b-unslop-good-lora-v1
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -82,40 +82,29 @@ Use this full fiction passage for held-out testing:
|
|
| 82 |
|
| 83 |
## Full observed output on that sample
|
| 84 |
|
| 85 |
-
|
| 86 |
|
| 87 |
Short sanity sample observed output:
|
| 88 |
|
| 89 |
-
>
|
| 90 |
-
|
| 91 |
-
|
| 92 |
-
> * **Input:** "This feature saves teams hours every week, but the copy sounds too robotic and generic."
|
| 93 |
-
> * **Task:** Polish this AI passage to feel more human while preserving meaning.
|
| 94 |
-
> * **Goal:** Make it sound less like an AI generated it and more like a natural human wrote it, without changing the core message.
|
| 95 |
-
>
|
| 96 |
-
> ...and it continued with analysis instead of returning only the rewritten line.
|
| 97 |
|
| 98 |
Held-out fiction sample observed output:
|
| 99 |
|
| 100 |
-
>
|
| 101 |
-
>
|
| 102 |
-
> 1. **Analyze the Request:**
|
| 103 |
-
> * **Task:** Polish an AI-generated passage to make it feel more human while preserving the original meaning.
|
| 104 |
-
> * **Input Text:** A dramatic scene involving two characters on a mountain pass...
|
| 105 |
-
> * **Goal:** Enhance flow, imagery, emotional resonance, and voice without altering the core narrative.
|
| 106 |
-
>
|
| 107 |
-
> ...and it again continued with reasoning / commentary instead of a direct rewritten passage.
|
| 108 |
|
| 109 |
## Judgment
|
| 110 |
|
| 111 |
-
Blunt judgment:
|
| 112 |
|
| 113 |
Why:
|
| 114 |
-
- the
|
| 115 |
-
-
|
| 116 |
-
-
|
|
|
|
| 117 |
|
| 118 |
-
So the
|
| 119 |
|
| 120 |
## Comparison vs pilot series
|
| 121 |
|
|
@@ -123,8 +112,8 @@ So the result is informative but negative: the 9B Qwen 3.5 lane is operationally
|
|
| 123 |
- **1.7B**: more fluent than 0.6B, but still invented scenes and structure
|
| 124 |
- **4B**: first clearly improved text-only model in the series; mostly kept the scene intact, but still drifted and over-shaped the prose
|
| 125 |
- **30B-A3B VL Instruct**: first model in the series that looked plausibly faithful on held-out evaluation
|
| 126 |
-
- **Qwen3.5 9B**:
|
| 127 |
|
| 128 |
## Conclusion
|
| 129 |
|
| 130 |
-
This repo is now a real post-run artifact with deployment-backed evaluation notes. The
|
|
|
|
| 82 |
|
| 83 |
## Full observed output on that sample
|
| 84 |
|
| 85 |
+
After switching the live Modal endpoint to Qwen 3.5's official non-thinking mode (`enable_thinking=False` in the chat template), the model stopped emitting reasoning scaffolding and produced direct rewrite output.
|
| 86 |
|
| 87 |
Short sanity sample observed output:
|
| 88 |
|
| 89 |
+
> This feature saves teams hours every week, but the copy sounds too robotic and generic.
|
| 90 |
+
|
| 91 |
+
This is clean in format (no visible thinking), but it is basically a no-op rewrite.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 92 |
|
| 93 |
Held-out fiction sample observed output:
|
| 94 |
|
| 95 |
+
> The wind came up all at once, as if the mountain had inhaled. She stood at the edge of the pass, her cloak flapping like a torn banner behind her, and looked down into the valley, where the last lights were going out one by one. Each one she saw go out was an answer to a question she had never dared to ask. She heard bells in the valley, not a warning but a funeral. They already knew. Don't, he said, breathless, his hand on her arm. His hand touched her cloak, then nothing. If you cross that line, there is no going back. She did not turn. The cold burned her lungs, made her think clearly. There was no going back, she said. Only a going forward you were willing to pretend didn't exist. Thunder rolled, low and far away. For a moment the sky was white fire, and in that moment he saw her face, set, terrified, blazing with purpose. Not the girl he had promised to protect, but the woman the world had made her. You will die, he said. She smiled then, and turned to face him, her eyes wet. So will everyone, she said. The difference is what we leave burning when we are gone
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 96 |
|
| 97 |
## Judgment
|
| 98 |
|
| 99 |
+
Blunt judgment: non-thinking mode fixes the serving format, but the actual rewrite quality is still mixed.
|
| 100 |
|
| 101 |
Why:
|
| 102 |
+
- the endpoint now behaves like a rewrite endpoint instead of a reasoning endpoint
|
| 103 |
+
- the model returns direct prose rather than `Thinking Process` scaffolding
|
| 104 |
+
- but on the held-out sample it mostly simplifies and flattens the prose rather than producing a clearly stronger human rewrite
|
| 105 |
+
- on the short sanity sample it barely rewrites at all
|
| 106 |
|
| 107 |
+
So this is a meaningful improvement over the earlier deployment-backed result, but still not a strong positive evaluation. The 9B lane is now operationally and format-wise usable; it is just not yet convincingly good enough on quality to declare it the production unslop endpoint.
|
| 108 |
|
| 109 |
## Comparison vs pilot series
|
| 110 |
|
|
|
|
| 112 |
- **1.7B**: more fluent than 0.6B, but still invented scenes and structure
|
| 113 |
- **4B**: first clearly improved text-only model in the series; mostly kept the scene intact, but still drifted and over-shaped the prose
|
| 114 |
- **30B-A3B VL Instruct**: first model in the series that looked plausibly faithful on held-out evaluation
|
| 115 |
+
- **Qwen3.5 9B**: official non-thinking mode fixes the reasoning-scaffold failure, but the rewrite quality still looks middling rather than clearly strong
|
| 116 |
|
| 117 |
## Conclusion
|
| 118 |
|
| 119 |
+
This repo is now a real post-run artifact with deployment-backed evaluation notes. The key result is that Qwen 3.5's official non-thinking mode materially changes serving behavior: the model can now be used as a direct rewrite endpoint without visible reasoning scaffolding. However, the actual rewrite quality is still only middling on the tested samples. So this remains a useful experiment result and a viable serving path, but not yet a strong enough model to promote as the production unslop endpoint.
|