Text-to-Image
Diffusers
stable-diffusion-xl
sdxl
lora
control
controlnet
control-lora
brightness
grayscale
template:sd-lora
Instructions to use Oysiyl/controlnet-lora-brightness-sdxl with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use Oysiyl/controlnet-lora-brightness-sdxl with Diffusers:
pip install -U diffusers transformers accelerate
from diffusers import ControlNetModel, StableDiffusionControlNetPipeline controlnet = ControlNetModel.from_pretrained("Oysiyl/controlnet-lora-brightness-sdxl") pipe = StableDiffusionControlNetPipeline.from_pretrained( "stabilityai/stable-diffusion-xl-base-1.0", controlnet=controlnet ) - Inference
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
Update README: Fix image URLs, show all 7 scale comparisons, update repo references
Browse files
README.md
CHANGED
|
@@ -16,7 +16,7 @@ tags:
|
|
| 16 |
widget:
|
| 17 |
- text: "a beautiful garden scene with colorful flowers and butterflies, highly detailed, professional photography, vibrant colors"
|
| 18 |
output:
|
| 19 |
-
url: "https://huggingface.co/Oysiyl/controlnet-lora-brightness-sdxl
|
| 20 |
inference: true
|
| 21 |
---
|
| 22 |
|
|
@@ -121,7 +121,7 @@ pipe = StableDiffusionXLControlLoraV3Pipeline.from_pretrained(
|
|
| 121 |
)
|
| 122 |
|
| 123 |
# Load Control LoRA weights
|
| 124 |
-
pipe.load_lora_weights("Oysiyl/controlnet-lora-brightness-sdxl
|
| 125 |
pipe.to("cuda")
|
| 126 |
|
| 127 |
# Load grayscale/brightness control image
|
|
@@ -213,24 +213,24 @@ The model includes intermediate checkpoints from throughout training:
|
|
| 213 |
|
| 214 |
```python
|
| 215 |
# Early checkpoint (25% - 2,500 samples)
|
| 216 |
-
pipe.load_lora_weights("Oysiyl/controlnet-lora-brightness-sdxl
|
| 217 |
adapter_name="brightness",
|
| 218 |
-
|
| 219 |
|
| 220 |
# Mid checkpoint (50% - 5,000 samples)
|
| 221 |
-
pipe.load_lora_weights("Oysiyl/controlnet-lora-brightness-sdxl
|
| 222 |
adapter_name="brightness",
|
| 223 |
-
|
| 224 |
|
| 225 |
# Late checkpoint (75% - 7,500 samples)
|
| 226 |
-
pipe.load_lora_weights("Oysiyl/controlnet-lora-brightness-sdxl
|
| 227 |
adapter_name="brightness",
|
| 228 |
-
|
| 229 |
|
| 230 |
# Near-final checkpoint (99% - 9,984 samples)
|
| 231 |
-
pipe.load_lora_weights("Oysiyl/controlnet-lora-brightness-sdxl
|
| 232 |
adapter_name="brightness",
|
| 233 |
-
|
| 234 |
|
| 235 |
# Final model (10,000 samples, main branch - recommended)
|
| 236 |
pipe.load_lora_weights("Oysiyl/controlnet-lora-brightness-sdxl-10k",
|
|
@@ -286,9 +286,25 @@ The model includes checkpoints from throughout training:
|
|
| 286 |
|
| 287 |
### Visual Comparison
|
| 288 |
|
| 289 |
-
|
|
|
|
|
|
|
|
|
|
| 290 |
|
| 291 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 292 |
|
| 293 |
### Key Observations
|
| 294 |
|
|
@@ -388,24 +404,26 @@ accelerate launch --mixed_precision="bf16" train_sdxl.py \
|
|
| 388 |
--init_lora_weights="gaussian"
|
| 389 |
```
|
| 390 |
|
| 391 |
-
## Available
|
|
|
|
|
|
|
| 392 |
|
| 393 |
-
-
|
| 394 |
-
-
|
| 395 |
-
-
|
| 396 |
-
-
|
| 397 |
-
-
|
| 398 |
|
| 399 |
## Citation
|
| 400 |
|
| 401 |
```bibtex
|
| 402 |
-
@misc{controlnet-lora-brightness-sdxl
|
| 403 |
author = {Oysiyl},
|
| 404 |
title = {ControlNet LoRA SDXL - Brightness Control (10k @ 1024×1024)},
|
| 405 |
year = {2026},
|
| 406 |
publisher = {HuggingFace},
|
| 407 |
journal = {HuggingFace Model Hub},
|
| 408 |
-
howpublished = {\url{https://huggingface.co/Oysiyl/controlnet-lora-brightness-sdxl
|
| 409 |
}
|
| 410 |
```
|
| 411 |
|
|
|
|
| 16 |
widget:
|
| 17 |
- text: "a beautiful garden scene with colorful flowers and butterflies, highly detailed, professional photography, vibrant colors"
|
| 18 |
output:
|
| 19 |
+
url: "https://huggingface.co/Oysiyl/controlnet-lora-brightness-sdxl/resolve/main/examples/example.png"
|
| 20 |
inference: true
|
| 21 |
---
|
| 22 |
|
|
|
|
| 121 |
)
|
| 122 |
|
| 123 |
# Load Control LoRA weights
|
| 124 |
+
pipe.load_lora_weights("Oysiyl/controlnet-lora-brightness-sdxl", adapter_name="brightness")
|
| 125 |
pipe.to("cuda")
|
| 126 |
|
| 127 |
# Load grayscale/brightness control image
|
|
|
|
| 213 |
|
| 214 |
```python
|
| 215 |
# Early checkpoint (25% - 2,500 samples)
|
| 216 |
+
pipe.load_lora_weights("Oysiyl/controlnet-lora-brightness-sdxl",
|
| 217 |
adapter_name="brightness",
|
| 218 |
+
subfolder="checkpoint-78")
|
| 219 |
|
| 220 |
# Mid checkpoint (50% - 5,000 samples)
|
| 221 |
+
pipe.load_lora_weights("Oysiyl/controlnet-lora-brightness-sdxl",
|
| 222 |
adapter_name="brightness",
|
| 223 |
+
subfolder="checkpoint-156")
|
| 224 |
|
| 225 |
# Late checkpoint (75% - 7,500 samples)
|
| 226 |
+
pipe.load_lora_weights("Oysiyl/controlnet-lora-brightness-sdxl",
|
| 227 |
adapter_name="brightness",
|
| 228 |
+
subfolder="checkpoint-234")
|
| 229 |
|
| 230 |
# Near-final checkpoint (99% - 9,984 samples)
|
| 231 |
+
pipe.load_lora_weights("Oysiyl/controlnet-lora-brightness-sdxl",
|
| 232 |
adapter_name="brightness",
|
| 233 |
+
subfolder="checkpoint-312")
|
| 234 |
|
| 235 |
# Final model (10,000 samples, main branch - recommended)
|
| 236 |
pipe.load_lora_weights("Oysiyl/controlnet-lora-brightness-sdxl-10k",
|
|
|
|
| 286 |
|
| 287 |
### Visual Comparison
|
| 288 |
|
| 289 |
+
Each comparison shows QR input + all 5 checkpoints (25%, 50%, 75%, 99%, 100%) at different conditioning scales:
|
| 290 |
+
|
| 291 |
+
#### Scale 0.25 (Subtle Control)
|
| 292 |
+

|
| 293 |
|
| 294 |
+
#### Scale 0.5 (Light Control)
|
| 295 |
+

|
| 296 |
+
|
| 297 |
+
#### Scale 0.7 (Moderate Control)
|
| 298 |
+

|
| 299 |
+
|
| 300 |
+
#### Scale 1.0 (Balanced Control - Recommended)
|
| 301 |
+

|
| 302 |
+
|
| 303 |
+
#### Scale 1.25 (Strong Control)
|
| 304 |
+

|
| 305 |
+
|
| 306 |
+
#### Scale 1.5 (Very Strong Control)
|
| 307 |
+

|
| 308 |
|
| 309 |
### Key Observations
|
| 310 |
|
|
|
|
| 404 |
--init_lora_weights="gaussian"
|
| 405 |
```
|
| 406 |
|
| 407 |
+
## Available Checkpoints
|
| 408 |
+
|
| 409 |
+
All checkpoints are available in the main branch:
|
| 410 |
|
| 411 |
+
- **Root directory**: Final model (10,000 samples, recommended)
|
| 412 |
+
- **checkpoint-78/**: Early checkpoint (2,500 samples, 25% trained)
|
| 413 |
+
- **checkpoint-156/**: Mid checkpoint (5,000 samples, 50% trained)
|
| 414 |
+
- **checkpoint-234/**: Late checkpoint (7,500 samples, 75% trained)
|
| 415 |
+
- **checkpoint-312/**: Near-final checkpoint (9,984 samples, 99% trained)
|
| 416 |
|
| 417 |
## Citation
|
| 418 |
|
| 419 |
```bibtex
|
| 420 |
+
@misc{controlnet-lora-brightness-sdxl,
|
| 421 |
author = {Oysiyl},
|
| 422 |
title = {ControlNet LoRA SDXL - Brightness Control (10k @ 1024×1024)},
|
| 423 |
year = {2026},
|
| 424 |
publisher = {HuggingFace},
|
| 425 |
journal = {HuggingFace Model Hub},
|
| 426 |
+
howpublished = {\url{https://huggingface.co/Oysiyl/controlnet-lora-brightness-sdxl}}
|
| 427 |
}
|
| 428 |
```
|
| 429 |
|