Instructions to use WhiteAiZ/Illustrious-xl-v1.0 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use WhiteAiZ/Illustrious-xl-v1.0 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("WhiteAiZ/Illustrious-xl-v1.0", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,10 +1,84 @@
|
|
| 1 |
---
|
| 2 |
-
license:
|
| 3 |
-
|
| 4 |
-
- en
|
| 5 |
-
library_name: diffusers
|
| 6 |
pipeline_tag: text-to-image
|
| 7 |
-
tags:
|
| 8 |
-
- text-to-image
|
| 9 |
---
|
| 10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
license: mit
|
| 3 |
+
base_model: OnomaAIResearch/Illustrious-xl-early-release-v0
|
|
|
|
|
|
|
| 4 |
pipeline_tag: text-to-image
|
|
|
|
|
|
|
| 5 |
---
|
| 6 |
+
|
| 7 |
+
# Illustrious XL v1.0 β High-Resolution Focused Illustration Generative Model
|
| 8 |
+
|
| 9 |
+
|
| 10 |
+
|
| 11 |
+
## Overview
|
| 12 |
+
|
| 13 |
+
**Illustrious XL v1.0** is a cutting-edge generative model developed by **OnomaAI**, built on the **Stable Diffusion XL** architecture. It is trained from our previous checkpoint, **Illustrious XL v0.1**, and designed to produce stunning **high-resolution images**.
|
| 14 |
+
|
| 15 |
+
It achieves an unprecedented **native resolution of 1536Γ1536** within the **SDXL** framework, pushing beyond previous limits in **detail and clarity**. The model seamlessly blends **natural language understanding** with **tag-based prompting** (Danbooru style), allowing both **descriptive sentences** and **specific tags** for **flexible and robust** prompt handling.
|
| 16 |
+
|
| 17 |
+
As a result, **Illustrious XL v1.0** is a powerful foundation for creators seeking **versatility in content generation without sacrificing fidelity**.
|
| 18 |
+
|
| 19 |
+
---
|
| 20 |
+
|
| 21 |
+
## Knowledge Cutoff
|
| 22 |
+
|
| 23 |
+
**Illustrious XL v1.0** was trained in **July 2024**, with knowledge up to **June 2024**.
|
| 24 |
+
|
| 25 |
+
However, due to its **native support of v0.1 LoRA**, you might not have to worry about knowledge limits!
|
| 26 |
+
|
| 27 |
+
---
|
| 28 |
+
|
| 29 |
+
## Key Features
|
| 30 |
+
|
| 31 |
+
### π 1536Γ1536 Native Resolution
|
| 32 |
+
|
| 33 |
+
- First-of-its-kind **Stable Diffusion XL** model to natively support **1536px resolution**.
|
| 34 |
+
- Generates images with **exceptional detail, sharpness, and clarity** at high resolutions that were previously unattainable in **SDXL**.
|
| 35 |
+
- Supports a **wide range of resolutions** between **512Γ512 to 1536Γ1536** β resolutions like **1248Γ1824** are possible without **high-resolution modifications**.
|
| 36 |
+
|
| 37 |
+
### π§ NLP + Tag-Based Prompting
|
| 38 |
+
|
| 39 |
+
- Integrates **advanced natural language processing** with **Danbooru tag-based prompts**.
|
| 40 |
+
- **Tag-based approaches** are more **concise and accurate**, but this hybrid prompt system means you can use:
|
| 41 |
+
- **Plain English descriptions**
|
| 42 |
+
- **Precise tags**
|
| 43 |
+
- **Or both together**
|
| 44 |
+
- The model understands and **leverages each**, giving you **greater control** and **nuance** in image generation.
|
| 45 |
+
|
| 46 |
+
### π Extensive Compatibility
|
| 47 |
+
|
| 48 |
+
- Fully compatible with a wide range of **extensions and add-ons**.
|
| 49 |
+
- Supports **LoRA**, **ControlNet modules**, and other adaptation methods trained on **Illustrious v0.1**.
|
| 50 |
+
- You can **mix and match enhancements** to fine-tune style, pose, or composition **without breaking compatibility**.
|
| 51 |
+
|
| 52 |
+
### ποΈ Pretrained Base Model
|
| 53 |
+
|
| 54 |
+
- **Illustrious XL v1.0** is provided as a **pretrained base checkpoint** without **fine-tuning** on specific aesthetics or biases.
|
| 55 |
+
- This **"raw" model** offers a **robust foundation** for further training.
|
| 56 |
+
- Ideal for creators who want to **apply their own fine-tuning** (e.g., **LoRA training**) to achieve **particular art styles** or **specialized outputs**.
|
| 57 |
+
- A **flexible starting point** for **new innovations**.
|
| 58 |
+
|
| 59 |
+
---
|
| 60 |
+
|
| 61 |
+
## Future Plans
|
| 62 |
+
|
| 63 |
+
### π Higher Resolutions in v2/v3
|
| 64 |
+
|
| 65 |
+
- Upcoming versions (**Illustrious XL v2 and v3**) are planned to support even **larger resolutions**, targeting up to **2K resolution and beyond**.
|
| 66 |
+
- Expect **even more detail** and **scaling capability**, enabling **ultra-crisp large-format images**.
|
| 67 |
+
|
| 68 |
+
### π¨ v-Parameterization Models & Color Control
|
| 69 |
+
|
| 70 |
+
- A specialized **v-parameterization variant** is ready, **breaking SDXL's previously considered limits** β both academically and practically.
|
| 71 |
+
- Future releases will focus on **enhanced color control**, allowing users **finer adjustments** over **color balance** and **consistency** in generated images.
|
| 72 |
+
|
| 73 |
+
### π Continuous Improvement
|
| 74 |
+
|
| 75 |
+
- The **Illustrious roadmap** is ambitious β each iteration will integrate **community feedback** and the **latest research**.
|
| 76 |
+
- We will continue **high-resolution research**, breaking previously considered limits with **careful and sophisticated approaches**.
|
| 77 |
+
|
| 78 |
+
---
|
| 79 |
+
|
| 80 |
+
## Useful Links
|
| 81 |
+
|
| 82 |
+
- **[Illustrious v0.1 (Hugging Face)](https://huggingface.co/)**
|
| 83 |
+
- **[OnomaAI TooToon](https://tootoon.ai/)**
|
| 84 |
+
- **[Terms of Use](#)**
|