Instructions to use AiArtLab/sdxs-1b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use AiArtLab/sdxs-1b with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("AiArtLab/sdxs-1b", dtype=torch.bfloat16, device_map="cuda") prompt = "sdxs-1b" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
Update README.md
Browse files
README.md
CHANGED
|
@@ -233,18 +233,21 @@ image = pipeline(
|
|
| 233 |
|
| 234 |
The VAE in Simple Diffusion utilizes an asymmetric VAE architecture featuring an 8x encoder and a 16x decoder. While a compression factor of 8 is maintained during training, the resolution is effectively doubled during inference through an additional upscaling block. This strategy reduces training costs by an order of magnitude and boosts inference speed without perceptual quality loss. Effectively, this acts as an integrated latent upscaler. To ensure a fair comparison with other VAEs, we downsampled the generated images to match the input resolution for metric evaluation. The SDXS VAE was not trained from scratch but was initialized from weights of FLUX 2 VAE, then redisigned and retrained. We also trained [16 ch vae](https://huggingface.co/AiArtLab/simplevae) with flux.1 quality based on aura vae.
|
| 235 |
|
| 236 |
-
[eval.py](src/eval.py)
|
| 237 |
```
|
| 238 |
-
|
| 239 |
-
|
| 240 |
-
FLUX.
|
| 241 |
-
|
| 242 |
-
|
| 243 |
-
|
| 244 |
-
|
| 245 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 246 |
```
|
| 247 |
-
To the best of our knowledge, this VAE achieves SOTA
|
| 248 |
|
| 249 |
### Unet
|
| 250 |
|
|
|
|
| 233 |
|
| 234 |
The VAE in Simple Diffusion utilizes an asymmetric VAE architecture featuring an 8x encoder and a 16x decoder. While a compression factor of 8 is maintained during training, the resolution is effectively doubled during inference through an additional upscaling block. This strategy reduces training costs by an order of magnitude and boosts inference speed without perceptual quality loss. Effectively, this acts as an integrated latent upscaler. To ensure a fair comparison with other VAEs, we downsampled the generated images to match the input resolution for metric evaluation. The SDXS VAE was not trained from scratch but was initialized from weights of FLUX 2 VAE, then redisigned and retrained. We also trained [16 ch vae](https://huggingface.co/AiArtLab/simplevae) with flux.1 quality based on aura vae.
|
| 235 |
|
|
|
|
| 236 |
```
|
| 237 |
+
Wan2.2-T2V-A14B | MSE=8.908e-04 PSNR=33.21 LPIPS=0.052
|
| 238 |
+
FLUX.1-schnell VAE | MSE=6.020e-04 PSNR=34.59 LPIPS=0.038
|
| 239 |
+
FLUX.2-klein-9B | MSE=3.638e-04 PSNR=36.60 LPIPS=0.025
|
| 240 |
+
sdxs-1b | MSE=3.491e-04 PSNR=36.95 LPIPS=0.027
|
| 241 |
+
|
| 242 |
+
=== Percents ===
|
| 243 |
+
| Модель | MSE | PSNR | LPIPS | Edge | Skew|0 | Kurt|0 |
|
| 244 |
+
|----------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
|
| 245 |
+
| Wan2.2-T2V-A14B | 100% | 100% | 100% | 100% | 100% | 100% |
|
| 246 |
+
| FLUX.1-schnell VAE | 148.0% | 104.2% | 136.7% | 128.8% | 104.9% | 112.2% |
|
| 247 |
+
| FLUX.2-klein-9B | 244.8% | 110.2% | 209.7% | 165.9% | 93.2% | 118.3% |
|
| 248 |
+
| sdxs-1b | 255.2% | 111.2% | 193.7% | 171.6% | 93.3% | 118.2% |
|
| 249 |
```
|
| 250 |
+
To the best of our knowledge, this VAE achieves SOTA: [eval.py](src/eval.py)
|
| 251 |
|
| 252 |
### Unet
|
| 253 |
|