Instructions to use Metal079/SonicDiffusionV2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use Metal079/SonicDiffusionV2 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Metal079/SonicDiffusionV2", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
Update README.md
Browse files
README.md
CHANGED
|
@@ -1 +1,36 @@
|
|
| 1 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
SonicDiffusionV2.ckpt was trained on AnythingV3 for 200 epochs of 203 hand captioned images from various artists.
|
| 2 |
+
Much more customizable in style and context from previous version
|
| 3 |
+
Examples:
|
| 4 |
+
mobian walking in a snowy sidewalk while drinking coffee
|
| 5 |
+

|
| 6 |
+
|
| 7 |
+
((masterpiece, best quality, very detailed eyes,official art, 8k,4k,2k)),intricate details, illustration,(((goddess))),(extremely detailed clothes),((looking up)),((fromabove)), perfect face, detailed face,smile, 1girl,((light blue eyes)),blonde hair, halo, ((glowing light,))upper body,(angel wings),(heavenly background)
|
| 8 |
+

|
| 9 |
+
|
| 10 |
+
mobian studying for a test
|
| 11 |
+

|
| 12 |
+
|
| 13 |
+
mobian, 1girl, baggy black priest clothes, chains, messy blonde hair, glowing eyes, detailed, :D, golden staff, fantasy, golden light, magic circle, windy, forest
|
| 14 |
+

|
| 15 |
+
|
| 16 |
+
SD2.1 version:
|
| 17 |
+
I also attempted to create a SD2.1 version using the same images, my computer crashed at 30000 steps but the results are still pretty nice.
|
| 18 |
+
It especially excels at adding styles.
|
| 19 |
+
Heres some examples:
|
| 20 |
+
|
| 21 |
+
mobian in ww1 gear, portrait, regal
|
| 22 |
+

|
| 23 |
+
|
| 24 |
+
mobian mage doing research in lab, portrait, regal, painting
|
| 25 |
+

|
| 26 |
+
|
| 27 |
+
Limitations:
|
| 28 |
+
Many of the input images were of female mobians and as such the model has a tendency to create females, adding 'boy' should help.
|
| 29 |
+
|
| 30 |
+
Due to the way I cropped the images, images tend to generate a 'blur' around the edge photos. Next time I might just leave them as is and see what happens.
|
| 31 |
+
|
| 32 |
+
More images of different scenarios should be added, I tried to add as many as I could but there's a lot of room for improvement.
|
| 33 |
+
|
| 34 |
+
Help:
|
| 35 |
+
If you would like to help with gathering or captioning images please message me at Metal#0407 on discord.
|
| 36 |
+
|