Upload README.md with huggingface_hub
Browse files
README.md
ADDED
|
@@ -0,0 +1,460 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# AI Toolkit by Ostris
|
| 2 |
+
|
| 3 |
+
AI Toolkit is an all in one training suite for diffusion models. I try to support all the latest models on consumer grade hardware. Image and video models. It can be run as a GUI or CLI. It is designed to be easy to use but still have every feature imaginable.
|
| 4 |
+
|
| 5 |
+
## Support My Work
|
| 6 |
+
|
| 7 |
+
If you enjoy my projects or use them commercially, please consider sponsoring me. Every bit helps! 💖
|
| 8 |
+
|
| 9 |
+
[Sponsor on GitHub](https://github.com/orgs/ostris) | [Support on Patreon](https://www.patreon.com/ostris) | [Donate on PayPal](https://www.paypal.com/donate/?hosted_button_id=9GEFUKC8T9R9W)
|
| 10 |
+
|
| 11 |
+
### Current Sponsors
|
| 12 |
+
|
| 13 |
+
All of these people / organizations are the ones who selflessly make this project possible. Thank you!!
|
| 14 |
+
|
| 15 |
+
_Last updated: 2025-08-23 14:55 UTC_
|
| 16 |
+
|
| 17 |
+
<p align="center">
|
| 18 |
+
<a href="https://x.com/NuxZoe" target="_blank" rel="noopener noreferrer"><img src="https://pbs.twimg.com/profile_images/1919488160125616128/QAZXTMEj_400x400.png" alt="a16z" width="200" height="200" style="border-radius:8px;margin:5px;display: inline-block;"></a>
|
| 19 |
+
<a href="https://github.com/replicate" target="_blank" rel="noopener noreferrer"><img src="https://avatars.githubusercontent.com/u/60410876?v=4" alt="Replicate" width="200" height="200" style="border-radius:8px;margin:5px;display: inline-block;"></a>
|
| 20 |
+
<a href="https://github.com/huggingface" target="_blank" rel="noopener noreferrer"><img src="https://avatars.githubusercontent.com/u/25720743?v=4" alt="Hugging Face" width="200" height="200" style="border-radius:8px;margin:5px;display: inline-block;"></a>
|
| 21 |
+
<a href="https://github.com/josephrocca" target="_blank" rel="noopener noreferrer"><img src="https://avatars.githubusercontent.com/u/1167575?u=92d92921b4cb5c8c7e225663fed53c4b41897736&v=4" alt="josephrocca" width="200" height="200" style="border-radius:8px;margin:5px;display: inline-block;"></a>
|
| 22 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/162524101/81a72689c3754ac5b9e38612ce5ce914/eyJ3IjoyMDB9/1.png?token-hash=JHRjAxd2XxV1aXIUijj-l65pfTnLoefYSvgNPAsw2lI%3D" alt="Prasanth Veerina" width="200" height="200" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 23 |
+
<a href="https://github.com/weights-ai" target="_blank" rel="noopener noreferrer"><img src="https://avatars.githubusercontent.com/u/185568492?v=4" alt="Weights" width="200" height="200" style="border-radius:8px;margin:5px;display: inline-block;"></a>
|
| 24 |
+
</p>
|
| 25 |
+
<hr style="width:100%;border:none;height:2px;background:#ddd;margin:30px 0;">
|
| 26 |
+
<p align="center">
|
| 27 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/161471720/dd330b4036d44a5985ed5985c12a5def/eyJ3IjoyMDB9/1.jpeg?token-hash=k1f4Vv7TevzYa9tqlzAjsogYmkZs8nrXQohPCDGJGkc%3D" alt="Vladimir Sotnikov" width="150" height="150" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 28 |
+
<img src="https://c8.patreon.com/4/200/33158543/C" alt="clement Delangue" width="150" height="150" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 29 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/8654302/b0f5ebedc62a47c4b56222693e1254e9/eyJ3IjoyMDB9/2.jpeg?token-hash=suI7_QjKUgWpdPuJPaIkElkTrXfItHlL8ZHLPT-w_d4%3D" alt="Misch Strotz" width="150" height="150" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 30 |
+
<img src="https://c8.patreon.com/4/200/93304/J" alt="Joseph Rocca" width="150" height="150" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 31 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/120239481/49b1ce70d3d24704b8ec34de24ec8f55/eyJ3IjoyMDB9/1.jpeg?token-hash=o0y1JqSXqtGvVXnxb06HMXjQXs6OII9yMMx5WyyUqT4%3D" alt="nitish PNR" width="150" height="150" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 32 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/152118848/3b15a43d71714552b5ed1c9f84e66adf/eyJ3IjoyMDB9/1.png?token-hash=MKf3sWHz0MFPm_OAFjdsNvxoBfN5B5l54mn1ORdlRy8%3D" alt="Kristjan Retter" width="150" height="150" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 33 |
+
</p>
|
| 34 |
+
<hr style="width:100%;border:none;height:2px;background:#ddd;margin:30px 0;">
|
| 35 |
+
<p align="center">
|
| 36 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/2298192/1228b69bd7d7481baf3103315183250d/eyJ3IjoyMDB9/1.jpg?token-hash=opN1e4r4Nnvqbtr8R9HI8eyf9m5F50CiHDOdHzb4UcA%3D" alt="Mohamed Oumoumad" width="100" height="100" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 37 |
+
<img src="https://c8.patreon.com/4/200/548524/S" alt="Steve Hanff" width="100" height="100" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 38 |
+
<img src="https://c8.patreon.com/4/200/8449560/P" alt="Patron" width="100" height="100" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 39 |
+
<a href="https://x.com/NuxZoe" target="_blank" rel="noopener noreferrer"><img src="https://pbs.twimg.com/profile_images/1916482710069014528/RDLnPRSg_400x400.jpg" alt="tungsten" width="100" height="100" style="border-radius:8px;margin:5px;display: inline-block;"></a>
|
| 40 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/169502989/220069e79ce745b29237e94c22a729df/eyJ3IjoyMDB9/1.png?token-hash=E8E2JOqx66k2zMtYUw8Gy57dw-gVqA6OPpdCmWFFSFw%3D" alt="Timothy Bielec" width="100" height="100" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 41 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/34200989/58ae95ebda0640c8b7a91b4fa31357aa/eyJ3IjoyMDB9/1.jpeg?token-hash=4mVDM1kCYGauYa33zLG14_g0oj9_UjDK_-Qp4zk42GE%3D" alt="Noah Miller" width="100" height="100" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 42 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/27288932/6c35d2d961ee4e14a7a368c990791315/eyJ3IjoyMDB9/1.jpeg?token-hash=TGIto_PGEG2NEKNyqwzEnRStOkhrjb3QlMhHA3raKJY%3D" alt="David Garrido" width="100" height="100" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 43 |
+
<a href="https://x.com/RalFingerLP" target="_blank" rel="noopener noreferrer"><img src="https://pbs.twimg.com/profile_images/919595465041162241/ZU7X3T5k_400x400.jpg" alt="RalFinger" width="100" height="100" style="border-radius:8px;margin:5px;display: inline-block;"></a>
|
| 44 |
+
</p>
|
| 45 |
+
<hr style="width:100%;border:none;height:2px;background:#ddd;margin:30px 0;">
|
| 46 |
+
<p align="center">
|
| 47 |
+
<a href="http://www.ir-ltd.net" target="_blank" rel="noopener noreferrer"><img src="https://pbs.twimg.com/profile_images/1602579392198283264/6Tm2GYus_400x400.jpg" alt="IR-Entertainment Ltd" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;"></a>
|
| 48 |
+
<a href="https://github.com/jakeblakeley" target="_blank" rel="noopener noreferrer"><img src="https://avatars.githubusercontent.com/u/2407659?u=be0bc786663527f2346b2e99ff608796bce19b26&v=4" alt="Jake Blakeley" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;"></a>
|
| 49 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/9547341/bb35d9a222fd460e862e960ba3eacbaf/eyJ3IjoyMDB9/1.jpeg?token-hash=Q2XGDvkCbiONeWNxBCTeTMOcuwTjOaJ8Z-CAf5xq3Hs%3D" alt="Travis Harrington" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 50 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/98811435/3a3632d1795b4c2b9f8f0270f2f6a650/eyJ3IjoyMDB9/1.jpeg?token-hash=657rzuJ0bZavMRZW3XZ-xQGqm3Vk6FkMZgFJVMCOPdk%3D" alt="EmmanuelMr18" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 51 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/81275465/1e4148fe9c47452b838949d02dd9a70f/eyJ3IjoyMDB9/1.jpeg?token-hash=YAX1ucxybpCIujUCXfdwzUQkttIn3c7pfi59uaFPSwM%3D" alt="Aaron Amortegui" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 52 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/570742/4ceb33453a5a4745b430a216aba9280f/eyJ3IjoyMDB9/1.jpg?token-hash=nPcJ2zj3sloND9jvbnbYnob2vMXRnXdRuujthqDLWlU%3D" alt="Al H" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 53 |
+
<a href="https://github.com/IanRanson" target="_blank" rel="noopener noreferrer"><img src="https://avatars.githubusercontent.com/u/46779408?v=4" alt="IanRanson" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;"></a>
|
| 54 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/99036356/7ae9c4d80e604e739b68cca12ee2ed01/eyJ3IjoyMDB9/3.png?token-hash=ZhsBMoTOZjJ-Y6h5NOmU5MT-vDb2fjK46JDlpEehkVQ%3D" alt="Noctre" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 55 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/141098579/1a9f0a1249d447a7a0df718a57343912/eyJ3IjoyMDB9/2.png?token-hash=_n-AQmPgY0FP9zCGTIEsr5ka4Y7YuaMkt3qL26ZqGg8%3D" alt="The Local Lab" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 56 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/93348210/5c650f32a0bc481d80900d2674528777/eyJ3IjoyMDB9/1.jpeg?token-hash=0jiknRw3jXqYWW6En8bNfuHgVDj4LI_rL7lSS4-_xlo%3D" alt="Armin Behjati" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 57 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/155963250/6f8fd7075c3b4247bfeb054ba49172d6/eyJ3IjoyMDB9/1.png?token-hash=z81EHmdU2cqSrwa9vJmZTV3h0LG-z9Qakhxq34FrYT4%3D" alt="Un Defined" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 58 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/45562978/0de33cf52ec642ae8a2f612cddec4ca6/eyJ3IjoyMDB9/1.jpeg?token-hash=aD4debMD5ZQjqTII6s4zYSgVK2-bdQt9p3eipi0bENs%3D" alt="Jack English" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 59 |
+
<img src="https://c8.patreon.com/4/200/27791680/J" alt="Jean-Tristan Marin" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 60 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/82763/f99cc484361d4b9d94fe4f0814ada303/eyJ3IjoyMDB9/1.jpeg?token-hash=A3JWlBNL0b24FFWb-FCRDAyhs-OAxg-zrhfBXP_axuU%3D" alt="Doron Adler" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 61 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/103077711/bb215761cc004e80bd9cec7d4bcd636d/eyJ3IjoyMDB9/2.jpeg?token-hash=3U8kdZSUpnmeYIDVK4zK9TTXFpnAud_zOwBRXx18018%3D" alt="John Dopamine" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 62 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/134129880/680c7e14cd1a4d1a9face921fb010f88/eyJ3IjoyMDB9/1.png?token-hash=5fqqHE6DCTbt7gDQL7VRcWkV71jF7FvWcLhpYl5aMXA%3D" alt="Bharat Prabhakar" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 63 |
+
<img src="https://c8.patreon.com/4/200/70218846/C" alt="Cosmosis" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 64 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/30931983/54ab4e4ceab946e79a6418d205f9ed51/eyJ3IjoyMDB9/1.png?token-hash=j2phDrgd6IWuqKqNIDbq9fR2B3fMF-GUCQSdETS1w5Y%3D" alt="HestoySeghuro ." width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 65 |
+
<img src="https://c8.patreon.com/4/200/4105384/J" alt="Jack Blakely" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 66 |
+
<img src="https://c8.patreon.com/4/200/494309/J" alt="Julian Tsependa" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 67 |
+
<img src="https://c8.patreon.com/4/200/24653779/R" alt="RayHell" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 68 |
+
<img src="https://c8.patreon.com/4/200/4541423/S" alt="Sören " width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 69 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/97985240/3d1d0e6905d045aba713e8132cab4a30/eyJ3IjoyMDB9/1.png?token-hash=fRavvbO_yqWKA_OsJb5DzjfKZ1Yt-TG-ihMoeVBvlcM%3D" alt="עומר מכלוף" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 70 |
+
<a href="https://www.youtube.com/@happyme7055" target="_blank" rel="noopener noreferrer"><img src="https://yt3.googleusercontent.com/ytc/AIdro_mFqhIRk99SoEWY2gvSvVp6u1SkCGMkRqYQ1OlBBeoOVp8=s160-c-k-c0x00ffffff-no-rj" alt="Marcus Rass" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;"></a>
|
| 71 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/5021048/c6beacab0fdb4568bf9f0d549aa4bc44/eyJ3IjoyMDB9/1.jpeg?token-hash=JTEtFVzUeU7pQw4R3eSn6rGgqgi44uc2rDBAv6F6A4o%3D" alt="Infinite " width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 72 |
+
<img src="https://c8.patreon.com/4/200/53077895/M" alt="Marc" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 73 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/157407541/bb9d80cffdab4334ad78366060561520/eyJ3IjoyMDB9/2.png?token-hash=WYz-U_9zabhHstOT5UIa5jBaoFwrwwqyWxWEzIR2m_c%3D" alt="Tokio Studio srl IT10640050968" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 74 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/44568304/a9d83a0e786b41b4bdada150f7c9271c/eyJ3IjoyMDB9/1.jpeg?token-hash=FtxnwrSrknQUQKvDRv2rqPceX2EF23eLq4pNQYM_fmw%3D" alt="Albert Bukoski" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 75 |
+
<img src="https://c8.patreon.com/4/200/5048649/B" alt="Ben Ward" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 76 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/111904990/08b1cf65be6a4de091c9b73b693b3468/eyJ3IjoyMDB9/1.png?token-hash=_Odz6RD3CxtubEHbUxYujcjw6zAajbo3w8TRz249VBA%3D" alt="Brian Smith" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 77 |
+
<img src="https://c8.patreon.com/4/200/33228112/J" alt="Jimmy Simmons" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 78 |
+
<img src="https://c8.patreon.com/4/200/5602036/K" alt="Kelevra" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 79 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/159203973/36c817f941ac4fa18103a4b8c0cb9cae/eyJ3IjoyMDB9/1.png?token-hash=zkt72HW3EoiIEAn3LSk9gJPBsXfuTVcc4rRBS3CeR8w%3D" alt="Marko jak" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 80 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/11198131/e696d9647feb4318bcf16243c2425805/eyJ3IjoyMDB9/1.jpeg?token-hash=c2c2p1SaiX86iXAigvGRvzm4jDHvIFCg298A49nIfUM%3D" alt="Nicholas Agranoff" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 81 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/785333/bdb9ede5765d42e5a2021a86eebf0d8f/eyJ3IjoyMDB9/2.jpg?token-hash=l_rajMhxTm6wFFPn7YdoKBxeUqhdRXKdy6_8SGCuNsE%3D" alt="Sapjes " width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 82 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/76566911/6485eaf5ec6249a7b524ee0b979372f0/eyJ3IjoyMDB9/1.jpeg?token-hash=mwCSkTelDBaengG32NkN0lVl5mRjB-cwo6-a47wnOsU%3D" alt="the biitz" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 83 |
+
<img src="https://c8.patreon.com/4/200/83034/W" alt="william tatum" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 84 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/32633822/1ab5612efe80417cbebfe91e871fc052/eyJ3IjoyMDB9/1.png?token-hash=pOS_IU3b3RL5-iL96A3Xqoj2bQ-dDo4RUkBylcMED_s%3D" alt="Zack Abrams" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 85 |
+
<a href="https://github.com/julien-blanchon" target="_blank" rel="noopener noreferrer"><img src="https://avatars.githubusercontent.com/u/11278197?v=4" alt="Blanchon" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;"></a>
|
| 86 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/66157709/6fe70df085e24464995a1a9293a53760/eyJ3IjoyMDB9/1.jpeg?token-hash=eqe0wvg6JfbRUGMKpL_x3YPI5Ppf18aUUJe2EzADU-g%3D" alt="Joey Santana" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 87 |
+
<img src="https://c8.patreon.com/4/200/2446176/S" alt="Scott VanKirk" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 88 |
+
<img src="https://c8.patreon.com/4/200/30530914/T" alt="Techer " width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 89 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/25209707/36ae876d662d4d85aaf162b6d67d31e7/eyJ3IjoyMDB9/1.png?token-hash=Zows_A6uqlY5jClhfr4Y3QfMnDKVkS3mbxNHUDkVejo%3D" alt="fjioq8" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 90 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/46680573/ee3d99c04a674dd5a8e1ecfb926db6a2/eyJ3IjoyMDB9/1.jpeg?token-hash=cgD4EXyfZMPnXIrcqWQ5jGqzRUfqjPafb9yWfZUPB4Q%3D" alt="Neil Murray" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 91 |
+
<img src="https://ostris.com/wp-content/uploads/2025/08/supporter_default.jpg" alt="Joakim Sällström" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 92 |
+
<img src="https://c8.patreon.com/4/200/63510241/A" alt="Andrew Park" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 93 |
+
<a href="https://github.com/Spikhalskiy" target="_blank" rel="noopener noreferrer"><img src="https://avatars.githubusercontent.com/u/532108?u=2464983638afea8caf4cd9f0e4a7bc3e6a63bb0a&v=4" alt="Dmitry Spikhalsky" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;"></a>
|
| 94 |
+
<img src="https://c8.patreon.com/4/200/88567307/E" alt="el Chavo" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 95 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/117569999/55f75c57f95343e58402529cec852b26/eyJ3IjoyMDB9/1.jpeg?token-hash=squblHZH4-eMs3gI46Uqu1oTOK9sQ-0gcsFdZcB9xQg%3D" alt="James Thompson" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 96 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/28533016/e8f6044ccfa7483f87eeaa01c894a773/eyJ3IjoyMDB9/2.png?token-hash=ak-h3JWB50hyenCavcs32AAPw6nNhmH2nBFKpdk5hvM%3D" alt="William Tatum" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 97 |
+
<img src="https://ostris.com/wp-content/uploads/2025/08/supporter_default.jpg" alt="Heikki Rinkinen" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 98 |
+
<img src="https://c8.patreon.com/4/200/6175608/B" alt="Bobbie " width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 99 |
+
<img src="https://c8.patreon.com/4/200/59408413/B" alt="ByteC" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 100 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/53634141/c1441f6c605344bbaef885d4272977bb/eyJ3IjoyMDB9/1.JPG?token-hash=Aizd6AxQhY3n6TBE5AwCVeSwEBbjALxQmu6xqc08qBo%3D" alt="Jana Spacelight" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 101 |
+
<img src="https://c8.patreon.com/4/200/11180426/J" alt="jarrett towe" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 102 |
+
<img src="https://c8.patreon.com/4/200/358350/L" alt="L D" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 103 |
+
<a href="https://github.com/Slartibart23" target="_blank" rel="noopener noreferrer"><img src="https://avatars.githubusercontent.com/u/133593860?u=31217adb2522fb295805824ffa7e14e8f0fca6fa&v=4" alt="Slarti" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;"></a>
|
| 104 |
+
<img src="https://ostris.com/wp-content/uploads/2025/08/supporter_default.jpg" alt="Tommy Falkowski" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 105 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/91298241/1b1e6d698cde4faaaae6fc4c2d95d257/eyJ3IjoyMDB9/1.jpeg?token-hash=GCo7gAF_UUdJqz3FsCq8p1pq3AEoRAoC6YIvy5xEeZk%3D" alt="Daniel Partzsch" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 106 |
+
<img src="https://ostris.com/wp-content/uploads/2025/08/supporter_default.jpg" alt="Karol Stępień" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 107 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/156564939/17dbfd45c59d4cf29853d710cb0c5d6f/eyJ3IjoyMDB9/1.png?token-hash=e6wXA_S8cgJeEDI9eJK934eB0TiM8mxJm9zW_VH0gDU%3D" alt="Hans Untch" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 108 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/7957049/1880cfd07e52471b978e1965c95a3230/eyJ3IjoyMDB9/1.jpg?token-hash=Vcm3Nc22Sowd8mQKQemOekTdcFpwaoyRW6bslBfmn0Q%3D" alt="Aaron T." width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 109 |
+
<img src="https://c8.patreon.com/4/200/13054423/A" alt="Alexander Hawkins" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 110 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/88656169/dd8943d7421d41bb9a8eb99f6d1279da/eyJ3IjoyMDB9/1.jpeg?token-hash=wT5j273p5pV10l81yR6kYdfYHR_yQ81xUzr3OfcSf7s%3D" alt="Ame Ame" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 111 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/55160464/42d4719ba0834e5d83aa989c04e762da/eyJ3IjoyMDB9/1.jpeg?token-hash=_twZUkW3NREIxGUOWskUdvuZQGEcRv9XMfu5NrnCe5M%3D" alt="Chris Canterbury" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 112 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/3712451/432e22a355494ec0a1ea1927ff8d452e/eyJ3IjoyMDB9/7.jpeg?token-hash=OpQ9SAfVQ4Un9dSYlGTHuApZo5GlJ797Mo0DtVtMOSc%3D" alt="David Shorey" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 113 |
+
<img src="https://c8.patreon.com/4/200/63920575/D" alt="Dutchman5oh" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 114 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/27580949/97c7dd2456a34c71b6429612a9e20462/eyJ3IjoyMDB9/1.jpeg?token-hash=cASxwWk8joAXx4tUAHch5CvTiYBR2UOHMeJK6se5fl0%3D" alt="Gergely Madácsi" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 115 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/33866796/7fd2a214fd5c4062b0dd63a29f8de5bd/eyJ3IjoyMDB9/1.png?token-hash=8s-7yi8GawIlqr0FCTk5JWKy26acMiYlOD8LAk2HqqU%3D" alt="James" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 116 |
+
<img src="https://c8.patreon.com/4/200/21828017/J" alt="Jim" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 117 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/84891403/83682a2a2d3b49ba9d28e7221edd5752/eyJ3IjoyMDB9/1.jpeg?token-hash=LVB6lta4BonhfPwSUnZIDmSW3IU-eEO4sXD7NSK367g%3D" alt="Koray Birand" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 118 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/63232055/2300b4ab370341b5b476902c9b8218ee/eyJ3IjoyMDB9/1.png?token-hash=R9Nb4O0aLBRwxT1cGHUMThlvf6A2MD5SO88lpZBdH7M%3D" alt="Marek P" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 119 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/82801071/cbfab241940d4d8a965194af9712c385/eyJ3IjoyMDB9/1.jpeg?token-hash=QWKtCj4hNdio9mtf4LGCCtXp5oHafKZA_OPGg-ge1aE%3D" alt="Mark Mueller" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 120 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/902918/5344727418634dc7b7fe7709d515a1d9/eyJ3IjoyMDB9/2.jpg?token-hash=myqV_oclkicVk9BDrvTO50jyjxJJGZ8i7oVJHwc05to%3D" alt="Michael Carychao" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 121 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/181152559/09f961bc0bb647229b083e40c42275e0/eyJ3IjoyMDB9/1.png?token-hash=1jsb8M7mbrVVHVxTE_vCaM_mJ4O7fKsaChCgafB2qms%3D" alt="Parindu Shah" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 122 |
+
<img src="https://c8.patreon.com/4/200/9944625/P" alt="Pomoe " width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 123 |
+
<img src="https://c8.patreon.com/4/200/4993009/R" alt="Rogertam " width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 124 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/25047900/423e4cb73aba457f8f9c6e5582eddaeb/eyJ3IjoyMDB9/1.jpeg?token-hash=81RvQXBbT66usxqtyWum9Ul4oBn3qHK1cM71IvthC-U%3D" alt="Ruairi Robinson" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 125 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/31613309/434500d03f714dc18049306ed3f0165c/eyJ3IjoyMDB9/1.jpg?token-hash=acILbq09wxUfJe-G2nMYUYkvHJ88ZxkzU4JebRPw2P0%3D" alt="Theta Graphics" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 126 |
+
<img src="https://c10.patreonusercontent.com/4/patreon-media/p/user/178476551/0b9e83efcd234df5a6bea30d59e6c1cd/eyJ3IjoyMDB9/1.png?token-hash=3XoYMrMxk-K6GelM22mE-FwkjFulX9hpIL7QI3wO2jI%3D" alt="Timmy" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 127 |
+
<img src="https://c8.patreon.com/4/200/10876902/T" alt="Tyssel" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 128 |
+
<img src="https://ostris.com/wp-content/uploads/2025/08/supporter_default.jpg" alt="Juan Franco" width="60" height="60" style="border-radius:8px;margin:5px;display: inline-block;">
|
| 129 |
+
</p>
|
| 130 |
+
|
| 131 |
+
---
|
| 132 |
+
|
| 133 |
+
|
| 134 |
+
|
| 135 |
+
|
| 136 |
+
## Installation
|
| 137 |
+
|
| 138 |
+
Requirements:
|
| 139 |
+
- python >3.10
|
| 140 |
+
- Nvidia GPU with enough ram to do what you need
|
| 141 |
+
- python venv
|
| 142 |
+
- git
|
| 143 |
+
|
| 144 |
+
|
| 145 |
+
Linux:
|
| 146 |
+
```bash
|
| 147 |
+
git clone https://github.com/ostris/ai-toolkit.git
|
| 148 |
+
cd ai-toolkit
|
| 149 |
+
python3 -m venv venv
|
| 150 |
+
source venv/bin/activate
|
| 151 |
+
# install torch first
|
| 152 |
+
pip3 install --no-cache-dir torch==2.7.0 torchvision==0.22.0 torchaudio==2.7.0 --index-url https://download.pytorch.org/whl/cu126
|
| 153 |
+
pip3 install -r requirements.txt
|
| 154 |
+
```
|
| 155 |
+
|
| 156 |
+
Windows:
|
| 157 |
+
|
| 158 |
+
If you are having issues with Windows. I recommend using the easy install script at [https://github.com/Tavris1/AI-Toolkit-Easy-Install](https://github.com/Tavris1/AI-Toolkit-Easy-Install)
|
| 159 |
+
|
| 160 |
+
```bash
|
| 161 |
+
git clone https://github.com/ostris/ai-toolkit.git
|
| 162 |
+
cd ai-toolkit
|
| 163 |
+
python -m venv venv
|
| 164 |
+
.\venv\Scripts\activate
|
| 165 |
+
pip install --no-cache-dir torch==2.7.0 torchvision==0.22.0 torchaudio==2.7.0 --index-url https://download.pytorch.org/whl/cu126
|
| 166 |
+
pip install -r requirements.txt
|
| 167 |
+
```
|
| 168 |
+
|
| 169 |
+
|
| 170 |
+
# AI Toolkit UI
|
| 171 |
+
|
| 172 |
+
<img src="https://ostris.com/wp-content/uploads/2025/02/toolkit-ui.jpg" alt="AI Toolkit UI" width="100%">
|
| 173 |
+
|
| 174 |
+
The AI Toolkit UI is a web interface for the AI Toolkit. It allows you to easily start, stop, and monitor jobs. It also allows you to easily train models with a few clicks. It also allows you to set a token for the UI to prevent unauthorized access so it is mostly safe to run on an exposed server.
|
| 175 |
+
|
| 176 |
+
## Running the UI
|
| 177 |
+
|
| 178 |
+
Requirements:
|
| 179 |
+
- Node.js > 18
|
| 180 |
+
|
| 181 |
+
The UI does not need to be kept running for the jobs to run. It is only needed to start/stop/monitor jobs. The commands below
|
| 182 |
+
will install / update the UI and it's dependencies and start the UI.
|
| 183 |
+
|
| 184 |
+
```bash
|
| 185 |
+
cd ui
|
| 186 |
+
npm run build_and_start
|
| 187 |
+
```
|
| 188 |
+
|
| 189 |
+
You can now access the UI at `http://localhost:8675` or `http://<your-ip>:8675` if you are running it on a server.
|
| 190 |
+
|
| 191 |
+
## Securing the UI
|
| 192 |
+
|
| 193 |
+
If you are hosting the UI on a cloud provider or any network that is not secure, I highly recommend securing it with an auth token.
|
| 194 |
+
You can do this by setting the environment variable `AI_TOOLKIT_AUTH` to super secure password. This token will be required to access
|
| 195 |
+
the UI. You can set this when starting the UI like so:
|
| 196 |
+
|
| 197 |
+
```bash
|
| 198 |
+
# Linux
|
| 199 |
+
AI_TOOLKIT_AUTH=super_secure_password npm run build_and_start
|
| 200 |
+
|
| 201 |
+
# Windows
|
| 202 |
+
set AI_TOOLKIT_AUTH=super_secure_password && npm run build_and_start
|
| 203 |
+
|
| 204 |
+
# Windows Powershell
|
| 205 |
+
$env:AI_TOOLKIT_AUTH="super_secure_password"; npm run build_and_start
|
| 206 |
+
```
|
| 207 |
+
|
| 208 |
+
|
| 209 |
+
## FLUX.1 Training
|
| 210 |
+
|
| 211 |
+
### Tutorial
|
| 212 |
+
|
| 213 |
+
To get started quickly, check out [@araminta_k](https://x.com/araminta_k) tutorial on [Finetuning Flux Dev on a 3090](https://www.youtube.com/watch?v=HzGW_Kyermg) with 24GB VRAM.
|
| 214 |
+
|
| 215 |
+
|
| 216 |
+
### Requirements
|
| 217 |
+
You currently need a GPU with **at least 24GB of VRAM** to train FLUX.1. If you are using it as your GPU to control
|
| 218 |
+
your monitors, you probably need to set the flag `low_vram: true` in the config file under `model:`. This will quantize
|
| 219 |
+
the model on CPU and should allow it to train with monitors attached. Users have gotten it to work on Windows with WSL,
|
| 220 |
+
but there are some reports of a bug when running on windows natively.
|
| 221 |
+
I have only tested on linux for now. This is still extremely experimental
|
| 222 |
+
and a lot of quantizing and tricks had to happen to get it to fit on 24GB at all.
|
| 223 |
+
|
| 224 |
+
### FLUX.1-dev
|
| 225 |
+
|
| 226 |
+
FLUX.1-dev has a non-commercial license. Which means anything you train will inherit the
|
| 227 |
+
non-commercial license. It is also a gated model, so you need to accept the license on HF before using it.
|
| 228 |
+
Otherwise, this will fail. Here are the required steps to setup a license.
|
| 229 |
+
|
| 230 |
+
1. Sign into HF and accept the model access here [black-forest-labs/FLUX.1-dev](https://huggingface.co/black-forest-labs/FLUX.1-dev)
|
| 231 |
+
2. Make a file named `.env` in the root on this folder
|
| 232 |
+
3. [Get a READ key from huggingface](https://huggingface.co/settings/tokens/new?) and add it to the `.env` file like so `HF_TOKEN=your_key_here`
|
| 233 |
+
|
| 234 |
+
### FLUX.1-schnell
|
| 235 |
+
|
| 236 |
+
FLUX.1-schnell is Apache 2.0. Anything trained on it can be licensed however you want and it does not require a HF_TOKEN to train.
|
| 237 |
+
However, it does require a special adapter to train with it, [ostris/FLUX.1-schnell-training-adapter](https://huggingface.co/ostris/FLUX.1-schnell-training-adapter).
|
| 238 |
+
It is also highly experimental. For best overall quality, training on FLUX.1-dev is recommended.
|
| 239 |
+
|
| 240 |
+
To use it, You just need to add the assistant to the `model` section of your config file like so:
|
| 241 |
+
|
| 242 |
+
```yaml
|
| 243 |
+
model:
|
| 244 |
+
name_or_path: "black-forest-labs/FLUX.1-schnell"
|
| 245 |
+
assistant_lora_path: "ostris/FLUX.1-schnell-training-adapter"
|
| 246 |
+
is_flux: true
|
| 247 |
+
quantize: true
|
| 248 |
+
```
|
| 249 |
+
|
| 250 |
+
You also need to adjust your sample steps since schnell does not require as many
|
| 251 |
+
|
| 252 |
+
```yaml
|
| 253 |
+
sample:
|
| 254 |
+
guidance_scale: 1 # schnell does not do guidance
|
| 255 |
+
sample_steps: 4 # 1 - 4 works well
|
| 256 |
+
```
|
| 257 |
+
|
| 258 |
+
### Training
|
| 259 |
+
1. Copy the example config file located at `config/examples/train_lora_flux_24gb.yaml` (`config/examples/train_lora_flux_schnell_24gb.yaml` for schnell) to the `config` folder and rename it to `whatever_you_want.yml`
|
| 260 |
+
2. Edit the file following the comments in the file
|
| 261 |
+
3. Run the file like so `python run.py config/whatever_you_want.yml`
|
| 262 |
+
|
| 263 |
+
A folder with the name and the training folder from the config file will be created when you start. It will have all
|
| 264 |
+
checkpoints and images in it. You can stop the training at any time using ctrl+c and when you resume, it will pick back up
|
| 265 |
+
from the last checkpoint.
|
| 266 |
+
|
| 267 |
+
IMPORTANT. If you press crtl+c while it is saving, it will likely corrupt that checkpoint. So wait until it is done saving
|
| 268 |
+
|
| 269 |
+
### Need help?
|
| 270 |
+
|
| 271 |
+
Please do not open a bug report unless it is a bug in the code. You are welcome to [Join my Discord](https://discord.gg/VXmU2f5WEU)
|
| 272 |
+
and ask for help there. However, please refrain from PMing me directly with general question or support. Ask in the discord
|
| 273 |
+
and I will answer when I can.
|
| 274 |
+
|
| 275 |
+
## Gradio UI
|
| 276 |
+
|
| 277 |
+
To get started training locally with a with a custom UI, once you followed the steps above and `ai-toolkit` is installed:
|
| 278 |
+
|
| 279 |
+
```bash
|
| 280 |
+
cd ai-toolkit #in case you are not yet in the ai-toolkit folder
|
| 281 |
+
huggingface-cli login #provide a `write` token to publish your LoRA at the end
|
| 282 |
+
python flux_train_ui.py
|
| 283 |
+
```
|
| 284 |
+
|
| 285 |
+
You will instantiate a UI that will let you upload your images, caption them, train and publish your LoRA
|
| 286 |
+

|
| 287 |
+
|
| 288 |
+
|
| 289 |
+
## Training in RunPod
|
| 290 |
+
If you would like to use Runpod, but have not signed up yet, please consider using [my Runpod affiliate link](https://runpod.io?ref=h0y9jyr2) to help support this project.
|
| 291 |
+
|
| 292 |
+
|
| 293 |
+
I maintain an official Runpod Pod template here which can be accessed [here](https://console.runpod.io/deploy?template=0fqzfjy6f3&ref=h0y9jyr2).
|
| 294 |
+
|
| 295 |
+
I have also created a short video showing how to get started using AI Toolkit with Runpod [here](https://youtu.be/HBNeS-F6Zz8).
|
| 296 |
+
|
| 297 |
+
## Training in Modal
|
| 298 |
+
|
| 299 |
+
### 1. Setup
|
| 300 |
+
#### ai-toolkit:
|
| 301 |
+
```
|
| 302 |
+
git clone https://github.com/ostris/ai-toolkit.git
|
| 303 |
+
cd ai-toolkit
|
| 304 |
+
git submodule update --init --recursive
|
| 305 |
+
python -m venv venv
|
| 306 |
+
source venv/bin/activate
|
| 307 |
+
pip install torch
|
| 308 |
+
pip install -r requirements.txt
|
| 309 |
+
pip install --upgrade accelerate transformers diffusers huggingface_hub #Optional, run it if you run into issues
|
| 310 |
+
```
|
| 311 |
+
#### Modal:
|
| 312 |
+
- Run `pip install modal` to install the modal Python package.
|
| 313 |
+
- Run `modal setup` to authenticate (if this doesn’t work, try `python -m modal setup`).
|
| 314 |
+
|
| 315 |
+
#### Hugging Face:
|
| 316 |
+
- Get a READ token from [here](https://huggingface.co/settings/tokens) and request access to Flux.1-dev model from [here](https://huggingface.co/black-forest-labs/FLUX.1-dev).
|
| 317 |
+
- Run `huggingface-cli login` and paste your token.
|
| 318 |
+
|
| 319 |
+
### 2. Upload your dataset
|
| 320 |
+
- Drag and drop your dataset folder containing the .jpg, .jpeg, or .png images and .txt files in `ai-toolkit`.
|
| 321 |
+
|
| 322 |
+
### 3. Configs
|
| 323 |
+
- Copy an example config file located at ```config/examples/modal``` to the `config` folder and rename it to ```whatever_you_want.yml```.
|
| 324 |
+
- Edit the config following the comments in the file, **<ins>be careful and follow the example `/root/ai-toolkit` paths</ins>**.
|
| 325 |
+
|
| 326 |
+
### 4. Edit run_modal.py
|
| 327 |
+
- Set your entire local `ai-toolkit` path at `code_mount = modal.Mount.from_local_dir` like:
|
| 328 |
+
|
| 329 |
+
```
|
| 330 |
+
code_mount = modal.Mount.from_local_dir("/Users/username/ai-toolkit", remote_path="/root/ai-toolkit")
|
| 331 |
+
```
|
| 332 |
+
- Choose a `GPU` and `Timeout` in `@app.function` _(default is A100 40GB and 2 hour timeout)_.
|
| 333 |
+
|
| 334 |
+
### 5. Training
|
| 335 |
+
- Run the config file in your terminal: `modal run run_modal.py --config-file-list-str=/root/ai-toolkit/config/whatever_you_want.yml`.
|
| 336 |
+
- You can monitor your training in your local terminal, or on [modal.com](https://modal.com/).
|
| 337 |
+
- Models, samples and optimizer will be stored in `Storage > flux-lora-models`.
|
| 338 |
+
|
| 339 |
+
### 6. Saving the model
|
| 340 |
+
- Check contents of the volume by running `modal volume ls flux-lora-models`.
|
| 341 |
+
- Download the content by running `modal volume get flux-lora-models your-model-name`.
|
| 342 |
+
- Example: `modal volume get flux-lora-models my_first_flux_lora_v1`.
|
| 343 |
+
|
| 344 |
+
### Screenshot from Modal
|
| 345 |
+
|
| 346 |
+
<img width="1728" alt="Modal Traning Screenshot" src="https://github.com/user-attachments/assets/7497eb38-0090-49d6-8ad9-9c8ea7b5388b">
|
| 347 |
+
|
| 348 |
+
---
|
| 349 |
+
|
| 350 |
+
## Dataset Preparation
|
| 351 |
+
|
| 352 |
+
Datasets generally need to be a folder containing images and associated text files. Currently, the only supported
|
| 353 |
+
formats are jpg, jpeg, and png. Webp currently has issues. The text files should be named the same as the images
|
| 354 |
+
but with a `.txt` extension. For example `image2.jpg` and `image2.txt`. The text file should contain only the caption.
|
| 355 |
+
You can add the word `[trigger]` in the caption file and if you have `trigger_word` in your config, it will be automatically
|
| 356 |
+
replaced.
|
| 357 |
+
|
| 358 |
+
Images are never upscaled but they are downscaled and placed in buckets for batching. **You do not need to crop/resize your images**.
|
| 359 |
+
The loader will automatically resize them and can handle varying aspect ratios.
|
| 360 |
+
|
| 361 |
+
|
| 362 |
+
## Training Specific Layers
|
| 363 |
+
|
| 364 |
+
To train specific layers with LoRA, you can use the `only_if_contains` network kwargs. For instance, if you want to train only the 2 layers
|
| 365 |
+
used by The Last Ben, [mentioned in this post](https://x.com/__TheBen/status/1829554120270987740), you can adjust your
|
| 366 |
+
network kwargs like so:
|
| 367 |
+
|
| 368 |
+
```yaml
|
| 369 |
+
network:
|
| 370 |
+
type: "lora"
|
| 371 |
+
linear: 128
|
| 372 |
+
linear_alpha: 128
|
| 373 |
+
network_kwargs:
|
| 374 |
+
only_if_contains:
|
| 375 |
+
- "transformer.single_transformer_blocks.7.proj_out"
|
| 376 |
+
- "transformer.single_transformer_blocks.20.proj_out"
|
| 377 |
+
```
|
| 378 |
+
|
| 379 |
+
The naming conventions of the layers are in diffusers format, so checking the state dict of a model will reveal
|
| 380 |
+
the suffix of the name of the layers you want to train. You can also use this method to only train specific groups of weights.
|
| 381 |
+
For instance to only train the `single_transformer` for FLUX.1, you can use the following:
|
| 382 |
+
|
| 383 |
+
```yaml
|
| 384 |
+
network:
|
| 385 |
+
type: "lora"
|
| 386 |
+
linear: 128
|
| 387 |
+
linear_alpha: 128
|
| 388 |
+
network_kwargs:
|
| 389 |
+
only_if_contains:
|
| 390 |
+
- "transformer.single_transformer_blocks."
|
| 391 |
+
```
|
| 392 |
+
|
| 393 |
+
You can also exclude layers by their names by using `ignore_if_contains` network kwarg. So to exclude all the single transformer blocks,
|
| 394 |
+
|
| 395 |
+
|
| 396 |
+
```yaml
|
| 397 |
+
network:
|
| 398 |
+
type: "lora"
|
| 399 |
+
linear: 128
|
| 400 |
+
linear_alpha: 128
|
| 401 |
+
network_kwargs:
|
| 402 |
+
ignore_if_contains:
|
| 403 |
+
- "transformer.single_transformer_blocks."
|
| 404 |
+
```
|
| 405 |
+
|
| 406 |
+
`ignore_if_contains` takes priority over `only_if_contains`. So if a weight is covered by both,
|
| 407 |
+
if will be ignored.
|
| 408 |
+
|
| 409 |
+
## LoKr Training
|
| 410 |
+
|
| 411 |
+
To learn more about LoKr, read more about it at [KohakuBlueleaf/LyCORIS](https://github.com/KohakuBlueleaf/LyCORIS/blob/main/docs/Guidelines.md). To train a LoKr model, you can adjust the network type in the config file like so:
|
| 412 |
+
|
| 413 |
+
```yaml
|
| 414 |
+
network:
|
| 415 |
+
type: "lokr"
|
| 416 |
+
lokr_full_rank: true
|
| 417 |
+
lokr_factor: 8
|
| 418 |
+
```
|
| 419 |
+
|
| 420 |
+
Everything else should work the same including layer targeting.
|
| 421 |
+
|
| 422 |
+
|
| 423 |
+
## Updates
|
| 424 |
+
|
| 425 |
+
Only larger updates are listed here. There are usually smaller daily updated that are omitted.
|
| 426 |
+
|
| 427 |
+
### Jul 17, 2025
|
| 428 |
+
- Make it easy to add control images to the samples in the ui
|
| 429 |
+
|
| 430 |
+
### Jul 11, 2025
|
| 431 |
+
- Added better video config settings to the UI for video models.
|
| 432 |
+
- Added Wan I2V training to the UI
|
| 433 |
+
|
| 434 |
+
### June 29, 2025
|
| 435 |
+
- Fixed issue where Kontext forced sizes on sampling
|
| 436 |
+
|
| 437 |
+
### June 26, 2025
|
| 438 |
+
- Added support for FLUX.1 Kontext training
|
| 439 |
+
- added support for instruction dataset training
|
| 440 |
+
|
| 441 |
+
### June 25, 2025
|
| 442 |
+
- Added support for OmniGen2 training
|
| 443 |
+
-
|
| 444 |
+
### June 17, 2025
|
| 445 |
+
- Performance optimizations for batch preparation
|
| 446 |
+
- Added some docs via a popup for items in the simple ui explaining what settings do. Still a WIP
|
| 447 |
+
|
| 448 |
+
### June 16, 2025
|
| 449 |
+
- Hide control images in the UI when viewing datasets
|
| 450 |
+
- WIP on mean flow loss
|
| 451 |
+
|
| 452 |
+
### June 12, 2025
|
| 453 |
+
- Fixed issue that resulted in blank captions in the dataloader
|
| 454 |
+
|
| 455 |
+
### June 10, 2025
|
| 456 |
+
- Decided to keep track up updates in the readme
|
| 457 |
+
- Added support for SDXL in the UI
|
| 458 |
+
- Added support for SD 1.5 in the UI
|
| 459 |
+
- Fixed UI Wan 2.1 14b name bug
|
| 460 |
+
- Added support for for conv training in the UI for models that support it
|