Instructions to use zhaoyudashuaige/IP-Adapter-FaceID-Bin-Conversion-XL with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use zhaoyudashuaige/IP-Adapter-FaceID-Bin-Conversion-XL with Diffusers:
pip install -U diffusers transformers accelerate
from diffusers import ControlNetModel, StableDiffusionControlNetPipeline controlnet = ControlNetModel.from_pretrained("zhaoyudashuaige/IP-Adapter-FaceID-Bin-Conversion-XL") pipe = StableDiffusionControlNetPipeline.from_pretrained( "stabilityai/stable-diffusion-xl-base-1.0", controlnet=controlnet ) - Notebooks
- Google Colab
- Kaggle
Commit ·
245cbfd
0
Parent(s):
Duplicate from RGArt/IP-Adapter-FaceID-Bin-Conversion-XL
Browse filesCo-authored-by: Mike Frett <RGArt@users.noreply.huggingface.co>
- .gitattributes +35 -0
- README.md +38 -0
- ip-adapter-faceid-plusv2_sdxl.safetensors +3 -0
.gitattributes
ADDED
|
@@ -0,0 +1,35 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
*.7z filter=lfs diff=lfs merge=lfs -text
|
| 2 |
+
*.arrow filter=lfs diff=lfs merge=lfs -text
|
| 3 |
+
*.bin filter=lfs diff=lfs merge=lfs -text
|
| 4 |
+
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
| 5 |
+
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
| 6 |
+
*.ftz filter=lfs diff=lfs merge=lfs -text
|
| 7 |
+
*.gz filter=lfs diff=lfs merge=lfs -text
|
| 8 |
+
*.h5 filter=lfs diff=lfs merge=lfs -text
|
| 9 |
+
*.joblib filter=lfs diff=lfs merge=lfs -text
|
| 10 |
+
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
| 11 |
+
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
| 12 |
+
*.model filter=lfs diff=lfs merge=lfs -text
|
| 13 |
+
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
| 14 |
+
*.npy filter=lfs diff=lfs merge=lfs -text
|
| 15 |
+
*.npz filter=lfs diff=lfs merge=lfs -text
|
| 16 |
+
*.onnx filter=lfs diff=lfs merge=lfs -text
|
| 17 |
+
*.ot filter=lfs diff=lfs merge=lfs -text
|
| 18 |
+
*.parquet filter=lfs diff=lfs merge=lfs -text
|
| 19 |
+
*.pb filter=lfs diff=lfs merge=lfs -text
|
| 20 |
+
*.pickle filter=lfs diff=lfs merge=lfs -text
|
| 21 |
+
*.pkl filter=lfs diff=lfs merge=lfs -text
|
| 22 |
+
*.pt filter=lfs diff=lfs merge=lfs -text
|
| 23 |
+
*.pth filter=lfs diff=lfs merge=lfs -text
|
| 24 |
+
*.rar filter=lfs diff=lfs merge=lfs -text
|
| 25 |
+
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
| 26 |
+
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
| 27 |
+
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
| 28 |
+
*.tar filter=lfs diff=lfs merge=lfs -text
|
| 29 |
+
*.tflite filter=lfs diff=lfs merge=lfs -text
|
| 30 |
+
*.tgz filter=lfs diff=lfs merge=lfs -text
|
| 31 |
+
*.wasm filter=lfs diff=lfs merge=lfs -text
|
| 32 |
+
*.xz filter=lfs diff=lfs merge=lfs -text
|
| 33 |
+
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
+
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
+
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
base_model: stabilityai/stable-diffusion-xl-base-1.0
|
| 4 |
+
tags:
|
| 5 |
+
- ip-adapter
|
| 6 |
+
- faceid
|
| 7 |
+
- safetensors
|
| 8 |
+
- controlnet
|
| 9 |
+
- sdxl
|
| 10 |
+
library_name: diffusers
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
+
# IP-Adapter FaceID Plus V2 SDXL (Flattened Safetensors)
|
| 14 |
+
|
| 15 |
+
This repository contains the converted and flattened `.safetensors` version of the **IP-Adapter FaceID Plus V2** for SDXL.
|
| 16 |
+
|
| 17 |
+
## 🚀 Why this version?
|
| 18 |
+
The original `.bin` weights provided by the authors use a nested dictionary structure (e.g., the `image_proj` key contains its own sub-dictionary). This often causes "KeyError" or "Expected Tensor but received dict" errors in various WebUIs and custom scripts.
|
| 19 |
+
|
| 20 |
+
**This version:**
|
| 21 |
+
- **Flattened Keys:** Converted nested dictionaries into a flat structure (e.g., `image_proj.0.weight`) compatible with [ComfyUI](https://github.com), [SD-WebUI-Forge](https://github.com), and [Easy Diffusion](https://easydiffusion.github.io).
|
| 22 |
+
- **Safe Format:** Converted from Pickle (`.bin`) to `.safetensors` for faster loading and improved security.
|
| 23 |
+
- **SDXL Native:** Specifically for use with SDXL 1.0 base models.
|
| 24 |
+
|
| 25 |
+
## 🛠 Usage
|
| 26 |
+
|
| 27 |
+
To use this model, you typically need three components:
|
| 28 |
+
1. **This Model:** Place in your `models/ControlNet` folder.
|
| 29 |
+
2. **FaceID LoRA:** You **must** use the matching [SDXL FaceID Plus v2 LoRA](https://huggingface.co) at a weight of ~0.5-0.7.
|
| 30 |
+
3. **InsightFace:** Your environment must have the `insightface` library installed.
|
| 31 |
+
|
| 32 |
+
### Recommended Settings:
|
| 33 |
+
- **Preprocessor:** `ip-adapter_face_id_plus`
|
| 34 |
+
- **ControlNet Strength:** 0.5 - 0.8 (Start at 0.6 if skin texture appears too harsh)
|
| 35 |
+
- **Ending Control Step:** 0.7 - 0.8 (Helps blend skin textures naturally)
|
| 36 |
+
|
| 37 |
+
## ⚖️ Credits
|
| 38 |
+
Original weights and research by the [IP-Adapter Team](https://huggingface.co). Please refer to their repository for license details and original implementation.
|
ip-adapter-faceid-plusv2_sdxl.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6a4658886f9cac0da1c6c3202bb132fbc9edf0b4cd49d9d01c1d517d7334b404
|
| 3 |
+
size 1487560440
|