| --- |
| license: other |
| license_name: circlestone-labs-non-commercial-license |
| license_link: LICENSE.md |
| base_model: |
| - circlestone-labs/Anima |
| base_model_relation: adapter |
| tags: |
| - controlnet |
| - canny |
| - anima |
| - text-to-image |
| - diffusion-single-file |
| - comfyui |
| datasets: |
| - RicemanT/booru-essence-2026 |
| --- |
| |
| ## Anima-ControlNet-VACE-Canny |
|
|
| A Canny ControlNet for [Anima](https://huggingface.co/circlestone-labs/Anima), trained with [Anima VACE ControlNet implementation by TaihoC](https://github.com/TaihoC/sd-scripts-animaCN/tree/feat/anima-vace-controlnet). |
|
|
| ⚠️ Requires the `fix/anima-vace-hardening` branch of [PineCookie/ComfyUI-Advanced-ControlNet](https://github.com/PineCookie/ComfyUI-Advanced-ControlNet/tree/fix/anima-vace-hardening). (TaihoC's fork currently has a duplicate control hook bug.) |
|
|
|  |
|
|
| --- |
| ## Training Details |
|
|
| ### Dataset |
|
|
| - **Dataset**: ~15,000 Danbooru images from [RicemanT/booru-essence-2026](https://huggingface.co/datasets/RicemanT/booru-essence-2026). |
| - **Canny Edge Maps**: Generated using `cv2.Canny` with `min_threshold=100` and `max_threshold=200` (no random thresholds). |
| - **Caption Dropout**: 10%. |
|
|
| ### Hyperparameters |
| - **Control Blocks**: 4 control blocks, connected to the base model at blocks 0, 7, 14, and 21. |
| - **Batch Size**: 16 (GPU: 2, Gradient Accumulation: 8) |
| - **Training Steps**: 3000 |
| - **Learning Rate**: 5e-5, cosine, 150 warmup steps |
| - **Optimizer**: `AdamW_adv` |
| - betas: (0.9, 0.99) |
| - use_atan2: True |
| - orthogonal_gradient: iterative |
| - state_precision: bf16_sr |
| - stochastic_rounding: True |
| - **Training Precision**: full bf16 |
| - **Timestep Sampling**: `shift`, `discrete_flow_shift=3.0`, `sigmoid_scale=1.0` |
| - **Resolution**: 1024x1024 |
|
|
| **Peak VRAM Usage**: ~32GB (no gradient checkpointing) |
|
|
| **Compute Cost**: ~10 hours on 1x L40S |
|
|
| --- |
| ### Credits |
|
|
| - [Anima VACE ControlNet - TaihoC](https://github.com/TaihoC/sd-scripts-animaCN/tree/feat/anima-vace-controlnet) |
| - [booru-essence-2026 - RicemanT](https://huggingface.co/datasets/RicemanT/booru-essence-2026) |
| - [sd-scripts - kohya-ss](https://github.com/kohya-ss/sd-scripts) |
| - [Anima - Circlestone Labs](https://huggingface.co/circlestone-labs/Anima) |
|
|
