KIMCAHLLIE commited on
Commit
02f0713
·
verified ·
1 Parent(s): 84ddc81

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +78 -0
README.md ADDED
@@ -0,0 +1,78 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: openrail
3
+ base_model: runwayml/stable-diffusion-v1-5
4
+ tags:
5
+ - stable-diffusion
6
+ - lora
7
+ - diffusers
8
+ - image-generation
9
+ - anime-style
10
+ ---
11
+
12
+ # Shinkai-style LoRA (Stable Diffusion 1.5)
13
+
14
+ This repository contains **LoRA weights fine-tuned on top of Stable Diffusion 1.5**
15
+ to reproduce background-oriented anime-style visuals inspired by Makoto Shinkai.
16
+
17
+ ---
18
+
19
+ ## 🔑 Trigger Token
20
+ Use the following trigger token in your prompt:
21
+
22
+ `shinkai_makoto_style`
23
+
24
+ ---
25
+
26
+ ## 📊 Dataset
27
+ - Number of images: **25**
28
+ - Resolution: **512x512**
29
+ - Captioning: auto-generated captions + trigger token
30
+ - Format: `imagefolder` + `metadata.jsonl`
31
+
32
+ Dataset is included in this repository:
33
+
34
+ `dataset/`
35
+
36
+ ---
37
+
38
+ ## 🧠 Training Details
39
+ - Base model: `runwayml/stable-diffusion-v1-5`
40
+ - Method: **LoRA fine-tuning (Diffusers)**
41
+ - Training steps: **1500**
42
+ - Batch size: 1
43
+ - Gradient accumulation: 4
44
+ - Mixed precision: bf16
45
+ - Environment: Google Colab (single GPU)
46
+ - Checkpoint resume used due to Colab runtime limits
47
+
48
+ ---
49
+
50
+ ## 🖼️ Inference Example (Diffusers)
51
+
52
+ ```python
53
+ import torch
54
+ from diffusers import StableDiffusionPipeline
55
+
56
+ base_model = "runwayml/stable-diffusion-v1-5"
57
+ lora_repo = "KIMCHALLIE/shinkai-style-lora"
58
+
59
+ pipe = StableDiffusionPipeline.from_pretrained(
60
+ base_model,
61
+ torch_dtype=torch.float16,
62
+ safety_checker=None
63
+ ).to("cuda")
64
+
65
+ pipe.load_lora_weights(lora_repo)
66
+
67
+ prompt = (
68
+ "shinkai_makoto_style, rainy city street at dusk, "
69
+ "cinematic lighting, detailed background, anime illustration"
70
+ )
71
+
72
+ image = pipe(
73
+ prompt=prompt,
74
+ num_inference_steps=45,
75
+ guidance_scale=6.5
76
+ ).images[0]
77
+
78
+ image.save("result.png")