Hugging Face's logo

Rac11m
/
sd-tryon-model-lora-sdxl

Text-to-Image
Diffusers
TensorBoard
stable-diffusion
stable-diffusion-diffusers
diffusers-training
lora
stable-diffusion-xl
stable-diffusion-xl-diffusers
Model card Files
xet
 Metrics Community
Rac11m commited on
Commit
cdc2529
·
verified ·
1 Parent(s): 272796c

End of training

Browse files
Files changed (22) hide show
  1. .gitattributes +4 -0
  2. README.md +43 -0
  3. image_0.png +3 -0
  4. image_1.png +3 -0
  5. image_2.png +3 -0
  6. image_3.png +3 -0
  7. logs/text2image-fine-tune/1746362204.1792953/events.out.tfevents.1746362204.548ea8abe000.9080.1 +3 -0
  8. logs/text2image-fine-tune/1746362204.180898/hparams.yml +54 -0
  9. logs/text2image-fine-tune/1746363610.2025266/events.out.tfevents.1746363610.548ea8abe000.15371.1 +3 -0
  10. logs/text2image-fine-tune/1746363610.204039/hparams.yml +54 -0
  11. logs/text2image-fine-tune/1746364508.2742507/events.out.tfevents.1746364508.548ea8abe000.19121.1 +3 -0
  12. logs/text2image-fine-tune/1746364508.2806346/hparams.yml +54 -0
  13. logs/text2image-fine-tune/1746366045.0525992/events.out.tfevents.1746366045.548ea8abe000.25891.1 +3 -0
  14. logs/text2image-fine-tune/1746366045.0543807/hparams.yml +51 -0
  15. logs/text2image-fine-tune/1746366197.2601933/events.out.tfevents.1746366197.548ea8abe000.26989.1 +3 -0
  16. logs/text2image-fine-tune/1746366197.2623632/hparams.yml +51 -0
  17. logs/text2image-fine-tune/events.out.tfevents.1746362204.548ea8abe000.9080.0 +3 -0
  18. logs/text2image-fine-tune/events.out.tfevents.1746363610.548ea8abe000.15371.0 +3 -0
  19. logs/text2image-fine-tune/events.out.tfevents.1746364508.548ea8abe000.19121.0 +3 -0
  20. logs/text2image-fine-tune/events.out.tfevents.1746366045.548ea8abe000.25891.0 +3 -0
  21. logs/text2image-fine-tune/events.out.tfevents.1746366197.548ea8abe000.26989.0 +3 -0
  22. pytorch_lora_weights.safetensors +3 -0
.gitattributes CHANGED
@@ -33,3 +33,7 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ image_0.png filter=lfs diff=lfs merge=lfs -text
37
+ image_1.png filter=lfs diff=lfs merge=lfs -text
38
+ image_2.png filter=lfs diff=lfs merge=lfs -text
39
+ image_3.png filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,43 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: runwayml/stable-diffusion-v1-5
3
+ library_name: diffusers
4
+ license: creativeml-openrail-m
5
+ inference: true
6
+ tags:
7
+ - stable-diffusion
8
+ - stable-diffusion-diffusers
9
+ - text-to-image
10
+ - diffusers
11
+ - diffusers-training
12
+ - lora
13
+ ---
14
+
15
+ <!-- This model card has been generated automatically according to the information the training script had access to. You
16
+ should probably proofread and complete it, then remove this comment. -->
17
+
18
+
19
+ # LoRA text2image fine-tuning - Rac11m/sd-tryon-model-lora-sdxl
20
+ These are LoRA adaption weights for runwayml/stable-diffusion-v1-5. The weights were fine-tuned on the None dataset. You can find some example images in the following.
21
+
22
+ ![img_0](./image_0.png)
23
+ ![img_1](./image_1.png)
24
+ ![img_2](./image_2.png)
25
+ ![img_3](./image_3.png)
26
+
27
+
28
+
29
+ ## Intended uses & limitations
30
+
31
+ #### How to use
32
+
33
+ ```python
34
+ # TODO: add an example code snippet for running this diffusion pipeline
35
+ ```
36
+
37
+ #### Limitations and bias
38
+
39
+ [TODO: provide examples of latent issues and potential remediations]
40
+
41
+ ## Training details
42
+
43
+ [TODO: describe the data used to train the model]
image_0.png ADDED

Git LFS Details

  • SHA256: 218e8e039c049d27132db93d68a21b890f8d5d7bb2aa9b97856a29cf57650b05
  • Pointer size: 131 Bytes
  • Size of remote file: 345 kB
image_1.png ADDED

Git LFS Details

  • SHA256: 15d9ff817c6fc94b3c6b0852c624ffa31391f059c7463ce2d8a9997fa86ca3ea
  • Pointer size: 131 Bytes
  • Size of remote file: 439 kB
image_2.png ADDED

Git LFS Details

  • SHA256: 283002bcdbd0015e910c1ac07cf96b7dacfafd7eea3a079b47bbda93e57f92b2
  • Pointer size: 131 Bytes
  • Size of remote file: 405 kB
image_3.png ADDED

Git LFS Details

  • SHA256: add23098acbe8e2ba0d3b633e8de1a7583ce59044cd9062adac0e0a737716274
  • Pointer size: 131 Bytes
  • Size of remote file: 397 kB
logs/text2image-fine-tune/1746362204.1792953/events.out.tfevents.1746362204.548ea8abe000.9080.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:49779f96cffacd1d685f7662261e093721229a9be0051c5158311c2bfe09403a
3
+ size 2608
logs/text2image-fine-tune/1746362204.180898/hparams.yml ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.01
5
+ allow_tf32: false
6
+ cache_dir: null
7
+ caption_column: text
8
+ center_crop: false
9
+ checkpointing_steps: 500
10
+ checkpoints_total_limit: null
11
+ dataloader_num_workers: 0
12
+ dataset_config_name: null
13
+ dataset_name: null
14
+ debug_loss: false
15
+ enable_npu_flash_attention: false
16
+ enable_xformers_memory_efficient_attention: false
17
+ gradient_accumulation_steps: 1
18
+ gradient_checkpointing: false
19
+ hub_model_id: null
20
+ hub_token: null
21
+ image_column: image
22
+ learning_rate: 0.0001
23
+ local_rank: -1
24
+ logging_dir: logs
25
+ lr_scheduler: constant
26
+ lr_warmup_steps: 0
27
+ max_grad_norm: 1.0
28
+ max_train_samples: null
29
+ max_train_steps: 200
30
+ mixed_precision: fp16
31
+ noise_offset: 0
32
+ num_train_epochs: 2
33
+ num_validation_images: 4
34
+ output_dir: sd-tryon-model-lora-sdxl
35
+ prediction_type: null
36
+ pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
37
+ pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
38
+ push_to_hub: true
39
+ random_flip: true
40
+ rank: 4
41
+ report_to: tensorboard
42
+ resolution: 512
43
+ resume_from_checkpoint: null
44
+ revision: null
45
+ scale_lr: false
46
+ seed: 42
47
+ snr_gamma: null
48
+ train_batch_size: 1
49
+ train_data_dir: /content/drive/MyDrive/PFE/mini/mini/images
50
+ train_text_encoder: false
51
+ use_8bit_adam: false
52
+ validation_epochs: 1
53
+ validation_prompt: a slim black woman in forties
54
+ variant: null
logs/text2image-fine-tune/1746363610.2025266/events.out.tfevents.1746363610.548ea8abe000.15371.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d979f4225d45ca7a7dae065c084ca87ebfd735d0214f4cfa4098eee826ea79bd
3
+ size 2608
logs/text2image-fine-tune/1746363610.204039/hparams.yml ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.01
5
+ allow_tf32: false
6
+ cache_dir: null
7
+ caption_column: text
8
+ center_crop: false
9
+ checkpointing_steps: 500
10
+ checkpoints_total_limit: null
11
+ dataloader_num_workers: 0
12
+ dataset_config_name: null
13
+ dataset_name: null
14
+ debug_loss: false
15
+ enable_npu_flash_attention: false
16
+ enable_xformers_memory_efficient_attention: false
17
+ gradient_accumulation_steps: 1
18
+ gradient_checkpointing: false
19
+ hub_model_id: null
20
+ hub_token: null
21
+ image_column: image
22
+ learning_rate: 0.0001
23
+ local_rank: -1
24
+ logging_dir: logs
25
+ lr_scheduler: constant
26
+ lr_warmup_steps: 0
27
+ max_grad_norm: 1.0
28
+ max_train_samples: null
29
+ max_train_steps: 50
30
+ mixed_precision: fp16
31
+ noise_offset: 0
32
+ num_train_epochs: 1
33
+ num_validation_images: 4
34
+ output_dir: sd-tryon-model-lora-sdxl
35
+ prediction_type: null
36
+ pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
37
+ pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
38
+ push_to_hub: true
39
+ random_flip: true
40
+ rank: 4
41
+ report_to: tensorboard
42
+ resolution: 512
43
+ resume_from_checkpoint: null
44
+ revision: null
45
+ scale_lr: false
46
+ seed: 42
47
+ snr_gamma: null
48
+ train_batch_size: 1
49
+ train_data_dir: /content/drive/MyDrive/PFE/mini/mini/images
50
+ train_text_encoder: false
51
+ use_8bit_adam: false
52
+ validation_epochs: 1
53
+ validation_prompt: a slim black woman in forties
54
+ variant: null
logs/text2image-fine-tune/1746364508.2742507/events.out.tfevents.1746364508.548ea8abe000.19121.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0f0b48dc99d32ed833b25e1c04a693d136ccf6c1fb93b2004b8d321e6dd170f4
3
+ size 2606
logs/text2image-fine-tune/1746364508.2806346/hparams.yml ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.01
5
+ allow_tf32: false
6
+ cache_dir: null
7
+ caption_column: text
8
+ center_crop: false
9
+ checkpointing_steps: 500
10
+ checkpoints_total_limit: null
11
+ dataloader_num_workers: 8
12
+ dataset_config_name: null
13
+ dataset_name: null
14
+ debug_loss: false
15
+ enable_npu_flash_attention: false
16
+ enable_xformers_memory_efficient_attention: false
17
+ gradient_accumulation_steps: 4
18
+ gradient_checkpointing: false
19
+ hub_model_id: null
20
+ hub_token: null
21
+ image_column: image
22
+ learning_rate: 0.0001
23
+ local_rank: -1
24
+ logging_dir: logs
25
+ lr_scheduler: cosine
26
+ lr_warmup_steps: 0
27
+ max_grad_norm: 1.0
28
+ max_train_samples: null
29
+ max_train_steps: 50
30
+ mixed_precision: fp16
31
+ noise_offset: 0
32
+ num_train_epochs: 2
33
+ num_validation_images: 4
34
+ output_dir: sd-tryon-model-lora-sdxl
35
+ prediction_type: null
36
+ pretrained_model_name_or_path: stabilityai/stable-diffusion-xl-base-1.0
37
+ pretrained_vae_model_name_or_path: madebyollin/sdxl-vae-fp16-fix
38
+ push_to_hub: true
39
+ random_flip: false
40
+ rank: 4
41
+ report_to: tensorboard
42
+ resolution: 512
43
+ resume_from_checkpoint: null
44
+ revision: null
45
+ scale_lr: false
46
+ seed: 1337
47
+ snr_gamma: null
48
+ train_batch_size: 1
49
+ train_data_dir: /content/drive/MyDrive/PFE/mini/mini/images
50
+ train_text_encoder: false
51
+ use_8bit_adam: false
52
+ validation_epochs: 1
53
+ validation_prompt: a slim black woman in forties
54
+ variant: null
logs/text2image-fine-tune/1746366045.0525992/events.out.tfevents.1746366045.548ea8abe000.25891.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95fe8dc9517e1cc45db313321591d87ec809428c5d856503de55542a959e0bca
3
+ size 2385
logs/text2image-fine-tune/1746366045.0543807/hparams.yml ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.01
5
+ allow_tf32: false
6
+ cache_dir: null
7
+ caption_column: text
8
+ center_crop: false
9
+ checkpointing_steps: 500
10
+ checkpoints_total_limit: null
11
+ dataloader_num_workers: 8
12
+ dataset_config_name: null
13
+ dataset_name: null
14
+ enable_xformers_memory_efficient_attention: false
15
+ gradient_accumulation_steps: 4
16
+ gradient_checkpointing: false
17
+ hub_model_id: null
18
+ hub_token: null
19
+ image_column: image
20
+ image_interpolation_mode: lanczos
21
+ learning_rate: 0.0001
22
+ local_rank: -1
23
+ logging_dir: logs
24
+ lr_scheduler: cosine
25
+ lr_warmup_steps: 0
26
+ max_grad_norm: 1.0
27
+ max_train_samples: null
28
+ max_train_steps: 50
29
+ mixed_precision: fp16
30
+ noise_offset: 0
31
+ num_train_epochs: 2
32
+ num_validation_images: 4
33
+ output_dir: sd-tryon-model-lora-sdxl
34
+ prediction_type: null
35
+ pretrained_model_name_or_path: runwayml/stable-diffusion-v1-5
36
+ push_to_hub: true
37
+ random_flip: false
38
+ rank: 4
39
+ report_to: tensorboard
40
+ resolution: 512
41
+ resume_from_checkpoint: null
42
+ revision: null
43
+ scale_lr: false
44
+ seed: 1337
45
+ snr_gamma: null
46
+ train_batch_size: 1
47
+ train_data_dir: /content/drive/MyDrive/PFE/mini/mini/images
48
+ use_8bit_adam: false
49
+ validation_epochs: 1
50
+ validation_prompt: a slim black woman in forties
51
+ variant: null
logs/text2image-fine-tune/1746366197.2601933/events.out.tfevents.1746366197.548ea8abe000.26989.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db74bdb78059bf026d9f628782eafbd5f0792fd5a5c4627bf37cce7d1e39aef4
3
+ size 2385
logs/text2image-fine-tune/1746366197.2623632/hparams.yml ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.01
5
+ allow_tf32: false
6
+ cache_dir: null
7
+ caption_column: text
8
+ center_crop: false
9
+ checkpointing_steps: 500
10
+ checkpoints_total_limit: null
11
+ dataloader_num_workers: 8
12
+ dataset_config_name: null
13
+ dataset_name: null
14
+ enable_xformers_memory_efficient_attention: false
15
+ gradient_accumulation_steps: 4
16
+ gradient_checkpointing: false
17
+ hub_model_id: null
18
+ hub_token: null
19
+ image_column: image
20
+ image_interpolation_mode: lanczos
21
+ learning_rate: 0.0001
22
+ local_rank: -1
23
+ logging_dir: logs
24
+ lr_scheduler: cosine
25
+ lr_warmup_steps: 0
26
+ max_grad_norm: 1.0
27
+ max_train_samples: null
28
+ max_train_steps: 50
29
+ mixed_precision: fp16
30
+ noise_offset: 0
31
+ num_train_epochs: 2
32
+ num_validation_images: 4
33
+ output_dir: sd-tryon-model-lora-sdxl
34
+ prediction_type: null
35
+ pretrained_model_name_or_path: runwayml/stable-diffusion-v1-5
36
+ push_to_hub: true
37
+ random_flip: false
38
+ rank: 4
39
+ report_to: tensorboard
40
+ resolution: 512
41
+ resume_from_checkpoint: null
42
+ revision: null
43
+ scale_lr: false
44
+ seed: 1337
45
+ snr_gamma: null
46
+ train_batch_size: 1
47
+ train_data_dir: /content/drive/MyDrive/PFE/mini/mini/images
48
+ use_8bit_adam: false
49
+ validation_epochs: 1
50
+ validation_prompt: a slim black woman in forties
51
+ variant: null
logs/text2image-fine-tune/events.out.tfevents.1746362204.548ea8abe000.9080.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad832222f8a8d238bb95895f99c515fcdf2f4fe97c575bad516a7e556e350c1c
3
+ size 7567827
logs/text2image-fine-tune/events.out.tfevents.1746363610.548ea8abe000.15371.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da965906f1723ff270e6e50701596d843279ee9e8632cff6364c4819d0bb3d2f
3
+ size 4642060
logs/text2image-fine-tune/events.out.tfevents.1746364508.548ea8abe000.19121.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:65ebde3be505dabacd11ae80397f095fce2c8c2a448a51bdaf3f9ff9abc660cf
3
+ size 9057350
logs/text2image-fine-tune/events.out.tfevents.1746366045.548ea8abe000.25891.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:92938dae7a7867c4925020bec817dd2492b76fcfdbd9d56a80f43590c035c0f3
3
+ size 88
logs/text2image-fine-tune/events.out.tfevents.1746366197.548ea8abe000.26989.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9b46b09c8e30d0f7abf6c042071a8025cd3aad23a58572c82e89b887fbcfe61
3
+ size 4168715
pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98dde773a1c70c337bea4687a211c77640563fb14708fea2fa307c25d8f969c6
3
+ size 3226184