---
license: openrail++
datasets:
- hf-vision/chest-xray-pneumonia
language:
- en
base_model:
- Manojb/stable-diffusion-2-1-base
library_name: diffusers
---

# cxr-pneumonia-dreambooth

Diffuser model finetuned using DreamBooth from [stable-diffusion-2-1-base](https://huggingface.co/Manojb/stable-diffusion-2-1-base) to generate synthetic pneumonia chest x-ray images.

The bones still look a little weird...

---

### Generation Prompt

Due to the model being trained using DreamBooth, it is crucial that the correct prompt is used during generation:

```
A chest xray showing pneumonia infection, lung opacity
```

---

### Training Config

```python
training_config = {
    "method": "full_dreambooth",
    "resolution": 512,
    "train_batch_size": 8,
    "gradient_accumulation_steps": 2,  # Effective batch size: 16
    "learning_rate": 5e-6,  # Lower for full finetuning
    "max_train_steps": 800,
    "train_text_encoder": True,  # Thanks to 80GB A100 in Colab this is possible
    "with_prior_preservation": True,
    "prior_loss_weight": 1.0,
    "num_class_images": 200,
    "mixed_precision": "fp16",
    "gradient_checkpointing": False,
}
```

---

### Validation Images

***Train Steps 200***

![image](https://cdn-uploads.huggingface.co/production/uploads/67d5b5a056a9d31aa0b49687/MRN1Hhc2ieshhOHpvrBRf.png)

***Train Steps 400***

![image](https://cdn-uploads.huggingface.co/production/uploads/67d5b5a056a9d31aa0b49687/noK7eicRLhfVsNPZ7QXe6.png)

***Train Steps 600***

![image](https://cdn-uploads.huggingface.co/production/uploads/67d5b5a056a9d31aa0b49687/uptirTERSjyYq9blFS23-.png)

***Train Steps 800***

![image](https://cdn-uploads.huggingface.co/production/uploads/67d5b5a056a9d31aa0b49687/OGqHYbfzL0AsGPZdfZidz.png)