Update README.md (#3)
Browse files- Update README.md (85d21351fff32955baf875ea0f753e1c6f83bdbb)
Co-authored-by: Miriam Shem <MiriamShem@users.noreply.huggingface.co>
README.md
CHANGED
|
@@ -25,7 +25,7 @@ This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.
|
|
| 25 |
|
| 26 |
## Key Improvements Over Base Model
|
| 27 |
|
| 28 |
-
###
|
| 29 |
- **Base Model**: Generic text-to-text transformer trained on diverse internet content
|
| 30 |
- **Fine-tuned Model**: Specialized for child helpline case summarization with understanding of:
|
| 31 |
- Child protection terminology and concepts
|
|
@@ -33,7 +33,7 @@ This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.
|
|
| 33 |
- Sensitive case reporting protocols
|
| 34 |
- Legal and procedural references specific to child welfare
|
| 35 |
|
| 36 |
-
###
|
| 37 |
- **Contextual Understanding**: Better comprehension of child welfare scenarios including child labor, forced marriage, abuse cases
|
| 38 |
- **Structured Summaries**: Generates concise, actionable summaries that capture key information:
|
| 39 |
- Caller identity and location
|
|
@@ -41,7 +41,7 @@ This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.
|
|
| 41 |
- Action items and referrals provided
|
| 42 |
- **Sensitive Content Handling**: Trained to appropriately summarize sensitive child protection cases while maintaining essential details
|
| 43 |
|
| 44 |
-
###
|
| 45 |
|
| 46 |
| Configuration | Value |
|
| 47 |
|---------------|--------|
|
|
@@ -182,11 +182,11 @@ This model is specifically designed for:
|
|
| 182 |
Compared to the base FLAN-T5 model, this fine-tuned version shows significant improvements across all evaluation metrics:
|
| 183 |
|
| 184 |
### Key Improvements:
|
| 185 |
-
- **
|
| 186 |
-
- **
|
| 187 |
-
- **
|
| 188 |
-
- **
|
| 189 |
-
- **
|
| 190 |
|
| 191 |
### Performance Highlights:
|
| 192 |
- **Relevance**: Better identification of key information in child protection contexts
|
|
@@ -202,10 +202,10 @@ If you use this model in your research or applications, please cite:
|
|
| 202 |
```bibtex
|
| 203 |
@misc{flan-t5-child-helpline-summarizer,
|
| 204 |
title={Fine-tuned FLAN-T5 for Child Helpline Case Summarization},
|
| 205 |
-
author={
|
| 206 |
year={2024},
|
| 207 |
publisher={Hugging Face},
|
| 208 |
-
howpublished={\url{https://huggingface.co/
|
| 209 |
}
|
| 210 |
```
|
| 211 |
|
|
|
|
| 25 |
|
| 26 |
## Key Improvements Over Base Model
|
| 27 |
|
| 28 |
+
### Domain Specialization
|
| 29 |
- **Base Model**: Generic text-to-text transformer trained on diverse internet content
|
| 30 |
- **Fine-tuned Model**: Specialized for child helpline case summarization with understanding of:
|
| 31 |
- Child protection terminology and concepts
|
|
|
|
| 33 |
- Sensitive case reporting protocols
|
| 34 |
- Legal and procedural references specific to child welfare
|
| 35 |
|
| 36 |
+
### Enhanced Performance
|
| 37 |
- **Contextual Understanding**: Better comprehension of child welfare scenarios including child labor, forced marriage, abuse cases
|
| 38 |
- **Structured Summaries**: Generates concise, actionable summaries that capture key information:
|
| 39 |
- Caller identity and location
|
|
|
|
| 41 |
- Action items and referrals provided
|
| 42 |
- **Sensitive Content Handling**: Trained to appropriately summarize sensitive child protection cases while maintaining essential details
|
| 43 |
|
| 44 |
+
### Technical Specifications
|
| 45 |
|
| 46 |
| Configuration | Value |
|
| 47 |
|---------------|--------|
|
|
|
|
| 182 |
Compared to the base FLAN-T5 model, this fine-tuned version shows significant improvements across all evaluation metrics:
|
| 183 |
|
| 184 |
### Key Improvements:
|
| 185 |
+
- ** ROUGE Scores**: 50-84% improvement across ROUGE-1, ROUGE-2, and ROUGE-L metrics
|
| 186 |
+
- ** Domain Accuracy**: 94% accuracy in using child protection terminology (vs 52% for base model)
|
| 187 |
+
- ** Information Extraction**: 91% success rate in identifying key case details (vs 68% for base model)
|
| 188 |
+
- ** Action Item Detection**: 87% accuracy in identifying referrals and follow-up actions (vs 45% for base model)
|
| 189 |
+
- ** Professional Assessment**: 4.4/5 overall quality rating from child protection professionals (vs 2.8/5 for base model)
|
| 190 |
|
| 191 |
### Performance Highlights:
|
| 192 |
- **Relevance**: Better identification of key information in child protection contexts
|
|
|
|
| 202 |
```bibtex
|
| 203 |
@misc{flan-t5-child-helpline-summarizer,
|
| 204 |
title={Fine-tuned FLAN-T5 for Child Helpline Case Summarization},
|
| 205 |
+
author={openchs},
|
| 206 |
year={2024},
|
| 207 |
publisher={Hugging Face},
|
| 208 |
+
howpublished={\url{https://huggingface.co/openchs/sum-flan-t5-base-synthetic-v1}}
|
| 209 |
}
|
| 210 |
```
|
| 211 |
|