Update README.md
#3
by MiriamShem - opened
README.md
CHANGED
|
@@ -13,7 +13,7 @@ This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.
|
|
| 13 |
|
| 14 |
## Key Improvements Over Base Model
|
| 15 |
|
| 16 |
-
###
|
| 17 |
- **Base Model**: Generic text-to-text transformer trained on diverse internet content
|
| 18 |
- **Fine-tuned Model**: Specialized for child helpline case summarization with understanding of:
|
| 19 |
- Child protection terminology and concepts
|
|
@@ -21,7 +21,7 @@ This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.
|
|
| 21 |
- Sensitive case reporting protocols
|
| 22 |
- Legal and procedural references specific to child welfare
|
| 23 |
|
| 24 |
-
###
|
| 25 |
- **Contextual Understanding**: Better comprehension of child welfare scenarios including child labor, forced marriage, abuse cases
|
| 26 |
- **Structured Summaries**: Generates concise, actionable summaries that capture key information:
|
| 27 |
- Caller identity and location
|
|
@@ -29,7 +29,7 @@ This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.
|
|
| 29 |
- Action items and referrals provided
|
| 30 |
- **Sensitive Content Handling**: Trained to appropriately summarize sensitive child protection cases while maintaining essential details
|
| 31 |
|
| 32 |
-
###
|
| 33 |
|
| 34 |
| Configuration | Value |
|
| 35 |
|---------------|--------|
|
|
@@ -170,11 +170,11 @@ This model is specifically designed for:
|
|
| 170 |
Compared to the base FLAN-T5 model, this fine-tuned version shows significant improvements across all evaluation metrics:
|
| 171 |
|
| 172 |
### Key Improvements:
|
| 173 |
-
- **
|
| 174 |
-
- **
|
| 175 |
-
- **
|
| 176 |
-
- **
|
| 177 |
-
- **
|
| 178 |
|
| 179 |
### Performance Highlights:
|
| 180 |
- **Relevance**: Better identification of key information in child protection contexts
|
|
@@ -190,10 +190,10 @@ If you use this model in your research or applications, please cite:
|
|
| 190 |
```bibtex
|
| 191 |
@misc{flan-t5-child-helpline-summarizer,
|
| 192 |
title={Fine-tuned FLAN-T5 for Child Helpline Case Summarization},
|
| 193 |
-
author={
|
| 194 |
year={2024},
|
| 195 |
publisher={Hugging Face},
|
| 196 |
-
howpublished={\url{https://huggingface.co/
|
| 197 |
}
|
| 198 |
```
|
| 199 |
|
|
|
|
| 13 |
|
| 14 |
## Key Improvements Over Base Model
|
| 15 |
|
| 16 |
+
### Domain Specialization
|
| 17 |
- **Base Model**: Generic text-to-text transformer trained on diverse internet content
|
| 18 |
- **Fine-tuned Model**: Specialized for child helpline case summarization with understanding of:
|
| 19 |
- Child protection terminology and concepts
|
|
|
|
| 21 |
- Sensitive case reporting protocols
|
| 22 |
- Legal and procedural references specific to child welfare
|
| 23 |
|
| 24 |
+
### Enhanced Performance
|
| 25 |
- **Contextual Understanding**: Better comprehension of child welfare scenarios including child labor, forced marriage, abuse cases
|
| 26 |
- **Structured Summaries**: Generates concise, actionable summaries that capture key information:
|
| 27 |
- Caller identity and location
|
|
|
|
| 29 |
- Action items and referrals provided
|
| 30 |
- **Sensitive Content Handling**: Trained to appropriately summarize sensitive child protection cases while maintaining essential details
|
| 31 |
|
| 32 |
+
### Technical Specifications
|
| 33 |
|
| 34 |
| Configuration | Value |
|
| 35 |
|---------------|--------|
|
|
|
|
| 170 |
Compared to the base FLAN-T5 model, this fine-tuned version shows significant improvements across all evaluation metrics:
|
| 171 |
|
| 172 |
### Key Improvements:
|
| 173 |
+
- ** ROUGE Scores**: 50-84% improvement across ROUGE-1, ROUGE-2, and ROUGE-L metrics
|
| 174 |
+
- ** Domain Accuracy**: 94% accuracy in using child protection terminology (vs 52% for base model)
|
| 175 |
+
- ** Information Extraction**: 91% success rate in identifying key case details (vs 68% for base model)
|
| 176 |
+
- ** Action Item Detection**: 87% accuracy in identifying referrals and follow-up actions (vs 45% for base model)
|
| 177 |
+
- ** Professional Assessment**: 4.4/5 overall quality rating from child protection professionals (vs 2.8/5 for base model)
|
| 178 |
|
| 179 |
### Performance Highlights:
|
| 180 |
- **Relevance**: Better identification of key information in child protection contexts
|
|
|
|
| 190 |
```bibtex
|
| 191 |
@misc{flan-t5-child-helpline-summarizer,
|
| 192 |
title={Fine-tuned FLAN-T5 for Child Helpline Case Summarization},
|
| 193 |
+
author={openchs},
|
| 194 |
year={2024},
|
| 195 |
publisher={Hugging Face},
|
| 196 |
+
howpublished={\url{https://huggingface.co/openchs/sum-flan-t5-base-synthetic-v1}}
|
| 197 |
}
|
| 198 |
```
|
| 199 |
|