Create readme.md
Browse files
readme.md
ADDED
|
@@ -0,0 +1,53 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags:
|
| 3 |
+
- chatbot
|
| 4 |
+
- evaluation
|
| 5 |
+
- first-aid
|
| 6 |
+
license: mit
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# π₯ First Aid Assistant - Evaluation Results
|
| 10 |
+
|
| 11 |
+
This repository contains the **evaluation results** for the `First Aid Assistant` chatbot, tested on **10 first-aid-related questions**.
|
| 12 |
+
|
| 13 |
+
## π Evaluation Metrics
|
| 14 |
+
The chatbot's responses were evaluated using **Precision, Recall, F1 Score, and Cosine Similarity**.
|
| 15 |
+
|
| 16 |
+
| Metric | Score |
|
| 17 |
+
|-----------|--------|
|
| 18 |
+
| Precision | **1.00** |
|
| 19 |
+
| Recall | **1.00** |
|
| 20 |
+
| F1 Score | **1.00** |
|
| 21 |
+
|
| 22 |
+
> π Full evaluation results are available in **[`evaluation_results.txt`](./evaluation_results.txt)**.
|
| 23 |
+
|
| 24 |
+
## π Evaluation Visualization
|
| 25 |
+
Below is a graphical representation of the chatbotβs performance.
|
| 26 |
+
|
| 27 |
+

|
| 28 |
+
|
| 29 |
+
---
|
| 30 |
+
|
| 31 |
+
## π **Evaluation Method**
|
| 32 |
+
- Used **TF-IDF + Cosine Similarity** to compare chatbot responses with expected answers.
|
| 33 |
+
- Evaluated on **10 first-aid-related questions** covering:
|
| 34 |
+
- High fever in infants
|
| 35 |
+
- Low blood sugar treatment
|
| 36 |
+
- First-aid steps for burns, seizures, choking, etc.
|
| 37 |
+
- **Expected answers** were sourced from medical literature.
|
| 38 |
+
|
| 39 |
+
---
|
| 40 |
+
|
| 41 |
+
## π₯ **Download & Re-Evaluate**
|
| 42 |
+
You can **re-evaluate the chatbot** by running the following:
|
| 43 |
+
|
| 44 |
+
```
|
| 45 |
+
git clone https://huggingface.co/DrSyedFaizan/First_Aid_Assistant_Evaluation
|
| 46 |
+
cd First_Aid_Assistant_Evaluation
|
| 47 |
+
python eval.py # Runs evaluation on the chatbot
|
| 48 |
+
```
|
| 49 |
+
|
| 50 |
+
## π **Author**
|
| 51 |
+
π¨ββ **Dr. Syed Faizan** | π₯ Healthcare AI & Data Science
|
| 52 |
+
π **Hugging Face Repo**: [First_Aid_Assistant_Evaluation](https://huggingface.co/DrSyedFaizan/First_Aid_Assistant_Evaluation)
|
| 53 |
+
|