DrSyedFaizan commited on
Commit
9e65751
Β·
verified Β·
1 Parent(s): 4fead8f

Create readme.md

Browse files
Files changed (1) hide show
  1. readme.md +53 -0
readme.md ADDED
@@ -0,0 +1,53 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - chatbot
4
+ - evaluation
5
+ - first-aid
6
+ license: mit
7
+ ---
8
+
9
+ # πŸ₯ First Aid Assistant - Evaluation Results
10
+
11
+ This repository contains the **evaluation results** for the `First Aid Assistant` chatbot, tested on **10 first-aid-related questions**.
12
+
13
+ ## πŸ“Š Evaluation Metrics
14
+ The chatbot's responses were evaluated using **Precision, Recall, F1 Score, and Cosine Similarity**.
15
+
16
+ | Metric | Score |
17
+ |-----------|--------|
18
+ | Precision | **1.00** |
19
+ | Recall | **1.00** |
20
+ | F1 Score | **1.00** |
21
+
22
+ > πŸ” Full evaluation results are available in **[`evaluation_results.txt`](./evaluation_results.txt)**.
23
+
24
+ ## πŸ“ˆ Evaluation Visualization
25
+ Below is a graphical representation of the chatbot’s performance.
26
+
27
+ ![Evaluation Graph](./evaluation_plot.png)
28
+
29
+ ---
30
+
31
+ ## πŸ“– **Evaluation Method**
32
+ - Used **TF-IDF + Cosine Similarity** to compare chatbot responses with expected answers.
33
+ - Evaluated on **10 first-aid-related questions** covering:
34
+ - High fever in infants
35
+ - Low blood sugar treatment
36
+ - First-aid steps for burns, seizures, choking, etc.
37
+ - **Expected answers** were sourced from medical literature.
38
+
39
+ ---
40
+
41
+ ## πŸ“₯ **Download & Re-Evaluate**
42
+ You can **re-evaluate the chatbot** by running the following:
43
+
44
+ ```
45
+ git clone https://huggingface.co/DrSyedFaizan/First_Aid_Assistant_Evaluation
46
+ cd First_Aid_Assistant_Evaluation
47
+ python eval.py # Runs evaluation on the chatbot
48
+ ```
49
+
50
+ ## πŸ“Œ **Author**
51
+ πŸ‘¨β€βš• **Dr. Syed Faizan** | πŸ₯ Healthcare AI & Data Science
52
+ πŸ”— **Hugging Face Repo**: [First_Aid_Assistant_Evaluation](https://huggingface.co/DrSyedFaizan/First_Aid_Assistant_Evaluation)
53
+