PM-AI commited on
Commit
41d328c
·
1 Parent(s): 1fd2e02

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -12
README.md CHANGED
@@ -63,22 +63,23 @@ One thing has been changed in this training script: when a sentence pair consist
63
  It makes no sense to say identical sentences have a score of 4.8 or 4.9.
64
 
65
  #### Parameterization of training
66
- - **Script: [training_stsbenchmark_continue_training.py](https://github.com/UKPLab/sentence-transformers/blob/b86eec31cf0a102ad786ba1ff31bfeb4998d3ca5/examples/training/sts/training_stsbenchmark_continue_training.py)**
67
- - **Datasets: todo**
68
- - **GPU: NVIDIA A40 (Driver Version: 515.48.07; CUDA Version: 11.7)**
69
- - **Batch Size: 32**
70
- - **Base Model: todo**
71
- - **Loss Function: Cosine Similarity**
72
- - **Learning Rate: 2e-5**
73
- - **Epochs: 3**
74
- - **Evaluation Samples: 500**
75
- - **Evaluation Steps: 1000**
76
- - **Warmup Steps: 10%**
77
- - **:**
78
 
79
  ### Evaluation <a name="evaluation"></a>
80
 
81
  todo todo todo
 
 
82
 
83
  The evaluation is based on **[germanDPR](https://arxiv.org/abs/2104.12741)**.
84
  The dataset developed by [Deepset.ai](deepset.ai) consists of question-answer pairs, which are supplemented by three "hard negatives" per question.
 
63
  It makes no sense to say identical sentences have a score of 4.8 or 4.9.
64
 
65
  #### Parameterization of training
66
+ - **Script:** [training_stsbenchmark_continue_training.py](https://github.com/UKPLab/sentence-transformers/blob/b86eec31cf0a102ad786ba1ff31bfeb4998d3ca5/examples/training/sts/training_stsbenchmark_continue_training.py)
67
+ - **Datasets:** todo
68
+ - **GPU:** NVIDIA A40 (Driver Version: 515.48.07; CUDA Version: 11.7)
69
+ - **Batch Size:** 32
70
+ - **Base Model:** todo
71
+ - **Loss Function:** Cosine Similarity
72
+ - **Learning Rate:** 2e-5
73
+ - **Epochs:** 3
74
+ - **Evaluation Samples:** 500
75
+ - **Evaluation Steps:** 1000
76
+ - **Warmup Steps:** 10%
 
77
 
78
  ### Evaluation <a name="evaluation"></a>
79
 
80
  todo todo todo
81
+ todo links für die datensets, knowledge distillation etc
82
+
83
 
84
  The evaluation is based on **[germanDPR](https://arxiv.org/abs/2104.12741)**.
85
  The dataset developed by [Deepset.ai](deepset.ai) consists of question-answer pairs, which are supplemented by three "hard negatives" per question.