Sentence Similarity
Transformers
PyTorch
German
English
xlm-roberta
feature-extraction
semantic textual similarity
sts
semantic search
sentence similarity
paraphrasing
sentence-transformer
text-embeddings-inference
Instructions to use PM-AI/sts_paraphrase_xlm-roberta-base_de-en with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use PM-AI/sts_paraphrase_xlm-roberta-base_de-en with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("PM-AI/sts_paraphrase_xlm-roberta-base_de-en") model = AutoModel.from_pretrained("PM-AI/sts_paraphrase_xlm-roberta-base_de-en", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -63,22 +63,23 @@ One thing has been changed in this training script: when a sentence pair consist
|
|
| 63 |
It makes no sense to say identical sentences have a score of 4.8 or 4.9.
|
| 64 |
|
| 65 |
#### Parameterization of training
|
| 66 |
-
- **Script: [training_stsbenchmark_continue_training.py](https://github.com/UKPLab/sentence-transformers/blob/b86eec31cf0a102ad786ba1ff31bfeb4998d3ca5/examples/training/sts/training_stsbenchmark_continue_training.py)
|
| 67 |
-
- **Datasets:
|
| 68 |
-
- **GPU: NVIDIA A40 (Driver Version: 515.48.07; CUDA Version: 11.7)
|
| 69 |
-
- **Batch Size:
|
| 70 |
-
- **Base Model:
|
| 71 |
-
- **Loss Function: Cosine Similarity
|
| 72 |
-
- **Learning Rate: 2e-5
|
| 73 |
-
- **Epochs:
|
| 74 |
-
- **Evaluation Samples:
|
| 75 |
-
- **Evaluation Steps:
|
| 76 |
-
- **Warmup Steps: 10%
|
| 77 |
-
- **:**
|
| 78 |
|
| 79 |
### Evaluation <a name="evaluation"></a>
|
| 80 |
|
| 81 |
todo todo todo
|
|
|
|
|
|
|
| 82 |
|
| 83 |
The evaluation is based on **[germanDPR](https://arxiv.org/abs/2104.12741)**.
|
| 84 |
The dataset developed by [Deepset.ai](deepset.ai) consists of question-answer pairs, which are supplemented by three "hard negatives" per question.
|
|
|
|
| 63 |
It makes no sense to say identical sentences have a score of 4.8 or 4.9.
|
| 64 |
|
| 65 |
#### Parameterization of training
|
| 66 |
+
- **Script:** [training_stsbenchmark_continue_training.py](https://github.com/UKPLab/sentence-transformers/blob/b86eec31cf0a102ad786ba1ff31bfeb4998d3ca5/examples/training/sts/training_stsbenchmark_continue_training.py)
|
| 67 |
+
- **Datasets:** todo
|
| 68 |
+
- **GPU:** NVIDIA A40 (Driver Version: 515.48.07; CUDA Version: 11.7)
|
| 69 |
+
- **Batch Size:** 32
|
| 70 |
+
- **Base Model:** todo
|
| 71 |
+
- **Loss Function:** Cosine Similarity
|
| 72 |
+
- **Learning Rate:** 2e-5
|
| 73 |
+
- **Epochs:** 3
|
| 74 |
+
- **Evaluation Samples:** 500
|
| 75 |
+
- **Evaluation Steps:** 1000
|
| 76 |
+
- **Warmup Steps:** 10%
|
|
|
|
| 77 |
|
| 78 |
### Evaluation <a name="evaluation"></a>
|
| 79 |
|
| 80 |
todo todo todo
|
| 81 |
+
todo links für die datensets, knowledge distillation etc
|
| 82 |
+
|
| 83 |
|
| 84 |
The evaluation is based on **[germanDPR](https://arxiv.org/abs/2104.12741)**.
|
| 85 |
The dataset developed by [Deepset.ai](deepset.ai) consists of question-answer pairs, which are supplemented by three "hard negatives" per question.
|