---
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- dense
- generated_from_trainer
- dataset_size:21470
- loss:MultipleNegativesRankingLoss
base_model: thenlper/gte-small
widget:
- source_sentence: This positive resistance model is a different way of analyzing
feedback oscillator operation.
sentences:
- This positive resistance model is a different way of analyzing feedback oscillator
operation.
- This negative resistance model is an alternate way of analyzing feedback oscillator
operation.
- I am BE 8th sem. CSE student. Which path should I choose as a career or which
course I should do to get a good job in future within my country?
- source_sentence: Danny Danny Kortchmar played guitar , Charles Larkey played bass
and Gordon played drums producing with Lou Adler .
sentences:
- What is the main reason for all the problems within India?
- Gordon played guitar , Danny Kortchmar played bass and Lou Adler played drums
with Charles Larkey producing .
- Danny Danny Kortchmar played guitar , Charles Larkey played bass and Gordon played
drums producing with Lou Adler .
- source_sentence: The Ngage isn't still lacking in earbuds.
sentences:
- What is Queen's University's acceptance rate for international students on campus?
- The Ngage is still lacking in earbuds.
- The Ngage isn't still lacking in earbuds.
- source_sentence: Previously reported figures were consistently revised down.
sentences:
- Previously reported figures were consistently revised down.
- What are the side effects for using Proactiv on the face? How are the side effects
treated?
- Previously reported numbers were infrequently revised down.
- source_sentence: What is the fastest way to get a PAN card within India?
sentences:
- He has also used the OpenMusic software (designed at IRCAM ) to create computer-generated
music.
- What is the fastest way to get a PAN card outside India?
- What is the fastest way to get a PAN card within India?
pipeline_tag: sentence-similarity
library_name: sentence-transformers
metrics:
- cosine_accuracy@1
- cosine_accuracy@3
- cosine_accuracy@5
- cosine_accuracy@10
- cosine_precision@1
- cosine_precision@3
- cosine_precision@5
- cosine_precision@10
- cosine_recall@1
- cosine_recall@3
- cosine_recall@5
- cosine_recall@10
- cosine_ndcg@10
- cosine_mrr@10
- cosine_map@100
model-index:
- name: SentenceTransformer based on thenlper/gte-small
results:
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: NanoMSMARCO
type: NanoMSMARCO
metrics:
- type: cosine_accuracy@1
value: 0.28
name: Cosine Accuracy@1
- type: cosine_accuracy@3
value: 0.48
name: Cosine Accuracy@3
- type: cosine_accuracy@5
value: 0.52
name: Cosine Accuracy@5
- type: cosine_accuracy@10
value: 0.58
name: Cosine Accuracy@10
- type: cosine_precision@1
value: 0.28
name: Cosine Precision@1
- type: cosine_precision@3
value: 0.15999999999999998
name: Cosine Precision@3
- type: cosine_precision@5
value: 0.10400000000000001
name: Cosine Precision@5
- type: cosine_precision@10
value: 0.057999999999999996
name: Cosine Precision@10
- type: cosine_recall@1
value: 0.28
name: Cosine Recall@1
- type: cosine_recall@3
value: 0.48
name: Cosine Recall@3
- type: cosine_recall@5
value: 0.52
name: Cosine Recall@5
- type: cosine_recall@10
value: 0.58
name: Cosine Recall@10
- type: cosine_ndcg@10
value: 0.4281391945817123
name: Cosine Ndcg@10
- type: cosine_mrr@10
value: 0.3795238095238095
name: Cosine Mrr@10
- type: cosine_map@100
value: 0.39018847344323304
name: Cosine Map@100
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: NanoNQ
type: NanoNQ
metrics:
- type: cosine_accuracy@1
value: 0.32
name: Cosine Accuracy@1
- type: cosine_accuracy@3
value: 0.6
name: Cosine Accuracy@3
- type: cosine_accuracy@5
value: 0.66
name: Cosine Accuracy@5
- type: cosine_accuracy@10
value: 0.74
name: Cosine Accuracy@10
- type: cosine_precision@1
value: 0.32
name: Cosine Precision@1
- type: cosine_precision@3
value: 0.2
name: Cosine Precision@3
- type: cosine_precision@5
value: 0.132
name: Cosine Precision@5
- type: cosine_precision@10
value: 0.07400000000000001
name: Cosine Precision@10
- type: cosine_recall@1
value: 0.3
name: Cosine Recall@1
- type: cosine_recall@3
value: 0.55
name: Cosine Recall@3
- type: cosine_recall@5
value: 0.61
name: Cosine Recall@5
- type: cosine_recall@10
value: 0.68
name: Cosine Recall@10
- type: cosine_ndcg@10
value: 0.5108521344166539
name: Cosine Ndcg@10
- type: cosine_mrr@10
value: 0.4791904761904762
name: Cosine Mrr@10
- type: cosine_map@100
value: 0.452598225251627
name: Cosine Map@100
- task:
type: nano-beir
name: Nano BEIR
dataset:
name: NanoBEIR mean
type: NanoBEIR_mean
metrics:
- type: cosine_accuracy@1
value: 0.30000000000000004
name: Cosine Accuracy@1
- type: cosine_accuracy@3
value: 0.54
name: Cosine Accuracy@3
- type: cosine_accuracy@5
value: 0.5900000000000001
name: Cosine Accuracy@5
- type: cosine_accuracy@10
value: 0.6599999999999999
name: Cosine Accuracy@10
- type: cosine_precision@1
value: 0.30000000000000004
name: Cosine Precision@1
- type: cosine_precision@3
value: 0.18
name: Cosine Precision@3
- type: cosine_precision@5
value: 0.11800000000000001
name: Cosine Precision@5
- type: cosine_precision@10
value: 0.066
name: Cosine Precision@10
- type: cosine_recall@1
value: 0.29000000000000004
name: Cosine Recall@1
- type: cosine_recall@3
value: 0.515
name: Cosine Recall@3
- type: cosine_recall@5
value: 0.565
name: Cosine Recall@5
- type: cosine_recall@10
value: 0.63
name: Cosine Recall@10
- type: cosine_ndcg@10
value: 0.4694956644991831
name: Cosine Ndcg@10
- type: cosine_mrr@10
value: 0.4293571428571429
name: Cosine Mrr@10
- type: cosine_map@100
value: 0.42139334934743
name: Cosine Map@100
---
# SentenceTransformer based on thenlper/gte-small
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [thenlper/gte-small](https://huggingface.co/thenlper/gte-small). It maps sentences & paragraphs to a 384-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
## Model Details
### Model Description
- **Model Type:** Sentence Transformer
- **Base model:** [thenlper/gte-small](https://huggingface.co/thenlper/gte-small)
- **Maximum Sequence Length:** 128 tokens
- **Output Dimensionality:** 384 dimensions
- **Similarity Function:** Cosine Similarity
### Model Sources
- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
- **Repository:** [Sentence Transformers on GitHub](https://github.com/huggingface/sentence-transformers)
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
### Full Model Architecture
```
SentenceTransformer(
(0): Transformer({'max_seq_length': 128, 'do_lower_case': False, 'architecture': 'BertModel'})
(1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
(2): Normalize()
)
```
## Usage
### Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
```bash
pip install -U sentence-transformers
```
Then you can load this model and run inference.
```python
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("redis/unified-negatives")
# Run inference
sentences = [
'What is the fastest way to get a PAN card within India?',
'What is the fastest way to get a PAN card within India?',
'What is the fastest way to get a PAN card outside India?',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[1.0000, 1.0000, 0.2943],
# [1.0000, 1.0000, 0.2943],
# [0.2943, 0.2943, 1.0000]])
```
## Evaluation
### Metrics
#### Information Retrieval
* Datasets: `NanoMSMARCO` and `NanoNQ`
* Evaluated with [InformationRetrievalEvaluator](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator)
| Metric | NanoMSMARCO | NanoNQ |
|:--------------------|:------------|:-----------|
| cosine_accuracy@1 | 0.28 | 0.32 |
| cosine_accuracy@3 | 0.48 | 0.6 |
| cosine_accuracy@5 | 0.52 | 0.66 |
| cosine_accuracy@10 | 0.58 | 0.74 |
| cosine_precision@1 | 0.28 | 0.32 |
| cosine_precision@3 | 0.16 | 0.2 |
| cosine_precision@5 | 0.104 | 0.132 |
| cosine_precision@10 | 0.058 | 0.074 |
| cosine_recall@1 | 0.28 | 0.3 |
| cosine_recall@3 | 0.48 | 0.55 |
| cosine_recall@5 | 0.52 | 0.61 |
| cosine_recall@10 | 0.58 | 0.68 |
| **cosine_ndcg@10** | **0.4281** | **0.5109** |
| cosine_mrr@10 | 0.3795 | 0.4792 |
| cosine_map@100 | 0.3902 | 0.4526 |
#### Nano BEIR
* Dataset: `NanoBEIR_mean`
* Evaluated with [NanoBEIREvaluator](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.NanoBEIREvaluator) with these parameters:
```json
{
"dataset_names": [
"msmarco",
"nq"
],
"dataset_id": "lightonai/NanoBEIR-en"
}
```
| Metric | Value |
|:--------------------|:-----------|
| cosine_accuracy@1 | 0.3 |
| cosine_accuracy@3 | 0.54 |
| cosine_accuracy@5 | 0.59 |
| cosine_accuracy@10 | 0.66 |
| cosine_precision@1 | 0.3 |
| cosine_precision@3 | 0.18 |
| cosine_precision@5 | 0.118 |
| cosine_precision@10 | 0.066 |
| cosine_recall@1 | 0.29 |
| cosine_recall@3 | 0.515 |
| cosine_recall@5 | 0.565 |
| cosine_recall@10 | 0.63 |
| **cosine_ndcg@10** | **0.4695** |
| cosine_mrr@10 | 0.4294 |
| cosine_map@100 | 0.4214 |
## Training Details
### Training Dataset
#### Unnamed Dataset
* Size: 21,470 training samples
* Columns: anchor, positive, and negative
* Approximate statistics based on the first 1000 samples:
| | anchor | positive | negative |
|:--------|:-----------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|:-----------------------------------------------------------------------------------|
| type | string | string | string |
| details |
The pale coloration provides camouflage for the beetle on the light sand. | The pale coloration provides camouflage for the beetle on the light sand. | The pale coloration helps the beetle stand out on the light sand. |
| It is found from Fennoscandinavia to the Pyrenees , Italy and Greece and from Britain to Russia and Ukraine . | It is found from Fennoscandinavia to the Pyrenees , Italy and Greece and from Britain to Russia and Ukraine . | It is located from Fennoscandinavia to the Pyrenees , Great Britain and Greece and from Italy to Russia and Ukraine . |
| Is Swami Vivekananda's speech at parliament of world's religions, Chicago overrated in Chicago? | Is Swami Vivekananda's speech at parliament of world's religions, Chicago overrated in Chicago? | Is Swami Vivekananda's speech at parliament of world's religions, Chicago overrated outside Chicago? |
* Loss: [MultipleNegativesRankingLoss](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
```json
{
"scale": 7.0,
"similarity_fct": "cos_sim",
"gather_across_devices": false
}
```
### Evaluation Dataset
#### Unnamed Dataset
* Size: 2,386 evaluation samples
* Columns: anchor, positive, and negative
* Approximate statistics based on the first 1000 samples:
| | anchor | positive | negative |
|:--------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|:----------------------------------------------------------------------------------|
| type | string | string | string |
| details | He died at Fort Edward on August 18 , 1861 , and was buried at the Union Cemetery in Sandy Hill . | He died at Fort Edward on August 18 , 1861 , and was buried at the Union Cemetery in Sandy Hill . | He died at Sandy Hill on August 18 , 1861 , and was buried at the Union Cemetery in Fort Edward . |
| It was this cooperation which led to the development of the satellite AIS system. | It was this cooperation which led to the development of the satellite AIS system. | It was this cooperation which led to the halting of development of the satellite AIS system. |
| What is the best field of engineering on campus? | What is the best field of engineering on campus? | What is the best field of engineering off campus? |
* Loss: [MultipleNegativesRankingLoss](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
```json
{
"scale": 7.0,
"similarity_fct": "cos_sim",
"gather_across_devices": false
}
```
### Training Hyperparameters
#### Non-Default Hyperparameters
- `eval_strategy`: steps
- `per_device_train_batch_size`: 128
- `per_device_eval_batch_size`: 128
- `learning_rate`: 1e-06
- `weight_decay`: 0.001
- `max_steps`: 3000
- `warmup_ratio`: 0.1
- `fp16`: True
- `dataloader_drop_last`: True
- `dataloader_num_workers`: 1
- `dataloader_prefetch_factor`: 1
- `load_best_model_at_end`: True
- `optim`: adamw_torch
- `ddp_find_unused_parameters`: False
- `push_to_hub`: True
- `hub_model_id`: redis/unified-negatives
- `eval_on_start`: True
#### All Hyperparameters