Sentence Similarity
sentence-transformers
Safetensors
bert
advai-notebooks
embedding
demo
synthetic-data
random-initialization
text-embeddings-inference
Instructions to use widebluesky/wbs-embedding-demo with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use widebluesky/wbs-embedding-demo with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("widebluesky/wbs-embedding-demo") sentences = [ "That is a happy person", "That is a happy dog", "That is a very happy person", "Today is a sunny day" ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Notebooks
- Google Colab
- Kaggle
Associate verified demo dataset and pin training-data provenance
Browse files- README.md +18 -12
- publish_manifest.json +2 -2
README.md
CHANGED
|
@@ -8,7 +8,7 @@ tags:
|
|
| 8 |
- random-initialization
|
| 9 |
pipeline_tag: sentence-similarity
|
| 10 |
datasets:
|
| 11 |
-
- widebluesky/wbs-
|
| 12 |
---
|
| 13 |
|
| 14 |
# widebluesky/wbs-embedding-demo
|
|
@@ -92,27 +92,33 @@ resuming training and local machine paths are not part of this publication.
|
|
| 92 |
|
| 93 |
## Training and evaluation dataset
|
| 94 |
|
| 95 |
-
Dataset: [widebluesky/wbs-
|
| 96 |
-
Verified dataset revision: [`
|
| 97 |
|
| 98 |
-
This
|
| 99 |
-
|
| 100 |
-
|
|
|
|
|
|
|
| 101 |
|
| 102 |
-
Training uses `embedding_training` (24 query-positive samples).
|
| 103 |
-
`queries` (12 train / 3 validation / 3 test),
|
| 104 |
-
and `qrels` (216 judgments).
|
| 105 |
|
| 106 |
```python
|
| 107 |
from datasets import load_dataset
|
| 108 |
|
| 109 |
data = load_dataset(
|
| 110 |
-
"widebluesky/wbs-
|
| 111 |
-
revision="
|
| 112 |
)
|
| 113 |
```
|
| 114 |
|
| 115 |
Access uses the existing Hugging Face login; both model and dataset repositories are private.
|
| 116 |
Original project-native data files are available under `source/` in the dataset repository.
|
| 117 |
-
Canonical
|
| 118 |
Training sample fingerprint: `cebc151f0e9c04eae8c92a1d79a8c3ae6771b1a81fb7484e7a13a34555ee9173`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
- random-initialization
|
| 9 |
pipeline_tag: sentence-similarity
|
| 10 |
datasets:
|
| 11 |
+
- widebluesky/wbs-embedding-demo
|
| 12 |
---
|
| 13 |
|
| 14 |
# widebluesky/wbs-embedding-demo
|
|
|
|
| 92 |
|
| 93 |
## Training and evaluation dataset
|
| 94 |
|
| 95 |
+
Dataset: [widebluesky/wbs-embedding-demo](https://huggingface.co/datasets/widebluesky/wbs-embedding-demo).
|
| 96 |
+
Verified dataset revision: [`d5d422450670f840377c9f8bb3b11b7919cdadfa`](https://huggingface.co/datasets/widebluesky/wbs-embedding-demo/tree/d5d422450670f840377c9f8bb3b11b7919cdadfa) (`demo-v1`).
|
| 97 |
|
| 98 |
+
This independently versioned task dataset contains the exact synthetic records used
|
| 99 |
+
for this trained demo release. It includes its own training samples and a complete
|
| 100 |
+
local copy of the evaluation benchmark. No other dataset repository is required.
|
| 101 |
+
All records were reloaded from the pinned Hub revision and checked against the
|
| 102 |
+
original training provenance before associating this dataset with the model.
|
| 103 |
|
| 104 |
+
Training uses `embedding_training` (24 query-positive contrastive samples).
|
| 105 |
+
Evaluation uses `queries` (12 train / 3 validation / 3 test), `corpus` (12 documents)
|
| 106 |
+
and `qrels` (216 judgments). Ranker training pairs and candidates are not included.
|
| 107 |
|
| 108 |
```python
|
| 109 |
from datasets import load_dataset
|
| 110 |
|
| 111 |
data = load_dataset(
|
| 112 |
+
"widebluesky/wbs-embedding-demo", "embedding_training",
|
| 113 |
+
revision="d5d422450670f840377c9f8bb3b11b7919cdadfa", token=True,
|
| 114 |
)
|
| 115 |
```
|
| 116 |
|
| 117 |
Access uses the existing Hugging Face login; both model and dataset repositories are private.
|
| 118 |
Original project-native data files are available under `source/` in the dataset repository.
|
| 119 |
+
Canonical benchmark fingerprint: `f96589e88e79ce684f3c8733ae1a3c98a8f028459f6e82e3477efeb2867b2a19`.
|
| 120 |
Training sample fingerprint: `cebc151f0e9c04eae8c92a1d79a8c3ae6771b1a81fb7484e7a13a34555ee9173`.
|
| 121 |
+
|
| 122 |
+
This association supersedes the former shared retrieval dataset association.
|
| 123 |
+
The original `widebluesky/wbs-retrieval-demo` dataset and its pinned `demo-v1` revision
|
| 124 |
+
remain available for historical reproducibility.
|
publish_manifest.json
CHANGED
|
@@ -9,8 +9,8 @@
|
|
| 9 |
},
|
| 10 |
{
|
| 11 |
"path": "README.md",
|
| 12 |
-
"bytes":
|
| 13 |
-
"sha256": "
|
| 14 |
},
|
| 15 |
{
|
| 16 |
"path": "advai_metadata.json",
|
|
|
|
| 9 |
},
|
| 10 |
{
|
| 11 |
"path": "README.md",
|
| 12 |
+
"bytes": 4256,
|
| 13 |
+
"sha256": "c4ced8a8837245aa74142ccb0929e7b2c36d81864339ca303b9cad4e58097cff"
|
| 14 |
},
|
| 15 |
{
|
| 16 |
"path": "advai_metadata.json",
|