Sentence Similarity
sentence-transformers
PyTorch
ONNX
Safetensors
OpenVINO
Transformers
English
mpnet
fill-mask
feature-extraction
text-embeddings-inference
Eval Results
Instructions to use sentence-transformers/all-mpnet-base-v2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use sentence-transformers/all-mpnet-base-v2 with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("sentence-transformers/all-mpnet-base-v2") sentences = [ "That is a happy person", "That is a happy dog", "That is a very happy person", "Today is a sunny day" ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Transformers
How to use sentence-transformers/all-mpnet-base-v2 with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("sentence-transformers/all-mpnet-base-v2") model = AutoModelForMaskedLM.from_pretrained("sentence-transformers/all-mpnet-base-v2") - Inference
- Notebooks
- Google Colab
- Kaggle
Add evaluation results for model sentence-transformers/all-mpnet-base-v2 revision 9a3225965996d404b775526de6dbfe85d3368642
#47
by Samoed - opened
- .eval_results/BrightAopsRetrieval.yaml +22 -0
- .eval_results/BrightBiologyLongRetrieval.yaml +22 -0
- .eval_results/BrightBiologyRetrieval.yaml +22 -0
- .eval_results/BrightEarthScienceLongRetrieval.yaml +22 -0
- .eval_results/BrightEarthScienceRetrieval.yaml +22 -0
- .eval_results/BrightEconomicsLongRetrieval.yaml +22 -0
- .eval_results/BrightEconomicsRetrieval.yaml +22 -0
- .eval_results/BrightLeetcodeRetrieval.yaml +22 -0
- .eval_results/BrightPonyLongRetrieval.yaml +22 -0
- .eval_results/BrightPonyRetrieval.yaml +22 -0
- .eval_results/BrightPsychologyLongRetrieval.yaml +22 -0
- .eval_results/BrightPsychologyRetrieval.yaml +22 -0
- .eval_results/BrightRoboticsLongRetrieval.yaml +22 -0
- .eval_results/BrightRoboticsRetrieval.yaml +22 -0
- .eval_results/BrightStackoverflowLongRetrieval.yaml +22 -0
- .eval_results/BrightStackoverflowRetrieval.yaml +22 -0
- .eval_results/BrightSustainableLivingLongRetrieval.yaml +22 -0
- .eval_results/BrightSustainableLivingRetrieval.yaml +22 -0
- .eval_results/BrightTheoremQAQuestionsRetrieval.yaml +22 -0
- .eval_results/BrightTheoremQATheoremsRetrieval.yaml +22 -0
.eval_results/BrightAopsRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightAopsRetrieval_default_standard
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 5.325
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightAopsRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 5.325
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightBiologyLongRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightBiologyLongRetrieval_default_long
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 25.566
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightBiologyLongRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 25.566
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightBiologyRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightBiologyRetrieval_default_standard
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 15.098
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightBiologyRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 15.098
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightEarthScienceLongRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightEarthScienceLongRetrieval_default_long
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 34.052
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightEarthScienceLongRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 34.052
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightEarthScienceRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightEarthScienceRetrieval_default_standard
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 20.414
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightEarthScienceRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 20.414
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightEconomicsLongRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightEconomicsLongRetrieval_default_long
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 18.932
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightEconomicsLongRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 18.932
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightEconomicsRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightEconomicsRetrieval_default_standard
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 16.639
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightEconomicsRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 16.639
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightLeetcodeRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightLeetcodeRetrieval_default_standard
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 26.404
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightLeetcodeRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 26.404
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightPonyLongRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightPonyLongRetrieval_default_long
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 1.19
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightPonyLongRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 1.19
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightPonyRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightPonyRetrieval_default_standard
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 6.996
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightPonyRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 6.996
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightPsychologyLongRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightPsychologyLongRetrieval_default_long
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 15.842
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightPsychologyLongRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 15.842
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightPsychologyRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightPsychologyRetrieval_default_standard
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 22.664
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightPsychologyRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 22.664
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightRoboticsLongRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightRoboticsLongRetrieval_default_long
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 10.891
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightRoboticsLongRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 10.891
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightRoboticsRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightRoboticsRetrieval_default_standard
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 8.221
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightRoboticsRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 8.221
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightStackoverflowLongRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightStackoverflowLongRetrieval_default_long
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 14.957
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightStackoverflowLongRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 14.957
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightStackoverflowRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightStackoverflowRetrieval_default_standard
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 11.024
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightStackoverflowRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 11.024
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightSustainableLivingLongRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightSustainableLivingLongRetrieval_default_long
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 18.009
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightSustainableLivingLongRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 18.009
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightSustainableLivingRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightSustainableLivingRetrieval_default_standard
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 15.343
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightSustainableLivingRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 15.343
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightTheoremQAQuestionsRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightTheoremQAQuestionsRetrieval_default_standard
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 20.035
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightTheoremQAQuestionsRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 20.035
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|
.eval_results/BrightTheoremQATheoremsRetrieval.yaml
ADDED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
- dataset:
|
| 2 |
+
id: mteb/BRIGHT
|
| 3 |
+
task_id: BrightTheoremQATheoremsRetrieval_default_standard
|
| 4 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 5 |
+
value: 10.779
|
| 6 |
+
date: '2026-03-26'
|
| 7 |
+
notes: Obtained using MTEB v2.10.12
|
| 8 |
+
source:
|
| 9 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 10 |
+
name: Obtained using MTEB v2.10.12
|
| 11 |
+
user: mteb
|
| 12 |
+
- dataset:
|
| 13 |
+
id: mteb/BRIGHT
|
| 14 |
+
task_id: BrightTheoremQATheoremsRetrieval
|
| 15 |
+
revision: c26703e6600d97c579ee2985f16cf307db13ed85
|
| 16 |
+
value: 10.779
|
| 17 |
+
date: '2026-03-26'
|
| 18 |
+
notes: Obtained using MTEB v2.10.12
|
| 19 |
+
source:
|
| 20 |
+
url: https://github.com/embeddings-benchmark/mteb/
|
| 21 |
+
name: Obtained using MTEB v2.10.12
|
| 22 |
+
user: mteb
|