| MTEB AmazonCounterfactualClassification (de) |
Configuration deTask ClassificationMetric accuracyComparison conditions not established |
71.7238 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonCounterfactualClassification (de) |
Configuration deTask ClassificationMetric apComparison conditions not established |
82.2209 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonCounterfactualClassification (de) |
Configuration deTask ClassificationMetric f1Comparison conditions not established |
69.9553 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonCounterfactualClassification (en) |
Configuration enTask ClassificationMetric accuracyComparison conditions not established |
78.9701 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonCounterfactualClassification (en) |
Configuration enTask ClassificationMetric apComparison conditions not established |
43.6935 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonCounterfactualClassification (en) |
Configuration enTask ClassificationMetric f1Comparison conditions not established |
73.3808 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonCounterfactualClassification (en-ext) |
Configuration en-extTask ClassificationMetric accuracyComparison conditions not established |
79.6552 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonCounterfactualClassification (en-ext) |
Configuration en-extTask ClassificationMetric apComparison conditions not established |
28.5079 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonCounterfactualClassification (en-ext) |
Configuration en-extTask ClassificationMetric f1Comparison conditions not established |
66.8452 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonCounterfactualClassification (ja) |
Configuration jaTask ClassificationMetric accuracyComparison conditions not established |
73.3298 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonCounterfactualClassification (ja) |
Configuration jaTask ClassificationMetric apComparison conditions not established |
20.7205 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonCounterfactualClassification (ja) |
Configuration jaTask ClassificationMetric f1Comparison conditions not established |
59.78 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonPolarityClassification |
Configuration defaultTask ClassificationMetric accuracyComparison conditions not established |
90.6377 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonPolarityClassification |
Configuration defaultTask ClassificationMetric apComparison conditions not established |
87.2228 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonPolarityClassification |
Configuration defaultTask ClassificationMetric f1Comparison conditions not established |
90.6038 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonReviewsClassification (de) |
Configuration deTask ClassificationMetric accuracyComparison conditions not established |
41.828 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonReviewsClassification (de) |
Configuration deTask ClassificationMetric f1Comparison conditions not established |
41.271 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonReviewsClassification (en) |
Configuration enTask ClassificationMetric accuracyComparison conditions not established |
44.546 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonReviewsClassification (en) |
Configuration enTask ClassificationMetric f1Comparison conditions not established |
44.0567 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonReviewsClassification (es) |
Configuration esTask ClassificationMetric accuracyComparison conditions not established |
40.534 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonReviewsClassification (es) |
Configuration esTask ClassificationMetric f1Comparison conditions not established |
39.8207 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonReviewsClassification (fr) |
Configuration frTask ClassificationMetric accuracyComparison conditions not established |
39.684 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonReviewsClassification (fr) |
Configuration frTask ClassificationMetric f1Comparison conditions not established |
39.1105 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonReviewsClassification (ja) |
Configuration jaTask ClassificationMetric accuracyComparison conditions not established |
37.436 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonReviewsClassification (ja) |
Configuration jaTask ClassificationMetric f1Comparison conditions not established |
37.0708 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonReviewsClassification (zh) |
Configuration zhTask ClassificationMetric accuracyComparison conditions not established |
37.226 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonReviewsClassification (zh) |
Configuration zhTask ClassificationMetric f1Comparison conditions not established |
36.6537 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB ArguAna |
Configuration defaultTask RetrievalMetric map_at_1Comparison conditions not established |
22.831 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB ArguAna |
Configuration defaultTask RetrievalMetric map_at_10Comparison conditions not established |
36.42 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB ArguAna |
Configuration defaultTask RetrievalMetric map_at_100Comparison conditions not established |
37.699 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB ArguAna |
Configuration defaultTask RetrievalMetric map_at_1000Comparison conditions not established |
37.724 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB ArguAna |
Configuration defaultTask RetrievalMetric map_at_3Comparison conditions not established |
32.207 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB ArguAna |
Configuration defaultTask RetrievalMetric map_at_5Comparison conditions not established |
34.312 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB ArguAna |
Configuration defaultTask RetrievalMetric mrr_at_1Comparison conditions not established |
23.257 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB ArguAna |
Configuration defaultTask RetrievalMetric mrr_at_10Comparison conditions not established |
36.574 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB ArguAna |
Configuration defaultTask RetrievalMetric mrr_at_100Comparison conditions not established |
37.854 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB ArguAna |
Configuration defaultTask RetrievalMetric mrr_at_1000Comparison conditions not established |
37.878 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| MTEB ArguAna |
Configuration defaultTask RetrievalMetric mrr_at_3Comparison conditions not established |
32.385 |
intfloat Publisher reported |
Evaluated revision not stated |
— |
| mteb/arguana |
Task ArguAnaMetric ArguAnaSetup Obtained using MTEB v1.12.75Comparison conditions not established |
44.206 |
Obtained using MTEB v1.12.75 Reported by a third party |
Evaluated revision not stated |
2026-04-02 |
| mteb/arguana |
Task ArguAna_default_testMetric ArguAna_default_testSetup Obtained using MTEB v1.12.75Comparison conditions not established |
44.206 |
Obtained using MTEB v1.12.75 Reported by a third party |
Evaluated revision not stated |
2026-04-02 |