| MTEB 8TagsClustering |
Configuration defaultTask ClusteringMetric v_measureComparison conditions not established |
33.6668 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB AFQMC |
Configuration defaultTask STSMetric cos_sim_spearmanComparison conditions not established |
43.5476 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB ATEC |
Configuration defaultTask STSMetric cos_sim_spearmanComparison conditions not established |
48.9119 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB AllegroReviews |
Configuration defaultTask ClassificationMetric accuracyComparison conditions not established |
41.6899 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB AlloProfClusteringP2P |
Configuration defaultTask ClusteringMetric v_measureComparison conditions not established |
54.2024 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB AlloProfClusteringS2S |
Configuration defaultTask ClusteringMetric v_measureComparison conditions not established |
44.3408 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB AlloprofReranking |
Configuration defaultTask RerankingMetric mapComparison conditions not established |
64.915 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB AlloprofRetrieval |
Configuration defaultTask RetrievalMetric ndcg_at_10Comparison conditions not established |
53.638 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonCounterfactualClassification (en) |
Configuration enTask ClassificationMetric accuracyComparison conditions not established |
75.9552 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonPolarityClassification |
Configuration defaultTask ClassificationMetric accuracyComparison conditions not established |
80.7176 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonReviewsClassification (de) |
Configuration deTask ClassificationMetric accuracyComparison conditions not established |
40.108 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonReviewsClassification (en) |
Configuration enTask ClassificationMetric accuracyComparison conditions not established |
43.642 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonReviewsClassification (es) |
Configuration esTask ClassificationMetric accuracyComparison conditions not established |
40.17 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonReviewsClassification (fr) |
Configuration frTask ClassificationMetric accuracyComparison conditions not established |
39.568 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonReviewsClassification (ja) |
Configuration jaTask ClassificationMetric accuracyComparison conditions not established |
35.75 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB AmazonReviewsClassification (zh) |
Configuration zhTask ClassificationMetric accuracyComparison conditions not established |
33.342 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB ArguAna |
Configuration defaultTask RetrievalMetric ndcg_at_10Comparison conditions not established |
58.231 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB ArguAna-PL |
Configuration defaultTask RetrievalMetric ndcg_at_10Comparison conditions not established |
53.166 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB ArxivClusteringP2P |
Configuration defaultTask ClusteringMetric v_measureComparison conditions not established |
46.019 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB ArxivClusteringS2S |
Configuration defaultTask ClusteringMetric v_measureComparison conditions not established |
41.0663 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB AskUbuntuDupQuestions |
Configuration defaultTask RerankingMetric mapComparison conditions not established |
61.8751 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB BIOSSES |
Configuration defaultTask STSMetric cos_sim_spearmanComparison conditions not established |
81.2145 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB BQ |
Configuration defaultTask STSMetric cos_sim_spearmanComparison conditions not established |
51.7159 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB BSARDRetrieval |
Configuration defaultTask RetrievalMetric ndcg_at_10Comparison conditions not established |
26.115 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB BUCC (de-en) |
Configuration de-enTask BitextMiningMetric f1Comparison conditions not established |
98.6169 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB BUCC (fr-en) |
Configuration fr-enTask BitextMiningMetric f1Comparison conditions not established |
97.896 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB BUCC (ru-en) |
Configuration ru-enTask BitextMiningMetric f1Comparison conditions not established |
97.1239 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB BUCC (zh-en) |
Configuration zh-enTask BitextMiningMetric f1Comparison conditions not established |
98.1569 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB Banking77Classification |
Configuration defaultTask ClassificationMetric accuracyComparison conditions not established |
85.3604 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB BiorxivClusteringP2P |
Configuration defaultTask ClusteringMetric v_measureComparison conditions not established |
37.5904 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB BiorxivClusteringS2S |
Configuration defaultTask ClusteringMetric v_measureComparison conditions not established |
34.2147 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB CBD |
Configuration defaultTask ClassificationMetric accuracyComparison conditions not established |
62.52 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB CDSC-E |
Configuration defaultTask PairClassificationMetric cos_sim_apComparison conditions not established |
74.9013 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB CDSC-R |
Configuration defaultTask STSMetric cos_sim_spearmanComparison conditions not established |
90.3073 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB CLSClusteringP2P |
Configuration defaultTask ClusteringMetric v_measureComparison conditions not established |
37.9485 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB CLSClusteringS2S |
Configuration defaultTask ClusteringMetric v_measureComparison conditions not established |
38.1196 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB CMedQAv1 |
Configuration defaultTask RerankingMetric mapComparison conditions not established |
86.1095 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB CMedQAv2 |
Configuration defaultTask RerankingMetric mapComparison conditions not established |
87.2804 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB CQADupstackAndroidRetrieval |
Configuration defaultTask RetrievalMetric ndcg_at_10Comparison conditions not established |
47.099 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |
| MTEB CQADupstackEnglishRetrieval |
Configuration defaultTask RetrievalMetric ndcg_at_10Comparison conditions not established |
45.973 |
Alibaba-NLP Publisher reported |
Evaluated revision not stated |
— |