multilingual-e5-small/README.md

language, license, model-index, tags

language	license	model-index	tags
multilingual af am ar as az be bg bn br bs ca cs cy da de el en eo es et eu fa fi fr fy ga gd gl gu ha he hi hr hu hy id is it ja jv ka kk km kn ko ku ky la lo lt lv mg mk ml mn mr ms my ne nl no om or pa pl ps pt ro ru sa sd si sk sl so sq sr su sv sw ta te th tl tr ug uk ur uz vi xh yi zh	mit	name results intfloat/multilingual-e5-small dataset metrics task config name revision split type en MTEB AmazonCounterfactualClassification (en) e8379541af4e31359cca9fbcf4b00f2671dba205 test mteb/amazon_counterfactual type value accuracy 73.79104477611939 type value ap 36.9996434842022 type value f1 67.95453679103099 type Classification dataset metrics task config name revision split type de MTEB AmazonCounterfactualClassification (de) e8379541af4e31359cca9fbcf4b00f2671dba205 test mteb/amazon_counterfactual type value accuracy 71.64882226980728 type value ap 82.11942130026586 type value f1 69.87963421606715 type Classification dataset metrics task config name revision split type en-ext MTEB AmazonCounterfactualClassification (en-ext) e8379541af4e31359cca9fbcf4b00f2671dba205 test mteb/amazon_counterfactual type value accuracy 75.8095952023988 type value ap 24.46869495579561 type value f1 63.00108480037597 type Classification dataset metrics task config name revision split type ja MTEB AmazonCounterfactualClassification (ja) e8379541af4e31359cca9fbcf4b00f2671dba205 test mteb/amazon_counterfactual type value accuracy 64.186295503212 type value ap 15.496804690197042 type value f1 52.07153895475031 type Classification dataset metrics task config name revision split type default MTEB AmazonPolarityClassification e2d317d38cd51312af73b3d32a06d1a08b442046 test mteb/amazon_polarity type value accuracy 88.699325 type value ap 85.27039559917269 type value f1 88.65556295032513 type Classification dataset metrics task config name revision split type en MTEB AmazonReviewsClassification (en) 1399c76144fd37290681b995c656ef9b2e06e26d test mteb/amazon_reviews_multi type value accuracy 44.69799999999999 type value f1 43.73187348654165 type Classification dataset metrics task config name revision split type de MTEB AmazonReviewsClassification (de) 1399c76144fd37290681b995c656ef9b2e06e26d test mteb/amazon_reviews_multi type value accuracy 40.245999999999995 type value f1 39.3863530637684 type Classification dataset metrics task config name revision split type es MTEB AmazonReviewsClassification (es) 1399c76144fd37290681b995c656ef9b2e06e26d test mteb/amazon_reviews_multi type value accuracy 40.394 type value f1 39.301223469483446 type Classification dataset metrics task config name revision split type fr MTEB AmazonReviewsClassification (fr) 1399c76144fd37290681b995c656ef9b2e06e26d test mteb/amazon_reviews_multi type value accuracy 38.864 type value f1 37.97974261868003 type Classification dataset metrics task config name revision split type ja MTEB AmazonReviewsClassification (ja) 1399c76144fd37290681b995c656ef9b2e06e26d test mteb/amazon_reviews_multi type value accuracy 37.682 type value f1 37.07399369768313 type Classification dataset metrics task config name revision split type zh MTEB AmazonReviewsClassification (zh) 1399c76144fd37290681b995c656ef9b2e06e26d test mteb/amazon_reviews_multi type value accuracy 37.504 type value f1 36.62317273874278 type Classification dataset metrics task config name revision split type default MTEB ArguAna None test arguana type value map_at_1 19.061 type value map_at_10 31.703 type value map_at_100 32.967 type value map_at_1000 33.001000000000005 type value map_at_3 27.466 type value map_at_5 29.564 type value mrr_at_1 19.559 type value mrr_at_10 31.874999999999996 type value mrr_at_100 33.146 type value mrr_at_1000 33.18 type value mrr_at_3 27.667 type value mrr_at_5 29.74 type value ndcg_at_1 19.061 type value ndcg_at_10 39.062999999999995 type value ndcg_at_100 45.184000000000005 type value ndcg_at_1000 46.115 type value ndcg_at_3 30.203000000000003 type value ndcg_at_5 33.953 type value precision_at_1 19.061 type value precision_at_10 6.279999999999999 type value precision_at_100 0.9129999999999999 type value precision_at_1000 0.099 type value precision_at_3 12.706999999999999 type value precision_at_5 9.431000000000001 type value recall_at_1 19.061 type value recall_at_10 62.802 type value recall_at_100 91.323 type value recall_at_1000 98.72 type value recall_at_3 38.122 type value recall_at_5 47.155 type Retrieval dataset metrics task config name revision split type default MTEB ArxivClusteringP2P a122ad7f3f0291bf49cc6f4d32aa80929df69d5d test mteb/arxiv-clustering-p2p type value v_measure 39.22266660528253 type Clustering dataset metrics task config name revision split type default MTEB ArxivClusteringS2S f910caf1a6075f7329cdf8c1a6135696f37dbd53 test mteb/arxiv-clustering-s2s type value v_measure 30.79980849482483 type Clustering dataset metrics task config name revision split type default MTEB AskUbuntuDupQuestions 2000358ca161889fa9c082cb41daa8dcfb161a54 test mteb/askubuntudupquestions-reranking type value map 57.8790068352054 type value mrr 71.78791276436706 type Reranking dataset metrics task config name revision split type default MTEB BIOSSES d3fb88f8f02e40887cd149695127462bbcf29b4a test mteb/biosses-sts type value cos_sim_pearson 82.36328364043163 type value cos_sim_spearman 82.26211536195868 type value euclidean_pearson 80.3183865039173 type value euclidean_spearman 79.88495276296132 type value manhattan_pearson 80.14484480692127 type value manhattan_spearman 80.39279565980743 type STS dataset metrics task config name revision split type de-en MTEB BUCC (de-en) d51519689f32196a32af33b075a01d0e7c51e252 test mteb/bucc-bitext-mining type value accuracy 98.0375782881002 type value f1 97.86012526096033 type value precision 97.77139874739039 type value recall 98.0375782881002 type BitextMining dataset metrics task config name revision split type fr-en MTEB BUCC (fr-en) d51519689f32196a32af33b075a01d0e7c51e252 test mteb/bucc-bitext-mining type value accuracy 93.35241030156286 type value f1 92.66050333846944 type value precision 92.3306919069631 type value recall 93.35241030156286 type BitextMining dataset metrics task config name revision split type ru-en MTEB BUCC (ru-en) d51519689f32196a32af33b075a01d0e7c51e252 test mteb/bucc-bitext-mining type value accuracy 94.0699688257707 type value f1 93.50236693222492 type value precision 93.22791825424315 type value recall 94.0699688257707 type BitextMining dataset metrics task config name revision split type zh-en MTEB BUCC (zh-en) d51519689f32196a32af33b075a01d0e7c51e252 test mteb/bucc-bitext-mining type value accuracy 89.25750394944708 type value f1 88.79234684921889 type value precision 88.57293312269616 type value recall 89.25750394944708 type BitextMining dataset metrics task config name revision split type default MTEB Banking77Classification 0fd18e25b25c072e09e0d92ab615fda904d66300 test mteb/banking77 type value accuracy 79.41558441558442 type value f1 79.25886487487219 type Classification dataset metrics task config name revision split type default MTEB BiorxivClusteringP2P 65b79d1d13f80053f67aca9498d9402c2d9f1f40 test mteb/biorxiv-clustering-p2p type value v_measure 35.747820820329736 type Clustering dataset metrics task config name revision split type default MTEB BiorxivClusteringS2S 258694dd0231531bc1fd9de6ceb52a0853c6d908 test mteb/biorxiv-clustering-s2s type value v_measure 27.045143830596146 type Clustering dataset metrics task config name revision split type default MTEB CQADupstackRetrieval None test BeIR/cqadupstack type value map_at_1 24.252999999999997 type value map_at_10 31.655916666666666 type value map_at_100 32.680749999999996 type value map_at_1000 32.79483333333334 type value map_at_3 29.43691666666666 type value map_at_5 30.717416666666665 type value mrr_at_1 28.602750000000004 type value mrr_at_10 35.56875 type value mrr_at_100 36.3595 type value mrr_at_1000 36.427749999999996 type value mrr_at_3 33.586166666666664 type value mrr_at_5 34.73641666666666 type value ndcg_at_1 28.602750000000004 type value ndcg_at_10 36.06933333333334 type value ndcg_at_100 40.70141666666667 type value ndcg_at_1000 43.24341666666667 type value ndcg_at_3 32.307916666666664 type value ndcg_at_5 34.129999999999995 type value precision_at_1 28.602750000000004 type value precision_at_10 6.097666666666667 type value precision_at_100 0.9809166666666668 type value precision_at_1000 0.13766666666666663 type value precision_at_3 14.628166666666667 type value precision_at_5 10.266916666666667 type value recall_at_1 24.252999999999997 type value recall_at_10 45.31916666666667 type value recall_at_100 66.03575000000001 type value recall_at_1000 83.94708333333334 type value recall_at_3 34.71941666666666 type value recall_at_5 39.46358333333333 type Retrieval dataset metrics task config name revision split type default MTEB ClimateFEVER None test climate-fever type value map_at_1 9.024000000000001 type value map_at_10 15.644 type value map_at_100 17.154 type value map_at_1000 17.345 type value map_at_3 13.028 type value map_at_5 14.251 type value mrr_at_1 19.674 type value mrr_at_10 29.826999999999998 type value mrr_at_100 30.935000000000002 type value mrr_at_1000 30.987 type value mrr_at_3 26.645000000000003 type value mrr_at_5 28.29 type value ndcg_at_1 19.674 type value ndcg_at_10 22.545 type value ndcg_at_100 29.207 type value ndcg_at_1000 32.912 type value ndcg_at_3 17.952 type value ndcg_at_5 19.363 type value precision_at_1 19.674 type value precision_at_10 7.212000000000001 type value precision_at_100 1.435 type value precision_at_1000 0.212 type value precision_at_3 13.507 type value precision_at_5 10.397 type value recall_at_1 9.024000000000001 type value recall_at_10 28.077999999999996 type value recall_at_100 51.403 type value recall_at_1000 72.406 type value recall_at_3 16.768 type value recall_at_5 20.737 type Retrieval dataset metrics task config name revision split type default MTEB DBPedia None test dbpedia-entity type value map_at_1 8.012 type value map_at_10 17.138 type value map_at_100 24.146 type value map_at_1000 25.622 type value map_at_3 12.552 type value map_at_5 14.435 type value mrr_at_1 62.25000000000001 type value mrr_at_10 71.186 type value mrr_at_100 71.504 type value mrr_at_1000 71.514 type value mrr_at_3 69.333 type value mrr_at_5 70.408 type value ndcg_at_1 49.75 type value ndcg_at_10 37.76 type value ndcg_at_100 42.071 type value ndcg_at_1000 49.309 type value ndcg_at_3 41.644 type value ndcg_at_5 39.812999999999995 type value precision_at_1 62.25000000000001 type value precision_at_10 30.15 type value precision_at_100 9.753 type value precision_at_1000 1.9189999999999998 type value precision_at_3 45.667 type value precision_at_5 39.15 type value recall_at_1 8.012 type value recall_at_10 22.599 type value recall_at_100 48.068 type value recall_at_1000 71.328 type value recall_at_3 14.043 type value recall_at_5 17.124 type Retrieval dataset metrics task config name revision split type default MTEB EmotionClassification 4f58c6b202a23cf9a4da393831edf4f9183cad37 test mteb/emotion type value accuracy 42.455 type value f1 37.59462649781862 type Classification dataset metrics task config name revision split type default MTEB FEVER None test fever type value map_at_1 58.092 type value map_at_10 69.586 type value map_at_100 69.968 type value map_at_1000 69.982 type value map_at_3 67.48100000000001 type value map_at_5 68.915 type value mrr_at_1 62.166 type value mrr_at_10 73.588 type value mrr_at_100 73.86399999999999 type value mrr_at_1000 73.868 type value mrr_at_3 71.6 type value mrr_at_5 72.99 type value ndcg_at_1 62.166 type value ndcg_at_10 75.27199999999999 type value ndcg_at_100 76.816 type value ndcg_at_1000 77.09700000000001 type value ndcg_at_3 71.36 type value ndcg_at_5 73.785 type value precision_at_1 62.166 type value precision_at_10 9.716 type value precision_at_100 1.065 type value precision_at_1000 0.11 type value precision_at_3 28.278 type value precision_at_5 18.343999999999998 type value recall_at_1 58.092 type value recall_at_10 88.73400000000001 type value recall_at_100 95.195 type value recall_at_1000 97.04599999999999 type value recall_at_3 78.45 type value recall_at_5 84.316 type Retrieval dataset metrics task config name revision split type default MTEB FiQA2018 None test fiqa type value map_at_1 16.649 type value map_at_10 26.457000000000004 type value map_at_100 28.169 type value map_at_1000 28.352 type value map_at_3 23.305 type value map_at_5 25.169000000000004 type value mrr_at_1 32.407000000000004 type value mrr_at_10 40.922 type value mrr_at_100 41.931000000000004 type value mrr_at_1000 41.983 type value mrr_at_3 38.786 type value mrr_at_5 40.205999999999996 type value ndcg_at_1 32.407000000000004 type value ndcg_at_10 33.314 type value ndcg_at_100 40.312 type value ndcg_at_1000 43.685 type value ndcg_at_3 30.391000000000002 type value ndcg_at_5 31.525 type value precision_at_1 32.407000000000004 type value precision_at_10 8.966000000000001 type value precision_at_100 1.6019999999999999 type value precision_at_1000 0.22200000000000003 type value precision_at_3 20.165 type value precision_at_5 14.722 type value recall_at_1 16.649 type value recall_at_10 39.117000000000004 type value recall_at_100 65.726 type value recall_at_1000 85.784 type value recall_at_3 27.914 type value recall_at_5 33.289 type Retrieval dataset metrics task config name revision split type default MTEB HotpotQA None test hotpotqa type value map_at_1 36.253 type value map_at_10 56.16799999999999 type value map_at_100 57.06099999999999 type value map_at_1000 57.126 type value map_at_3 52.644999999999996 type value map_at_5 54.909 type value mrr_at_1 72.505 type value mrr_at_10 79.66 type value mrr_at_100 79.869 type value mrr_at_1000 79.88 type value mrr_at_3 78.411 type value mrr_at_5 79.19800000000001 type value ndcg_at_1 72.505 type value ndcg_at_10 65.094 type value ndcg_at_100 68.219 type value ndcg_at_1000 69.515 type value ndcg_at_3 59.99 type value ndcg_at_5 62.909000000000006 type value precision_at_1 72.505 type value precision_at_10 13.749 type value precision_at_100 1.619 type value precision_at_1000 0.179 type value precision_at_3 38.357 type value precision_at_5 25.313000000000002 type value recall_at_1 36.253 type value recall_at_10 68.744 type value recall_at_100 80.925 type value recall_at_1000 89.534 type value recall_at_3 57.535000000000004 type value recall_at_5 63.282000000000004 type Retrieval dataset metrics task config name revision split type default MTEB ImdbClassification 3d86128a09e091d6018b6d26cad27f2739fc2db7 test mteb/imdb type value accuracy 80.82239999999999 type value ap 75.65895781725314 type value f1 80.75880969095746 type Classification dataset metrics task config name revision split type default MTEB MSMARCO None dev msmarco type value map_at_1 21.624 type value map_at_10 34.075 type value map_at_100 35.229 type value map_at_1000 35.276999999999994 type value map_at_3 30.245 type value map_at_5 32.42 type value mrr_at_1 22.264 type value mrr_at_10 34.638000000000005 type value mrr_at_100 35.744 type value mrr_at_1000 35.787 type value mrr_at_3 30.891000000000002 type value mrr_at_5 33.042 type value ndcg_at_1 22.264 type value ndcg_at_10 40.991 type value ndcg_at_100 46.563 type value ndcg_at_1000 47.743 type value ndcg_at_3 33.198 type value ndcg_at_5 37.069 type value precision_at_1 22.264 type value precision_at_10 6.5089999999999995 type value precision_at_100 0.9299999999999999 type value precision_at_1000 0.10300000000000001 type value precision_at_3 14.216999999999999 type value precision_at_5 10.487 type value recall_at_1 21.624 type value recall_at_10 62.303 type value recall_at_100 88.124 type value recall_at_1000 97.08 type value recall_at_3 41.099999999999994 type value recall_at_5 50.381 type Retrieval dataset metrics task config name revision split type en MTEB MTOPDomainClassification (en) d80d48c1eb48d3562165c59d59d0034df9fff0bf test mteb/mtop_domain type value accuracy 91.06703146374831 type value f1 90.86867815863172 type Classification dataset metrics task config name revision split type de MTEB MTOPDomainClassification (de) d80d48c1eb48d3562165c59d59d0034df9fff0bf test mteb/mtop_domain type value accuracy 87.46970977740209 type value f1 86.36832872036588 type Classification dataset metrics task config name revision split type es MTEB MTOPDomainClassification (es) d80d48c1eb48d3562165c59d59d0034df9fff0bf test mteb/mtop_domain type value accuracy 89.26951300867245 type value f1 88.93561193959502 type Classification dataset metrics task config name revision split type fr MTEB MTOPDomainClassification (fr) d80d48c1eb48d3562165c59d59d0034df9fff0bf test mteb/mtop_domain type value accuracy 84.22799874725963 type value f1 84.30490069236556 type Classification dataset metrics task config name revision split type hi MTEB MTOPDomainClassification (hi) d80d48c1eb48d3562165c59d59d0034df9fff0bf test mteb/mtop_domain type value accuracy 86.02007888131948 type value f1 85.39376041027991 type Classification dataset metrics task config name revision split type th MTEB MTOPDomainClassification (th) d80d48c1eb48d3562165c59d59d0034df9fff0bf test mteb/mtop_domain type value accuracy 85.34900542495481 type value f1 85.39859673336713 type Classification dataset metrics task config name revision split type en MTEB MTOPIntentClassification (en) ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba test mteb/mtop_intent type value accuracy 71.078431372549 type value f1 53.45071102002276 type Classification dataset metrics task config name revision split type de MTEB MTOPIntentClassification (de) ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba test mteb/mtop_intent type value accuracy 65.85798816568047 type value f1 46.53112748993529 type Classification dataset metrics task config name revision split type es MTEB MTOPIntentClassification (es) ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba test mteb/mtop_intent type value accuracy 67.96864576384256 type value f1 45.966703022829506 type Classification dataset metrics task config name revision split type fr MTEB MTOPIntentClassification (fr) ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba test mteb/mtop_intent type value accuracy 61.31537738803633 type value f1 45.52601712835461 type Classification dataset metrics task config name revision split type hi MTEB MTOPIntentClassification (hi) ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba test mteb/mtop_intent type value accuracy 66.29616349946218 type value f1 47.24166485726613 type Classification dataset metrics task config name revision split type th MTEB MTOPIntentClassification (th) ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba test mteb/mtop_intent type value accuracy 67.51537070524412 type value f1 49.463476319014276 type Classification dataset metrics task config name revision split type af MTEB MassiveIntentClassification (af) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 57.06792199058508 type value f1 54.094921857502285 type Classification dataset metrics task config name revision split type am MTEB MassiveIntentClassification (am) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 51.960322797579025 type value f1 48.547371223370945 type Classification dataset metrics task config name revision split type ar MTEB MassiveIntentClassification (ar) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 54.425016812373904 type value f1 50.47069202054312 type Classification dataset metrics task config name revision split type az MTEB MassiveIntentClassification (az) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 59.798251513113655 type value f1 57.05013069086648 type Classification dataset metrics task config name revision split type bn MTEB MassiveIntentClassification (bn) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 59.37794216543376 type value f1 56.3607992649805 type Classification dataset metrics task config name revision split type cy MTEB MassiveIntentClassification (cy) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 46.56018829858777 type value f1 43.87319715715134 type Classification dataset metrics task config name revision split type da MTEB MassiveIntentClassification (da) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 62.9724277067922 type value f1 59.36480066245562 type Classification dataset metrics task config name revision split type de MTEB MassiveIntentClassification (de) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 62.72696704774715 type value f1 59.143595966615855 type Classification dataset metrics task config name revision split type el MTEB MassiveIntentClassification (el) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 61.5971755211836 type value f1 59.169445724946726 type Classification dataset metrics task config name revision split type en MTEB MassiveIntentClassification (en) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 70.29589778076665 type value f1 67.7577001808977 type Classification dataset metrics task config name revision split type es MTEB MassiveIntentClassification (es) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 66.31136516476126 type value f1 64.52032955983242 type Classification dataset metrics task config name revision split type fa MTEB MassiveIntentClassification (fa) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 65.54472091459314 type value f1 61.47903120066317 type Classification dataset metrics task config name revision split type fi MTEB MassiveIntentClassification (fi) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 61.45595158036314 type value f1 58.0891846024637 type Classification dataset metrics task config name revision split type fr MTEB MassiveIntentClassification (fr) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 65.47074646940149 type value f1 62.84830858877575 type Classification dataset metrics task config name revision split type he MTEB MassiveIntentClassification (he) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 58.046402151983855 type value f1 55.269074430533195 type Classification dataset metrics task config name revision split type hi MTEB MassiveIntentClassification (hi) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 64.06523201075991 type value f1 61.35339643021369 type Classification dataset metrics task config name revision split type hu MTEB MassiveIntentClassification (hu) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 60.954942837928726 type value f1 57.07035922704846 type Classification dataset metrics task config name revision split type hy MTEB MassiveIntentClassification (hy) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 57.404169468728995 type value f1 53.94259011839138 type Classification dataset metrics task config name revision split type id MTEB MassiveIntentClassification (id) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 64.16610625420309 type value f1 61.337103431499365 type Classification dataset metrics task config name revision split type is MTEB MassiveIntentClassification (is) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 52.262945527908535 type value f1 49.7610691598921 type Classification dataset metrics task config name revision split type it MTEB MassiveIntentClassification (it) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 65.54472091459314 type value f1 63.469099018440154 type Classification dataset metrics task config name revision split type ja MTEB MassiveIntentClassification (ja) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 68.22797579018157 type value f1 64.89098471083001 type Classification dataset metrics task config name revision split type jv MTEB MassiveIntentClassification (jv) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 50.847343644922674 type value f1 47.8536963168393 type Classification dataset metrics task config name revision split type ka MTEB MassiveIntentClassification (ka) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 48.45326160053799 type value f1 46.370078045805556 type Classification dataset metrics task config name revision split type km MTEB MassiveIntentClassification (km) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 42.83120376597175 type value f1 39.68948521599982 type Classification dataset metrics task config name revision split type kn MTEB MassiveIntentClassification (kn) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 57.5084061869536 type value f1 53.961876160401545 type Classification dataset metrics task config name revision split type ko MTEB MassiveIntentClassification (ko) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 63.7895090786819 type value f1 61.134223684676 type Classification dataset metrics task config name revision split type lv MTEB MassiveIntentClassification (lv) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 54.98991257565569 type value f1 52.579862862826296 type Classification dataset metrics task config name revision split type ml MTEB MassiveIntentClassification (ml) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 61.90316072629456 type value f1 58.203024538290336 type Classification dataset metrics task config name revision split type mn MTEB MassiveIntentClassification (mn) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 57.09818426361802 type value f1 54.22718458445455 type Classification dataset metrics task config name revision split type ms MTEB MassiveIntentClassification (ms) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 58.991257565568255 type value f1 55.84892781767421 type Classification dataset metrics task config name revision split type my MTEB MassiveIntentClassification (my) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 55.901143241425686 type value f1 52.25264332199797 type Classification dataset metrics task config name revision split type nb MTEB MassiveIntentClassification (nb) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 61.96368527236047 type value f1 58.927243876153454 type Classification dataset metrics task config name revision split type nl MTEB MassiveIntentClassification (nl) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 65.64223268325489 type value f1 62.340453718379706 type Classification dataset metrics task config name revision split type pl MTEB MassiveIntentClassification (pl) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 64.52589105581708 type value f1 61.661113187022174 type Classification dataset metrics task config name revision split type pt MTEB MassiveIntentClassification (pt) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 66.84599865501009 type value f1 64.59342572873005 type Classification dataset metrics task config name revision split type ro MTEB MassiveIntentClassification (ro) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 60.81035642232684 type value f1 57.5169089806797 type Classification dataset metrics task config name revision split type ru MTEB MassiveIntentClassification (ru) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 58.652238071815056 type value f1 53.22732406426353 type value f1_weighted 57.585586737209546 type value main_score 58.652238071815056 type Classification dataset metrics task config name revision split type sl MTEB MassiveIntentClassification (sl) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 56.51647612642906 type value f1 54.33154780100043 type Classification dataset metrics task config name revision split type sq MTEB MassiveIntentClassification (sq) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 57.985877605917956 type value f1 54.46187524463802 type Classification dataset metrics task config name revision split type sv MTEB MassiveIntentClassification (sv) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 65.03026227303296 type value f1 62.34377392877748 type Classification dataset metrics task config name revision split type sw MTEB MassiveIntentClassification (sw) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 53.567585743106925 type value f1 50.73770655983206 type Classification dataset metrics task config name revision split type ta MTEB MassiveIntentClassification (ta) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 57.2595830531271 type value f1 53.657327291708626 type Classification dataset metrics task config name revision split type te MTEB MassiveIntentClassification (te) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 57.82784129119032 type value f1 54.82518072665301 type Classification dataset metrics task config name revision split type th MTEB MassiveIntentClassification (th) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 64.06859448554137 type value f1 63.00185280500495 type Classification dataset metrics task config name revision split type tl MTEB MassiveIntentClassification (tl) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 58.91055817081371 type value f1 55.54116301224262 type Classification dataset metrics task config name revision split type tr MTEB MassiveIntentClassification (tr) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 63.54404841963686 type value f1 59.57650946030184 type Classification dataset metrics task config name revision split type ur MTEB MassiveIntentClassification (ur) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 59.27706792199059 type value f1 56.50010066083435 type Classification dataset metrics task config name revision split type vi MTEB MassiveIntentClassification (vi) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 64.0719569603228 type value f1 61.817075925647956 type Classification dataset metrics task config name revision split type zh-CN MTEB MassiveIntentClassification (zh-CN) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 68.23806321452591 type value f1 65.24917026029749 type Classification dataset metrics task config name revision split type zh-TW MTEB MassiveIntentClassification (zh-TW) 31efe3c427b0bae9c22cbb560b8f15491cc6bed7 test mteb/amazon_massive_intent type value accuracy 62.53530598520511 type value f1 61.71131132295768 type Classification dataset metrics task config name revision split type af MTEB MassiveScenarioClassification (af) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 63.04303967720243 type value f1 60.3950085685985 type Classification dataset metrics task config name revision split type am MTEB MassiveScenarioClassification (am) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 56.83591123066578 type value f1 54.95059828830849 type Classification dataset metrics task config name revision split type ar MTEB MassiveScenarioClassification (ar) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 59.62340282447881 type value f1 59.525159996498225 type Classification dataset metrics task config name revision split type az MTEB MassiveScenarioClassification (az) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 60.85406859448555 type value f1 59.129299095681276 type Classification dataset metrics task config name revision split type bn MTEB MassiveScenarioClassification (bn) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 62.76731674512441 type value f1 61.159560612627715 type Classification dataset metrics task config name revision split type cy MTEB MassiveScenarioClassification (cy) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 50.181573638197705 type value f1 46.98422176289957 type Classification dataset metrics task config name revision split type da MTEB MassiveScenarioClassification (da) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 68.92737054472092 type value f1 67.69135611952979 type Classification dataset metrics task config name revision split type de MTEB MassiveScenarioClassification (de) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 69.18964357767318 type value f1 68.46106138186214 type Classification dataset metrics task config name revision split type el MTEB MassiveScenarioClassification (el) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 67.0712844653665 type value f1 66.75545422473901 type Classification dataset metrics task config name revision split type en MTEB MassiveScenarioClassification (en) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 74.4754539340955 type value f1 74.38427146553252 type Classification dataset metrics task config name revision split type es MTEB MassiveScenarioClassification (es) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 69.82515131136518 type value f1 69.63516462173847 type Classification dataset metrics task config name revision split type fa MTEB MassiveScenarioClassification (fa) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 68.70880968392737 type value f1 67.45420662567926 type Classification dataset metrics task config name revision split type fi MTEB MassiveScenarioClassification (fi) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 65.95494283792871 type value f1 65.06191009049222 type Classification dataset metrics task config name revision split type fr MTEB MassiveScenarioClassification (fr) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 68.75924680564896 type value f1 68.30833379585945 type Classification dataset metrics task config name revision split type he MTEB MassiveScenarioClassification (he) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 63.806321452589096 type value f1 63.273048243765054 type Classification dataset metrics task config name revision split type hi MTEB MassiveScenarioClassification (hi) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 67.68997982515133 type value f1 66.54703855381324 type Classification dataset metrics task config name revision split type hu MTEB MassiveScenarioClassification (hu) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 66.46940147948891 type value f1 65.91017343463396 type Classification dataset metrics task config name revision split type hy MTEB MassiveScenarioClassification (hy) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 59.49899125756556 type value f1 57.90333469917769 type Classification dataset metrics task config name revision split type id MTEB MassiveScenarioClassification (id) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 67.9219905850706 type value f1 67.23169403762938 type Classification dataset metrics task config name revision split type is MTEB MassiveScenarioClassification (is) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 56.486213853396094 type value f1 54.85282355583758 type Classification dataset metrics task config name revision split type it MTEB MassiveScenarioClassification (it) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 69.04169468728985 type value f1 68.83833333320462 type Classification dataset metrics task config name revision split type ja MTEB MassiveScenarioClassification (ja) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 73.88702084734365 type value f1 74.04474735232299 type Classification dataset metrics task config name revision split type jv MTEB MassiveScenarioClassification (jv) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 56.63416274377943 type value f1 55.11332211687954 type Classification dataset metrics task config name revision split type ka MTEB MassiveScenarioClassification (ka) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 52.23604572965702 type value f1 50.86529813991055 type Classification dataset metrics task config name revision split type km MTEB MassiveScenarioClassification (km) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 46.62407531943511 type value f1 43.63485467164535 type Classification dataset metrics task config name revision split type kn MTEB MassiveScenarioClassification (kn) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 59.15601882985878 type value f1 57.522837510959924 type Classification dataset metrics task config name revision split type ko MTEB MassiveScenarioClassification (ko) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 69.84532616005382 type value f1 69.60021127179697 type Classification dataset metrics task config name revision split type lv MTEB MassiveScenarioClassification (lv) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 56.65770006724949 type value f1 55.84219135523227 type Classification dataset metrics task config name revision split type ml MTEB MassiveScenarioClassification (ml) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 66.53665097511768 type value f1 65.09087787792639 type Classification dataset metrics task config name revision split type mn MTEB MassiveScenarioClassification (mn) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 59.31405514458642 type value f1 58.06135303831491 type Classification dataset metrics task config name revision split type ms MTEB MassiveScenarioClassification (ms) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 64.88231338264964 type value f1 62.751099407787926 type Classification dataset metrics task config name revision split type my MTEB MassiveScenarioClassification (my) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 58.86012104909213 type value f1 56.29118323058282 type Classification dataset metrics task config name revision split type nb MTEB MassiveScenarioClassification (nb) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 67.37390719569602 type value f1 66.27922244885102 type Classification dataset metrics task config name revision split type nl MTEB MassiveScenarioClassification (nl) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 70.8675184936113 type value f1 70.22146529932019 type Classification dataset metrics task config name revision split type pl MTEB MassiveScenarioClassification (pl) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 68.2212508406187 type value f1 67.77454802056282 type Classification dataset metrics task config name revision split type pt MTEB MassiveScenarioClassification (pt) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 68.18090114324143 type value f1 68.03737625431621 type Classification dataset metrics task config name revision split type ro MTEB MassiveScenarioClassification (ro) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 64.65030262273034 type value f1 63.792945486912856 type Classification dataset metrics task config name revision split type ru MTEB MassiveScenarioClassification (ru) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 63.772749631087066 type value f1 63.4539101720024 type value f1_weighted 62.778603897469566 type value main_score 63.772749631087066 type Classification dataset metrics task config name revision split type sl MTEB MassiveScenarioClassification (sl) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 60.17821116341627 type value f1 59.3935969827171 type Classification dataset metrics task config name revision split type sq MTEB MassiveScenarioClassification (sq) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 62.86146603900471 type value f1 60.133692735032376 type Classification dataset metrics task config name revision split type sv MTEB MassiveScenarioClassification (sv) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 70.89441829186282 type value f1 70.03064076194089 type Classification dataset metrics task config name revision split type sw MTEB MassiveScenarioClassification (sw) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 58.15063887020847 type value f1 56.23326278499678 type Classification dataset metrics task config name revision split type ta MTEB MassiveScenarioClassification (ta) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 59.43846671149966 type value f1 57.70440450281974 type Classification dataset metrics task config name revision split type te MTEB MassiveScenarioClassification (te) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 60.8507061197041 type value f1 59.22916396061171 type Classification dataset metrics task config name revision split type th MTEB MassiveScenarioClassification (th) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 70.65568258238063 type value f1 69.90736239440633 type Classification dataset metrics task config name revision split type tl MTEB MassiveScenarioClassification (tl) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 60.8843308675185 type value f1 59.30332663713599 type Classification dataset metrics task config name revision split type tr MTEB MassiveScenarioClassification (tr) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 68.05312710154674 type value f1 67.44024062594775 type Classification dataset metrics task config name revision split type ur MTEB MassiveScenarioClassification (ur) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 62.111634162743776 type value f1 60.89083013084519 type Classification dataset metrics task config name revision split type vi MTEB MassiveScenarioClassification (vi) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 67.44115669132482 type value f1 67.92227541674552 type Classification dataset metrics task config name revision split type zh-CN MTEB MassiveScenarioClassification (zh-CN) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 74.4687289845326 type value f1 74.16376793486025 type Classification dataset metrics task config name revision split type zh-TW MTEB MassiveScenarioClassification (zh-TW) 7d571f92784cd94a019292a1f45445077d0ef634 test mteb/amazon_massive_scenario type value accuracy 68.31876260928043 type value f1 68.5246745215607 type Classification dataset metrics task config name revision split type default MTEB MedrxivClusteringP2P e7a26af6f3ae46b30dde8737f02c07b1505bcc73 test mteb/medrxiv-clustering-p2p type value v_measure 30.90431696479766 type Clustering dataset metrics task config name revision split type default MTEB MedrxivClusteringS2S 35191c8c0dca72d8ff3efcd72aa802307d469663 test mteb/medrxiv-clustering-s2s type value v_measure 27.259158476693774 type Clustering dataset metrics task config name revision split type default MTEB MindSmallReranking 3bdac13927fdc888b903db93b2ffdbd90b295a69 test mteb/mind_small type value map 30.28445330838555 type value mrr 31.15758529581164 type Reranking dataset metrics task config name revision split type default MTEB NFCorpus None test nfcorpus type value map_at_1 5.353 type value map_at_10 11.565 type value map_at_100 14.097000000000001 type value map_at_1000 15.354999999999999 type value map_at_3 8.749 type value map_at_5 9.974 type value mrr_at_1 42.105 type value mrr_at_10 50.589 type value mrr_at_100 51.187000000000005 type value mrr_at_1000 51.233 type value mrr_at_3 48.246 type value mrr_at_5 49.546 type value ndcg_at_1 40.402 type value ndcg_at_10 31.009999999999998 type value ndcg_at_100 28.026 type value ndcg_at_1000 36.905 type value ndcg_at_3 35.983 type value ndcg_at_5 33.764 type value precision_at_1 42.105 type value precision_at_10 22.786 type value precision_at_100 6.916 type value precision_at_1000 1.981 type value precision_at_3 33.333 type value precision_at_5 28.731 type value recall_at_1 5.353 type value recall_at_10 15.039 type value recall_at_100 27.348 type value recall_at_1000 59.453 type value recall_at_3 9.792 type value recall_at_5 11.882 type Retrieval dataset metrics task config name revision split type default MTEB NQ None test nq type value map_at_1 33.852 type value map_at_10 48.924 type value map_at_100 49.854 type value map_at_1000 49.886 type value map_at_3 44.9 type value map_at_5 47.387 type value mrr_at_1 38.035999999999994 type value mrr_at_10 51.644 type value mrr_at_100 52.339 type value mrr_at_1000 52.35999999999999 type value mrr_at_3 48.421 type value mrr_at_5 50.468999999999994 type value ndcg_at_1 38.007000000000005 type value ndcg_at_10 56.293000000000006 type value ndcg_at_100 60.167 type value ndcg_at_1000 60.916000000000004 type value ndcg_at_3 48.903999999999996 type value ndcg_at_5 52.978 type value precision_at_1 38.007000000000005 type value precision_at_10 9.041 type value precision_at_100 1.1199999999999999 type value precision_at_1000 0.11900000000000001 type value precision_at_3 22.084 type value precision_at_5 15.608 type value recall_at_1 33.852 type value recall_at_10 75.893 type value recall_at_100 92.589 type value recall_at_1000 98.153 type value recall_at_3 56.969 type value recall_at_5 66.283 type Retrieval dataset metrics task config name revision split type default MTEB QuoraRetrieval None test quora type value map_at_1 69.174 type value map_at_10 82.891 type value map_at_100 83.545 type value map_at_1000 83.56700000000001 type value map_at_3 79.944 type value map_at_5 81.812 type value mrr_at_1 79.67999999999999 type value mrr_at_10 86.279 type value mrr_at_100 86.39 type value mrr_at_1000 86.392 type value mrr_at_3 85.21 type value mrr_at_5 85.92999999999999 type value ndcg_at_1 79.69000000000001 type value ndcg_at_10 86.929 type value ndcg_at_100 88.266 type value ndcg_at_1000 88.428 type value ndcg_at_3 83.899 type value ndcg_at_5 85.56700000000001 type value precision_at_1 79.69000000000001 type value precision_at_10 13.161000000000001 type value precision_at_100 1.513 type value precision_at_1000 0.156 type value precision_at_3 36.603 type value precision_at_5 24.138 type value recall_at_1 69.174 type value recall_at_10 94.529 type value recall_at_100 99.15 type value recall_at_1000 99.925 type value recall_at_3 85.86200000000001 type value recall_at_5 90.501 type Retrieval dataset metrics task config name revision split type default MTEB RedditClustering 24640382cdbf8abc73003fb0fa6d111a705499eb test mteb/reddit-clustering type value v_measure 39.13064340585255 type Clustering dataset metrics task config name revision split type default MTEB RedditClusteringP2P 282350215ef01743dc01b456c7f5241fa8937f16 test mteb/reddit-clustering-p2p type value v_measure 58.97884249325877 type Clustering dataset metrics task config name revision split type default MTEB SCIDOCS None test scidocs type value map_at_1 3.4680000000000004 type value map_at_10 7.865 type value map_at_100 9.332 type value map_at_1000 9.587 type value map_at_3 5.800000000000001 type value map_at_5 6.8790000000000004 type value mrr_at_1 17.0 type value mrr_at_10 25.629 type value mrr_at_100 26.806 type value mrr_at_1000 26.889000000000003 type value mrr_at_3 22.8 type value mrr_at_5 24.26 type value ndcg_at_1 17.0 type value ndcg_at_10 13.895 type value ndcg_at_100 20.491999999999997 type value ndcg_at_1000 25.759999999999998 type value ndcg_at_3 13.347999999999999 type value ndcg_at_5 11.61 type value precision_at_1 17.0 type value precision_at_10 7.090000000000001 type value precision_at_100 1.669 type value precision_at_1000 0.294 type value precision_at_3 12.3 type value precision_at_5 10.02 type value recall_at_1 3.4680000000000004 type value recall_at_10 14.363000000000001 type value recall_at_100 33.875 type value recall_at_1000 59.711999999999996 type value recall_at_3 7.483 type value recall_at_5 10.173 type Retrieval dataset metrics task config name revision split type default MTEB SICK-R a6ea5a8cab320b040a23452cc28066d9beae2cee test mteb/sickr-sts type value cos_sim_pearson 83.04084311714061 type value cos_sim_spearman 77.51342467443078 type value euclidean_pearson 80.0321166028479 type value euclidean_spearman 77.29249114733226 type value manhattan_pearson 80.03105964262431 type value manhattan_spearman 77.22373689514794 type STS dataset metrics task config name revision split type default MTEB STS12 a0d554a64d88156834ff5ae9920b964011b16384 test mteb/sts12-sts type value cos_sim_pearson 84.1680158034387 type value cos_sim_spearman 76.55983344071117 type value euclidean_pearson 79.75266678300143 type value euclidean_spearman 75.34516823467025 type value manhattan_pearson 79.75959151517357 type value manhattan_spearman 75.42330344141912 type STS dataset metrics task config name revision split type default MTEB STS13 7e90230a92c190f1bf69ae9002b8cea547a64cca test mteb/sts13-sts type value cos_sim_pearson 76.48898993209346 type value cos_sim_spearman 76.96954120323366 type value euclidean_pearson 76.94139109279668 type value euclidean_spearman 76.85860283201711 type value manhattan_pearson 76.6944095091912 type value manhattan_spearman 76.61096912972553 type STS dataset metrics task config name revision split type default MTEB STS14 6031580fec1f6af667f0bd2da0a551cf4f0b2375 test mteb/sts14-sts type value cos_sim_pearson 77.85082366246944 type value cos_sim_spearman 75.52053350101731 type value euclidean_pearson 77.1165845070926 type value euclidean_spearman 75.31216065884388 type value manhattan_pearson 77.06193941833494 type value manhattan_spearman 75.31003701700112 type STS dataset metrics task config name revision split type default MTEB STS15 ae752c7c21bf194d8b67fd573edf7ae58183cbe3 test mteb/sts15-sts type value cos_sim_pearson 86.36305246526497 type value cos_sim_spearman 87.11704613927415 type value euclidean_pearson 86.04199125810939 type value euclidean_spearman 86.51117572414263 type value manhattan_pearson 86.0805106816633 type value manhattan_spearman 86.52798366512229 type STS dataset metrics task config name revision split type default MTEB STS16 4d8694f8f0e0100860b497b999b3dbed754a0513 test mteb/sts16-sts type value cos_sim_pearson 82.18536255599724 type value cos_sim_spearman 83.63377151025418 type value euclidean_pearson 83.24657467993141 type value euclidean_spearman 84.02751481993825 type value manhattan_pearson 83.11941806582371 type value manhattan_spearman 83.84251281019304 type STS dataset metrics task config name revision split type ko-ko MTEB STS17 (ko-ko) af5e6fb845001ecf41f4c1e033ce921939a2a68d test mteb/sts17-crosslingual-sts type value cos_sim_pearson 78.95816528475514 type value cos_sim_spearman 78.86607380120462 type value euclidean_pearson 78.51268699230545 type value euclidean_spearman 79.11649316502229 type value manhattan_pearson 78.32367302808157 type value manhattan_spearman 78.90277699624637 type STS dataset metrics task config name revision split type ar-ar MTEB STS17 (ar-ar) af5e6fb845001ecf41f4c1e033ce921939a2a68d test mteb/sts17-crosslingual-sts type value cos_sim_pearson 72.89126914997624 type value cos_sim_spearman 73.0296921832678 type value euclidean_pearson 71.50385903677738 type value euclidean_spearman 73.13368899716289 type value manhattan_pearson 71.47421463379519 type value manhattan_spearman 73.03383242946575 type STS dataset metrics task config name revision split type en-ar MTEB STS17 (en-ar) af5e6fb845001ecf41f4c1e033ce921939a2a68d test mteb/sts17-crosslingual-sts type value cos_sim_pearson 59.22923684492637 type value cos_sim_spearman 57.41013211368396 type value euclidean_pearson 61.21107388080905 type value euclidean_spearman 60.07620768697254 type value manhattan_pearson 59.60157142786555 type value manhattan_spearman 59.14069604103739 type STS dataset metrics task config name revision split type en-de MTEB STS17 (en-de) af5e6fb845001ecf41f4c1e033ce921939a2a68d test mteb/sts17-crosslingual-sts type value cos_sim_pearson 76.24345978774299 type value cos_sim_spearman 77.24225743830719 type value euclidean_pearson 76.66226095469165 type value euclidean_spearman 77.60708820493146 type value manhattan_pearson 76.05303324760429 type value manhattan_spearman 76.96353149912348 type STS dataset metrics task config name revision split type en-en MTEB STS17 (en-en) af5e6fb845001ecf41f4c1e033ce921939a2a68d test mteb/sts17-crosslingual-sts type value cos_sim_pearson 85.50879160160852 type value cos_sim_spearman 86.43594662965224 type value euclidean_pearson 86.06846012826577 type value euclidean_spearman 86.02041395794136 type value manhattan_pearson 86.10916255616904 type value manhattan_spearman 86.07346068198953 type STS dataset metrics task config name revision split type en-tr MTEB STS17 (en-tr) af5e6fb845001ecf41f4c1e033ce921939a2a68d test mteb/sts17-crosslingual-sts type value cos_sim_pearson 58.39803698977196 type value cos_sim_spearman 55.96910950423142 type value euclidean_pearson 58.17941175613059 type value euclidean_spearman 55.03019330522745 type value manhattan_pearson 57.333358138183286 type value manhattan_spearman 54.04614023149965 type STS dataset metrics task config name revision split type es-en MTEB STS17 (es-en) af5e6fb845001ecf41f4c1e033ce921939a2a68d test mteb/sts17-crosslingual-sts type value cos_sim_pearson 70.98304089637197 type value cos_sim_spearman 72.44071656215888 type value euclidean_pearson 72.19224359033983 type value euclidean_spearman 73.89871188913025 type value manhattan_pearson 71.21098311547406 type value manhattan_spearman 72.93405764824821 type STS dataset metrics task config name revision split type es-es MTEB STS17 (es-es) af5e6fb845001ecf41f4c1e033ce921939a2a68d test mteb/sts17-crosslingual-sts type value cos_sim_pearson 85.99792397466308 type value cos_sim_spearman 84.83824377879495 type value euclidean_pearson 85.70043288694438 type value euclidean_spearman 84.70627558703686 type value manhattan_pearson 85.89570850150801 type value manhattan_spearman 84.95806105313007 type STS dataset metrics task config name revision split type fr-en MTEB STS17 (fr-en) af5e6fb845001ecf41f4c1e033ce921939a2a68d test mteb/sts17-crosslingual-sts type value cos_sim_pearson 72.21850322994712 type value cos_sim_spearman 72.28669398117248 type value euclidean_pearson 73.40082510412948 type value euclidean_spearman 73.0326539281865 type value manhattan_pearson 71.8659633964841 type value manhattan_spearman 71.57817425823303 type STS dataset metrics task config name revision split type it-en MTEB STS17 (it-en) af5e6fb845001ecf41f4c1e033ce921939a2a68d test mteb/sts17-crosslingual-sts type value cos_sim_pearson 75.80921368595645 type value cos_sim_spearman 77.33209091229315 type value euclidean_pearson 76.53159540154829 type value euclidean_spearman 78.17960842810093 type value manhattan_pearson 76.13530186637601 type value manhattan_spearman 78.00701437666875 type STS dataset metrics task config name revision split type nl-en MTEB STS17 (nl-en) af5e6fb845001ecf41f4c1e033ce921939a2a68d test mteb/sts17-crosslingual-sts type value cos_sim_pearson 74.74980608267349 type value cos_sim_spearman 75.37597374318821 type value euclidean_pearson 74.90506081911661 type value euclidean_spearman 75.30151613124521 type value manhattan_pearson 74.62642745918002 type value manhattan_spearman 75.18619716592303 type STS dataset metrics task config name revision split type en MTEB STS22 (en) 6d1ba47164174a496b7fa5d3569dae26a6813b80 test mteb/sts22-crosslingual-sts type value cos_sim_pearson 59.632662289205584 type value cos_sim_spearman 60.938543391610914 type value euclidean_pearson 62.113200529767056 type value euclidean_spearman 61.410312633261164 type value manhattan_pearson 61.75494698945686 type value manhattan_spearman 60.92726195322362 type STS dataset metrics task config name revision split type de MTEB STS22 (de) 6d1ba47164174a496b7fa5d3569dae26a6813b80 test mteb/sts22-crosslingual-sts type value cos_sim_pearson 45.283470551557244 type value cos_sim_spearman 53.44833015864201 type value euclidean_pearson 41.17892011120893 type value euclidean_spearman 53.81441383126767 type value manhattan_pearson 41.17482200420659 type value manhattan_spearman 53.82180269276363 type STS dataset metrics task config name revision split type es MTEB STS22 (es) 6d1ba47164174a496b7fa5d3569dae26a6813b80 test mteb/sts22-crosslingual-sts type value cos_sim_pearson 60.5069165306236 type value cos_sim_spearman 66.87803259033826 type value euclidean_pearson 63.5428979418236 type value euclidean_spearman 66.9293576586897 type value manhattan_pearson 63.59789526178922 type value manhattan_spearman 66.86555009875066 type STS dataset metrics task config name revision split type pl MTEB STS22 (pl) 6d1ba47164174a496b7fa5d3569dae26a6813b80 test mteb/sts22-crosslingual-sts type value cos_sim_pearson 28.23026196280264 type value cos_sim_spearman 35.79397812652861 type value euclidean_pearson 17.828102102767353 type value euclidean_spearman 35.721501145568894 type value manhattan_pearson 17.77134274219677 type value manhattan_spearman 35.98107902846267 type STS dataset metrics task config name revision split type tr MTEB STS22 (tr) 6d1ba47164174a496b7fa5d3569dae26a6813b80 test mteb/sts22-crosslingual-sts type value cos_sim_pearson 56.51946541393812 type value cos_sim_spearman 63.714686006214485 type value euclidean_pearson 58.32104651305898 type value euclidean_spearman 62.237110895702216 type value manhattan_pearson 58.579416468759185 type value manhattan_spearman 62.459738981727 type STS dataset metrics task config name revision split type ar MTEB STS22 (ar) 6d1ba47164174a496b7fa5d3569dae26a6813b80 test mteb/sts22-crosslingual-sts type value cos_sim_pearson 48.76009839569795 type value cos_sim_spearman 56.65188431953149 type value euclidean_pearson 50.997682160915595 type value euclidean_spearman 55.99910008818135 type value manhattan_pearson 50.76220659606342 type value manhattan_spearman 55.517347595391456 type STS dataset metrics task config name revision split type ru MTEB STS22 (ru) 6d1ba47164174a496b7fa5d3569dae26a6813b80 test mteb/sts22-crosslingual-sts type value cosine_pearson 50.724322379215934 type value cosine_spearman 59.90449732164651 type value euclidean_pearson 50.227545226784024 type value euclidean_spearman 59.898906527601085 type value main_score 59.90449732164651 type value manhattan_pearson 50.21762139819405 type value manhattan_spearman 59.761039813759 type value pearson 50.724322379215934 type value spearman 59.90449732164651 type STS dataset metrics task config name revision split type zh MTEB STS22 (zh) 6d1ba47164174a496b7fa5d3569dae26a6813b80 test mteb/sts22-crosslingual-sts type value cos_sim_pearson 54.717524559088005 type value cos_sim_spearman 66.83570886252286 type value euclidean_pearson 58.41338625505467 type value euclidean_spearman 66.68991427704938 type value manhattan_pearson 58.78638572916807 type value manhattan_spearman 66.58684161046335 type STS dataset metrics task config name revision split type fr MTEB STS22 (fr) 6d1ba47164174a496b7fa5d3569dae26a6813b80 test mteb/sts22-crosslingual-sts type value cos_sim_pearson 73.2962042954962 type value cos_sim_spearman 76.58255504852025 type value euclidean_pearson 75.70983192778257 type value euclidean_spearman 77.4547684870542 type value manhattan_pearson 75.75565853870485 type value manhattan_spearman 76.90208974949428 type STS dataset metrics task config name revision split type de-en MTEB STS22 (de-en) 6d1ba47164174a496b7fa5d3569dae26a6813b80 test mteb/sts22-crosslingual-sts type value cos_sim_pearson 54.47396266924846 type value cos_sim_spearman 56.492267162048606 type value euclidean_pearson 55.998505203070195 type value euclidean_spearman 56.46447012960222 type value manhattan_pearson 54.873172394430995 type value manhattan_spearman 56.58111534551218 type STS dataset metrics task config name revision split type es-en MTEB STS22 (es-en) 6d1ba47164174a496b7fa5d3569dae26a6813b80 test mteb/sts22-crosslingual-sts type value cos_sim_pearson 69.87177267688686 type value cos_sim_spearman 74.57160943395763 type value euclidean_pearson 70.88330406826788 type value euclidean_spearman 74.29767636038422 type value manhattan_pearson 71.38245248369536 type value manhattan_spearman 74.53102232732175 type STS dataset metrics task config name revision split type it MTEB STS22 (it) 6d1ba47164174a496b7fa5d3569dae26a6813b80 test mteb/sts22-crosslingual-sts type value cos_sim_pearson 72.80225656959544 type value cos_sim_spearman 76.52646173725735 type value euclidean_pearson 73.95710720200799 type value euclidean_spearman 76.54040031984111 type value manhattan_pearson 73.89679971946774 type value manhattan_spearman 76.60886958161574 type STS dataset metrics task config name revision split type pl-en MTEB STS22 (pl-en) 6d1ba47164174a496b7fa5d3569dae26a6813b80 test mteb/sts22-crosslingual-sts type value cos_sim_pearson 70.70844249898789 type value cos_sim_spearman 72.68571783670241 type value euclidean_pearson 72.38800772441031 type value euclidean_spearman 72.86804422703312 type value manhattan_pearson 71.29840508203515 type value manhattan_spearman 71.86264441749513 type STS dataset metrics task config name revision split type zh-en MTEB STS22 (zh-en) 6d1ba47164174a496b7fa5d3569dae26a6813b80 test mteb/sts22-crosslingual-sts type value cos_sim_pearson 58.647478923935694 type value cos_sim_spearman 63.74453623540931 type value euclidean_pearson 59.60138032437505 type value euclidean_spearman 63.947930832166065 type value manhattan_pearson 58.59735509491861 type value manhattan_spearman 62.082503844627404 type STS dataset metrics task config name revision split type es-it MTEB STS22 (es-it) 6d1ba47164174a496b7fa5d3569dae26a6813b80 test mteb/sts22-crosslingual-sts type value cos_sim_pearson 65.8722516867162 type value cos_sim_spearman 71.81208592523012 type value euclidean_pearson 67.95315252165956 type value euclidean_spearman 73.00749822046009 type value manhattan_pearson 68.07884688638924 type value manhattan_spearman 72.34210325803069 type STS dataset metrics task config name revision split type de-fr MTEB STS22 (de-fr) 6d1ba47164174a496b7fa5d3569dae26a6813b80 test mteb/sts22-crosslingual-sts type value cos_sim_pearson 54.5405814240949 type value cos_sim_spearman 60.56838649023775 type value euclidean_pearson 53.011731611314104 type value euclidean_spearman 58.533194841668426 type value manhattan_pearson 53.623067729338494 type value manhattan_spearman 58.018756154446926 type STS dataset metrics task config name revision split type de-pl MTEB STS22 (de-pl) 6d1ba47164174a496b7fa5d3569dae26a6813b80 test mteb/sts22-crosslingual-sts type value cos_sim_pearson 13.611046866216112 type value cos_sim_spearman 28.238192909158492 type value euclidean_pearson 22.16189199885129 type value euclidean_spearman 35.012895679076564 type value manhattan_pearson 21.969771178698387 type value manhattan_spearman 32.456985088607475 type STS dataset metrics task config name revision split type fr-pl MTEB STS22 (fr-pl) 6d1ba47164174a496b7fa5d3569dae26a6813b80 test mteb/sts22-crosslingual-sts type value cos_sim_pearson 74.58077407011655 type value cos_sim_spearman 84.51542547285167 type value euclidean_pearson 74.64613843596234 type value euclidean_spearman 84.51542547285167 type value manhattan_pearson 75.15335973101396 type value manhattan_spearman 84.51542547285167 type STS dataset metrics task config name revision split type default MTEB STSBenchmark b0fddb56ed78048fa8b90373c8a3cfc37b684831 test mteb/stsbenchmark-sts type value cos_sim_pearson 82.0739825531578 type value cos_sim_spearman 84.01057479311115 type value euclidean_pearson 83.85453227433344 type value euclidean_spearman 84.01630226898655 type value manhattan_pearson 83.75323603028978 type value manhattan_spearman 83.89677983727685 type STS dataset metrics task config name revision split type default MTEB SciDocsRR d3c5e1fc0b855ab6097bf1cda04dd73947d7caab test mteb/scidocs-reranking type value map 78.12945623123957 type value mrr 93.87738713719106 type Reranking dataset metrics task config name revision split type default MTEB SciFact None test scifact type value map_at_1 52.983000000000004 type value map_at_10 62.946000000000005 type value map_at_100 63.514 type value map_at_1000 63.554 type value map_at_3 60.183 type value map_at_5 61.672000000000004 type value mrr_at_1 55.667 type value mrr_at_10 64.522 type value mrr_at_100 64.957 type value mrr_at_1000 64.995 type value mrr_at_3 62.388999999999996 type value mrr_at_5 63.639 type value ndcg_at_1 55.667 type value ndcg_at_10 67.704 type value ndcg_at_100 70.299 type value ndcg_at_1000 71.241 type value ndcg_at_3 62.866 type value ndcg_at_5 65.16999999999999 type value precision_at_1 55.667 type value precision_at_10 9.033 type value precision_at_100 1.053 type value precision_at_1000 0.11299999999999999 type value precision_at_3 24.444 type value precision_at_5 16.133 type value recall_at_1 52.983000000000004 type value recall_at_10 80.656 type value recall_at_100 92.5 type value recall_at_1000 99.667 type value recall_at_3 67.744 type value recall_at_5 73.433 type Retrieval dataset metrics task config name revision split type default MTEB SprintDuplicateQuestions d66bd1f72af766a5cc4b0ca5e00c162f89e8cc46 test mteb/sprintduplicatequestions-pairclassification type value cos_sim_accuracy 99.72772277227723 type value cos_sim_ap 92.17845897992215 type value cos_sim_f1 85.9746835443038 type value cos_sim_precision 87.07692307692308 type value cos_sim_recall 84.89999999999999 type value dot_accuracy 99.3039603960396 type value dot_ap 60.70244020124878 type value dot_f1 59.92742353551063 type value dot_precision 62.21743810548978 type value dot_recall 57.8 type value euclidean_accuracy 99.71683168316832 type value euclidean_ap 91.53997039964659 type value euclidean_f1 84.88372093023257 type value euclidean_precision 90.02242152466367 type value euclidean_recall 80.30000000000001 type value manhattan_accuracy 99.72376237623763 type value manhattan_ap 91.80756777790289 type value manhattan_f1 85.48468106479157 type value manhattan_precision 85.8728557013118 type value manhattan_recall 85.1 type value max_accuracy 99.72772277227723 type value max_ap 92.17845897992215 type value max_f1 85.9746835443038 type PairClassification dataset metrics task config name revision split type default MTEB StackExchangeClustering 6cbc1f7b2bc0622f2e39d2c77fa502909748c259 test mteb/stackexchange-clustering type value v_measure 53.52464042600003 type Clustering dataset metrics task config name revision split type default MTEB StackExchangeClusteringP2P 815ca46b2622cec33ccafc3735d572c266efdb44 test mteb/stackexchange-clustering-p2p type value v_measure 32.071631948736 type Clustering dataset metrics task config name revision split type default MTEB StackOverflowDupQuestions e185fbe320c72810689fc5848eb6114e1ef5ec69 test mteb/stackoverflowdupquestions-reranking type value map 49.19552407604654 type value mrr 49.95269130379425 type Reranking dataset metrics task config name revision split type default MTEB SummEval cda12ad7615edc362dbf25a00fdd61d3b1eaf93c test mteb/summeval type value cos_sim_pearson 29.345293033095427 type value cos_sim_spearman 29.976931423258403 type value dot_pearson 27.047078008958408 type value dot_spearman 27.75894368380218 type Summarization dataset metrics task config name revision split type default MTEB TRECCOVID None test trec-covid type value map_at_1 0.22 type value map_at_10 1.706 type value map_at_100 9.634 type value map_at_1000 23.665 type value map_at_3 0.5950000000000001 type value map_at_5 0.95 type value mrr_at_1 86.0 type value mrr_at_10 91.8 type value mrr_at_100 91.8 type value mrr_at_1000 91.8 type value mrr_at_3 91.0 type value mrr_at_5 91.8 type value ndcg_at_1 80.0 type value ndcg_at_10 72.573 type value ndcg_at_100 53.954 type value ndcg_at_1000 47.760999999999996 type value ndcg_at_3 76.173 type value ndcg_at_5 75.264 type value precision_at_1 86.0 type value precision_at_10 76.4 type value precision_at_100 55.50000000000001 type value precision_at_1000 21.802 type value precision_at_3 81.333 type value precision_at_5 80.4 type value recall_at_1 0.22 type value recall_at_10 1.925 type value recall_at_100 12.762 type value recall_at_1000 44.946000000000005 type value recall_at_3 0.634 type value recall_at_5 1.051 type Retrieval dataset metrics task config name revision split type sqi-eng MTEB Tatoeba (sqi-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 91.0 type value f1 88.55666666666666 type value precision 87.46166666666667 type value recall 91.0 type BitextMining dataset metrics task config name revision split type fry-eng MTEB Tatoeba (fry-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 57.22543352601156 type value f1 51.03220478943021 type value precision 48.8150289017341 type value recall 57.22543352601156 type BitextMining dataset metrics task config name revision split type kur-eng MTEB Tatoeba (kur-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 46.58536585365854 type value f1 39.66870798578116 type value precision 37.416085946573745 type value recall 46.58536585365854 type BitextMining dataset metrics task config name revision split type tur-eng MTEB Tatoeba (tur-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 89.7 type value f1 86.77999999999999 type value precision 85.45333333333332 type value recall 89.7 type BitextMining dataset metrics task config name revision split type deu-eng MTEB Tatoeba (deu-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 97.39999999999999 type value f1 96.58333333333331 type value precision 96.2 type value recall 97.39999999999999 type BitextMining dataset metrics task config name revision split type nld-eng MTEB Tatoeba (nld-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 92.4 type value f1 90.3 type value precision 89.31666666666668 type value recall 92.4 type BitextMining dataset metrics task config name revision split type ron-eng MTEB Tatoeba (ron-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 86.9 type value f1 83.67190476190476 type value precision 82.23333333333332 type value recall 86.9 type BitextMining dataset metrics task config name revision split type ang-eng MTEB Tatoeba (ang-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 50.0 type value f1 42.23229092632078 type value precision 39.851634683724235 type value recall 50.0 type BitextMining dataset metrics task config name revision split type ido-eng MTEB Tatoeba (ido-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 76.3 type value f1 70.86190476190477 type value precision 68.68777777777777 type value recall 76.3 type BitextMining dataset metrics task config name revision split type jav-eng MTEB Tatoeba (jav-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 57.073170731707314 type value f1 50.658958927251604 type value precision 48.26480836236933 type value recall 57.073170731707314 type BitextMining dataset metrics task config name revision split type isl-eng MTEB Tatoeba (isl-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 68.2 type value f1 62.156507936507936 type value precision 59.84964285714286 type value recall 68.2 type BitextMining dataset metrics task config name revision split type slv-eng MTEB Tatoeba (slv-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 77.52126366950182 type value f1 72.8496210148701 type value precision 70.92171498003819 type value recall 77.52126366950182 type BitextMining dataset metrics task config name revision split type cym-eng MTEB Tatoeba (cym-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 70.78260869565217 type value f1 65.32422360248447 type value precision 63.063067367415194 type value recall 70.78260869565217 type BitextMining dataset metrics task config name revision split type kaz-eng MTEB Tatoeba (kaz-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 78.43478260869566 type value f1 73.02608695652172 type value precision 70.63768115942028 type value recall 78.43478260869566 type BitextMining dataset metrics task config name revision split type est-eng MTEB Tatoeba (est-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 60.9 type value f1 55.309753694581275 type value precision 53.130476190476195 type value recall 60.9 type BitextMining dataset metrics task config name revision split type heb-eng MTEB Tatoeba (heb-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 72.89999999999999 type value f1 67.92023809523809 type value precision 65.82595238095237 type value recall 72.89999999999999 type BitextMining dataset metrics task config name revision split type gla-eng MTEB Tatoeba (gla-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 46.80337756332931 type value f1 39.42174900558496 type value precision 36.97101116280851 type value recall 46.80337756332931 type BitextMining dataset metrics task config name revision split type mar-eng MTEB Tatoeba (mar-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 89.8 type value f1 86.79 type value precision 85.375 type value recall 89.8 type BitextMining dataset metrics task config name revision split type lat-eng MTEB Tatoeba (lat-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 47.199999999999996 type value f1 39.95484348984349 type value precision 37.561071428571424 type value recall 47.199999999999996 type BitextMining dataset metrics task config name revision split type bel-eng MTEB Tatoeba (bel-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 87.8 type value f1 84.68190476190475 type value precision 83.275 type value recall 87.8 type BitextMining dataset metrics task config name revision split type pms-eng MTEB Tatoeba (pms-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 48.76190476190476 type value f1 42.14965986394558 type value precision 39.96743626743626 type value recall 48.76190476190476 type BitextMining dataset metrics task config name revision split type gle-eng MTEB Tatoeba (gle-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 66.10000000000001 type value f1 59.58580086580086 type value precision 57.150238095238095 type value recall 66.10000000000001 type BitextMining dataset metrics task config name revision split type pes-eng MTEB Tatoeba (pes-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 87.3 type value f1 84.0 type value precision 82.48666666666666 type value recall 87.3 type BitextMining dataset metrics task config name revision split type nob-eng MTEB Tatoeba (nob-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 90.4 type value f1 87.79523809523809 type value precision 86.6 type value recall 90.4 type BitextMining dataset metrics task config name revision split type bul-eng MTEB Tatoeba (bul-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 87.0 type value f1 83.81 type value precision 82.36666666666666 type value recall 87.0 type BitextMining dataset metrics task config name revision split type cbk-eng MTEB Tatoeba (cbk-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 63.9 type value f1 57.76533189033189 type value precision 55.50595238095239 type value recall 63.9 type BitextMining dataset metrics task config name revision split type hun-eng MTEB Tatoeba (hun-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 76.1 type value f1 71.83690476190478 type value precision 70.04928571428573 type value recall 76.1 type BitextMining dataset metrics task config name revision split type uig-eng MTEB Tatoeba (uig-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 66.3 type value f1 59.32626984126984 type value precision 56.62535714285713 type value recall 66.3 type BitextMining dataset metrics task config name revision split type rus-eng MTEB Tatoeba (rus-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 92.10000000000001 type value f1 89.76666666666667 type value main_score 89.76666666666667 type value precision 88.64999999999999 type value recall 92.10000000000001 type BitextMining dataset metrics task config name revision split type spa-eng MTEB Tatoeba (spa-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 93.10000000000001 type value f1 91.10000000000001 type value precision 90.16666666666666 type value recall 93.10000000000001 type BitextMining dataset metrics task config name revision split type hye-eng MTEB Tatoeba (hye-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 85.71428571428571 type value f1 82.29142600436403 type value precision 80.8076626877166 type value recall 85.71428571428571 type BitextMining dataset metrics task config name revision split type tel-eng MTEB Tatoeba (tel-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 88.88888888888889 type value f1 85.7834757834758 type value precision 84.43732193732193 type value recall 88.88888888888889 type BitextMining dataset metrics task config name revision split type afr-eng MTEB Tatoeba (afr-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 88.5 type value f1 85.67190476190476 type value precision 84.43333333333332 type value recall 88.5 type BitextMining dataset metrics task config name revision split type mon-eng MTEB Tatoeba (mon-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 82.72727272727273 type value f1 78.21969696969695 type value precision 76.18181818181819 type value recall 82.72727272727273 type BitextMining dataset metrics task config name revision split type arz-eng MTEB Tatoeba (arz-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 61.0062893081761 type value f1 55.13976240391334 type value precision 52.92112499659669 type value recall 61.0062893081761 type BitextMining dataset metrics task config name revision split type hrv-eng MTEB Tatoeba (hrv-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 89.5 type value f1 86.86666666666666 type value precision 85.69166666666668 type value recall 89.5 type BitextMining dataset metrics task config name revision split type nov-eng MTEB Tatoeba (nov-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 73.54085603112841 type value f1 68.56031128404669 type value precision 66.53047989623866 type value recall 73.54085603112841 type BitextMining dataset metrics task config name revision split type gsw-eng MTEB Tatoeba (gsw-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 43.58974358974359 type value f1 36.45299145299145 type value precision 33.81155881155882 type value recall 43.58974358974359 type BitextMining dataset metrics task config name revision split type nds-eng MTEB Tatoeba (nds-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 59.599999999999994 type value f1 53.264689754689755 type value precision 50.869166666666665 type value recall 59.599999999999994 type BitextMining dataset metrics task config name revision split type ukr-eng MTEB Tatoeba (ukr-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 85.2 type value f1 81.61666666666665 type value precision 80.02833333333335 type value recall 85.2 type BitextMining dataset metrics task config name revision split type uzb-eng MTEB Tatoeba (uzb-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 63.78504672897196 type value f1 58.00029669188548 type value precision 55.815809968847354 type value recall 63.78504672897196 type BitextMining dataset metrics task config name revision split type lit-eng MTEB Tatoeba (lit-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 66.5 type value f1 61.518333333333345 type value precision 59.622363699102834 type value recall 66.5 type BitextMining dataset metrics task config name revision split type ina-eng MTEB Tatoeba (ina-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 88.6 type value f1 85.60222222222221 type value precision 84.27916666666665 type value recall 88.6 type BitextMining dataset metrics task config name revision split type lfn-eng MTEB Tatoeba (lfn-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 58.699999999999996 type value f1 52.732375957375965 type value precision 50.63214035964035 type value recall 58.699999999999996 type BitextMining dataset metrics task config name revision split type zsm-eng MTEB Tatoeba (zsm-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 92.10000000000001 type value f1 89.99666666666667 type value precision 89.03333333333333 type value recall 92.10000000000001 type BitextMining dataset metrics task config name revision split type ita-eng MTEB Tatoeba (ita-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 90.10000000000001 type value f1 87.55666666666667 type value precision 86.36166666666668 type value recall 90.10000000000001 type BitextMining dataset metrics task config name revision split type cmn-eng MTEB Tatoeba (cmn-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 91.4 type value f1 88.89000000000001 type value precision 87.71166666666666 type value recall 91.4 type BitextMining dataset metrics task config name revision split type lvs-eng MTEB Tatoeba (lvs-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 65.7 type value f1 60.67427750410509 type value precision 58.71785714285714 type value recall 65.7 type BitextMining dataset metrics task config name revision split type glg-eng MTEB Tatoeba (glg-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 85.39999999999999 type value f1 81.93190476190475 type value precision 80.37833333333333 type value recall 85.39999999999999 type BitextMining dataset metrics task config name revision split type ceb-eng MTEB Tatoeba (ceb-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 47.833333333333336 type value f1 42.006625781625786 type value precision 40.077380952380956 type value recall 47.833333333333336 type BitextMining dataset metrics task config name revision split type bre-eng MTEB Tatoeba (bre-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 10.4 type value f1 8.24465007215007 type value precision 7.664597069597071 type value recall 10.4 type BitextMining dataset metrics task config name revision split type ben-eng MTEB Tatoeba (ben-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 82.6 type value f1 77.76333333333334 type value precision 75.57833333333332 type value recall 82.6 type BitextMining dataset metrics task config name revision split type swg-eng MTEB Tatoeba (swg-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 52.67857142857143 type value f1 44.302721088435376 type value precision 41.49801587301587 type value recall 52.67857142857143 type BitextMining dataset metrics task config name revision split type arq-eng MTEB Tatoeba (arq-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 28.3205268935236 type value f1 22.426666605171157 type value precision 20.685900116470915 type value recall 28.3205268935236 type BitextMining dataset metrics task config name revision split type kab-eng MTEB Tatoeba (kab-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 22.7 type value f1 17.833970473970474 type value precision 16.407335164835164 type value recall 22.7 type BitextMining dataset metrics task config name revision split type fra-eng MTEB Tatoeba (fra-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 92.2 type value f1 89.92999999999999 type value precision 88.87 type value recall 92.2 type BitextMining dataset metrics task config name revision split type por-eng MTEB Tatoeba (por-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 91.4 type value f1 89.25 type value precision 88.21666666666667 type value recall 91.4 type BitextMining dataset metrics task config name revision split type tat-eng MTEB Tatoeba (tat-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 69.19999999999999 type value f1 63.38269841269841 type value precision 61.14773809523809 type value recall 69.19999999999999 type BitextMining dataset metrics task config name revision split type oci-eng MTEB Tatoeba (oci-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 48.8 type value f1 42.839915639915645 type value precision 40.770287114845935 type value recall 48.8 type BitextMining dataset metrics task config name revision split type pol-eng MTEB Tatoeba (pol-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 88.8 type value f1 85.90666666666668 type value precision 84.54166666666666 type value recall 88.8 type BitextMining dataset metrics task config name revision split type war-eng MTEB Tatoeba (war-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 46.6 type value f1 40.85892920804686 type value precision 38.838223114604695 type value recall 46.6 type BitextMining dataset metrics task config name revision split type aze-eng MTEB Tatoeba (aze-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 84.0 type value f1 80.14190476190475 type value precision 78.45333333333333 type value recall 84.0 type BitextMining dataset metrics task config name revision split type vie-eng MTEB Tatoeba (vie-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 90.5 type value f1 87.78333333333333 type value precision 86.5 type value recall 90.5 type BitextMining dataset metrics task config name revision split type nno-eng MTEB Tatoeba (nno-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 74.5 type value f1 69.48397546897547 type value precision 67.51869047619049 type value recall 74.5 type BitextMining dataset metrics task config name revision split type cha-eng MTEB Tatoeba (cha-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 32.846715328467155 type value f1 27.828177499710343 type value precision 26.63451511991658 type value recall 32.846715328467155 type BitextMining dataset metrics task config name revision split type mhr-eng MTEB Tatoeba (mhr-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 8.0 type value f1 6.07664116764988 type value precision 5.544177607179943 type value recall 8.0 type BitextMining dataset metrics task config name revision split type dan-eng MTEB Tatoeba (dan-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 87.6 type value f1 84.38555555555554 type value precision 82.91583333333334 type value recall 87.6 type BitextMining dataset metrics task config name revision split type ell-eng MTEB Tatoeba (ell-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 87.5 type value f1 84.08333333333331 type value precision 82.47333333333333 type value recall 87.5 type BitextMining dataset metrics task config name revision split type amh-eng MTEB Tatoeba (amh-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 80.95238095238095 type value f1 76.13095238095238 type value precision 74.05753968253967 type value recall 80.95238095238095 type BitextMining dataset metrics task config name revision split type pam-eng MTEB Tatoeba (pam-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 8.799999999999999 type value f1 6.971422975172975 type value precision 6.557814916172301 type value recall 8.799999999999999 type BitextMining dataset metrics task config name revision split type hsb-eng MTEB Tatoeba (hsb-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 44.099378881987576 type value f1 37.01649742022413 type value precision 34.69420618488942 type value recall 44.099378881987576 type BitextMining dataset metrics task config name revision split type srp-eng MTEB Tatoeba (srp-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 84.3 type value f1 80.32666666666667 type value precision 78.60666666666665 type value recall 84.3 type BitextMining dataset metrics task config name revision split type epo-eng MTEB Tatoeba (epo-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 92.5 type value f1 90.49666666666666 type value precision 89.56666666666668 type value recall 92.5 type BitextMining dataset metrics task config name revision split type kzj-eng MTEB Tatoeba (kzj-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 10.0 type value f1 8.268423529875141 type value precision 7.878118605532398 type value recall 10.0 type BitextMining dataset metrics task config name revision split type awa-eng MTEB Tatoeba (awa-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 79.22077922077922 type value f1 74.27128427128426 type value precision 72.28715728715729 type value recall 79.22077922077922 type BitextMining dataset metrics task config name revision split type fao-eng MTEB Tatoeba (fao-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 65.64885496183206 type value f1 58.87495456197747 type value precision 55.992366412213734 type value recall 65.64885496183206 type BitextMining dataset metrics task config name revision split type mal-eng MTEB Tatoeba (mal-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 96.06986899563319 type value f1 94.78408539543909 type value precision 94.15332362930616 type value recall 96.06986899563319 type BitextMining dataset metrics task config name revision split type ile-eng MTEB Tatoeba (ile-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 77.2 type value f1 71.72571428571428 type value precision 69.41000000000001 type value recall 77.2 type BitextMining dataset metrics task config name revision split type bos-eng MTEB Tatoeba (bos-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 86.4406779661017 type value f1 83.2391713747646 type value precision 81.74199623352166 type value recall 86.4406779661017 type BitextMining dataset metrics task config name revision split type cor-eng MTEB Tatoeba (cor-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 8.4 type value f1 6.017828743398003 type value precision 5.4829865484756795 type value recall 8.4 type BitextMining dataset metrics task config name revision split type cat-eng MTEB Tatoeba (cat-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 83.5 type value f1 79.74833333333333 type value precision 78.04837662337664 type value recall 83.5 type BitextMining dataset metrics task config name revision split type eus-eng MTEB Tatoeba (eus-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 60.4 type value f1 54.467301587301584 type value precision 52.23242424242424 type value recall 60.4 type BitextMining dataset metrics task config name revision split type yue-eng MTEB Tatoeba (yue-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 74.9 type value f1 69.68699134199134 type value precision 67.59873015873016 type value recall 74.9 type BitextMining dataset metrics task config name revision split type swe-eng MTEB Tatoeba (swe-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 88.0 type value f1 84.9652380952381 type value precision 83.66166666666666 type value recall 88.0 type BitextMining dataset metrics task config name revision split type dtp-eng MTEB Tatoeba (dtp-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 9.1 type value f1 7.681244588744588 type value precision 7.370043290043291 type value recall 9.1 type BitextMining dataset metrics task config name revision split type kat-eng MTEB Tatoeba (kat-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 80.9651474530831 type value f1 76.84220605132133 type value precision 75.19606398962966 type value recall 80.9651474530831 type BitextMining dataset metrics task config name revision split type jpn-eng MTEB Tatoeba (jpn-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 86.9 type value f1 83.705 type value precision 82.3120634920635 type value recall 86.9 type BitextMining dataset metrics task config name revision split type csb-eng MTEB Tatoeba (csb-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 29.64426877470356 type value f1 23.98763072676116 type value precision 22.506399397703746 type value recall 29.64426877470356 type BitextMining dataset metrics task config name revision split type xho-eng MTEB Tatoeba (xho-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 70.4225352112676 type value f1 62.84037558685445 type value precision 59.56572769953053 type value recall 70.4225352112676 type BitextMining dataset metrics task config name revision split type orv-eng MTEB Tatoeba (orv-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 19.64071856287425 type value f1 15.125271011207756 type value precision 13.865019261197494 type value recall 19.64071856287425 type BitextMining dataset metrics task config name revision split type ind-eng MTEB Tatoeba (ind-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 90.2 type value f1 87.80666666666666 type value precision 86.70833333333331 type value recall 90.2 type BitextMining dataset metrics task config name revision split type tuk-eng MTEB Tatoeba (tuk-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 23.15270935960591 type value f1 18.407224958949097 type value precision 16.982385430661292 type value recall 23.15270935960591 type BitextMining dataset metrics task config name revision split type max-eng MTEB Tatoeba (max-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 55.98591549295775 type value f1 49.94718309859154 type value precision 47.77864154624717 type value recall 55.98591549295775 type BitextMining dataset metrics task config name revision split type swh-eng MTEB Tatoeba (swh-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 73.07692307692307 type value f1 66.74358974358974 type value precision 64.06837606837607 type value recall 73.07692307692307 type BitextMining dataset metrics task config name revision split type hin-eng MTEB Tatoeba (hin-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 94.89999999999999 type value f1 93.25 type value precision 92.43333333333332 type value recall 94.89999999999999 type BitextMining dataset metrics task config name revision split type dsb-eng MTEB Tatoeba (dsb-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 37.78705636743215 type value f1 31.63899658680452 type value precision 29.72264397629742 type value recall 37.78705636743215 type BitextMining dataset metrics task config name revision split type ber-eng MTEB Tatoeba (ber-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 21.6 type value f1 16.91697302697303 type value precision 15.71225147075147 type value recall 21.6 type BitextMining dataset metrics task config name revision split type tam-eng MTEB Tatoeba (tam-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 85.01628664495115 type value f1 81.38514037536838 type value precision 79.83170466883823 type value recall 85.01628664495115 type BitextMining dataset metrics task config name revision split type slk-eng MTEB Tatoeba (slk-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 83.39999999999999 type value f1 79.96380952380952 type value precision 78.48333333333333 type value recall 83.39999999999999 type BitextMining dataset metrics task config name revision split type tgl-eng MTEB Tatoeba (tgl-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 83.2 type value f1 79.26190476190476 type value precision 77.58833333333334 type value recall 83.2 type BitextMining dataset metrics task config name revision split type ast-eng MTEB Tatoeba (ast-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 75.59055118110236 type value f1 71.66854143232096 type value precision 70.30183727034121 type value recall 75.59055118110236 type BitextMining dataset metrics task config name revision split type mkd-eng MTEB Tatoeba (mkd-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 65.5 type value f1 59.26095238095238 type value precision 56.81909090909092 type value recall 65.5 type BitextMining dataset metrics task config name revision split type khm-eng MTEB Tatoeba (khm-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 55.26315789473685 type value f1 47.986523325858506 type value precision 45.33950006595436 type value recall 55.26315789473685 type BitextMining dataset metrics task config name revision split type ces-eng MTEB Tatoeba (ces-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 82.89999999999999 type value f1 78.835 type value precision 77.04761904761905 type value recall 82.89999999999999 type BitextMining dataset metrics task config name revision split type tzl-eng MTEB Tatoeba (tzl-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 43.269230769230774 type value f1 36.20421245421245 type value precision 33.57371794871795 type value recall 43.269230769230774 type BitextMining dataset metrics task config name revision split type urd-eng MTEB Tatoeba (urd-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 88.0 type value f1 84.70666666666666 type value precision 83.23166666666665 type value recall 88.0 type BitextMining dataset metrics task config name revision split type ara-eng MTEB Tatoeba (ara-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 77.4 type value f1 72.54666666666667 type value precision 70.54318181818181 type value recall 77.4 type BitextMining dataset metrics task config name revision split type kor-eng MTEB Tatoeba (kor-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 78.60000000000001 type value f1 74.1588888888889 type value precision 72.30250000000001 type value recall 78.60000000000001 type BitextMining dataset metrics task config name revision split type yid-eng MTEB Tatoeba (yid-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 72.40566037735849 type value f1 66.82587328813744 type value precision 64.75039308176099 type value recall 72.40566037735849 type BitextMining dataset metrics task config name revision split type fin-eng MTEB Tatoeba (fin-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 73.8 type value f1 68.56357142857144 type value precision 66.3178822055138 type value recall 73.8 type BitextMining dataset metrics task config name revision split type tha-eng MTEB Tatoeba (tha-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 91.78832116788321 type value f1 89.3552311435523 type value precision 88.20559610705597 type value recall 91.78832116788321 type BitextMining dataset metrics task config name revision split type wuu-eng MTEB Tatoeba (wuu-eng) 9080400076fbadbb4c4dcb136ff4eddc40b42553 test mteb/tatoeba-bitext-mining type value accuracy 74.3 type value f1 69.05085581085581 type value precision 66.955 type value recall 74.3 type BitextMining dataset metrics task config name revision split type default MTEB Touche2020 None test webis-touche2020 type value map_at_1 2.896 type value map_at_10 8.993 type value map_at_100 14.133999999999999 type value map_at_1000 15.668000000000001 type value map_at_3 5.862 type value map_at_5 7.17 type value mrr_at_1 34.694 type value mrr_at_10 42.931000000000004 type value mrr_at_100 44.81 type value mrr_at_1000 44.81 type value mrr_at_3 38.435 type value mrr_at_5 41.701 type value ndcg_at_1 31.633 type value ndcg_at_10 21.163 type value ndcg_at_100 33.306000000000004 type value ndcg_at_1000 45.275999999999996 type value ndcg_at_3 25.685999999999996 type value ndcg_at_5 23.732 type value precision_at_1 34.694 type value precision_at_10 17.755000000000003 type value precision_at_100 6.938999999999999 type value precision_at_1000 1.48 type value precision_at_3 25.85 type value precision_at_5 23.265 type value recall_at_1 2.896 type value recall_at_10 13.333999999999998 type value recall_at_100 43.517 type value recall_at_1000 79.836 type value recall_at_3 6.306000000000001 type value recall_at_5 8.825 type Retrieval dataset metrics task config name revision split type default MTEB ToxicConversationsClassification d7c0de2777da35d6aae2200a62c6e0e5af397c4c test mteb/toxic_conversations_50k type value accuracy 69.3874 type value ap 13.829909072469423 type value f1 53.54534203543492 type Classification dataset metrics task config name revision split type default MTEB TweetSentimentExtractionClassification d604517c81ca91fe16a244d1248fc021f9ecee7a test mteb/tweet_sentiment_extraction type value accuracy 62.62026032823995 type value f1 62.85251350485221 type Classification dataset metrics task config name revision split type default MTEB TwentyNewsgroupsClustering 6125ec4e24fa026cec8a478383ee943acfbd5449 test mteb/twentynewsgroups-clustering type value v_measure 33.21527881409797 type Clustering dataset metrics task config name revision split type default MTEB TwitterSemEval2015 70970daeab8776df92f5ea462b6173c0b46fd2d1 test mteb/twittersemeval2015-pairclassification type value cos_sim_accuracy 84.97943613280086 type value cos_sim_ap 70.75454316885921 type value cos_sim_f1 65.38274012676743 type value cos_sim_precision 60.761214318078835 type value cos_sim_recall 70.76517150395777 type value dot_accuracy 79.0546581629612 type value dot_ap 47.3197121792147 type value dot_f1 49.20106524633821 type value dot_precision 42.45499808502489 type value dot_recall 58.49604221635884 type value euclidean_accuracy 85.08076533349228 type value euclidean_ap 70.95016106374474 type value euclidean_f1 65.43987900176455 type value euclidean_precision 62.64478764478765 type value euclidean_recall 68.49604221635884 type value manhattan_accuracy 84.93771234428085 type value manhattan_ap 70.63668388755362 type value manhattan_f1 65.23895401262398 type value manhattan_precision 56.946084218811485 type value manhattan_recall 76.35883905013192 type value max_accuracy 85.08076533349228 type value max_ap 70.95016106374474 type value max_f1 65.43987900176455 type PairClassification dataset metrics task config name revision split type default MTEB TwitterURLCorpus 8b6510b0b1fa4e4c4f879467980e9be563ec1cdf test mteb/twitterurlcorpus-pairclassification type value cos_sim_accuracy 88.69096130709822 type value cos_sim_ap 84.82526278228542 type value cos_sim_f1 77.65485060585536 type value cos_sim_precision 75.94582658619167 type value cos_sim_recall 79.44256236526024 type value dot_accuracy 80.97954748321496 type value dot_ap 64.81642914145866 type value dot_f1 60.631996987229975 type value dot_precision 54.5897293631712 type value dot_recall 68.17831844779796 type value euclidean_accuracy 88.6987231730508 type value euclidean_ap 84.80003825477253 type value euclidean_f1 77.67194179854496 type value euclidean_precision 75.7128235122094 type value euclidean_recall 79.73514012935017 type value manhattan_accuracy 88.62692591298949 type value manhattan_ap 84.80451408255276 type value manhattan_f1 77.69888949572183 type value manhattan_precision 73.70311528631622 type value manhattan_recall 82.15275639051433 type value max_accuracy 88.6987231730508 type value max_ap 84.82526278228542 type value max_f1 77.69888949572183 type PairClassification dataset metrics task config name revision split type ru-en MTEB BUCC.v2 (ru-en) 1739dc11ffe9b7bfccd7f3d585aeb4c544fc6677 test mteb/bucc-bitext-mining type value accuracy 95.72566678212678 type value f1 94.42443135896548 type value main_score 94.42443135896548 type value precision 93.80868260016165 type value recall 95.72566678212678 type BitextMining dataset metrics task config name revision split type rus_Cyrl-rus_Cyrl MTEB BelebeleRetrieval (rus_Cyrl-rus_Cyrl) 75b399394a9803252cfec289d103de462763db7c test facebook/belebele type value main_score 92.23599999999999 type value map_at_1 87.111 type value map_at_10 90.717 type value map_at_100 90.879 type value map_at_1000 90.881 type value map_at_20 90.849 type value map_at_3 90.074 type value map_at_5 90.535 type value mrr_at_1 87.1111111111111 type value mrr_at_10 90.7173721340388 type value mrr_at_100 90.87859682638407 type value mrr_at_1000 90.88093553612326 type value mrr_at_20 90.84863516113515 type value mrr_at_3 90.07407407407409 type value mrr_at_5 90.53518518518521 type value nauc_map_at_1000_diff1 92.37373187280554 type value nauc_map_at_1000_max 79.90465445423249 type value nauc_map_at_1000_std -0.6220290556185463 type value nauc_map_at_100_diff1 92.37386697345335 type value nauc_map_at_100_max 79.90991577223959 type value nauc_map_at_100_std -0.602247514642845 type value nauc_map_at_10_diff1 92.30907447072467 type value nauc_map_at_10_max 79.86831935337598 type value nauc_map_at_10_std -0.7455191860719699 type value nauc_map_at_1_diff1 93.29828518358822 type value nauc_map_at_1_max 78.69539619887887 type value nauc_map_at_1_std -4.097150817605763 type value nauc_map_at_20_diff1 92.38414149703077 type value nauc_map_at_20_max 79.94789814504661 type value nauc_map_at_20_std -0.3928031130400773 type value nauc_map_at_3_diff1 92.21688899306734 type value nauc_map_at_3_max 80.34586671780885 type value nauc_map_at_3_std 0.24088319695435909 type value nauc_map_at_5_diff1 92.27931726042982 type value nauc_map_at_5_max 79.99198834003367 type value nauc_map_at_5_std -0.6296366922840796 type value nauc_mrr_at_1000_diff1 92.37373187280554 type value nauc_mrr_at_1000_max 79.90465445423249 type value nauc_mrr_at_1000_std -0.6220290556185463 type value nauc_mrr_at_100_diff1 92.37386697345335 type value nauc_mrr_at_100_max 79.90991577223959 type value nauc_mrr_at_100_std -0.602247514642845 type value nauc_mrr_at_10_diff1 92.30907447072467 type value nauc_mrr_at_10_max 79.86831935337598 type value nauc_mrr_at_10_std -0.7455191860719699 type value nauc_mrr_at_1_diff1 93.29828518358822 type value nauc_mrr_at_1_max 78.69539619887887 type value nauc_mrr_at_1_std -4.097150817605763 type value nauc_mrr_at_20_diff1 92.38414149703077 type value nauc_mrr_at_20_max 79.94789814504661 type value nauc_mrr_at_20_std -0.3928031130400773 type value nauc_mrr_at_3_diff1 92.21688899306734 type value nauc_mrr_at_3_max 80.34586671780885 type value nauc_mrr_at_3_std 0.24088319695435909 type value nauc_mrr_at_5_diff1 92.27931726042982 type value nauc_mrr_at_5_max 79.99198834003367 type value nauc_mrr_at_5_std -0.6296366922840796 type value nauc_ndcg_at_1000_diff1 92.30526497646306 type value nauc_ndcg_at_1000_max 80.12734537480418 type value nauc_ndcg_at_1000_std 0.22849408935578744 type value nauc_ndcg_at_100_diff1 92.31347123202318 type value nauc_ndcg_at_100_max 80.29207038703142 type value nauc_ndcg_at_100_std 0.816825944406239 type value nauc_ndcg_at_10_diff1 92.05430189845808 type value nauc_ndcg_at_10_max 80.16515667442968 type value nauc_ndcg_at_10_std 0.7486447532544893 type value nauc_ndcg_at_1_diff1 93.29828518358822 type value nauc_ndcg_at_1_max 78.69539619887887 type value nauc_ndcg_at_1_std -4.097150817605763 type value nauc_ndcg_at_20_diff1 92.40147868825079 type value nauc_ndcg_at_20_max 80.5117307181802 type value nauc_ndcg_at_20_std 2.0431351539517033 type value nauc_ndcg_at_3_diff1 91.88894444422789 type value nauc_ndcg_at_3_max 81.09256084196045 type value nauc_ndcg_at_3_std 2.422705909643621 type value nauc_ndcg_at_5_diff1 91.99711052955728 type value nauc_ndcg_at_5_max 80.46996334573979 type value nauc_ndcg_at_5_std 0.9086986899040708 type value nauc_precision_at_1000_diff1 .nan type value nauc_precision_at_1000_max .nan type value nauc_precision_at_1000_std .nan type value nauc_precision_at_100_diff1 93.46405228758012 type value nauc_precision_at_100_max 100.0 type value nauc_precision_at_100_std 70.71661998132774 type value nauc_precision_at_10_diff1 90.13938908896874 type value nauc_precision_at_10_max 82.21121782046167 type value nauc_precision_at_10_std 13.075230092036083 type value nauc_precision_at_1_diff1 93.29828518358822 type value nauc_precision_at_1_max 78.69539619887887 type value nauc_precision_at_1_std -4.097150817605763 type value nauc_precision_at_20_diff1 94.9723479135242 type value nauc_precision_at_20_max 91.04000574588684 type value nauc_precision_at_20_std 48.764634058749586 type value nauc_precision_at_3_diff1 90.52690041533852 type value nauc_precision_at_3_max 84.35075179497126 type value nauc_precision_at_3_std 12.036768730480507 type value nauc_precision_at_5_diff1 90.44234360410769 type value nauc_precision_at_5_max 83.21895424836558 type value nauc_precision_at_5_std 9.974323062558037 type value nauc_recall_at_1000_diff1 .nan type value nauc_recall_at_1000_max .nan type value nauc_recall_at_1000_std .nan type value nauc_recall_at_100_diff1 93.46405228758294 type value nauc_recall_at_100_max 100.0 type value nauc_recall_at_100_std 70.71661998132666 type value nauc_recall_at_10_diff1 90.13938908896864 type value nauc_recall_at_10_max 82.21121782046124 type value nauc_recall_at_10_std 13.075230092036506 type value nauc_recall_at_1_diff1 93.29828518358822 type value nauc_recall_at_1_max 78.69539619887887 type value nauc_recall_at_1_std -4.097150817605763 type value nauc_recall_at_20_diff1 94.97234791352489 type value nauc_recall_at_20_max 91.04000574588774 type value nauc_recall_at_20_std 48.764634058752065 type value nauc_recall_at_3_diff1 90.52690041533845 type value nauc_recall_at_3_max 84.35075179497079 type value nauc_recall_at_3_std 12.036768730480583 type value nauc_recall_at_5_diff1 90.44234360410861 type value nauc_recall_at_5_max 83.21895424836595 type value nauc_recall_at_5_std 9.974323062558147 type value ndcg_at_1 87.111 type value ndcg_at_10 92.23599999999999 type value ndcg_at_100 92.87100000000001 type value ndcg_at_1000 92.928 type value ndcg_at_20 92.67699999999999 type value ndcg_at_3 90.973 type value ndcg_at_5 91.801 type value precision_at_1 87.111 type value precision_at_10 9.689 type value precision_at_100 0.996 type value precision_at_1000 0.1 type value precision_at_20 4.928 type value precision_at_3 31.185000000000002 type value precision_at_5 19.111 type value recall_at_1 87.111 type value recall_at_10 96.88900000000001 type value recall_at_100 99.556 type value recall_at_1000 100.0 type value recall_at_20 98.556 type value recall_at_3 93.556 type value recall_at_5 95.556 type Retrieval dataset metrics task config name revision split type rus_Cyrl-eng_Latn MTEB BelebeleRetrieval (rus_Cyrl-eng_Latn) 75b399394a9803252cfec289d103de462763db7c test facebook/belebele type value main_score 86.615 type value map_at_1 78.0 type value map_at_10 83.822 type value map_at_100 84.033 type value map_at_1000 84.03500000000001 type value map_at_20 83.967 type value map_at_3 82.315 type value map_at_5 83.337 type value mrr_at_1 78.0 type value mrr_at_10 83.82213403880073 type value mrr_at_100 84.03281327810801 type value mrr_at_1000 84.03460051000452 type value mrr_at_20 83.9673773122303 type value mrr_at_3 82.31481481481484 type value mrr_at_5 83.33703703703708 type value nauc_map_at_1000_diff1 80.78467576987832 type value nauc_map_at_1000_max 51.41718334647604 type value nauc_map_at_1000_std -16.23873782768812 type value nauc_map_at_100_diff1 80.78490931240695 type value nauc_map_at_100_max 51.41504597713061 type value nauc_map_at_100_std -16.23538559475366 type value nauc_map_at_10_diff1 80.73989245374868 type value nauc_map_at_10_max 51.43026079433827 type value nauc_map_at_10_std -16.13414330905897 type value nauc_map_at_1_diff1 82.36966971144186 type value nauc_map_at_1_max 52.988877039509916 type value nauc_map_at_1_std -15.145824639495546 type value nauc_map_at_20_diff1 80.75923781626145 type value nauc_map_at_20_max 51.40181079374639 type value nauc_map_at_20_std -16.260566097377165 type value nauc_map_at_3_diff1 80.65242627065471 type value nauc_map_at_3_max 50.623980338841214 type value nauc_map_at_3_std -16.818343442794294 type value nauc_map_at_5_diff1 80.45976387021862 type value nauc_map_at_5_max 51.533621728445866 type value nauc_map_at_5_std -16.279891536945815 type value nauc_mrr_at_1000_diff1 80.78467576987832 type value nauc_mrr_at_1000_max 51.41718334647604 type value nauc_mrr_at_1000_std -16.23873782768812 type value nauc_mrr_at_100_diff1 80.78490931240695 type value nauc_mrr_at_100_max 51.41504597713061 type value nauc_mrr_at_100_std -16.23538559475366 type value nauc_mrr_at_10_diff1 80.73989245374868 type value nauc_mrr_at_10_max 51.43026079433827 type value nauc_mrr_at_10_std -16.13414330905897 type value nauc_mrr_at_1_diff1 82.36966971144186 type value nauc_mrr_at_1_max 52.988877039509916 type value nauc_mrr_at_1_std -15.145824639495546 type value nauc_mrr_at_20_diff1 80.75923781626145 type value nauc_mrr_at_20_max 51.40181079374639 type value nauc_mrr_at_20_std -16.260566097377165 type value nauc_mrr_at_3_diff1 80.65242627065471 type value nauc_mrr_at_3_max 50.623980338841214 type value nauc_mrr_at_3_std -16.818343442794294 type value nauc_mrr_at_5_diff1 80.45976387021862 type value nauc_mrr_at_5_max 51.533621728445866 type value nauc_mrr_at_5_std -16.279891536945815 type value nauc_ndcg_at_1000_diff1 80.60009446938174 type value nauc_ndcg_at_1000_max 51.381708043594166 type value nauc_ndcg_at_1000_std -16.054256944160848 type value nauc_ndcg_at_100_diff1 80.58971462930421 type value nauc_ndcg_at_100_max 51.25436917735444 type value nauc_ndcg_at_100_std -15.862944972269894 type value nauc_ndcg_at_10_diff1 80.37967179454489 type value nauc_ndcg_at_10_max 51.590394257251006 type value nauc_ndcg_at_10_std -15.489799384799591 type value nauc_ndcg_at_1_diff1 82.36966971144186 type value nauc_ndcg_at_1_max 52.988877039509916 type value nauc_ndcg_at_1_std -15.145824639495546 type value nauc_ndcg_at_20_diff1 80.40299527470081 type value nauc_ndcg_at_20_max 51.395132284307074 type value nauc_ndcg_at_20_std -15.906165526937203 type value nauc_ndcg_at_3_diff1 80.10347913649302 type value nauc_ndcg_at_3_max 50.018431855573844 type value nauc_ndcg_at_3_std -17.12743750163884 type value nauc_ndcg_at_5_diff1 79.65918647776613 type value nauc_ndcg_at_5_max 51.76710880330806 type value nauc_ndcg_at_5_std -16.071901882035945 type value nauc_precision_at_1000_diff1 .nan type value nauc_precision_at_1000_max .nan type value nauc_precision_at_1000_std .nan type value nauc_precision_at_100_diff1 77.41596638655459 type value nauc_precision_at_100_max 22.572362278246565 type value nauc_precision_at_100_std 26.890756302525716 type value nauc_precision_at_10_diff1 77.82112845138009 type value nauc_precision_at_10_max 54.2550353474723 type value nauc_precision_at_10_std -7.492997198879646 type value nauc_precision_at_1_diff1 82.36966971144186 type value nauc_precision_at_1_max 52.988877039509916 type value nauc_precision_at_1_std -15.145824639495546 type value nauc_precision_at_20_diff1 75.89091192032318 type value nauc_precision_at_20_max 52.03275754746293 type value nauc_precision_at_20_std -7.8411920323686175 type value nauc_precision_at_3_diff1 78.0256020644638 type value nauc_precision_at_3_max 47.80353641248523 type value nauc_precision_at_3_std -18.181625255723503 type value nauc_precision_at_5_diff1 75.21583976056174 type value nauc_precision_at_5_max 53.716281032960765 type value nauc_precision_at_5_std -14.411700753360812 type value nauc_recall_at_1000_diff1 .nan type value nauc_recall_at_1000_max .nan type value nauc_recall_at_1000_std .nan type value nauc_recall_at_100_diff1 77.4159663865523 type value nauc_recall_at_100_max 22.57236227824646 type value nauc_recall_at_100_std 26.89075630252133 type value nauc_recall_at_10_diff1 77.82112845138037 type value nauc_recall_at_10_max 54.25503534747204 type value nauc_recall_at_10_std -7.492997198879666 type value nauc_recall_at_1_diff1 82.36966971144186 type value nauc_recall_at_1_max 52.988877039509916 type value nauc_recall_at_1_std -15.145824639495546 type value nauc_recall_at_20_diff1 75.89091192032362 type value nauc_recall_at_20_max 52.032757547463184 type value nauc_recall_at_20_std -7.84119203236888 type value nauc_recall_at_3_diff1 78.02560206446354 type value nauc_recall_at_3_max 47.80353641248526 type value nauc_recall_at_3_std -18.181625255723656 type value nauc_recall_at_5_diff1 75.21583976056185 type value nauc_recall_at_5_max 53.71628103296118 type value nauc_recall_at_5_std -14.411700753360634 type value ndcg_at_1 78.0 type value ndcg_at_10 86.615 type value ndcg_at_100 87.558 type value ndcg_at_1000 87.613 type value ndcg_at_20 87.128 type value ndcg_at_3 83.639 type value ndcg_at_5 85.475 type value precision_at_1 78.0 type value precision_at_10 9.533 type value precision_at_100 0.996 type value precision_at_1000 0.1 type value precision_at_20 4.867 type value precision_at_3 29.148000000000003 type value precision_at_5 18.378 type value recall_at_1 78.0 type value recall_at_10 95.333 type value recall_at_100 99.556 type value recall_at_1000 100.0 type value recall_at_20 97.333 type value recall_at_3 87.444 type value recall_at_5 91.889 type Retrieval dataset metrics task config name revision split type eng_Latn-rus_Cyrl MTEB BelebeleRetrieval (eng_Latn-rus_Cyrl) 75b399394a9803252cfec289d103de462763db7c test facebook/belebele type value main_score 82.748 type value map_at_1 73.444 type value map_at_10 79.857 type value map_at_100 80.219 type value map_at_1000 80.22500000000001 type value map_at_20 80.10300000000001 type value map_at_3 78.593 type value map_at_5 79.515 type value mrr_at_1 73.44444444444444 type value mrr_at_10 79.85705467372136 type value mrr_at_100 80.21942320422542 type value mrr_at_1000 80.2245364027152 type value mrr_at_20 80.10273201266493 type value mrr_at_3 78.59259259259258 type value mrr_at_5 79.51481481481483 type value nauc_map_at_1000_diff1 83.69682652271125 type value nauc_map_at_1000_max 61.70131708044767 type value nauc_map_at_1000_std 9.345825405274955 type value nauc_map_at_100_diff1 83.68924820523492 type value nauc_map_at_100_max 61.6965735573098 type value nauc_map_at_100_std 9.366132859525775 type value nauc_map_at_10_diff1 83.61802964269985 type value nauc_map_at_10_max 61.74274476167882 type value nauc_map_at_10_std 9.504060995819101 type value nauc_map_at_1_diff1 86.37079221403225 type value nauc_map_at_1_max 61.856861655370686 type value nauc_map_at_1_std 4.708911881992707 type value nauc_map_at_20_diff1 83.62920965453047 type value nauc_map_at_20_max 61.761029350326965 type value nauc_map_at_20_std 9.572978651118351 type value nauc_map_at_3_diff1 83.66665673154306 type value nauc_map_at_3_max 61.13597610587937 type value nauc_map_at_3_std 9.309596395240598 type value nauc_map_at_5_diff1 83.52307226455358 type value nauc_map_at_5_max 61.59405758027573 type value nauc_map_at_5_std 9.320025423287671 type value nauc_mrr_at_1000_diff1 83.69682652271125 type value nauc_mrr_at_1000_max 61.70131708044767 type value nauc_mrr_at_1000_std 9.345825405274955 type value nauc_mrr_at_100_diff1 83.68924820523492 type value nauc_mrr_at_100_max 61.6965735573098 type value nauc_mrr_at_100_std 9.366132859525775 type value nauc_mrr_at_10_diff1 83.61802964269985 type value nauc_mrr_at_10_max 61.74274476167882 type value nauc_mrr_at_10_std 9.504060995819101 type value nauc_mrr_at_1_diff1 86.37079221403225 type value nauc_mrr_at_1_max 61.856861655370686 type value nauc_mrr_at_1_std 4.708911881992707 type value nauc_mrr_at_20_diff1 83.62920965453047 type value nauc_mrr_at_20_max 61.761029350326965 type value nauc_mrr_at_20_std 9.572978651118351 type value nauc_mrr_at_3_diff1 83.66665673154306 type value nauc_mrr_at_3_max 61.13597610587937 type value nauc_mrr_at_3_std 9.309596395240598 type value nauc_mrr_at_5_diff1 83.52307226455358 type value nauc_mrr_at_5_max 61.59405758027573 type value nauc_mrr_at_5_std 9.320025423287671 type value nauc_ndcg_at_1000_diff1 83.24213186482201 type value nauc_ndcg_at_1000_max 61.77629841787496 type value nauc_ndcg_at_1000_std 10.332527869705851 type value nauc_ndcg_at_100_diff1 83.06815820441027 type value nauc_ndcg_at_100_max 61.6947181864579 type value nauc_ndcg_at_100_std 10.888922975877316 type value nauc_ndcg_at_10_diff1 82.58238431386295 type value nauc_ndcg_at_10_max 62.10333663935709 type value nauc_ndcg_at_10_std 11.746030330958174 type value nauc_ndcg_at_1_diff1 86.37079221403225 type value nauc_ndcg_at_1_max 61.856861655370686 type value nauc_ndcg_at_1_std 4.708911881992707 type value nauc_ndcg_at_20_diff1 82.67888324480154 type value nauc_ndcg_at_20_max 62.28124917486516 type value nauc_ndcg_at_20_std 12.343058917563914 type value nauc_ndcg_at_3_diff1 82.71277373710663 type value nauc_ndcg_at_3_max 60.66677922989939 type value nauc_ndcg_at_3_std 10.843633736296528 type value nauc_ndcg_at_5_diff1 82.34691124846786 type value nauc_ndcg_at_5_max 61.605961382062716 type value nauc_ndcg_at_5_std 11.129011077702602 type value nauc_precision_at_1000_diff1 .nan type value nauc_precision_at_1000_max .nan type value nauc_precision_at_1000_std .nan type value nauc_precision_at_100_diff1 60.93103908230194 type value nauc_precision_at_100_max 52.621048419370695 type value nauc_precision_at_100_std 85.60090702947922 type value nauc_precision_at_10_diff1 76.26517273576093 type value nauc_precision_at_10_max 65.2013694366636 type value nauc_precision_at_10_std 26.50357920946173 type value nauc_precision_at_1_diff1 86.37079221403225 type value nauc_precision_at_1_max 61.856861655370686 type value nauc_precision_at_1_std 4.708911881992707 type value nauc_precision_at_20_diff1 73.47946930710295 type value nauc_precision_at_20_max 70.19520986689217 type value nauc_precision_at_20_std 45.93186111653967 type value nauc_precision_at_3_diff1 79.02026879450186 type value nauc_precision_at_3_max 58.75074624692399 type value nauc_precision_at_3_std 16.740684654251037 type value nauc_precision_at_5_diff1 76.47585662281637 type value nauc_precision_at_5_max 61.86270922013127 type value nauc_precision_at_5_std 20.1833625455035 type value nauc_recall_at_1000_diff1 .nan type value nauc_recall_at_1000_max .nan type value nauc_recall_at_1000_std .nan type value nauc_recall_at_100_diff1 60.93103908229921 type value nauc_recall_at_100_max 52.62104841936668 type value nauc_recall_at_100_std 85.60090702947748 type value nauc_recall_at_10_diff1 76.26517273576097 type value nauc_recall_at_10_max 65.20136943666347 type value nauc_recall_at_10_std 26.50357920946174 type value nauc_recall_at_1_diff1 86.37079221403225 type value nauc_recall_at_1_max 61.856861655370686 type value nauc_recall_at_1_std 4.708911881992707 type value nauc_recall_at_20_diff1 73.47946930710269 type value nauc_recall_at_20_max 70.19520986689254 type value nauc_recall_at_20_std 45.93186111653943 type value nauc_recall_at_3_diff1 79.02026879450173 type value nauc_recall_at_3_max 58.750746246923924 type value nauc_recall_at_3_std 16.740684654251076 type value nauc_recall_at_5_diff1 76.4758566228162 type value nauc_recall_at_5_max 61.862709220131386 type value nauc_recall_at_5_std 20.18336254550361 type value ndcg_at_1 73.444 type value ndcg_at_10 82.748 type value ndcg_at_100 84.416 type value ndcg_at_1000 84.52300000000001 type value ndcg_at_20 83.646 type value ndcg_at_3 80.267 type value ndcg_at_5 81.922 type value precision_at_1 73.444 type value precision_at_10 9.167 type value precision_at_100 0.992 type value precision_at_1000 0.1 type value precision_at_20 4.761 type value precision_at_3 28.37 type value precision_at_5 17.822 type value recall_at_1 73.444 type value recall_at_10 91.667 type value recall_at_100 99.222 type value recall_at_1000 100.0 type value recall_at_20 95.222 type value recall_at_3 85.111 type value recall_at_5 89.11099999999999 type Retrieval dataset metrics task config name revision split type eng_Latn-rus_Cyrl MTEB BibleNLPBitextMining (eng_Latn-rus_Cyrl) 264a18480c529d9e922483839b4b9758e690b762 train davidstap/biblenlp-corpus-mmteb type value accuracy 96.875 type value f1 95.83333333333333 type value main_score 95.83333333333333 type value precision 95.3125 type value recall 96.875 type BitextMining dataset metrics task config name revision split type rus_Cyrl-eng_Latn MTEB BibleNLPBitextMining (rus_Cyrl-eng_Latn) 264a18480c529d9e922483839b4b9758e690b762 train davidstap/biblenlp-corpus-mmteb type value accuracy 88.671875 type value f1 85.3515625 type value main_score 85.3515625 type value precision 83.85416666666667 type value recall 88.671875 type BitextMining dataset metrics task config name revision split type default MTEB CEDRClassification (default) c0ba03d058e3e1b2f3fd20518875a4563dd12db4 test ai-forever/cedr-classification type value accuracy 40.06907545164719 type value f1 26.285000550712407 type value lrap 64.4280021253997 type value main_score 40.06907545164719 type MultilabelClassification dataset metrics task config name revision split type default MTEB CyrillicTurkicLangClassification (default) e42d330f33d65b7b72dfd408883daf1661f06f18 test tatiana-merz/cyrillic_turkic_langs type value accuracy 43.3447265625 type value f1 40.08400146827895 type value f1_weighted 40.08499428040896 type value main_score 43.3447265625 type Classification dataset metrics task config name revision split type ace_Arab-rus_Cyrl MTEB FloresBitextMining (ace_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 6.225296442687747 type value f1 5.5190958860075 type value main_score 5.5190958860075 type value precision 5.3752643758000005 type value recall 6.225296442687747 type BitextMining dataset metrics task config name revision split type bam_Latn-rus_Cyrl MTEB FloresBitextMining (bam_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 68.37944664031622 type value f1 64.54819836666252 type value main_score 64.54819836666252 type value precision 63.07479233454916 type value recall 68.37944664031622 type BitextMining dataset metrics task config name revision split type dzo_Tibt-rus_Cyrl MTEB FloresBitextMining (dzo_Tibt-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 0.09881422924901186 type value f1 0.00019509225912934226 type value main_score 0.00019509225912934226 type value precision 9.76425190207627e-05 type value recall 0.09881422924901186 type BitextMining dataset metrics task config name revision split type hin_Deva-rus_Cyrl MTEB FloresBitextMining (hin_Deva-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.60474308300395 type value f1 99.47299077733861 type value main_score 99.47299077733861 type value precision 99.40711462450594 type value recall 99.60474308300395 type BitextMining dataset metrics task config name revision split type khm_Khmr-rus_Cyrl MTEB FloresBitextMining (khm_Khmr-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 88.83399209486166 type value f1 87.71151056318254 type value main_score 87.71151056318254 type value precision 87.32012500709193 type value recall 88.83399209486166 type BitextMining dataset metrics task config name revision split type mag_Deva-rus_Cyrl MTEB FloresBitextMining (mag_Deva-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.02371541501977 type value f1 97.7239789196311 type value main_score 97.7239789196311 type value precision 97.61904761904762 type value recall 98.02371541501977 type BitextMining dataset metrics task config name revision split type pap_Latn-rus_Cyrl MTEB FloresBitextMining (pap_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 94.0711462450593 type value f1 93.68187806922984 type value main_score 93.68187806922984 type value precision 93.58925452707051 type value recall 94.0711462450593 type BitextMining dataset metrics task config name revision split type sot_Latn-rus_Cyrl MTEB FloresBitextMining (sot_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 90.9090909090909 type value f1 89.23171936758892 type value main_score 89.23171936758892 type value precision 88.51790014083866 type value recall 90.9090909090909 type BitextMining dataset metrics task config name revision split type tur_Latn-rus_Cyrl MTEB FloresBitextMining (tur_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.2094861660079 type value f1 98.9459815546772 type value main_score 98.9459815546772 type value precision 98.81422924901186 type value recall 99.2094861660079 type BitextMining dataset metrics task config name revision split type ace_Latn-rus_Cyrl MTEB FloresBitextMining (ace_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 66.10671936758892 type value f1 63.81888256297873 type value main_score 63.81888256297873 type value precision 63.01614067933451 type value recall 66.10671936758892 type BitextMining dataset metrics task config name revision split type ban_Latn-rus_Cyrl MTEB FloresBitextMining (ban_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 79.44664031620553 type value f1 77.6311962082713 type value main_score 77.6311962082713 type value precision 76.93977931929739 type value recall 79.44664031620553 type BitextMining dataset metrics task config name revision split type ell_Grek-rus_Cyrl MTEB FloresBitextMining (ell_Grek-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.40711462450594 type value f1 99.2094861660079 type value main_score 99.2094861660079 type value precision 99.1106719367589 type value recall 99.40711462450594 type BitextMining dataset metrics task config name revision split type hne_Deva-rus_Cyrl MTEB FloresBitextMining (hne_Deva-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 96.83794466403161 type value f1 96.25352907961603 type value main_score 96.25352907961603 type value precision 96.02155091285526 type value recall 96.83794466403161 type BitextMining dataset metrics task config name revision split type kik_Latn-rus_Cyrl MTEB FloresBitextMining (kik_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 76.28458498023716 type value f1 73.5596919895859 type value main_score 73.5596919895859 type value precision 72.40900759055246 type value recall 76.28458498023716 type BitextMining dataset metrics task config name revision split type mai_Deva-rus_Cyrl MTEB FloresBitextMining (mai_Deva-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.72727272727273 type value f1 97.37812911725956 type value main_score 97.37812911725956 type value precision 97.26002258610953 type value recall 97.72727272727273 type BitextMining dataset metrics task config name revision split type pbt_Arab-rus_Cyrl MTEB FloresBitextMining (pbt_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 94.0711462450593 type value f1 93.34700387331966 type value main_score 93.34700387331966 type value precision 93.06920556920556 type value recall 94.0711462450593 type BitextMining dataset metrics task config name revision split type spa_Latn-rus_Cyrl MTEB FloresBitextMining (spa_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.2094861660079 type value f1 98.9459815546772 type value main_score 98.9459815546772 type value precision 98.81422924901186 type value recall 99.2094861660079 type BitextMining dataset metrics task config name revision split type twi_Latn-rus_Cyrl MTEB FloresBitextMining (twi_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 80.73122529644269 type value f1 77.77434363246721 type value main_score 77.77434363246721 type value precision 76.54444287596462 type value recall 80.73122529644269 type BitextMining dataset metrics task config name revision split type acm_Arab-rus_Cyrl MTEB FloresBitextMining (acm_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 94.56521739130434 type value f1 92.92490118577075 type value main_score 92.92490118577075 type value precision 92.16897233201581 type value recall 94.56521739130434 type BitextMining dataset metrics task config name revision split type bel_Cyrl-rus_Cyrl MTEB FloresBitextMining (bel_Cyrl-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.2094861660079 type value f1 98.98550724637681 type value main_score 98.98550724637681 type value precision 98.88833992094862 type value recall 99.2094861660079 type BitextMining dataset metrics task config name revision split type eng_Latn-rus_Cyrl MTEB FloresBitextMining (eng_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.60474308300395 type value f1 99.4729907773386 type value main_score 99.4729907773386 type value precision 99.40711462450594 type value recall 99.60474308300395 type BitextMining dataset metrics task config name revision split type hrv_Latn-rus_Cyrl MTEB FloresBitextMining (hrv_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.2094861660079 type value f1 99.05138339920948 type value main_score 99.05138339920948 type value precision 99.00691699604744 type value recall 99.2094861660079 type BitextMining dataset metrics task config name revision split type kin_Latn-rus_Cyrl MTEB FloresBitextMining (kin_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 88.2411067193676 type value f1 86.5485246227658 type value main_score 86.5485246227658 type value precision 85.90652101521667 type value recall 88.2411067193676 type BitextMining dataset metrics task config name revision split type mal_Mlym-rus_Cyrl MTEB FloresBitextMining (mal_Mlym-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.51778656126481 type value f1 98.07971014492753 type value main_score 98.07971014492753 type value precision 97.88372859025033 type value recall 98.51778656126481 type BitextMining dataset metrics task config name revision split type pes_Arab-rus_Cyrl MTEB FloresBitextMining (pes_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.51778656126481 type value f1 98.0566534914361 type value main_score 98.0566534914361 type value precision 97.82608695652173 type value recall 98.51778656126481 type BitextMining dataset metrics task config name revision split type srd_Latn-rus_Cyrl MTEB FloresBitextMining (srd_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 82.6086956521739 type value f1 80.9173470979821 type value main_score 80.9173470979821 type value precision 80.24468672882627 type value recall 82.6086956521739 type BitextMining dataset metrics task config name revision split type tzm_Tfng-rus_Cyrl MTEB FloresBitextMining (tzm_Tfng-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 7.41106719367589 type value f1 6.363562740945329 type value main_score 6.363562740945329 type value precision 6.090373175353411 type value recall 7.41106719367589 type BitextMining dataset metrics task config name revision split type acq_Arab-rus_Cyrl MTEB FloresBitextMining (acq_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 95.25691699604744 type value f1 93.81422924901187 type value main_score 93.81422924901187 type value precision 93.14064558629775 type value recall 95.25691699604744 type BitextMining dataset metrics task config name revision split type bem_Latn-rus_Cyrl MTEB FloresBitextMining (bem_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 68.08300395256917 type value f1 65.01368772860867 type value main_score 65.01368772860867 type value precision 63.91052337510628 type value recall 68.08300395256917 type BitextMining dataset metrics task config name revision split type epo_Latn-rus_Cyrl MTEB FloresBitextMining (epo_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.41897233201581 type value f1 98.17193675889328 type value main_score 98.17193675889328 type value precision 98.08210564139418 type value recall 98.41897233201581 type BitextMining dataset metrics task config name revision split type hun_Latn-rus_Cyrl MTEB FloresBitextMining (hun_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.30830039525692 type value f1 99.1106719367589 type value main_score 99.1106719367589 type value precision 99.01185770750988 type value recall 99.30830039525692 type BitextMining dataset metrics task config name revision split type kir_Cyrl-rus_Cyrl MTEB FloresBitextMining (kir_Cyrl-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.5296442687747 type value f1 97.07549806364035 type value main_score 97.07549806364035 type value precision 96.90958498023716 type value recall 97.5296442687747 type BitextMining dataset metrics task config name revision split type mar_Deva-rus_Cyrl MTEB FloresBitextMining (mar_Deva-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.82608695652173 type value f1 97.44400527009222 type value main_score 97.44400527009222 type value precision 97.28966685488425 type value recall 97.82608695652173 type BitextMining dataset metrics task config name revision split type plt_Latn-rus_Cyrl MTEB FloresBitextMining (plt_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 79.9407114624506 type value f1 78.3154177760691 type value main_score 78.3154177760691 type value precision 77.69877344877344 type value recall 79.9407114624506 type BitextMining dataset metrics task config name revision split type srp_Cyrl-rus_Cyrl MTEB FloresBitextMining (srp_Cyrl-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.70355731225297 type value f1 99.60474308300395 type value main_score 99.60474308300395 type value precision 99.55533596837944 type value recall 99.70355731225297 type BitextMining dataset metrics task config name revision split type uig_Arab-rus_Cyrl MTEB FloresBitextMining (uig_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 83.20158102766798 type value f1 81.44381923034585 type value main_score 81.44381923034585 type value precision 80.78813411582477 type value recall 83.20158102766798 type BitextMining dataset metrics task config name revision split type aeb_Arab-rus_Cyrl MTEB FloresBitextMining (aeb_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 91.20553359683794 type value f1 88.75352907961603 type value main_score 88.75352907961603 type value precision 87.64328063241106 type value recall 91.20553359683794 type BitextMining dataset metrics task config name revision split type ben_Beng-rus_Cyrl MTEB FloresBitextMining (ben_Beng-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.91304347826086 type value f1 98.60671936758894 type value main_score 98.60671936758894 type value precision 98.4766139657444 type value recall 98.91304347826086 type BitextMining dataset metrics task config name revision split type est_Latn-rus_Cyrl MTEB FloresBitextMining (est_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 96.24505928853755 type value f1 95.27417027417027 type value main_score 95.27417027417027 type value precision 94.84107378129117 type value recall 96.24505928853755 type BitextMining dataset metrics task config name revision split type hye_Armn-rus_Cyrl MTEB FloresBitextMining (hye_Armn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.02371541501977 type value f1 97.67786561264822 type value main_score 97.67786561264822 type value precision 97.55839022637441 type value recall 98.02371541501977 type BitextMining dataset metrics task config name revision split type kmb_Latn-rus_Cyrl MTEB FloresBitextMining (kmb_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 46.047430830039524 type value f1 42.94464804804471 type value main_score 42.94464804804471 type value precision 41.9851895607238 type value recall 46.047430830039524 type BitextMining dataset metrics task config name revision split type min_Arab-rus_Cyrl MTEB FloresBitextMining (min_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 3.9525691699604746 type value f1 3.402665192725756 type value main_score 3.402665192725756 type value precision 3.303787557740127 type value recall 3.9525691699604746 type BitextMining dataset metrics task config name revision split type pol_Latn-rus_Cyrl MTEB FloresBitextMining (pol_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.60474308300395 type value f1 99.4729907773386 type value main_score 99.4729907773386 type value precision 99.40711462450594 type value recall 99.60474308300395 type BitextMining dataset metrics task config name revision split type ssw_Latn-rus_Cyrl MTEB FloresBitextMining (ssw_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 73.22134387351778 type value f1 70.43086049508975 type value main_score 70.43086049508975 type value precision 69.35312022355656 type value recall 73.22134387351778 type BitextMining dataset metrics task config name revision split type ukr_Cyrl-rus_Cyrl MTEB FloresBitextMining (ukr_Cyrl-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.90118577075098 type value f1 99.86824769433464 type value main_score 99.86824769433464 type value precision 99.85177865612648 type value recall 99.90118577075098 type BitextMining dataset metrics task config name revision split type afr_Latn-rus_Cyrl MTEB FloresBitextMining (afr_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.2094861660079 type value f1 98.9459815546772 type value main_score 98.9459815546772 type value precision 98.81422924901186 type value recall 99.2094861660079 type BitextMining dataset metrics task config name revision split type bho_Deva-rus_Cyrl MTEB FloresBitextMining (bho_Deva-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 94.0711462450593 type value f1 93.12182382834557 type value main_score 93.12182382834557 type value precision 92.7523453232338 type value recall 94.0711462450593 type BitextMining dataset metrics task config name revision split type eus_Latn-rus_Cyrl MTEB FloresBitextMining (eus_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 92.19367588932806 type value f1 91.23604975587072 type value main_score 91.23604975587072 type value precision 90.86697443588663 type value recall 92.19367588932806 type BitextMining dataset metrics task config name revision split type ibo_Latn-rus_Cyrl MTEB FloresBitextMining (ibo_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 82.21343873517787 type value f1 80.17901604858126 type value main_score 80.17901604858126 type value precision 79.3792284780028 type value recall 82.21343873517787 type BitextMining dataset metrics task config name revision split type kmr_Latn-rus_Cyrl MTEB FloresBitextMining (kmr_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 68.67588932806325 type value f1 66.72311714750278 type value main_score 66.72311714750278 type value precision 66.00178401554004 type value recall 68.67588932806325 type BitextMining dataset metrics task config name revision split type min_Latn-rus_Cyrl MTEB FloresBitextMining (min_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 78.65612648221344 type value f1 76.26592719972166 type value main_score 76.26592719972166 type value precision 75.39980459997484 type value recall 78.65612648221344 type BitextMining dataset metrics task config name revision split type por_Latn-rus_Cyrl MTEB FloresBitextMining (por_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 96.83794466403161 type value f1 95.9669678147939 type value main_score 95.9669678147939 type value precision 95.59453227931488 type value recall 96.83794466403161 type BitextMining dataset metrics task config name revision split type sun_Latn-rus_Cyrl MTEB FloresBitextMining (sun_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 92.4901185770751 type value f1 91.66553983773662 type value main_score 91.66553983773662 type value precision 91.34530928009188 type value recall 92.4901185770751 type BitextMining dataset metrics task config name revision split type umb_Latn-rus_Cyrl MTEB FloresBitextMining (umb_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 41.00790513833992 type value f1 38.21319326004483 type value main_score 38.21319326004483 type value precision 37.200655467675546 type value recall 41.00790513833992 type BitextMining dataset metrics task config name revision split type ajp_Arab-rus_Cyrl MTEB FloresBitextMining (ajp_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 95.35573122529645 type value f1 93.97233201581028 type value main_score 93.97233201581028 type value precision 93.33333333333333 type value recall 95.35573122529645 type BitextMining dataset metrics task config name revision split type bjn_Arab-rus_Cyrl MTEB FloresBitextMining (bjn_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 3.6561264822134385 type value f1 3.1071978056336484 type value main_score 3.1071978056336484 type value precision 3.0039741229718215 type value recall 3.6561264822134385 type BitextMining dataset metrics task config name revision split type ewe_Latn-rus_Cyrl MTEB FloresBitextMining (ewe_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 62.845849802371546 type value f1 59.82201175670472 type value main_score 59.82201175670472 type value precision 58.72629236362003 type value recall 62.845849802371546 type BitextMining dataset metrics task config name revision split type ilo_Latn-rus_Cyrl MTEB FloresBitextMining (ilo_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 83.10276679841897 type value f1 80.75065288987582 type value main_score 80.75065288987582 type value precision 79.80726451662179 type value recall 83.10276679841897 type BitextMining dataset metrics task config name revision split type knc_Arab-rus_Cyrl MTEB FloresBitextMining (knc_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 10.079051383399209 type value f1 8.759282456080921 type value main_score 8.759282456080921 type value precision 8.474735138956142 type value recall 10.079051383399209 type BitextMining dataset metrics task config name revision split type mkd_Cyrl-rus_Cyrl MTEB FloresBitextMining (mkd_Cyrl-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.91304347826086 type value f1 98.55072463768116 type value main_score 98.55072463768116 type value precision 98.36956521739131 type value recall 98.91304347826086 type BitextMining dataset metrics task config name revision split type prs_Arab-rus_Cyrl MTEB FloresBitextMining (prs_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.01185770750988 type value f1 98.68247694334651 type value main_score 98.68247694334651 type value precision 98.51778656126481 type value recall 99.01185770750988 type BitextMining dataset metrics task config name revision split type swe_Latn-rus_Cyrl MTEB FloresBitextMining (swe_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.40711462450594 type value f1 99.22595520421606 type value main_score 99.22595520421606 type value precision 99.14361001317523 type value recall 99.40711462450594 type BitextMining dataset metrics task config name revision split type urd_Arab-rus_Cyrl MTEB FloresBitextMining (urd_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.82608695652173 type value f1 97.25625823451911 type value main_score 97.25625823451911 type value precision 97.03063241106719 type value recall 97.82608695652173 type BitextMining dataset metrics task config name revision split type aka_Latn-rus_Cyrl MTEB FloresBitextMining (aka_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 81.22529644268775 type value f1 77.94307687941227 type value main_score 77.94307687941227 type value precision 76.58782793293665 type value recall 81.22529644268775 type BitextMining dataset metrics task config name revision split type bjn_Latn-rus_Cyrl MTEB FloresBitextMining (bjn_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 85.27667984189723 type value f1 83.6869192829922 type value main_score 83.6869192829922 type value precision 83.08670670691656 type value recall 85.27667984189723 type BitextMining dataset metrics task config name revision split type fao_Latn-rus_Cyrl MTEB FloresBitextMining (fao_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 80.9288537549407 type value f1 79.29806087454745 type value main_score 79.29806087454745 type value precision 78.71445871526987 type value recall 80.9288537549407 type BitextMining dataset metrics task config name revision split type ind_Latn-rus_Cyrl MTEB FloresBitextMining (ind_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.12252964426878 type value f1 97.5296442687747 type value main_score 97.5296442687747 type value precision 97.23320158102767 type value recall 98.12252964426878 type BitextMining dataset metrics task config name revision split type knc_Latn-rus_Cyrl MTEB FloresBitextMining (knc_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 33.49802371541502 type value f1 32.02378215033989 type value main_score 32.02378215033989 type value precision 31.511356103747406 type value recall 33.49802371541502 type BitextMining dataset metrics task config name revision split type mlt_Latn-rus_Cyrl MTEB FloresBitextMining (mlt_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 91.40316205533597 type value f1 90.35317684386006 type value main_score 90.35317684386006 type value precision 89.94845939633488 type value recall 91.40316205533597 type BitextMining dataset metrics task config name revision split type quy_Latn-rus_Cyrl MTEB FloresBitextMining (quy_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 40.612648221343875 type value f1 38.74337544712602 type value main_score 38.74337544712602 type value precision 38.133716022178575 type value recall 40.612648221343875 type BitextMining dataset metrics task config name revision split type swh_Latn-rus_Cyrl MTEB FloresBitextMining (swh_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.13438735177866 type value f1 96.47435897435898 type value main_score 96.47435897435898 type value precision 96.18741765480895 type value recall 97.13438735177866 type BitextMining dataset metrics task config name revision split type uzn_Latn-rus_Cyrl MTEB FloresBitextMining (uzn_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 96.83794466403161 type value f1 96.26355528529442 type value main_score 96.26355528529442 type value precision 96.0501756697409 type value recall 96.83794466403161 type BitextMining dataset metrics task config name revision split type als_Latn-rus_Cyrl MTEB FloresBitextMining (als_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.91304347826086 type value f1 98.6907114624506 type value main_score 98.6907114624506 type value precision 98.6142480707698 type value recall 98.91304347826086 type BitextMining dataset metrics task config name revision split type bod_Tibt-rus_Cyrl MTEB FloresBitextMining (bod_Tibt-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 1.0869565217391304 type value f1 0.9224649610442628 type value main_score 0.9224649610442628 type value precision 0.8894275740459898 type value recall 1.0869565217391304 type BitextMining dataset metrics task config name revision split type fij_Latn-rus_Cyrl MTEB FloresBitextMining (fij_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 63.24110671936759 type value f1 60.373189068189525 type value main_score 60.373189068189525 type value precision 59.32326368115546 type value recall 63.24110671936759 type BitextMining dataset metrics task config name revision split type isl_Latn-rus_Cyrl MTEB FloresBitextMining (isl_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 89.03162055335969 type value f1 87.3102634715907 type value main_score 87.3102634715907 type value precision 86.65991814698712 type value recall 89.03162055335969 type BitextMining dataset metrics task config name revision split type kon_Latn-rus_Cyrl MTEB FloresBitextMining (kon_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 73.91304347826086 type value f1 71.518235523573 type value main_score 71.518235523573 type value precision 70.58714102449801 type value recall 73.91304347826086 type BitextMining dataset metrics task config name revision split type mni_Beng-rus_Cyrl MTEB FloresBitextMining (mni_Beng-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 29.545454545454547 type value f1 27.59513619889114 type value main_score 27.59513619889114 type value precision 26.983849851025344 type value recall 29.545454545454547 type BitextMining dataset metrics task config name revision split type ron_Latn-rus_Cyrl MTEB FloresBitextMining (ron_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.40711462450594 type value f1 99.2094861660079 type value main_score 99.2094861660079 type value precision 99.1106719367589 type value recall 99.40711462450594 type BitextMining dataset metrics task config name revision split type szl_Latn-rus_Cyrl MTEB FloresBitextMining (szl_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 86.26482213438736 type value f1 85.18912031587512 type value main_score 85.18912031587512 type value precision 84.77199409959775 type value recall 86.26482213438736 type BitextMining dataset metrics task config name revision split type vec_Latn-rus_Cyrl MTEB FloresBitextMining (vec_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 85.67193675889328 type value f1 84.62529734716581 type value main_score 84.62529734716581 type value precision 84.2611422440705 type value recall 85.67193675889328 type BitextMining dataset metrics task config name revision split type amh_Ethi-rus_Cyrl MTEB FloresBitextMining (amh_Ethi-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 94.76284584980237 type value f1 93.91735076517685 type value main_score 93.91735076517685 type value precision 93.57553798858147 type value recall 94.76284584980237 type BitextMining dataset metrics task config name revision split type bos_Latn-rus_Cyrl MTEB FloresBitextMining (bos_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.2094861660079 type value f1 99.05655938264634 type value main_score 99.05655938264634 type value precision 99.01185770750988 type value recall 99.2094861660079 type BitextMining dataset metrics task config name revision split type fin_Latn-rus_Cyrl MTEB FloresBitextMining (fin_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.02371541501977 type value f1 97.43741765480895 type value main_score 97.43741765480895 type value precision 97.1590909090909 type value recall 98.02371541501977 type BitextMining dataset metrics task config name revision split type ita_Latn-rus_Cyrl MTEB FloresBitextMining (ita_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.70355731225297 type value f1 99.60474308300395 type value main_score 99.60474308300395 type value precision 99.55533596837944 type value recall 99.70355731225297 type BitextMining dataset metrics task config name revision split type kor_Hang-rus_Cyrl MTEB FloresBitextMining (kor_Hang-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.33201581027669 type value f1 96.49868247694334 type value main_score 96.49868247694334 type value precision 96.10507246376811 type value recall 97.33201581027669 type BitextMining dataset metrics task config name revision split type mos_Latn-rus_Cyrl MTEB FloresBitextMining (mos_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 34.683794466403164 type value f1 32.766819308009076 type value main_score 32.766819308009076 type value precision 32.1637493670237 type value recall 34.683794466403164 type BitextMining dataset metrics task config name revision split type run_Latn-rus_Cyrl MTEB FloresBitextMining (run_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 83.399209486166 type value f1 81.10578750604326 type value main_score 81.10578750604326 type value precision 80.16763162673529 type value recall 83.399209486166 type BitextMining dataset metrics task config name revision split type tam_Taml-rus_Cyrl MTEB FloresBitextMining (tam_Taml-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.41897233201581 type value f1 98.01548089591567 type value main_score 98.01548089591567 type value precision 97.84020327498588 type value recall 98.41897233201581 type BitextMining dataset metrics task config name revision split type vie_Latn-rus_Cyrl MTEB FloresBitextMining (vie_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.1106719367589 type value f1 98.81422924901186 type value main_score 98.81422924901186 type value precision 98.66600790513834 type value recall 99.1106719367589 type BitextMining dataset metrics task config name revision split type apc_Arab-rus_Cyrl MTEB FloresBitextMining (apc_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 93.87351778656127 type value f1 92.10803689064558 type value main_score 92.10803689064558 type value precision 91.30434782608695 type value recall 93.87351778656127 type BitextMining dataset metrics task config name revision split type bug_Latn-rus_Cyrl MTEB FloresBitextMining (bug_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 57.608695652173914 type value f1 54.95878654927162 type value main_score 54.95878654927162 type value precision 54.067987427805654 type value recall 57.608695652173914 type BitextMining dataset metrics task config name revision split type fon_Latn-rus_Cyrl MTEB FloresBitextMining (fon_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 61.95652173913043 type value f1 58.06537275812945 type value main_score 58.06537275812945 type value precision 56.554057596959204 type value recall 61.95652173913043 type BitextMining dataset metrics task config name revision split type jav_Latn-rus_Cyrl MTEB FloresBitextMining (jav_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 93.47826086956522 type value f1 92.4784405318002 type value main_score 92.4784405318002 type value precision 92.09168143201127 type value recall 93.47826086956522 type BitextMining dataset metrics task config name revision split type lao_Laoo-rus_Cyrl MTEB FloresBitextMining (lao_Laoo-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 91.10671936758892 type value f1 89.76104922745239 type value main_score 89.76104922745239 type value precision 89.24754593232855 type value recall 91.10671936758892 type BitextMining dataset metrics task config name revision split type mri_Latn-rus_Cyrl MTEB FloresBitextMining (mri_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 71.14624505928853 type value f1 68.26947125119062 type value main_score 68.26947125119062 type value precision 67.15942311051006 type value recall 71.14624505928853 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ace_Arab MTEB FloresBitextMining (rus_Cyrl-ace_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 19.565217391304348 type value f1 16.321465000323805 type value main_score 16.321465000323805 type value precision 15.478527409347508 type value recall 19.565217391304348 type BitextMining dataset metrics task config name revision split type rus_Cyrl-bam_Latn MTEB FloresBitextMining (rus_Cyrl-bam_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 73.41897233201581 type value f1 68.77366228182746 type value main_score 68.77366228182746 type value precision 66.96012924273795 type value recall 73.41897233201581 type BitextMining dataset metrics task config name revision split type rus_Cyrl-dzo_Tibt MTEB FloresBitextMining (rus_Cyrl-dzo_Tibt) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 0.592885375494071 type value f1 0.02458062426370458 type value main_score 0.02458062426370458 type value precision 0.012824114724683876 type value recall 0.592885375494071 type BitextMining dataset metrics task config name revision split type rus_Cyrl-hin_Deva MTEB FloresBitextMining (rus_Cyrl-hin_Deva) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.90118577075098 type value f1 99.86824769433464 type value main_score 99.86824769433464 type value precision 99.85177865612648 type value recall 99.90118577075098 type BitextMining dataset metrics task config name revision split type rus_Cyrl-khm_Khmr MTEB FloresBitextMining (rus_Cyrl-khm_Khmr) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.13438735177866 type value f1 96.24505928853755 type value main_score 96.24505928853755 type value precision 95.81686429512516 type value recall 97.13438735177866 type BitextMining dataset metrics task config name revision split type rus_Cyrl-mag_Deva MTEB FloresBitextMining (rus_Cyrl-mag_Deva) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.50592885375494 type value f1 99.35770750988142 type value main_score 99.35770750988142 type value precision 99.29183135704875 type value recall 99.50592885375494 type BitextMining dataset metrics task config name revision split type rus_Cyrl-pap_Latn MTEB FloresBitextMining (rus_Cyrl-pap_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 96.93675889328063 type value f1 96.05072463768116 type value main_score 96.05072463768116 type value precision 95.66040843214758 type value recall 96.93675889328063 type BitextMining dataset metrics task config name revision split type rus_Cyrl-sot_Latn MTEB FloresBitextMining (rus_Cyrl-sot_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 93.67588932806325 type value f1 91.7786561264822 type value main_score 91.7786561264822 type value precision 90.91238471673255 type value recall 93.67588932806325 type BitextMining dataset metrics task config name revision split type rus_Cyrl-tur_Latn MTEB FloresBitextMining (rus_Cyrl-tur_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.01185770750988 type value f1 98.68247694334651 type value main_score 98.68247694334651 type value precision 98.51778656126481 type value recall 99.01185770750988 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ace_Latn MTEB FloresBitextMining (rus_Cyrl-ace_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 74.1106719367589 type value f1 70.21737923911836 type value main_score 70.21737923911836 type value precision 68.7068791410511 type value recall 74.1106719367589 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ban_Latn MTEB FloresBitextMining (rus_Cyrl-ban_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 81.7193675889328 type value f1 78.76470334510617 type value main_score 78.76470334510617 type value precision 77.76208475761422 type value recall 81.7193675889328 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ell_Grek MTEB FloresBitextMining (rus_Cyrl-ell_Grek) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.3201581027668 type value f1 97.76021080368908 type value main_score 97.76021080368908 type value precision 97.48023715415019 type value recall 98.3201581027668 type BitextMining dataset metrics task config name revision split type rus_Cyrl-hne_Deva MTEB FloresBitextMining (rus_Cyrl-hne_Deva) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.51778656126481 type value f1 98.0566534914361 type value main_score 98.0566534914361 type value precision 97.82608695652173 type value recall 98.51778656126481 type BitextMining dataset metrics task config name revision split type rus_Cyrl-kik_Latn MTEB FloresBitextMining (rus_Cyrl-kik_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 80.73122529644269 type value f1 76.42689244220864 type value main_score 76.42689244220864 type value precision 74.63877909530083 type value recall 80.73122529644269 type BitextMining dataset metrics task config name revision split type rus_Cyrl-mai_Deva MTEB FloresBitextMining (rus_Cyrl-mai_Deva) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.91304347826086 type value f1 98.56719367588933 type value main_score 98.56719367588933 type value precision 98.40250329380763 type value recall 98.91304347826086 type BitextMining dataset metrics task config name revision split type rus_Cyrl-pbt_Arab MTEB FloresBitextMining (rus_Cyrl-pbt_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.5296442687747 type value f1 96.73913043478261 type value main_score 96.73913043478261 type value precision 96.36034255599473 type value recall 97.5296442687747 type BitextMining dataset metrics task config name revision split type rus_Cyrl-spa_Latn MTEB FloresBitextMining (rus_Cyrl-spa_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.40711462450594 type value f1 99.20948616600789 type value main_score 99.20948616600789 type value precision 99.1106719367589 type value recall 99.40711462450594 type BitextMining dataset metrics task config name revision split type rus_Cyrl-twi_Latn MTEB FloresBitextMining (rus_Cyrl-twi_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 82.01581027667984 type value f1 78.064787822953 type value main_score 78.064787822953 type value precision 76.43272186750448 type value recall 82.01581027667984 type BitextMining dataset metrics task config name revision split type rus_Cyrl-acm_Arab MTEB FloresBitextMining (rus_Cyrl-acm_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.3201581027668 type value f1 97.76021080368908 type value main_score 97.76021080368908 type value precision 97.48023715415019 type value recall 98.3201581027668 type BitextMining dataset metrics task config name revision split type rus_Cyrl-bel_Cyrl MTEB FloresBitextMining (rus_Cyrl-bel_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.22134387351778 type value f1 97.67786561264822 type value main_score 97.67786561264822 type value precision 97.4308300395257 type value recall 98.22134387351778 type BitextMining dataset metrics task config name revision split type rus_Cyrl-eng_Latn MTEB FloresBitextMining (rus_Cyrl-eng_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.70355731225297 type value f1 99.60474308300395 type value main_score 99.60474308300395 type value precision 99.55533596837944 type value recall 99.70355731225297 type BitextMining dataset metrics task config name revision split type rus_Cyrl-hrv_Latn MTEB FloresBitextMining (rus_Cyrl-hrv_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.1106719367589 type value f1 98.83069828722002 type value main_score 98.83069828722002 type value precision 98.69894598155466 type value recall 99.1106719367589 type BitextMining dataset metrics task config name revision split type rus_Cyrl-kin_Latn MTEB FloresBitextMining (rus_Cyrl-kin_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 93.37944664031622 type value f1 91.53162055335969 type value main_score 91.53162055335969 type value precision 90.71475625823452 type value recall 93.37944664031622 type BitextMining dataset metrics task config name revision split type rus_Cyrl-mal_Mlym MTEB FloresBitextMining (rus_Cyrl-mal_Mlym) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.30830039525692 type value f1 99.07773386034255 type value main_score 99.07773386034255 type value precision 98.96245059288538 type value recall 99.30830039525692 type BitextMining dataset metrics task config name revision split type rus_Cyrl-pes_Arab MTEB FloresBitextMining (rus_Cyrl-pes_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.71541501976284 type value f1 98.30368906455863 type value main_score 98.30368906455863 type value precision 98.10606060606061 type value recall 98.71541501976284 type BitextMining dataset metrics task config name revision split type rus_Cyrl-srd_Latn MTEB FloresBitextMining (rus_Cyrl-srd_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 89.03162055335969 type value f1 86.11048371917937 type value main_score 86.11048371917937 type value precision 84.86001317523056 type value recall 89.03162055335969 type BitextMining dataset metrics task config name revision split type rus_Cyrl-tzm_Tfng MTEB FloresBitextMining (rus_Cyrl-tzm_Tfng) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 12.351778656126482 type value f1 10.112177999067715 type value main_score 10.112177999067715 type value precision 9.53495885438645 type value recall 12.351778656126482 type BitextMining dataset metrics task config name revision split type rus_Cyrl-acq_Arab MTEB FloresBitextMining (rus_Cyrl-acq_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.91304347826086 type value f1 98.55072463768116 type value main_score 98.55072463768116 type value precision 98.36956521739131 type value recall 98.91304347826086 type BitextMining dataset metrics task config name revision split type rus_Cyrl-bem_Latn MTEB FloresBitextMining (rus_Cyrl-bem_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 73.22134387351778 type value f1 68.30479412989295 type value main_score 68.30479412989295 type value precision 66.40073447632736 type value recall 73.22134387351778 type BitextMining dataset metrics task config name revision split type rus_Cyrl-epo_Latn MTEB FloresBitextMining (rus_Cyrl-epo_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.1106719367589 type value f1 98.81422924901186 type value main_score 98.81422924901186 type value precision 98.66600790513834 type value recall 99.1106719367589 type BitextMining dataset metrics task config name revision split type rus_Cyrl-hun_Latn MTEB FloresBitextMining (rus_Cyrl-hun_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 96.83794466403161 type value f1 95.88274044795784 type value main_score 95.88274044795784 type value precision 95.45454545454545 type value recall 96.83794466403161 type BitextMining dataset metrics task config name revision split type rus_Cyrl-kir_Cyrl MTEB FloresBitextMining (rus_Cyrl-kir_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 96.34387351778656 type value f1 95.49280429715212 type value main_score 95.49280429715212 type value precision 95.14163372859026 type value recall 96.34387351778656 type BitextMining dataset metrics task config name revision split type rus_Cyrl-mar_Deva MTEB FloresBitextMining (rus_Cyrl-mar_Deva) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.71541501976284 type value f1 98.28722002635047 type value main_score 98.28722002635047 type value precision 98.07312252964427 type value recall 98.71541501976284 type BitextMining dataset metrics task config name revision split type rus_Cyrl-plt_Latn MTEB FloresBitextMining (rus_Cyrl-plt_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 88.04347826086956 type value f1 85.14328063241106 type value main_score 85.14328063241106 type value precision 83.96339168078298 type value recall 88.04347826086956 type BitextMining dataset metrics task config name revision split type rus_Cyrl-srp_Cyrl MTEB FloresBitextMining (rus_Cyrl-srp_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.40711462450594 type value f1 99.2094861660079 type value main_score 99.2094861660079 type value precision 99.1106719367589 type value recall 99.40711462450594 type BitextMining dataset metrics task config name revision split type rus_Cyrl-uig_Arab MTEB FloresBitextMining (rus_Cyrl-uig_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 92.19367588932806 type value f1 89.98541313758706 type value main_score 89.98541313758706 type value precision 89.01021080368906 type value recall 92.19367588932806 type BitextMining dataset metrics task config name revision split type rus_Cyrl-aeb_Arab MTEB FloresBitextMining (rus_Cyrl-aeb_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 95.8498023715415 type value f1 94.63109354413703 type value main_score 94.63109354413703 type value precision 94.05467720685111 type value recall 95.8498023715415 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ben_Beng MTEB FloresBitextMining (rus_Cyrl-ben_Beng) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.40711462450594 type value f1 99.2094861660079 type value main_score 99.2094861660079 type value precision 99.1106719367589 type value recall 99.40711462450594 type BitextMining dataset metrics task config name revision split type rus_Cyrl-est_Latn MTEB FloresBitextMining (rus_Cyrl-est_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 95.55335968379447 type value f1 94.2588932806324 type value main_score 94.2588932806324 type value precision 93.65118577075098 type value recall 95.55335968379447 type BitextMining dataset metrics task config name revision split type rus_Cyrl-hye_Armn MTEB FloresBitextMining (rus_Cyrl-hye_Armn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.71541501976284 type value f1 98.28722002635045 type value main_score 98.28722002635045 type value precision 98.07312252964427 type value recall 98.71541501976284 type BitextMining dataset metrics task config name revision split type rus_Cyrl-kmb_Latn MTEB FloresBitextMining (rus_Cyrl-kmb_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 54.24901185770751 type value f1 49.46146674116913 type value main_score 49.46146674116913 type value precision 47.81033799314432 type value recall 54.24901185770751 type BitextMining dataset metrics task config name revision split type rus_Cyrl-min_Arab MTEB FloresBitextMining (rus_Cyrl-min_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 15.810276679841898 type value f1 13.271207641419332 type value main_score 13.271207641419332 type value precision 12.510673148766033 type value recall 15.810276679841898 type BitextMining dataset metrics task config name revision split type rus_Cyrl-pol_Latn MTEB FloresBitextMining (rus_Cyrl-pol_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.71541501976284 type value f1 98.32674571805006 type value main_score 98.32674571805006 type value precision 98.14723320158103 type value recall 98.71541501976284 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ssw_Latn MTEB FloresBitextMining (rus_Cyrl-ssw_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 80.8300395256917 type value f1 76.51717847370023 type value main_score 76.51717847370023 type value precision 74.74143610013175 type value recall 80.8300395256917 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ukr_Cyrl MTEB FloresBitextMining (rus_Cyrl-ukr_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.60474308300395 type value f1 99.4729907773386 type value main_score 99.4729907773386 type value precision 99.40711462450594 type value recall 99.60474308300395 type BitextMining dataset metrics task config name revision split type rus_Cyrl-afr_Latn MTEB FloresBitextMining (rus_Cyrl-afr_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.1106719367589 type value f1 98.81422924901186 type value main_score 98.81422924901186 type value precision 98.66600790513834 type value recall 99.1106719367589 type BitextMining dataset metrics task config name revision split type rus_Cyrl-bho_Deva MTEB FloresBitextMining (rus_Cyrl-bho_Deva) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 96.6403162055336 type value f1 95.56982872200265 type value main_score 95.56982872200265 type value precision 95.0592885375494 type value recall 96.6403162055336 type BitextMining dataset metrics task config name revision split type rus_Cyrl-eus_Latn MTEB FloresBitextMining (rus_Cyrl-eus_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.62845849802372 type value f1 96.9038208168643 type value main_score 96.9038208168643 type value precision 96.55797101449275 type value recall 97.62845849802372 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ibo_Latn MTEB FloresBitextMining (rus_Cyrl-ibo_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 89.2292490118577 type value f1 86.35234330886506 type value main_score 86.35234330886506 type value precision 85.09881422924902 type value recall 89.2292490118577 type BitextMining dataset metrics task config name revision split type rus_Cyrl-kmr_Latn MTEB FloresBitextMining (rus_Cyrl-kmr_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 83.49802371541502 type value f1 79.23630717108978 type value main_score 79.23630717108978 type value precision 77.48188405797102 type value recall 83.49802371541502 type BitextMining dataset metrics task config name revision split type rus_Cyrl-min_Latn MTEB FloresBitextMining (rus_Cyrl-min_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 79.34782608695652 type value f1 75.31689928429059 type value main_score 75.31689928429059 type value precision 73.91519410541149 type value recall 79.34782608695652 type BitextMining dataset metrics task config name revision split type rus_Cyrl-por_Latn MTEB FloresBitextMining (rus_Cyrl-por_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 96.54150197628458 type value f1 95.53218520609825 type value main_score 95.53218520609825 type value precision 95.07575757575756 type value recall 96.54150197628458 type BitextMining dataset metrics task config name revision split type rus_Cyrl-sun_Latn MTEB FloresBitextMining (rus_Cyrl-sun_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 93.2806324110672 type value f1 91.56973461321287 type value main_score 91.56973461321287 type value precision 90.84396334890405 type value recall 93.2806324110672 type BitextMining dataset metrics task config name revision split type rus_Cyrl-umb_Latn MTEB FloresBitextMining (rus_Cyrl-umb_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 51.87747035573123 type value f1 46.36591778884269 type value main_score 46.36591778884269 type value precision 44.57730391234227 type value recall 51.87747035573123 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ajp_Arab MTEB FloresBitextMining (rus_Cyrl-ajp_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.71541501976284 type value f1 98.30368906455863 type value main_score 98.30368906455863 type value precision 98.10606060606061 type value recall 98.71541501976284 type BitextMining dataset metrics task config name revision split type rus_Cyrl-bjn_Arab MTEB FloresBitextMining (rus_Cyrl-bjn_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 14.82213438735178 type value f1 12.365434276616856 type value main_score 12.365434276616856 type value precision 11.802079517180589 type value recall 14.82213438735178 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ewe_Latn MTEB FloresBitextMining (rus_Cyrl-ewe_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 71.44268774703558 type value f1 66.74603174603175 type value main_score 66.74603174603175 type value precision 64.99933339607253 type value recall 71.44268774703558 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ilo_Latn MTEB FloresBitextMining (rus_Cyrl-ilo_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 85.86956521739131 type value f1 83.00139015960917 type value main_score 83.00139015960917 type value precision 81.91411396574439 type value recall 85.86956521739131 type BitextMining dataset metrics task config name revision split type rus_Cyrl-knc_Arab MTEB FloresBitextMining (rus_Cyrl-knc_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 14.525691699604742 type value f1 12.618283715726806 type value main_score 12.618283715726806 type value precision 12.048458493742352 type value recall 14.525691699604742 type BitextMining dataset metrics task config name revision split type rus_Cyrl-mkd_Cyrl MTEB FloresBitextMining (rus_Cyrl-mkd_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.40711462450594 type value f1 99.22595520421606 type value main_score 99.22595520421606 type value precision 99.14361001317523 type value recall 99.40711462450594 type BitextMining dataset metrics task config name revision split type rus_Cyrl-prs_Arab MTEB FloresBitextMining (rus_Cyrl-prs_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.30830039525692 type value f1 99.07773386034255 type value main_score 99.07773386034255 type value precision 98.96245059288538 type value recall 99.30830039525692 type BitextMining dataset metrics task config name revision split type rus_Cyrl-swe_Latn MTEB FloresBitextMining (rus_Cyrl-swe_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.30830039525692 type value f1 99.07773386034256 type value main_score 99.07773386034256 type value precision 98.96245059288538 type value recall 99.30830039525692 type BitextMining dataset metrics task config name revision split type rus_Cyrl-urd_Arab MTEB FloresBitextMining (rus_Cyrl-urd_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.61660079051383 type value f1 98.15546772068511 type value main_score 98.15546772068511 type value precision 97.92490118577075 type value recall 98.61660079051383 type BitextMining dataset metrics task config name revision split type rus_Cyrl-aka_Latn MTEB FloresBitextMining (rus_Cyrl-aka_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 81.02766798418972 type value f1 76.73277809147375 type value main_score 76.73277809147375 type value precision 74.97404165882426 type value recall 81.02766798418972 type BitextMining dataset metrics task config name revision split type rus_Cyrl-bjn_Latn MTEB FloresBitextMining (rus_Cyrl-bjn_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 86.7588932806324 type value f1 83.92064566965753 type value main_score 83.92064566965753 type value precision 82.83734079929732 type value recall 86.7588932806324 type BitextMining dataset metrics task config name revision split type rus_Cyrl-fao_Latn MTEB FloresBitextMining (rus_Cyrl-fao_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 88.43873517786561 type value f1 85.48136645962732 type value main_score 85.48136645962732 type value precision 84.23418972332016 type value recall 88.43873517786561 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ind_Latn MTEB FloresBitextMining (rus_Cyrl-ind_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.01185770750988 type value f1 98.68247694334651 type value main_score 98.68247694334651 type value precision 98.51778656126481 type value recall 99.01185770750988 type BitextMining dataset metrics task config name revision split type rus_Cyrl-knc_Latn MTEB FloresBitextMining (rus_Cyrl-knc_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 45.8498023715415 type value f1 40.112030865489366 type value main_score 40.112030865489366 type value precision 38.28262440050776 type value recall 45.8498023715415 type BitextMining dataset metrics task config name revision split type rus_Cyrl-mlt_Latn MTEB FloresBitextMining (rus_Cyrl-mlt_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 93.18181818181817 type value f1 91.30787690570298 type value main_score 91.30787690570298 type value precision 90.4983060417843 type value recall 93.18181818181817 type BitextMining dataset metrics task config name revision split type rus_Cyrl-quy_Latn MTEB FloresBitextMining (rus_Cyrl-quy_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 62.450592885375485 type value f1 57.28742975628178 type value main_score 57.28742975628178 type value precision 55.56854987623269 type value recall 62.450592885375485 type BitextMining dataset metrics task config name revision split type rus_Cyrl-swh_Latn MTEB FloresBitextMining (rus_Cyrl-swh_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.3201581027668 type value f1 97.77667984189723 type value main_score 97.77667984189723 type value precision 97.51317523056655 type value recall 98.3201581027668 type BitextMining dataset metrics task config name revision split type rus_Cyrl-uzn_Latn MTEB FloresBitextMining (rus_Cyrl-uzn_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.12252964426878 type value f1 97.59081498211933 type value main_score 97.59081498211933 type value precision 97.34848484848484 type value recall 98.12252964426878 type BitextMining dataset metrics task config name revision split type rus_Cyrl-als_Latn MTEB FloresBitextMining (rus_Cyrl-als_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.30830039525692 type value f1 99.09420289855073 type value main_score 99.09420289855073 type value precision 98.99538866930172 type value recall 99.30830039525692 type BitextMining dataset metrics task config name revision split type rus_Cyrl-bod_Tibt MTEB FloresBitextMining (rus_Cyrl-bod_Tibt) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 11.561264822134387 type value f1 8.121312045385636 type value main_score 8.121312045385636 type value precision 7.350577020893972 type value recall 11.561264822134387 type BitextMining dataset metrics task config name revision split type rus_Cyrl-fij_Latn MTEB FloresBitextMining (rus_Cyrl-fij_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 72.23320158102767 type value f1 67.21000233846082 type value main_score 67.21000233846082 type value precision 65.3869439739005 type value recall 72.23320158102767 type BitextMining dataset metrics task config name revision split type rus_Cyrl-isl_Latn MTEB FloresBitextMining (rus_Cyrl-isl_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 91.99604743083005 type value f1 89.75955204216073 type value main_score 89.75955204216073 type value precision 88.7598814229249 type value recall 91.99604743083005 type BitextMining dataset metrics task config name revision split type rus_Cyrl-kon_Latn MTEB FloresBitextMining (rus_Cyrl-kon_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 81.81818181818183 type value f1 77.77800098452272 type value main_score 77.77800098452272 type value precision 76.1521268586486 type value recall 81.81818181818183 type BitextMining dataset metrics task config name revision split type rus_Cyrl-mni_Beng MTEB FloresBitextMining (rus_Cyrl-mni_Beng) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 54.74308300395256 type value f1 48.97285299254615 type value main_score 48.97285299254615 type value precision 46.95125742968299 type value recall 54.74308300395256 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ron_Latn MTEB FloresBitextMining (rus_Cyrl-ron_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.22134387351778 type value f1 97.64492753623189 type value main_score 97.64492753623189 type value precision 97.36495388669302 type value recall 98.22134387351778 type BitextMining dataset metrics task config name revision split type rus_Cyrl-szl_Latn MTEB FloresBitextMining (rus_Cyrl-szl_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 92.09486166007905 type value f1 90.10375494071147 type value main_score 90.10375494071147 type value precision 89.29606625258798 type value recall 92.09486166007905 type BitextMining dataset metrics task config name revision split type rus_Cyrl-vec_Latn MTEB FloresBitextMining (rus_Cyrl-vec_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 92.4901185770751 type value f1 90.51430453604365 type value main_score 90.51430453604365 type value precision 89.69367588932808 type value recall 92.4901185770751 type BitextMining dataset metrics task config name revision split type rus_Cyrl-amh_Ethi MTEB FloresBitextMining (rus_Cyrl-amh_Ethi) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.82608695652173 type value f1 97.11791831357048 type value main_score 97.11791831357048 type value precision 96.77206851119894 type value recall 97.82608695652173 type BitextMining dataset metrics task config name revision split type rus_Cyrl-bos_Latn MTEB FloresBitextMining (rus_Cyrl-bos_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.91304347826086 type value f1 98.55072463768116 type value main_score 98.55072463768116 type value precision 98.36956521739131 type value recall 98.91304347826086 type BitextMining dataset metrics task config name revision split type rus_Cyrl-fin_Latn MTEB FloresBitextMining (rus_Cyrl-fin_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 95.65217391304348 type value f1 94.4235836627141 type value main_score 94.4235836627141 type value precision 93.84881422924902 type value recall 95.65217391304348 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ita_Latn MTEB FloresBitextMining (rus_Cyrl-ita_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.91304347826086 type value f1 98.55072463768117 type value main_score 98.55072463768117 type value precision 98.36956521739131 type value recall 98.91304347826086 type BitextMining dataset metrics task config name revision split type rus_Cyrl-kor_Hang MTEB FloresBitextMining (rus_Cyrl-kor_Hang) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 95.55335968379447 type value f1 94.15349143610013 type value main_score 94.15349143610013 type value precision 93.49472990777339 type value recall 95.55335968379447 type BitextMining dataset metrics task config name revision split type rus_Cyrl-mos_Latn MTEB FloresBitextMining (rus_Cyrl-mos_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 43.67588932806324 type value f1 38.84849721190082 type value main_score 38.84849721190082 type value precision 37.43294462099682 type value recall 43.67588932806324 type BitextMining dataset metrics task config name revision split type rus_Cyrl-run_Latn MTEB FloresBitextMining (rus_Cyrl-run_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 90.21739130434783 type value f1 87.37483530961792 type value main_score 87.37483530961792 type value precision 86.07872200263506 type value recall 90.21739130434783 type BitextMining dataset metrics task config name revision split type rus_Cyrl-tam_Taml MTEB FloresBitextMining (rus_Cyrl-tam_Taml) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.40711462450594 type value f1 99.2094861660079 type value main_score 99.2094861660079 type value precision 99.1106719367589 type value recall 99.40711462450594 type BitextMining dataset metrics task config name revision split type rus_Cyrl-vie_Latn MTEB FloresBitextMining (rus_Cyrl-vie_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.03557312252964 type value f1 96.13636363636364 type value main_score 96.13636363636364 type value precision 95.70981554677206 type value recall 97.03557312252964 type BitextMining dataset metrics task config name revision split type rus_Cyrl-apc_Arab MTEB FloresBitextMining (rus_Cyrl-apc_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.12252964426878 type value f1 97.49670619235836 type value main_score 97.49670619235836 type value precision 97.18379446640316 type value recall 98.12252964426878 type BitextMining dataset metrics task config name revision split type rus_Cyrl-bug_Latn MTEB FloresBitextMining (rus_Cyrl-bug_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 67.29249011857708 type value f1 62.09268717667927 type value main_score 62.09268717667927 type value precision 60.28554009748714 type value recall 67.29249011857708 type BitextMining dataset metrics task config name revision split type rus_Cyrl-fon_Latn MTEB FloresBitextMining (rus_Cyrl-fon_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 63.43873517786561 type value f1 57.66660107569199 type value main_score 57.66660107569199 type value precision 55.66676396919363 type value recall 63.43873517786561 type BitextMining dataset metrics task config name revision split type rus_Cyrl-jav_Latn MTEB FloresBitextMining (rus_Cyrl-jav_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 94.46640316205533 type value f1 92.89384528514964 type value main_score 92.89384528514964 type value precision 92.19367588932806 type value recall 94.46640316205533 type BitextMining dataset metrics task config name revision split type rus_Cyrl-lao_Laoo MTEB FloresBitextMining (rus_Cyrl-lao_Laoo) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.23320158102767 type value f1 96.40974967061922 type value main_score 96.40974967061922 type value precision 96.034255599473 type value recall 97.23320158102767 type BitextMining dataset metrics task config name revision split type rus_Cyrl-mri_Latn MTEB FloresBitextMining (rus_Cyrl-mri_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 76.77865612648222 type value f1 73.11286539547409 type value main_score 73.11286539547409 type value precision 71.78177214337046 type value recall 76.77865612648222 type BitextMining dataset metrics task config name revision split type rus_Cyrl-taq_Latn MTEB FloresBitextMining (rus_Cyrl-taq_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 41.99604743083004 type value f1 37.25127063318763 type value main_score 37.25127063318763 type value precision 35.718929186985726 type value recall 41.99604743083004 type BitextMining dataset metrics task config name revision split type rus_Cyrl-war_Latn MTEB FloresBitextMining (rus_Cyrl-war_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 95.55335968379447 type value f1 94.1699604743083 type value main_score 94.1699604743083 type value precision 93.52766798418972 type value recall 95.55335968379447 type BitextMining dataset metrics task config name revision split type rus_Cyrl-arb_Arab MTEB FloresBitextMining (rus_Cyrl-arb_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.60474308300395 type value f1 99.4729907773386 type value main_score 99.4729907773386 type value precision 99.40711462450594 type value recall 99.60474308300395 type BitextMining dataset metrics task config name revision split type rus_Cyrl-bul_Cyrl MTEB FloresBitextMining (rus_Cyrl-bul_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.70355731225297 type value f1 99.60474308300395 type value main_score 99.60474308300395 type value precision 99.55533596837944 type value recall 99.70355731225297 type BitextMining dataset metrics task config name revision split type rus_Cyrl-fra_Latn MTEB FloresBitextMining (rus_Cyrl-fra_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.60474308300395 type value f1 99.47299077733861 type value main_score 99.47299077733861 type value precision 99.40711462450594 type value recall 99.60474308300395 type BitextMining dataset metrics task config name revision split type rus_Cyrl-jpn_Jpan MTEB FloresBitextMining (rus_Cyrl-jpn_Jpan) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 96.44268774703558 type value f1 95.30632411067194 type value main_score 95.30632411067194 type value precision 94.76284584980237 type value recall 96.44268774703558 type BitextMining dataset metrics task config name revision split type rus_Cyrl-lij_Latn MTEB FloresBitextMining (rus_Cyrl-lij_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 90.21739130434783 type value f1 87.4703557312253 type value main_score 87.4703557312253 type value precision 86.29611330698287 type value recall 90.21739130434783 type BitextMining dataset metrics task config name revision split type rus_Cyrl-mya_Mymr MTEB FloresBitextMining (rus_Cyrl-mya_Mymr) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.02371541501977 type value f1 97.364953886693 type value main_score 97.364953886693 type value precision 97.03557312252964 type value recall 98.02371541501977 type BitextMining dataset metrics task config name revision split type rus_Cyrl-sag_Latn MTEB FloresBitextMining (rus_Cyrl-sag_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 54.841897233201585 type value f1 49.61882037503349 type value main_score 49.61882037503349 type value precision 47.831968755881796 type value recall 54.841897233201585 type BitextMining dataset metrics task config name revision split type rus_Cyrl-taq_Tfng MTEB FloresBitextMining (rus_Cyrl-taq_Tfng) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 15.316205533596838 type value f1 11.614836360389717 type value main_score 11.614836360389717 type value precision 10.741446193235223 type value recall 15.316205533596838 type BitextMining dataset metrics task config name revision split type rus_Cyrl-wol_Latn MTEB FloresBitextMining (rus_Cyrl-wol_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 67.88537549407114 type value f1 62.2536417249856 type value main_score 62.2536417249856 type value precision 60.27629128666678 type value recall 67.88537549407114 type BitextMining dataset metrics task config name revision split type rus_Cyrl-arb_Latn MTEB FloresBitextMining (rus_Cyrl-arb_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 27.766798418972332 type value f1 23.39674889624077 type value main_score 23.39674889624077 type value precision 22.28521155585345 type value recall 27.766798418972332 type BitextMining dataset metrics task config name revision split type rus_Cyrl-cat_Latn MTEB FloresBitextMining (rus_Cyrl-cat_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.23320158102767 type value f1 96.42151326933936 type value main_score 96.42151326933936 type value precision 96.04743083003953 type value recall 97.23320158102767 type BitextMining dataset metrics task config name revision split type rus_Cyrl-fur_Latn MTEB FloresBitextMining (rus_Cyrl-fur_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 88.63636363636364 type value f1 85.80792396009788 type value main_score 85.80792396009788 type value precision 84.61508901726293 type value recall 88.63636363636364 type BitextMining dataset metrics task config name revision split type rus_Cyrl-kab_Latn MTEB FloresBitextMining (rus_Cyrl-kab_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 48.12252964426877 type value f1 43.05387582971066 type value main_score 43.05387582971066 type value precision 41.44165117538212 type value recall 48.12252964426877 type BitextMining dataset metrics task config name revision split type rus_Cyrl-lim_Latn MTEB FloresBitextMining (rus_Cyrl-lim_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 81.81818181818183 type value f1 77.81676163099087 type value main_score 77.81676163099087 type value precision 76.19565217391305 type value recall 81.81818181818183 type BitextMining dataset metrics task config name revision split type rus_Cyrl-nld_Latn MTEB FloresBitextMining (rus_Cyrl-nld_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.33201581027669 type value f1 96.4756258234519 type value main_score 96.4756258234519 type value precision 96.06389986824769 type value recall 97.33201581027669 type BitextMining dataset metrics task config name revision split type rus_Cyrl-san_Deva MTEB FloresBitextMining (rus_Cyrl-san_Deva) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 93.47826086956522 type value f1 91.70289855072463 type value main_score 91.70289855072463 type value precision 90.9370882740448 type value recall 93.47826086956522 type BitextMining dataset metrics task config name revision split type rus_Cyrl-tat_Cyrl MTEB FloresBitextMining (rus_Cyrl-tat_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.72727272727273 type value f1 97.00263504611331 type value main_score 97.00263504611331 type value precision 96.65678524374177 type value recall 97.72727272727273 type BitextMining dataset metrics task config name revision split type rus_Cyrl-xho_Latn MTEB FloresBitextMining (rus_Cyrl-xho_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 93.08300395256917 type value f1 91.12977602108036 type value main_score 91.12977602108036 type value precision 90.22562582345192 type value recall 93.08300395256917 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ars_Arab MTEB FloresBitextMining (rus_Cyrl-ars_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.40711462450594 type value f1 99.2094861660079 type value main_score 99.2094861660079 type value precision 99.1106719367589 type value recall 99.40711462450594 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ceb_Latn MTEB FloresBitextMining (rus_Cyrl-ceb_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 95.65217391304348 type value f1 94.3544137022398 type value main_score 94.3544137022398 type value precision 93.76646903820817 type value recall 95.65217391304348 type BitextMining dataset metrics task config name revision split type rus_Cyrl-fuv_Latn MTEB FloresBitextMining (rus_Cyrl-fuv_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 51.18577075098815 type value f1 44.5990252610806 type value main_score 44.5990252610806 type value precision 42.34331599450177 type value recall 51.18577075098815 type BitextMining dataset metrics task config name revision split type rus_Cyrl-kac_Latn MTEB FloresBitextMining (rus_Cyrl-kac_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 46.93675889328063 type value f1 41.79004018701787 type value main_score 41.79004018701787 type value precision 40.243355662392624 type value recall 46.93675889328063 type BitextMining dataset metrics task config name revision split type rus_Cyrl-lin_Latn MTEB FloresBitextMining (rus_Cyrl-lin_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 91.50197628458498 type value f1 89.1205533596838 type value main_score 89.1205533596838 type value precision 88.07147562582345 type value recall 91.50197628458498 type BitextMining dataset metrics task config name revision split type rus_Cyrl-nno_Latn MTEB FloresBitextMining (rus_Cyrl-nno_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.81422924901186 type value f1 98.41897233201581 type value main_score 98.41897233201581 type value precision 98.22134387351778 type value recall 98.81422924901186 type BitextMining dataset metrics task config name revision split type rus_Cyrl-sat_Olck MTEB FloresBitextMining (rus_Cyrl-sat_Olck) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 2.371541501976284 type value f1 1.0726274943087382 type value main_score 1.0726274943087382 type value precision 0.875279634748803 type value recall 2.371541501976284 type BitextMining dataset metrics task config name revision split type rus_Cyrl-tel_Telu MTEB FloresBitextMining (rus_Cyrl-tel_Telu) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.01185770750988 type value f1 98.68247694334651 type value main_score 98.68247694334651 type value precision 98.51778656126481 type value recall 99.01185770750988 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ydd_Hebr MTEB FloresBitextMining (rus_Cyrl-ydd_Hebr) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 89.42687747035573 type value f1 86.47609636740073 type value main_score 86.47609636740073 type value precision 85.13669301712781 type value recall 89.42687747035573 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ary_Arab MTEB FloresBitextMining (rus_Cyrl-ary_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 89.82213438735178 type value f1 87.04545454545456 type value main_score 87.04545454545456 type value precision 85.76910408432148 type value recall 89.82213438735178 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ces_Latn MTEB FloresBitextMining (rus_Cyrl-ces_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.2094861660079 type value f1 98.9459815546772 type value main_score 98.9459815546772 type value precision 98.81422924901186 type value recall 99.2094861660079 type BitextMining dataset metrics task config name revision split type rus_Cyrl-gaz_Latn MTEB FloresBitextMining (rus_Cyrl-gaz_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 64.9209486166008 type value f1 58.697458119394874 type value main_score 58.697458119394874 type value precision 56.43402189597842 type value recall 64.9209486166008 type BitextMining dataset metrics task config name revision split type rus_Cyrl-kam_Latn MTEB FloresBitextMining (rus_Cyrl-kam_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 59.18972332015811 type value f1 53.19031511966295 type value main_score 53.19031511966295 type value precision 51.08128357343655 type value recall 59.18972332015811 type BitextMining dataset metrics task config name revision split type rus_Cyrl-lit_Latn MTEB FloresBitextMining (rus_Cyrl-lit_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 96.54150197628458 type value f1 95.5368906455863 type value main_score 95.5368906455863 type value precision 95.0592885375494 type value recall 96.54150197628458 type BitextMining dataset metrics task config name revision split type rus_Cyrl-nob_Latn MTEB FloresBitextMining (rus_Cyrl-nob_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.12252964426878 type value f1 97.51317523056655 type value main_score 97.51317523056655 type value precision 97.2167325428195 type value recall 98.12252964426878 type BitextMining dataset metrics task config name revision split type rus_Cyrl-scn_Latn MTEB FloresBitextMining (rus_Cyrl-scn_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 84.0909090909091 type value f1 80.37000439174352 type value main_score 80.37000439174352 type value precision 78.83994628559846 type value recall 84.0909090909091 type BitextMining dataset metrics task config name revision split type rus_Cyrl-tgk_Cyrl MTEB FloresBitextMining (rus_Cyrl-tgk_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 92.68774703557312 type value f1 90.86344814605684 type value main_score 90.86344814605684 type value precision 90.12516469038208 type value recall 92.68774703557312 type BitextMining dataset metrics task config name revision split type rus_Cyrl-yor_Latn MTEB FloresBitextMining (rus_Cyrl-yor_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 72.13438735177866 type value f1 66.78759646150951 type value main_score 66.78759646150951 type value precision 64.85080192096002 type value recall 72.13438735177866 type BitextMining dataset metrics task config name revision split type rus_Cyrl-arz_Arab MTEB FloresBitextMining (rus_Cyrl-arz_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.02371541501977 type value f1 97.364953886693 type value main_score 97.364953886693 type value precision 97.03557312252964 type value recall 98.02371541501977 type BitextMining dataset metrics task config name revision split type rus_Cyrl-cjk_Latn MTEB FloresBitextMining (rus_Cyrl-cjk_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 51.976284584980235 type value f1 46.468762353149714 type value main_score 46.468762353149714 type value precision 44.64073366247278 type value recall 51.976284584980235 type BitextMining dataset metrics task config name revision split type rus_Cyrl-gla_Latn MTEB FloresBitextMining (rus_Cyrl-gla_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 79.74308300395256 type value f1 75.55611165294958 type value main_score 75.55611165294958 type value precision 73.95033408620365 type value recall 79.74308300395256 type BitextMining dataset metrics task config name revision split type rus_Cyrl-kan_Knda MTEB FloresBitextMining (rus_Cyrl-kan_Knda) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.2094861660079 type value f1 98.96245059288538 type value main_score 98.96245059288538 type value precision 98.84716732542819 type value recall 99.2094861660079 type BitextMining dataset metrics task config name revision split type rus_Cyrl-lmo_Latn MTEB FloresBitextMining (rus_Cyrl-lmo_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 82.41106719367589 type value f1 78.56413514022209 type value main_score 78.56413514022209 type value precision 77.15313068573938 type value recall 82.41106719367589 type BitextMining dataset metrics task config name revision split type rus_Cyrl-npi_Deva MTEB FloresBitextMining (rus_Cyrl-npi_Deva) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.71541501976284 type value f1 98.3201581027668 type value main_score 98.3201581027668 type value precision 98.12252964426878 type value recall 98.71541501976284 type BitextMining dataset metrics task config name revision split type rus_Cyrl-shn_Mymr MTEB FloresBitextMining (rus_Cyrl-shn_Mymr) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 57.11462450592886 type value f1 51.51361369197337 type value main_score 51.51361369197337 type value precision 49.71860043649573 type value recall 57.11462450592886 type BitextMining dataset metrics task config name revision split type rus_Cyrl-tgl_Latn MTEB FloresBitextMining (rus_Cyrl-tgl_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.82608695652173 type value f1 97.18379446640316 type value main_score 97.18379446640316 type value precision 96.88735177865613 type value recall 97.82608695652173 type BitextMining dataset metrics task config name revision split type rus_Cyrl-yue_Hant MTEB FloresBitextMining (rus_Cyrl-yue_Hant) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.30830039525692 type value f1 99.09420289855072 type value main_score 99.09420289855072 type value precision 98.9953886693017 type value recall 99.30830039525692 type BitextMining dataset metrics task config name revision split type rus_Cyrl-asm_Beng MTEB FloresBitextMining (rus_Cyrl-asm_Beng) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 95.55335968379447 type value f1 94.16007905138339 type value main_score 94.16007905138339 type value precision 93.50296442687747 type value recall 95.55335968379447 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ckb_Arab MTEB FloresBitextMining (rus_Cyrl-ckb_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 92.88537549407114 type value f1 90.76745718050066 type value main_score 90.76745718050066 type value precision 89.80072463768116 type value recall 92.88537549407114 type BitextMining dataset metrics task config name revision split type rus_Cyrl-gle_Latn MTEB FloresBitextMining (rus_Cyrl-gle_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 91.699604743083 type value f1 89.40899680030115 type value main_score 89.40899680030115 type value precision 88.40085638998683 type value recall 91.699604743083 type BitextMining dataset metrics task config name revision split type rus_Cyrl-kas_Arab MTEB FloresBitextMining (rus_Cyrl-kas_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 88.3399209486166 type value f1 85.14351590438548 type value main_score 85.14351590438548 type value precision 83.72364953886692 type value recall 88.3399209486166 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ltg_Latn MTEB FloresBitextMining (rus_Cyrl-ltg_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 83.399209486166 type value f1 79.88408934061107 type value main_score 79.88408934061107 type value precision 78.53794509179885 type value recall 83.399209486166 type BitextMining dataset metrics task config name revision split type rus_Cyrl-nso_Latn MTEB FloresBitextMining (rus_Cyrl-nso_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 91.20553359683794 type value f1 88.95406635525212 type value main_score 88.95406635525212 type value precision 88.01548089591567 type value recall 91.20553359683794 type BitextMining dataset metrics task config name revision split type rus_Cyrl-sin_Sinh MTEB FloresBitextMining (rus_Cyrl-sin_Sinh) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.91304347826086 type value f1 98.56719367588933 type value main_score 98.56719367588933 type value precision 98.40250329380763 type value recall 98.91304347826086 type BitextMining dataset metrics task config name revision split type rus_Cyrl-tha_Thai MTEB FloresBitextMining (rus_Cyrl-tha_Thai) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 95.94861660079052 type value f1 94.66403162055336 type value main_score 94.66403162055336 type value precision 94.03820816864295 type value recall 95.94861660079052 type BitextMining dataset metrics task config name revision split type rus_Cyrl-zho_Hans MTEB FloresBitextMining (rus_Cyrl-zho_Hans) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.4308300395257 type value f1 96.5909090909091 type value main_score 96.5909090909091 type value precision 96.17918313570487 type value recall 97.4308300395257 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ast_Latn MTEB FloresBitextMining (rus_Cyrl-ast_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 94.46640316205533 type value f1 92.86890645586297 type value main_score 92.86890645586297 type value precision 92.14756258234519 type value recall 94.46640316205533 type BitextMining dataset metrics task config name revision split type rus_Cyrl-crh_Latn MTEB FloresBitextMining (rus_Cyrl-crh_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 94.66403162055336 type value f1 93.2663592446201 type value main_score 93.2663592446201 type value precision 92.66716073781292 type value recall 94.66403162055336 type BitextMining dataset metrics task config name revision split type rus_Cyrl-glg_Latn MTEB FloresBitextMining (rus_Cyrl-glg_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.81422924901186 type value f1 98.46837944664031 type value main_score 98.46837944664031 type value precision 98.3201581027668 type value recall 98.81422924901186 type BitextMining dataset metrics task config name revision split type rus_Cyrl-kas_Deva MTEB FloresBitextMining (rus_Cyrl-kas_Deva) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 69.1699604743083 type value f1 63.05505292906477 type value main_score 63.05505292906477 type value precision 60.62594108789761 type value recall 69.1699604743083 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ltz_Latn MTEB FloresBitextMining (rus_Cyrl-ltz_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 91.40316205533597 type value f1 89.26571616789009 type value main_score 89.26571616789009 type value precision 88.40179747788443 type value recall 91.40316205533597 type BitextMining dataset metrics task config name revision split type rus_Cyrl-nus_Latn MTEB FloresBitextMining (rus_Cyrl-nus_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 38.93280632411067 type value f1 33.98513032905371 type value main_score 33.98513032905371 type value precision 32.56257884802308 type value recall 38.93280632411067 type BitextMining dataset metrics task config name revision split type rus_Cyrl-slk_Latn MTEB FloresBitextMining (rus_Cyrl-slk_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.02371541501977 type value f1 97.42094861660078 type value main_score 97.42094861660078 type value precision 97.14262187088273 type value recall 98.02371541501977 type BitextMining dataset metrics task config name revision split type rus_Cyrl-tir_Ethi MTEB FloresBitextMining (rus_Cyrl-tir_Ethi) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 91.30434782608695 type value f1 88.78129117259552 type value main_score 88.78129117259552 type value precision 87.61528326745717 type value recall 91.30434782608695 type BitextMining dataset metrics task config name revision split type rus_Cyrl-zho_Hant MTEB FloresBitextMining (rus_Cyrl-zho_Hant) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.1106719367589 type value f1 98.81422924901186 type value main_score 98.81422924901186 type value precision 98.66600790513834 type value recall 99.1106719367589 type BitextMining dataset metrics task config name revision split type rus_Cyrl-awa_Deva MTEB FloresBitextMining (rus_Cyrl-awa_Deva) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.12252964426878 type value f1 97.70092226613966 type value main_score 97.70092226613966 type value precision 97.50494071146245 type value recall 98.12252964426878 type BitextMining dataset metrics task config name revision split type rus_Cyrl-cym_Latn MTEB FloresBitextMining (rus_Cyrl-cym_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 95.94861660079052 type value f1 94.74308300395256 type value main_score 94.74308300395256 type value precision 94.20289855072464 type value recall 95.94861660079052 type BitextMining dataset metrics task config name revision split type rus_Cyrl-grn_Latn MTEB FloresBitextMining (rus_Cyrl-grn_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 77.96442687747036 type value f1 73.64286789187975 type value main_score 73.64286789187975 type value precision 71.99324893260821 type value recall 77.96442687747036 type BitextMining dataset metrics task config name revision split type rus_Cyrl-kat_Geor MTEB FloresBitextMining (rus_Cyrl-kat_Geor) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.91304347826086 type value f1 98.56719367588933 type value main_score 98.56719367588933 type value precision 98.40250329380764 type value recall 98.91304347826086 type BitextMining dataset metrics task config name revision split type rus_Cyrl-lua_Latn MTEB FloresBitextMining (rus_Cyrl-lua_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 72.03557312252964 type value f1 67.23928163404449 type value main_score 67.23928163404449 type value precision 65.30797101449275 type value recall 72.03557312252964 type BitextMining dataset metrics task config name revision split type rus_Cyrl-nya_Latn MTEB FloresBitextMining (rus_Cyrl-nya_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 92.29249011857708 type value f1 90.0494071146245 type value main_score 90.0494071146245 type value precision 89.04808959156786 type value recall 92.29249011857708 type BitextMining dataset metrics task config name revision split type rus_Cyrl-slv_Latn MTEB FloresBitextMining (rus_Cyrl-slv_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.71541501976284 type value f1 98.30368906455863 type value main_score 98.30368906455863 type value precision 98.10606060606061 type value recall 98.71541501976284 type BitextMining dataset metrics task config name revision split type rus_Cyrl-tpi_Latn MTEB FloresBitextMining (rus_Cyrl-tpi_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 80.53359683794467 type value f1 76.59481822525301 type value main_score 76.59481822525301 type value precision 75.12913223140497 type value recall 80.53359683794467 type BitextMining dataset metrics task config name revision split type rus_Cyrl-zsm_Latn MTEB FloresBitextMining (rus_Cyrl-zsm_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.33201581027669 type value f1 96.58620365142104 type value main_score 96.58620365142104 type value precision 96.26152832674572 type value recall 97.33201581027669 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ayr_Latn MTEB FloresBitextMining (rus_Cyrl-ayr_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 45.55335968379446 type value f1 40.13076578531388 type value main_score 40.13076578531388 type value precision 38.398064362362355 type value recall 45.55335968379446 type BitextMining dataset metrics task config name revision split type rus_Cyrl-dan_Latn MTEB FloresBitextMining (rus_Cyrl-dan_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.01185770750988 type value f1 98.68247694334651 type value main_score 98.68247694334651 type value precision 98.51778656126481 type value recall 99.01185770750988 type BitextMining dataset metrics task config name revision split type rus_Cyrl-guj_Gujr MTEB FloresBitextMining (rus_Cyrl-guj_Gujr) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.01185770750988 type value f1 98.68247694334651 type value main_score 98.68247694334651 type value precision 98.51778656126481 type value recall 99.01185770750988 type BitextMining dataset metrics task config name revision split type rus_Cyrl-kaz_Cyrl MTEB FloresBitextMining (rus_Cyrl-kaz_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.81422924901186 type value f1 98.43544137022398 type value main_score 98.43544137022398 type value precision 98.25428194993412 type value recall 98.81422924901186 type BitextMining dataset metrics task config name revision split type rus_Cyrl-lug_Latn MTEB FloresBitextMining (rus_Cyrl-lug_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 82.21343873517787 type value f1 77.97485726833554 type value main_score 77.97485726833554 type value precision 76.22376717485415 type value recall 82.21343873517787 type BitextMining dataset metrics task config name revision split type rus_Cyrl-oci_Latn MTEB FloresBitextMining (rus_Cyrl-oci_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 93.87351778656127 type value f1 92.25319969885187 type value main_score 92.25319969885187 type value precision 91.5638528138528 type value recall 93.87351778656127 type BitextMining dataset metrics task config name revision split type rus_Cyrl-smo_Latn MTEB FloresBitextMining (rus_Cyrl-smo_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 84.88142292490119 type value f1 81.24364765669114 type value main_score 81.24364765669114 type value precision 79.69991416137661 type value recall 84.88142292490119 type BitextMining dataset metrics task config name revision split type rus_Cyrl-tsn_Latn MTEB FloresBitextMining (rus_Cyrl-tsn_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 87.05533596837944 type value f1 83.90645586297761 type value main_score 83.90645586297761 type value precision 82.56752305665349 type value recall 87.05533596837944 type BitextMining dataset metrics task config name revision split type rus_Cyrl-zul_Latn MTEB FloresBitextMining (rus_Cyrl-zul_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 95.15810276679841 type value f1 93.77140974967062 type value main_score 93.77140974967062 type value precision 93.16534914361002 type value recall 95.15810276679841 type BitextMining dataset metrics task config name revision split type rus_Cyrl-azb_Arab MTEB FloresBitextMining (rus_Cyrl-azb_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 81.91699604743083 type value f1 77.18050065876152 type value main_score 77.18050065876152 type value precision 75.21519543258673 type value recall 81.91699604743083 type BitextMining dataset metrics task config name revision split type rus_Cyrl-deu_Latn MTEB FloresBitextMining (rus_Cyrl-deu_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.50592885375494 type value f1 99.34123847167325 type value main_score 99.34123847167325 type value precision 99.2588932806324 type value recall 99.50592885375494 type BitextMining dataset metrics task config name revision split type rus_Cyrl-hat_Latn MTEB FloresBitextMining (rus_Cyrl-hat_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 91.00790513833992 type value f1 88.69126043039086 type value main_score 88.69126043039086 type value precision 87.75774044795784 type value recall 91.00790513833992 type BitextMining dataset metrics task config name revision split type rus_Cyrl-kbp_Latn MTEB FloresBitextMining (rus_Cyrl-kbp_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 47.233201581027664 type value f1 43.01118618096943 type value main_score 43.01118618096943 type value precision 41.739069205043556 type value recall 47.233201581027664 type BitextMining dataset metrics task config name revision split type rus_Cyrl-luo_Latn MTEB FloresBitextMining (rus_Cyrl-luo_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 60.47430830039525 type value f1 54.83210565429816 type value main_score 54.83210565429816 type value precision 52.81630744284779 type value recall 60.47430830039525 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ory_Orya MTEB FloresBitextMining (rus_Cyrl-ory_Orya) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.1106719367589 type value f1 98.83069828722003 type value main_score 98.83069828722003 type value precision 98.69894598155467 type value recall 99.1106719367589 type BitextMining dataset metrics task config name revision split type rus_Cyrl-sna_Latn MTEB FloresBitextMining (rus_Cyrl-sna_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 89.72332015810277 type value f1 87.30013645774514 type value main_score 87.30013645774514 type value precision 86.25329380764163 type value recall 89.72332015810277 type BitextMining dataset metrics task config name revision split type rus_Cyrl-tso_Latn MTEB FloresBitextMining (rus_Cyrl-tso_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 84.38735177865613 type value f1 80.70424744337788 type value main_score 80.70424744337788 type value precision 79.18560606060606 type value recall 84.38735177865613 type BitextMining dataset metrics task config name revision split type rus_Cyrl-azj_Latn MTEB FloresBitextMining (rus_Cyrl-azj_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.33201581027669 type value f1 96.56455862977602 type value main_score 96.56455862977602 type value precision 96.23682476943345 type value recall 97.33201581027669 type BitextMining dataset metrics task config name revision split type rus_Cyrl-dik_Latn MTEB FloresBitextMining (rus_Cyrl-dik_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 46.047430830039524 type value f1 40.05513069495283 type value main_score 40.05513069495283 type value precision 38.072590197096126 type value recall 46.047430830039524 type BitextMining dataset metrics task config name revision split type rus_Cyrl-hau_Latn MTEB FloresBitextMining (rus_Cyrl-hau_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 87.94466403162056 type value f1 84.76943346508563 type value main_score 84.76943346508563 type value precision 83.34486166007905 type value recall 87.94466403162056 type BitextMining dataset metrics task config name revision split type rus_Cyrl-kea_Latn MTEB FloresBitextMining (rus_Cyrl-kea_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 89.42687747035573 type value f1 86.83803021747684 type value main_score 86.83803021747684 type value precision 85.78416149068323 type value recall 89.42687747035573 type BitextMining dataset metrics task config name revision split type rus_Cyrl-lus_Latn MTEB FloresBitextMining (rus_Cyrl-lus_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 68.97233201581028 type value f1 64.05480726292745 type value main_score 64.05480726292745 type value precision 62.42670749487858 type value recall 68.97233201581028 type BitextMining dataset metrics task config name revision split type rus_Cyrl-pag_Latn MTEB FloresBitextMining (rus_Cyrl-pag_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 78.75494071146245 type value f1 74.58573558401933 type value main_score 74.58573558401933 type value precision 73.05532028358115 type value recall 78.75494071146245 type BitextMining dataset metrics task config name revision split type rus_Cyrl-snd_Arab MTEB FloresBitextMining (rus_Cyrl-snd_Arab) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 95.8498023715415 type value f1 94.56521739130434 type value main_score 94.56521739130434 type value precision 93.97233201581028 type value recall 95.8498023715415 type BitextMining dataset metrics task config name revision split type rus_Cyrl-tuk_Latn MTEB FloresBitextMining (rus_Cyrl-tuk_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 68.08300395256917 type value f1 62.93565240205557 type value main_score 62.93565240205557 type value precision 61.191590257043934 type value recall 68.08300395256917 type BitextMining dataset metrics task config name revision split type rus_Cyrl-bak_Cyrl MTEB FloresBitextMining (rus_Cyrl-bak_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 96.04743083003953 type value f1 94.86824769433464 type value main_score 94.86824769433464 type value precision 94.34288537549406 type value recall 96.04743083003953 type BitextMining dataset metrics task config name revision split type rus_Cyrl-dyu_Latn MTEB FloresBitextMining (rus_Cyrl-dyu_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 37.45059288537549 type value f1 31.670482312800807 type value main_score 31.670482312800807 type value precision 29.99928568357422 type value recall 37.45059288537549 type BitextMining dataset metrics task config name revision split type rus_Cyrl-heb_Hebr MTEB FloresBitextMining (rus_Cyrl-heb_Hebr) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.23320158102767 type value f1 96.38998682476942 type value main_score 96.38998682476942 type value precision 95.99802371541502 type value recall 97.23320158102767 type BitextMining dataset metrics task config name revision split type rus_Cyrl-khk_Cyrl MTEB FloresBitextMining (rus_Cyrl-khk_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.41897233201581 type value f1 98.00724637681158 type value main_score 98.00724637681158 type value precision 97.82938076416336 type value recall 98.41897233201581 type BitextMining dataset metrics task config name revision split type rus_Cyrl-lvs_Latn MTEB FloresBitextMining (rus_Cyrl-lvs_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.4308300395257 type value f1 96.61396574440053 type value main_score 96.61396574440053 type value precision 96.2203557312253 type value recall 97.4308300395257 type BitextMining dataset metrics task config name revision split type rus_Cyrl-pan_Guru MTEB FloresBitextMining (rus_Cyrl-pan_Guru) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.30830039525692 type value f1 99.07773386034256 type value main_score 99.07773386034256 type value precision 98.96245059288538 type value recall 99.30830039525692 type BitextMining dataset metrics task config name revision split type rus_Cyrl-som_Latn MTEB FloresBitextMining (rus_Cyrl-som_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 87.74703557312253 type value f1 84.52898550724638 type value main_score 84.52898550724638 type value precision 83.09288537549409 type value recall 87.74703557312253 type BitextMining dataset metrics task config name revision split type rus_Cyrl-tum_Latn MTEB FloresBitextMining (rus_Cyrl-tum_Latn) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 87.15415019762845 type value f1 83.85069640504425 type value main_score 83.85069640504425 type value precision 82.43671183888576 type value recall 87.15415019762845 type BitextMining dataset metrics task config name revision split type taq_Latn-rus_Cyrl MTEB FloresBitextMining (taq_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 28.55731225296443 type value f1 26.810726360049568 type value main_score 26.810726360049568 type value precision 26.260342858265577 type value recall 28.55731225296443 type BitextMining dataset metrics task config name revision split type war_Latn-rus_Cyrl MTEB FloresBitextMining (war_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 94.86166007905138 type value f1 94.03147083483051 type value main_score 94.03147083483051 type value precision 93.70653606003322 type value recall 94.86166007905138 type BitextMining dataset metrics task config name revision split type arb_Arab-rus_Cyrl MTEB FloresBitextMining (arb_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 96.34387351778656 type value f1 95.23056653491436 type value main_score 95.23056653491436 type value precision 94.70520421607378 type value recall 96.34387351778656 type BitextMining dataset metrics task config name revision split type bul_Cyrl-rus_Cyrl MTEB FloresBitextMining (bul_Cyrl-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.90118577075098 type value f1 99.86824769433464 type value main_score 99.86824769433464 type value precision 99.85177865612648 type value recall 99.90118577075098 type BitextMining dataset metrics task config name revision split type fra_Latn-rus_Cyrl MTEB FloresBitextMining (fra_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.2094861660079 type value f1 98.9459815546772 type value main_score 98.9459815546772 type value precision 98.81422924901186 type value recall 99.2094861660079 type BitextMining dataset metrics task config name revision split type jpn_Jpan-rus_Cyrl MTEB FloresBitextMining (jpn_Jpan-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.3201581027668 type value f1 97.76021080368905 type value main_score 97.76021080368905 type value precision 97.48023715415019 type value recall 98.3201581027668 type BitextMining dataset metrics task config name revision split type lij_Latn-rus_Cyrl MTEB FloresBitextMining (lij_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 83.49802371541502 type value f1 81.64800059239636 type value main_score 81.64800059239636 type value precision 80.9443055878478 type value recall 83.49802371541502 type BitextMining dataset metrics task config name revision split type mya_Mymr-rus_Cyrl MTEB FloresBitextMining (mya_Mymr-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 90.21739130434783 type value f1 88.76776366313682 type value main_score 88.76776366313682 type value precision 88.18370446119435 type value recall 90.21739130434783 type BitextMining dataset metrics task config name revision split type sag_Latn-rus_Cyrl MTEB FloresBitextMining (sag_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 41.699604743083 type value f1 39.53066322643847 type value main_score 39.53066322643847 type value precision 38.822876239229274 type value recall 41.699604743083 type BitextMining dataset metrics task config name revision split type taq_Tfng-rus_Cyrl MTEB FloresBitextMining (taq_Tfng-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 10.67193675889328 type value f1 9.205744965817951 type value main_score 9.205744965817951 type value precision 8.85195219073817 type value recall 10.67193675889328 type BitextMining dataset metrics task config name revision split type wol_Latn-rus_Cyrl MTEB FloresBitextMining (wol_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 63.537549407114625 type value f1 60.65190727391827 type value main_score 60.65190727391827 type value precision 59.61144833427442 type value recall 63.537549407114625 type BitextMining dataset metrics task config name revision split type arb_Latn-rus_Cyrl MTEB FloresBitextMining (arb_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 13.142292490118576 type value f1 12.372910318176764 type value main_score 12.372910318176764 type value precision 12.197580895919188 type value recall 13.142292490118576 type BitextMining dataset metrics task config name revision split type cat_Latn-rus_Cyrl MTEB FloresBitextMining (cat_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.01185770750988 type value f1 98.80599472990777 type value main_score 98.80599472990777 type value precision 98.72953133822698 type value recall 99.01185770750988 type BitextMining dataset metrics task config name revision split type fur_Latn-rus_Cyrl MTEB FloresBitextMining (fur_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 81.02766798418972 type value f1 79.36184294084613 type value main_score 79.36184294084613 type value precision 78.69187826527705 type value recall 81.02766798418972 type BitextMining dataset metrics task config name revision split type kab_Latn-rus_Cyrl MTEB FloresBitextMining (kab_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 34.387351778656125 type value f1 32.02306921576947 type value main_score 32.02306921576947 type value precision 31.246670347137467 type value recall 34.387351778656125 type BitextMining dataset metrics task config name revision split type lim_Latn-rus_Cyrl MTEB FloresBitextMining (lim_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 78.26086956521739 type value f1 75.90239449214359 type value main_score 75.90239449214359 type value precision 75.02211430745493 type value recall 78.26086956521739 type BitextMining dataset metrics task config name revision split type nld_Latn-rus_Cyrl MTEB FloresBitextMining (nld_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.2094861660079 type value f1 98.9459815546772 type value main_score 98.9459815546772 type value precision 98.81422924901186 type value recall 99.2094861660079 type BitextMining dataset metrics task config name revision split type san_Deva-rus_Cyrl MTEB FloresBitextMining (san_Deva-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 87.94466403162056 type value f1 86.68928897189767 type value main_score 86.68928897189767 type value precision 86.23822997079216 type value recall 87.94466403162056 type BitextMining dataset metrics task config name revision split type tat_Cyrl-rus_Cyrl MTEB FloresBitextMining (tat_Cyrl-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.03557312252964 type value f1 96.4167365353136 type value main_score 96.4167365353136 type value precision 96.16847826086958 type value recall 97.03557312252964 type BitextMining dataset metrics task config name revision split type xho_Latn-rus_Cyrl MTEB FloresBitextMining (xho_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 86.95652173913044 type value f1 85.5506497283435 type value main_score 85.5506497283435 type value precision 84.95270479733395 type value recall 86.95652173913044 type BitextMining dataset metrics task config name revision split type ars_Arab-rus_Cyrl MTEB FloresBitextMining (ars_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 96.6403162055336 type value f1 95.60935441370223 type value main_score 95.60935441370223 type value precision 95.13339920948617 type value recall 96.6403162055336 type BitextMining dataset metrics task config name revision split type ceb_Latn-rus_Cyrl MTEB FloresBitextMining (ceb_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 95.7509881422925 type value f1 95.05209198303827 type value main_score 95.05209198303827 type value precision 94.77662283368805 type value recall 95.7509881422925 type BitextMining dataset metrics task config name revision split type fuv_Latn-rus_Cyrl MTEB FloresBitextMining (fuv_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 45.25691699604743 type value f1 42.285666666742365 type value main_score 42.285666666742365 type value precision 41.21979853402283 type value recall 45.25691699604743 type BitextMining dataset metrics task config name revision split type kac_Latn-rus_Cyrl MTEB FloresBitextMining (kac_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 34.683794466403164 type value f1 33.3235346229031 type value main_score 33.3235346229031 type value precision 32.94673924616852 type value recall 34.683794466403164 type BitextMining dataset metrics task config name revision split type lin_Latn-rus_Cyrl MTEB FloresBitextMining (lin_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 86.85770750988142 type value f1 85.1867110799439 type value main_score 85.1867110799439 type value precision 84.53038212173273 type value recall 86.85770750988142 type BitextMining dataset metrics task config name revision split type nno_Latn-rus_Cyrl MTEB FloresBitextMining (nno_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.4308300395257 type value f1 96.78383210991906 type value main_score 96.78383210991906 type value precision 96.51185770750989 type value recall 97.4308300395257 type BitextMining dataset metrics task config name revision split type sat_Olck-rus_Cyrl MTEB FloresBitextMining (sat_Olck-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 1.185770750988142 type value f1 1.0279253129117258 type value main_score 1.0279253129117258 type value precision 1.0129746819135175 type value recall 1.185770750988142 type BitextMining dataset metrics task config name revision split type tel_Telu-rus_Cyrl MTEB FloresBitextMining (tel_Telu-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.12252964426878 type value f1 97.61198945981555 type value main_score 97.61198945981555 type value precision 97.401185770751 type value recall 98.12252964426878 type BitextMining dataset metrics task config name revision split type ydd_Hebr-rus_Cyrl MTEB FloresBitextMining (ydd_Hebr-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 75.8893280632411 type value f1 74.00244008018511 type value main_score 74.00244008018511 type value precision 73.25683020960382 type value recall 75.8893280632411 type BitextMining dataset metrics task config name revision split type ary_Arab-rus_Cyrl MTEB FloresBitextMining (ary_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 86.56126482213439 type value f1 83.72796285839765 type value main_score 83.72796285839765 type value precision 82.65014273166447 type value recall 86.56126482213439 type BitextMining dataset metrics task config name revision split type ces_Latn-rus_Cyrl MTEB FloresBitextMining (ces_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.60474308300395 type value f1 99.4729907773386 type value main_score 99.4729907773386 type value precision 99.40711462450594 type value recall 99.60474308300395 type BitextMining dataset metrics task config name revision split type gaz_Latn-rus_Cyrl MTEB FloresBitextMining (gaz_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 42.58893280632411 type value f1 40.75832866805978 type value main_score 40.75832866805978 type value precision 40.14285046917723 type value recall 42.58893280632411 type BitextMining dataset metrics task config name revision split type kam_Latn-rus_Cyrl MTEB FloresBitextMining (kam_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 45.25691699604743 type value f1 42.6975518029456 type value main_score 42.6975518029456 type value precision 41.87472710984596 type value recall 45.25691699604743 type BitextMining dataset metrics task config name revision split type lit_Latn-rus_Cyrl MTEB FloresBitextMining (lit_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.33201581027669 type value f1 96.62384716732542 type value main_score 96.62384716732542 type value precision 96.3175230566535 type value recall 97.33201581027669 type BitextMining dataset metrics task config name revision split type nob_Latn-rus_Cyrl MTEB FloresBitextMining (nob_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.71541501976284 type value f1 98.30368906455863 type value main_score 98.30368906455863 type value precision 98.10606060606061 type value recall 98.71541501976284 type BitextMining dataset metrics task config name revision split type scn_Latn-rus_Cyrl MTEB FloresBitextMining (scn_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 70.45454545454545 type value f1 68.62561022640075 type value main_score 68.62561022640075 type value precision 67.95229103411222 type value recall 70.45454545454545 type BitextMining dataset metrics task config name revision split type tgk_Cyrl-rus_Cyrl MTEB FloresBitextMining (tgk_Cyrl-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 92.4901185770751 type value f1 91.58514492753623 type value main_score 91.58514492753623 type value precision 91.24759298672342 type value recall 92.4901185770751 type BitextMining dataset metrics task config name revision split type yor_Latn-rus_Cyrl MTEB FloresBitextMining (yor_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 67.98418972332016 type value f1 64.72874247330768 type value main_score 64.72874247330768 type value precision 63.450823399938685 type value recall 67.98418972332016 type BitextMining dataset metrics task config name revision split type arz_Arab-rus_Cyrl MTEB FloresBitextMining (arz_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 94.56521739130434 type value f1 93.07971014492755 type value main_score 93.07971014492755 type value precision 92.42753623188406 type value recall 94.56521739130434 type BitextMining dataset metrics task config name revision split type cjk_Latn-rus_Cyrl MTEB FloresBitextMining (cjk_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 38.63636363636363 type value f1 36.25747140862938 type value main_score 36.25747140862938 type value precision 35.49101355074723 type value recall 38.63636363636363 type BitextMining dataset metrics task config name revision split type gla_Latn-rus_Cyrl MTEB FloresBitextMining (gla_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 69.26877470355731 type value f1 66.11797423328613 type value main_score 66.11797423328613 type value precision 64.89369649409694 type value recall 69.26877470355731 type BitextMining dataset metrics task config name revision split type kan_Knda-rus_Cyrl MTEB FloresBitextMining (kan_Knda-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.02371541501977 type value f1 97.51505740636176 type value main_score 97.51505740636176 type value precision 97.30731225296442 type value recall 98.02371541501977 type BitextMining dataset metrics task config name revision split type lmo_Latn-rus_Cyrl MTEB FloresBitextMining (lmo_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 73.3201581027668 type value f1 71.06371608677273 type value main_score 71.06371608677273 type value precision 70.26320288266223 type value recall 73.3201581027668 type BitextMining dataset metrics task config name revision split type npi_Deva-rus_Cyrl MTEB FloresBitextMining (npi_Deva-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.82608695652173 type value f1 97.36645107198466 type value main_score 97.36645107198466 type value precision 97.1772068511199 type value recall 97.82608695652173 type BitextMining dataset metrics task config name revision split type shn_Mymr-rus_Cyrl MTEB FloresBitextMining (shn_Mymr-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 39.426877470355734 type value f1 37.16728785513024 type value main_score 37.16728785513024 type value precision 36.56918548278505 type value recall 39.426877470355734 type BitextMining dataset metrics task config name revision split type tgl_Latn-rus_Cyrl MTEB FloresBitextMining (tgl_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.92490118577075 type value f1 97.6378693769998 type value main_score 97.6378693769998 type value precision 97.55371440154047 type value recall 97.92490118577075 type BitextMining dataset metrics task config name revision split type yue_Hant-rus_Cyrl MTEB FloresBitextMining (yue_Hant-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.92490118577075 type value f1 97.3833051006964 type value main_score 97.3833051006964 type value precision 97.1590909090909 type value recall 97.92490118577075 type BitextMining dataset metrics task config name revision split type asm_Beng-rus_Cyrl MTEB FloresBitextMining (asm_Beng-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 92.78656126482213 type value f1 91.76917395296842 type value main_score 91.76917395296842 type value precision 91.38292866553736 type value recall 92.78656126482213 type BitextMining dataset metrics task config name revision split type ckb_Arab-rus_Cyrl MTEB FloresBitextMining (ckb_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 80.8300395256917 type value f1 79.17664345468799 type value main_score 79.17664345468799 type value precision 78.5622171683459 type value recall 80.8300395256917 type BitextMining dataset metrics task config name revision split type gle_Latn-rus_Cyrl MTEB FloresBitextMining (gle_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 85.86956521739131 type value f1 84.45408265372492 type value main_score 84.45408265372492 type value precision 83.8774340026703 type value recall 85.86956521739131 type BitextMining dataset metrics task config name revision split type kas_Arab-rus_Cyrl MTEB FloresBitextMining (kas_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 76.28458498023716 type value f1 74.11216313578267 type value main_score 74.11216313578267 type value precision 73.2491277759584 type value recall 76.28458498023716 type BitextMining dataset metrics task config name revision split type ltg_Latn-rus_Cyrl MTEB FloresBitextMining (ltg_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 71.14624505928853 type value f1 68.69245357723618 type value main_score 68.69245357723618 type value precision 67.8135329666459 type value recall 71.14624505928853 type BitextMining dataset metrics task config name revision split type nso_Latn-rus_Cyrl MTEB FloresBitextMining (nso_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 87.64822134387352 type value f1 85.98419219986725 type value main_score 85.98419219986725 type value precision 85.32513873917036 type value recall 87.64822134387352 type BitextMining dataset metrics task config name revision split type sin_Sinh-rus_Cyrl MTEB FloresBitextMining (sin_Sinh-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.62845849802372 type value f1 97.10144927536231 type value main_score 97.10144927536231 type value precision 96.87986585219788 type value recall 97.62845849802372 type BitextMining dataset metrics task config name revision split type tha_Thai-rus_Cyrl MTEB FloresBitextMining (tha_Thai-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.71541501976284 type value f1 98.28722002635045 type value main_score 98.28722002635045 type value precision 98.07312252964427 type value recall 98.71541501976284 type BitextMining dataset metrics task config name revision split type zho_Hans-rus_Cyrl MTEB FloresBitextMining (zho_Hans-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.01185770750988 type value f1 98.68247694334651 type value main_score 98.68247694334651 type value precision 98.51778656126481 type value recall 99.01185770750988 type BitextMining dataset metrics task config name revision split type ast_Latn-rus_Cyrl MTEB FloresBitextMining (ast_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 95.65217391304348 type value f1 94.90649683857505 type value main_score 94.90649683857505 type value precision 94.61352657004831 type value recall 95.65217391304348 type BitextMining dataset metrics task config name revision split type crh_Latn-rus_Cyrl MTEB FloresBitextMining (crh_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 93.08300395256917 type value f1 92.20988998886428 type value main_score 92.20988998886428 type value precision 91.85631013694254 type value recall 93.08300395256917 type BitextMining dataset metrics task config name revision split type glg_Latn-rus_Cyrl MTEB FloresBitextMining (glg_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 95.55335968379447 type value f1 95.18006148440931 type value main_score 95.18006148440931 type value precision 95.06540560888386 type value recall 95.55335968379447 type BitextMining dataset metrics task config name revision split type kas_Deva-rus_Cyrl MTEB FloresBitextMining (kas_Deva-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 55.03952569169961 type value f1 52.19871938895554 type value main_score 52.19871938895554 type value precision 51.17660971469557 type value recall 55.03952569169961 type BitextMining dataset metrics task config name revision split type ltz_Latn-rus_Cyrl MTEB FloresBitextMining (ltz_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 87.64822134387352 type value f1 86.64179841897234 type value main_score 86.64179841897234 type value precision 86.30023235431587 type value recall 87.64822134387352 type BitextMining dataset metrics task config name revision split type nus_Latn-rus_Cyrl MTEB FloresBitextMining (nus_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 27.4703557312253 type value f1 25.703014277858088 type value main_score 25.703014277858088 type value precision 25.194105476917315 type value recall 27.4703557312253 type BitextMining dataset metrics task config name revision split type slk_Latn-rus_Cyrl MTEB FloresBitextMining (slk_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.30830039525692 type value f1 99.1106719367589 type value main_score 99.1106719367589 type value precision 99.02832674571805 type value recall 99.30830039525692 type BitextMining dataset metrics task config name revision split type tir_Ethi-rus_Cyrl MTEB FloresBitextMining (tir_Ethi-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 80.73122529644269 type value f1 78.66903754775608 type value main_score 78.66903754775608 type value precision 77.86431694163612 type value recall 80.73122529644269 type BitextMining dataset metrics task config name revision split type zho_Hant-rus_Cyrl MTEB FloresBitextMining (zho_Hant-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.22134387351778 type value f1 97.66798418972333 type value main_score 97.66798418972333 type value precision 97.40612648221344 type value recall 98.22134387351778 type BitextMining dataset metrics task config name revision split type awa_Deva-rus_Cyrl MTEB FloresBitextMining (awa_Deva-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.5296442687747 type value f1 96.94224857268335 type value main_score 96.94224857268335 type value precision 96.68560606060606 type value recall 97.5296442687747 type BitextMining dataset metrics task config name revision split type cym_Latn-rus_Cyrl MTEB FloresBitextMining (cym_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 92.68774703557312 type value f1 91.69854302097961 type value main_score 91.69854302097961 type value precision 91.31236846157795 type value recall 92.68774703557312 type BitextMining dataset metrics task config name revision split type grn_Latn-rus_Cyrl MTEB FloresBitextMining (grn_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 64.13043478260869 type value f1 61.850586118740004 type value main_score 61.850586118740004 type value precision 61.0049495186209 type value recall 64.13043478260869 type BitextMining dataset metrics task config name revision split type kat_Geor-rus_Cyrl MTEB FloresBitextMining (kat_Geor-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.02371541501977 type value f1 97.59881422924902 type value main_score 97.59881422924902 type value precision 97.42534036012296 type value recall 98.02371541501977 type BitextMining dataset metrics task config name revision split type lua_Latn-rus_Cyrl MTEB FloresBitextMining (lua_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 63.63636363636363 type value f1 60.9709122526128 type value main_score 60.9709122526128 type value precision 60.03915902282226 type value recall 63.63636363636363 type BitextMining dataset metrics task config name revision split type nya_Latn-rus_Cyrl MTEB FloresBitextMining (nya_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 89.2292490118577 type value f1 87.59723824473149 type value main_score 87.59723824473149 type value precision 86.90172707867349 type value recall 89.2292490118577 type BitextMining dataset metrics task config name revision split type slv_Latn-rus_Cyrl MTEB FloresBitextMining (slv_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.01185770750988 type value f1 98.74835309617917 type value main_score 98.74835309617917 type value precision 98.63636363636364 type value recall 99.01185770750988 type BitextMining dataset metrics task config name revision split type tpi_Latn-rus_Cyrl MTEB FloresBitextMining (tpi_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 77.37154150197628 type value f1 75.44251611276084 type value main_score 75.44251611276084 type value precision 74.78103665109595 type value recall 77.37154150197628 type BitextMining dataset metrics task config name revision split type zsm_Latn-rus_Cyrl MTEB FloresBitextMining (zsm_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.2094861660079 type value f1 98.96245059288538 type value main_score 98.96245059288538 type value precision 98.8471673254282 type value recall 99.2094861660079 type BitextMining dataset metrics task config name revision split type ayr_Latn-rus_Cyrl MTEB FloresBitextMining (ayr_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 27.766798418972332 type value f1 26.439103195281312 type value main_score 26.439103195281312 type value precision 26.052655604573964 type value recall 27.766798418972332 type BitextMining dataset metrics task config name revision split type dan_Latn-rus_Cyrl MTEB FloresBitextMining (dan_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.30830039525692 type value f1 99.07773386034255 type value main_score 99.07773386034255 type value precision 98.96245059288538 type value recall 99.30830039525692 type BitextMining dataset metrics task config name revision split type guj_Gujr-rus_Cyrl MTEB FloresBitextMining (guj_Gujr-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.82608695652173 type value f1 97.26449275362317 type value main_score 97.26449275362317 type value precision 97.02498588368154 type value recall 97.82608695652173 type BitextMining dataset metrics task config name revision split type kaz_Cyrl-rus_Cyrl MTEB FloresBitextMining (kaz_Cyrl-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.5296442687747 type value f1 97.03557312252964 type value main_score 97.03557312252964 type value precision 96.85022158342316 type value recall 97.5296442687747 type BitextMining dataset metrics task config name revision split type lug_Latn-rus_Cyrl MTEB FloresBitextMining (lug_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 68.57707509881423 type value f1 65.93361605820395 type value main_score 65.93361605820395 type value precision 64.90348248593789 type value recall 68.57707509881423 type BitextMining dataset metrics task config name revision split type oci_Latn-rus_Cyrl MTEB FloresBitextMining (oci_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 86.26482213438736 type value f1 85.33176417155623 type value main_score 85.33176417155623 type value precision 85.00208833384637 type value recall 86.26482213438736 type BitextMining dataset metrics task config name revision split type smo_Latn-rus_Cyrl MTEB FloresBitextMining (smo_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 77.96442687747036 type value f1 75.70960450188885 type value main_score 75.70960450188885 type value precision 74.8312632736777 type value recall 77.96442687747036 type BitextMining dataset metrics task config name revision split type tsn_Latn-rus_Cyrl MTEB FloresBitextMining (tsn_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 84.38735177865613 type value f1 82.13656376349225 type value main_score 82.13656376349225 type value precision 81.16794543904518 type value recall 84.38735177865613 type BitextMining dataset metrics task config name revision split type zul_Latn-rus_Cyrl MTEB FloresBitextMining (zul_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 90.21739130434783 type value f1 88.77570602050753 type value main_score 88.77570602050753 type value precision 88.15978104021582 type value recall 90.21739130434783 type BitextMining dataset metrics task config name revision split type azb_Arab-rus_Cyrl MTEB FloresBitextMining (azb_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 65.71146245059289 type value f1 64.18825390221271 type value main_score 64.18825390221271 type value precision 63.66811154793568 type value recall 65.71146245059289 type BitextMining dataset metrics task config name revision split type deu_Latn-rus_Cyrl MTEB FloresBitextMining (deu_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 99.70355731225297 type value f1 99.60474308300395 type value main_score 99.60474308300395 type value precision 99.55533596837944 type value recall 99.70355731225297 type BitextMining dataset metrics task config name revision split type hat_Latn-rus_Cyrl MTEB FloresBitextMining (hat_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 86.7588932806324 type value f1 85.86738623695146 type value main_score 85.86738623695146 type value precision 85.55235467420822 type value recall 86.7588932806324 type BitextMining dataset metrics task config name revision split type kbp_Latn-rus_Cyrl MTEB FloresBitextMining (kbp_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 34.88142292490119 type value f1 32.16511669463015 type value main_score 32.16511669463015 type value precision 31.432098549546318 type value recall 34.88142292490119 type BitextMining dataset metrics task config name revision split type luo_Latn-rus_Cyrl MTEB FloresBitextMining (luo_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 52.27272727272727 type value f1 49.60489626836975 type value main_score 49.60489626836975 type value precision 48.69639631803339 type value recall 52.27272727272727 type BitextMining dataset metrics task config name revision split type ory_Orya-rus_Cyrl MTEB FloresBitextMining (ory_Orya-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.82608695652173 type value f1 97.27437417654808 type value main_score 97.27437417654808 type value precision 97.04968944099377 type value recall 97.82608695652173 type BitextMining dataset metrics task config name revision split type sna_Latn-rus_Cyrl MTEB FloresBitextMining (sna_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 85.37549407114624 type value f1 83.09911316305177 type value main_score 83.09911316305177 type value precision 82.1284950958864 type value recall 85.37549407114624 type BitextMining dataset metrics task config name revision split type tso_Latn-rus_Cyrl MTEB FloresBitextMining (tso_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 82.90513833992095 type value f1 80.28290385503824 type value main_score 80.28290385503824 type value precision 79.23672543237761 type value recall 82.90513833992095 type BitextMining dataset metrics task config name revision split type azj_Latn-rus_Cyrl MTEB FloresBitextMining (azj_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.02371541501977 type value f1 97.49200075287031 type value main_score 97.49200075287031 type value precision 97.266139657444 type value recall 98.02371541501977 type BitextMining dataset metrics task config name revision split type dik_Latn-rus_Cyrl MTEB FloresBitextMining (dik_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 38.43873517786561 type value f1 35.78152442955223 type value main_score 35.78152442955223 type value precision 34.82424325078237 type value recall 38.43873517786561 type BitextMining dataset metrics task config name revision split type hau_Latn-rus_Cyrl MTEB FloresBitextMining (hau_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 81.42292490118577 type value f1 79.24612283124593 type value main_score 79.24612283124593 type value precision 78.34736070751448 type value recall 81.42292490118577 type BitextMining dataset metrics task config name revision split type kea_Latn-rus_Cyrl MTEB FloresBitextMining (kea_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 81.62055335968378 type value f1 80.47015182884748 type value main_score 80.47015182884748 type value precision 80.02671028885862 type value recall 81.62055335968378 type BitextMining dataset metrics task config name revision split type lus_Latn-rus_Cyrl MTEB FloresBitextMining (lus_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 62.74703557312253 type value f1 60.53900079111122 type value main_score 60.53900079111122 type value precision 59.80024202850289 type value recall 62.74703557312253 type BitextMining dataset metrics task config name revision split type pag_Latn-rus_Cyrl MTEB FloresBitextMining (pag_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 74.01185770750988 type value f1 72.57280648279529 type value main_score 72.57280648279529 type value precision 71.99952968456789 type value recall 74.01185770750988 type BitextMining dataset metrics task config name revision split type snd_Arab-rus_Cyrl MTEB FloresBitextMining (snd_Arab-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 91.30434782608695 type value f1 90.24653499445358 type value main_score 90.24653499445358 type value precision 89.83134068200232 type value recall 91.30434782608695 type BitextMining dataset metrics task config name revision split type tuk_Latn-rus_Cyrl MTEB FloresBitextMining (tuk_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 47.62845849802372 type value f1 45.812928836644254 type value main_score 45.812928836644254 type value precision 45.23713833170355 type value recall 47.62845849802372 type BitextMining dataset metrics task config name revision split type bak_Cyrl-rus_Cyrl MTEB FloresBitextMining (bak_Cyrl-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 95.8498023715415 type value f1 95.18904459615922 type value main_score 95.18904459615922 type value precision 94.92812441182006 type value recall 95.8498023715415 type BitextMining dataset metrics task config name revision split type dyu_Latn-rus_Cyrl MTEB FloresBitextMining (dyu_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 29.64426877470356 type value f1 27.287335193938166 type value main_score 27.287335193938166 type value precision 26.583996026587492 type value recall 29.64426877470356 type BitextMining dataset metrics task config name revision split type heb_Hebr-rus_Cyrl MTEB FloresBitextMining (heb_Hebr-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 98.91304347826086 type value f1 98.55072463768116 type value main_score 98.55072463768116 type value precision 98.36956521739131 type value recall 98.91304347826086 type BitextMining dataset metrics task config name revision split type khk_Cyrl-rus_Cyrl MTEB FloresBitextMining (khk_Cyrl-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 95.15810276679841 type value f1 94.44009547764487 type value main_score 94.44009547764487 type value precision 94.16579797014579 type value recall 95.15810276679841 type BitextMining dataset metrics task config name revision split type lvs_Latn-rus_Cyrl MTEB FloresBitextMining (lvs_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.92490118577075 type value f1 97.51467241585817 type value main_score 97.51467241585817 type value precision 97.36166007905138 type value recall 97.92490118577075 type BitextMining dataset metrics task config name revision split type pan_Guru-rus_Cyrl MTEB FloresBitextMining (pan_Guru-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 97.92490118577075 type value f1 97.42918313570486 type value main_score 97.42918313570486 type value precision 97.22261434217955 type value recall 97.92490118577075 type BitextMining dataset metrics task config name revision split type som_Latn-rus_Cyrl MTEB FloresBitextMining (som_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 75.69169960474308 type value f1 73.7211667065916 type value main_score 73.7211667065916 type value precision 72.95842401892384 type value recall 75.69169960474308 type BitextMining dataset metrics task config name revision split type tum_Latn-rus_Cyrl MTEB FloresBitextMining (tum_Latn-rus_Cyrl) e6b647fcb6299a2f686f742f4d4c023e553ea67e devtest mteb/flores type value accuracy 85.67193675889328 type value f1 82.9296066252588 type value main_score 82.9296066252588 type value precision 81.77330225447936 type value recall 85.67193675889328 type BitextMining dataset metrics task config name revision split type default MTEB GeoreviewClassification (default) 3765c0d1de6b7d264bc459433c45e5a75513839c test ai-forever/georeview-classification type value accuracy 44.6630859375 type value f1 42.607425073610536 type value f1_weighted 42.60639474586065 type value main_score 44.6630859375 type Classification dataset metrics task config name revision split type default MTEB GeoreviewClusteringP2P (default) 97a313c8fc85b47f13f33e7e9a95c1ad888c7fec test ai-forever/georeview-clustering-p2p type value main_score 58.15951247070825 type value v_measure 58.15951247070825 type value v_measure_std 0.6739615788288809 type Clustering dataset metrics task config name revision split type default MTEB HeadlineClassification (default) 2fe05ee6b5832cda29f2ef7aaad7b7fe6a3609eb test ai-forever/headline-classification type value accuracy 73.935546875 type value f1 73.8654872186846 type value f1_weighted 73.86733122685095 type value main_score 73.935546875 type Classification dataset metrics task config name revision split type default MTEB InappropriatenessClassification (default) 601651fdc45ef243751676e62dd7a19f491c0285 test ai-forever/inappropriateness-classification type value accuracy 59.16015624999999 type value ap 55.52276605836938 type value ap_weighted 55.52276605836938 type value f1 58.614248199637956 type value f1_weighted 58.614248199637956 type value main_score 59.16015624999999 type Classification dataset metrics task config name revision split type default MTEB KinopoiskClassification (default) 5911f26666ac11af46cb9c6849d0dc80a378af24 test ai-forever/kinopoisk-sentiment-classification type value accuracy 49.959999999999994 type value f1 48.4900332316098 type value f1_weighted 48.4900332316098 type value main_score 49.959999999999994 type Classification dataset metrics task config name revision split type default MTEB LanguageClassification (default) aa56583bf2bc52b0565770607d6fc3faebecf9e2 test papluca/language-identification type value accuracy 71.005859375 type value f1 69.63481100303348 type value f1_weighted 69.64640413409529 type value main_score 71.005859375 type Classification dataset metrics task config name revision split type ru MTEB MLSUMClusteringP2P (ru) b5d54f8f3b61ae17845046286940f03c6bc79bc7 test reciTAL/mlsum type value main_score 42.11280087032343 type value v_measure 42.11280087032343 type value v_measure_std 6.7619971723605135 type Clustering dataset metrics task config name revision split type ru MTEB MLSUMClusteringP2P.v2 (ru) b5d54f8f3b61ae17845046286940f03c6bc79bc7 test reciTAL/mlsum type value main_score 43.00112546945811 type value v_measure 43.00112546945811 type value v_measure_std 1.4740560414835675 type Clustering dataset metrics task config name revision split type ru MTEB MLSUMClusteringS2S (ru) b5d54f8f3b61ae17845046286940f03c6bc79bc7 test reciTAL/mlsum type value main_score 39.81446080575161 type value v_measure 39.81446080575161 type value v_measure_std 7.125661320308298 type Clustering dataset metrics task config name revision split type ru MTEB MLSUMClusteringS2S.v2 (ru) b5d54f8f3b61ae17845046286940f03c6bc79bc7 test reciTAL/mlsum type value main_score 39.29659668980239 type value v_measure 39.29659668980239 type value v_measure_std 2.6570502923023094 type Clustering dataset metrics task config name revision split type ru MTEB MultiLongDocRetrieval (ru) d67138e705d963e346253a80e59676ddb418810a dev Shitao/MLDR type value main_score 38.671 type value map_at_1 30.0 type value map_at_10 36.123 type value map_at_100 36.754999999999995 type value map_at_1000 36.806 type value map_at_20 36.464 type value map_at_3 35.25 type value map_at_5 35.8 type value mrr_at_1 30.0 type value mrr_at_10 36.122817460317464 type value mrr_at_100 36.75467016625293 type value mrr_at_1000 36.80612724920882 type value mrr_at_20 36.46359681984682 type value mrr_at_3 35.25 type value mrr_at_5 35.800000000000004 type value nauc_map_at_1000_diff1 55.61987610843598 type value nauc_map_at_1000_max 52.506795017152186 type value nauc_map_at_1000_std 2.95487192066911 type value nauc_map_at_100_diff1 55.598419532054734 type value nauc_map_at_100_max 52.48192017040307 type value nauc_map_at_100_std 2.930120252521189 type value nauc_map_at_10_diff1 56.02309155375198 type value nauc_map_at_10_max 52.739573233234424 type value nauc_map_at_10_std 2.4073432421641545 type value nauc_map_at_1_diff1 52.57059856776112 type value nauc_map_at_1_max 50.55668152952304 type value nauc_map_at_1_std 1.6572084853398048 type value nauc_map_at_20_diff1 55.75769029917031 type value nauc_map_at_20_max 52.53663737242853 type value nauc_map_at_20_std 2.8489192879814 type value nauc_map_at_3_diff1 56.90294128342709 type value nauc_map_at_3_max 53.10608389782041 type value nauc_map_at_3_std 1.4909731657889491 type value nauc_map_at_5_diff1 56.1258315436073 type value nauc_map_at_5_max 52.398078357541564 type value nauc_map_at_5_std 1.8256862015101467 type value nauc_mrr_at_1000_diff1 55.61987610843598 type value nauc_mrr_at_1000_max 52.506795017152186 type value nauc_mrr_at_1000_std 2.95487192066911 type value nauc_mrr_at_100_diff1 55.598419532054734 type value nauc_mrr_at_100_max 52.48192017040307 type value nauc_mrr_at_100_std 2.930120252521189 type value nauc_mrr_at_10_diff1 56.02309155375198 type value nauc_mrr_at_10_max 52.739573233234424 type value nauc_mrr_at_10_std 2.4073432421641545 type value nauc_mrr_at_1_diff1 52.57059856776112 type value nauc_mrr_at_1_max 50.55668152952304 type value nauc_mrr_at_1_std 1.6572084853398048 type value nauc_mrr_at_20_diff1 55.75769029917031 type value nauc_mrr_at_20_max 52.53663737242853 type value nauc_mrr_at_20_std 2.8489192879814 type value nauc_mrr_at_3_diff1 56.90294128342709 type value nauc_mrr_at_3_max 53.10608389782041 type value nauc_mrr_at_3_std 1.4909731657889491 type value nauc_mrr_at_5_diff1 56.1258315436073 type value nauc_mrr_at_5_max 52.398078357541564 type value nauc_mrr_at_5_std 1.8256862015101467 type value nauc_ndcg_at_1000_diff1 55.30733548408918 type value nauc_ndcg_at_1000_max 53.51143366189318 type value nauc_ndcg_at_1000_std 7.133789405525702 type value nauc_ndcg_at_100_diff1 54.32209039488095 type value nauc_ndcg_at_100_max 52.67499334461009 type value nauc_ndcg_at_100_std 6.878823275077807 type value nauc_ndcg_at_10_diff1 56.266780806997716 type value nauc_ndcg_at_10_max 53.52837255793743 type value nauc_ndcg_at_10_std 3.756832592964262 type value nauc_ndcg_at_1_diff1 52.57059856776112 type value nauc_ndcg_at_1_max 50.55668152952304 type value nauc_ndcg_at_1_std 1.6572084853398048 type value nauc_ndcg_at_20_diff1 55.39255420432796 type value nauc_ndcg_at_20_max 52.946114684072235 type value nauc_ndcg_at_20_std 5.414933414031693 type value nauc_ndcg_at_3_diff1 57.92826624996289 type value nauc_ndcg_at_3_max 53.89907760306972 type value nauc_ndcg_at_3_std 1.6661401245309218 type value nauc_ndcg_at_5_diff1 56.47508936029308 type value nauc_ndcg_at_5_max 52.66800998045517 type value nauc_ndcg_at_5_std 2.4127296184140423 type value nauc_precision_at_1000_diff1 57.25924020238401 type value nauc_precision_at_1000_max 65.1132590931922 type value nauc_precision_at_1000_std 40.60788709618145 type value nauc_precision_at_100_diff1 46.49620002554606 type value nauc_precision_at_100_max 53.02960148167071 type value nauc_precision_at_100_std 28.206028867032863 type value nauc_precision_at_10_diff1 56.562744749606765 type value nauc_precision_at_10_max 56.00594967783547 type value nauc_precision_at_10_std 8.368379831645163 type value nauc_precision_at_1_diff1 52.57059856776112 type value nauc_precision_at_1_max 50.55668152952304 type value nauc_precision_at_1_std 1.6572084853398048 type value nauc_precision_at_20_diff1 53.25915754614111 type value nauc_precision_at_20_max 54.03255118937036 type value nauc_precision_at_20_std 15.161611674272718 type value nauc_precision_at_3_diff1 60.726785748943854 type value nauc_precision_at_3_max 56.139896875869354 type value nauc_precision_at_3_std 2.2306901035769893 type value nauc_precision_at_5_diff1 57.1201127525187 type value nauc_precision_at_5_max 53.28665761862506 type value nauc_precision_at_5_std 4.358720050112237 type value nauc_recall_at_1000_diff1 57.259240202383964 type value nauc_recall_at_1000_max 65.11325909319218 type value nauc_recall_at_1000_std 40.60788709618142 type value nauc_recall_at_100_diff1 46.49620002554603 type value nauc_recall_at_100_max 53.02960148167071 type value nauc_recall_at_100_std 28.206028867032835 type value nauc_recall_at_10_diff1 56.562744749606765 type value nauc_recall_at_10_max 56.00594967783549 type value nauc_recall_at_10_std 8.368379831645147 type value nauc_recall_at_1_diff1 52.57059856776112 type value nauc_recall_at_1_max 50.55668152952304 type value nauc_recall_at_1_std 1.6572084853398048 type value nauc_recall_at_20_diff1 53.259157546141154 type value nauc_recall_at_20_max 54.03255118937038 type value nauc_recall_at_20_std 15.16161167427274 type value nauc_recall_at_3_diff1 60.72678574894387 type value nauc_recall_at_3_max 56.13989687586933 type value nauc_recall_at_3_std 2.2306901035770066 type value nauc_recall_at_5_diff1 57.12011275251864 type value nauc_recall_at_5_max 53.28665761862502 type value nauc_recall_at_5_std 4.3587200501122245 type value ndcg_at_1 30.0 type value ndcg_at_10 38.671 type value ndcg_at_100 42.173 type value ndcg_at_1000 44.016 type value ndcg_at_20 39.845000000000006 type value ndcg_at_3 36.863 type value ndcg_at_5 37.874 type value precision_at_1 30.0 type value precision_at_10 4.65 type value precision_at_100 0.64 type value precision_at_1000 0.08 type value precision_at_20 2.55 type value precision_at_3 13.833 type value precision_at_5 8.799999999999999 type value recall_at_1 30.0 type value recall_at_10 46.5 type value recall_at_100 64.0 type value recall_at_1000 79.5 type value recall_at_20 51.0 type value recall_at_3 41.5 type value recall_at_5 44.0 type Retrieval dataset metrics task config name revision split type rus MTEB MultilingualSentimentClassification (rus) 2b9b4d10fc589af67794141fe8cbd3739de1eb33 test mteb/multilingual-sentiment-classification type value accuracy 79.52710495963092 type value ap 84.5713457178972 type value ap_weighted 84.5713457178972 type value f1 77.88661181524105 type value f1_weighted 79.87563079922718 type value main_score 79.52710495963092 type Classification dataset metrics task config name revision split type arb_Arab-rus_Cyrl MTEB NTREXBitextMining (arb_Arab-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 86.47971957936905 type value f1 82.79864240805654 type value main_score 82.79864240805654 type value precision 81.21485800128767 type value recall 86.47971957936905 type BitextMining dataset metrics task config name revision split type bel_Cyrl-rus_Cyrl MTEB NTREXBitextMining (bel_Cyrl-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 94.84226339509264 type value f1 93.56399067465667 type value main_score 93.56399067465667 type value precision 93.01619095309631 type value recall 94.84226339509264 type BitextMining dataset metrics task config name revision split type ben_Beng-rus_Cyrl MTEB NTREXBitextMining (ben_Beng-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 92.18828242363544 type value f1 90.42393889620612 type value main_score 90.42393889620612 type value precision 89.67904925153297 type value recall 92.18828242363544 type BitextMining dataset metrics task config name revision split type bos_Latn-rus_Cyrl MTEB NTREXBitextMining (bos_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 94.69203805708563 type value f1 93.37172425304624 type value main_score 93.37172425304624 type value precision 92.79204521067315 type value recall 94.69203805708563 type BitextMining dataset metrics task config name revision split type bul_Cyrl-rus_Cyrl MTEB NTREXBitextMining (bul_Cyrl-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 96.99549323985978 type value f1 96.13086296110833 type value main_score 96.13086296110833 type value precision 95.72441996327827 type value recall 96.99549323985978 type BitextMining dataset metrics task config name revision split type ces_Latn-rus_Cyrl MTEB NTREXBitextMining (ces_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 95.94391587381071 type value f1 94.90680465142157 type value main_score 94.90680465142157 type value precision 94.44541812719079 type value recall 95.94391587381071 type BitextMining dataset metrics task config name revision split type deu_Latn-rus_Cyrl MTEB NTREXBitextMining (deu_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 96.09414121181773 type value f1 94.94408279085295 type value main_score 94.94408279085295 type value precision 94.41245201135037 type value recall 96.09414121181773 type BitextMining dataset metrics task config name revision split type ell_Grek-rus_Cyrl MTEB NTREXBitextMining (ell_Grek-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 96.19429143715573 type value f1 95.12101485561676 type value main_score 95.12101485561676 type value precision 94.60440660991488 type value recall 96.19429143715573 type BitextMining dataset metrics task config name revision split type eng_Latn-rus_Cyrl MTEB NTREXBitextMining (eng_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 96.49474211316975 type value f1 95.46581777428045 type value main_score 95.46581777428045 type value precision 94.98414288098814 type value recall 96.49474211316975 type BitextMining dataset metrics task config name revision split type fas_Arab-rus_Cyrl MTEB NTREXBitextMining (fas_Arab-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 94.44166249374061 type value f1 92.92383018972905 type value main_score 92.92383018972905 type value precision 92.21957936905358 type value recall 94.44166249374061 type BitextMining dataset metrics task config name revision split type fin_Latn-rus_Cyrl MTEB NTREXBitextMining (fin_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 92.18828242363544 type value f1 90.2980661468393 type value main_score 90.2980661468393 type value precision 89.42580537472877 type value recall 92.18828242363544 type BitextMining dataset metrics task config name revision split type fra_Latn-rus_Cyrl MTEB NTREXBitextMining (fra_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 95.84376564847271 type value f1 94.81054915706895 type value main_score 94.81054915706895 type value precision 94.31369276136427 type value recall 95.84376564847271 type BitextMining dataset metrics task config name revision split type heb_Hebr-rus_Cyrl MTEB NTREXBitextMining (heb_Hebr-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 94.89233850776164 type value f1 93.42513770655985 type value main_score 93.42513770655985 type value precision 92.73493573693875 type value recall 94.89233850776164 type BitextMining dataset metrics task config name revision split type hin_Deva-rus_Cyrl MTEB NTREXBitextMining (hin_Deva-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 93.23985978968453 type value f1 91.52816526376867 type value main_score 91.52816526376867 type value precision 90.76745946425466 type value recall 93.23985978968453 type BitextMining dataset metrics task config name revision split type hrv_Latn-rus_Cyrl MTEB NTREXBitextMining (hrv_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 93.99098647971958 type value f1 92.36354531797697 type value main_score 92.36354531797697 type value precision 91.63228970439788 type value recall 93.99098647971958 type BitextMining dataset metrics task config name revision split type hun_Latn-rus_Cyrl MTEB NTREXBitextMining (hun_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 93.64046069103655 type value f1 92.05224503421799 type value main_score 92.05224503421799 type value precision 91.33998616973079 type value recall 93.64046069103655 type BitextMining dataset metrics task config name revision split type ind_Latn-rus_Cyrl MTEB NTREXBitextMining (ind_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 91.68753129694541 type value f1 89.26222667334335 type value main_score 89.26222667334335 type value precision 88.14638624603572 type value recall 91.68753129694541 type BitextMining dataset metrics task config name revision split type jpn_Jpan-rus_Cyrl MTEB NTREXBitextMining (jpn_Jpan-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 91.28693039559339 type value f1 89.21161763348957 type value main_score 89.21161763348957 type value precision 88.31188340952988 type value recall 91.28693039559339 type BitextMining dataset metrics task config name revision split type kor_Hang-rus_Cyrl MTEB NTREXBitextMining (kor_Hang-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 89.53430145217827 type value f1 86.88322165788365 type value main_score 86.88322165788365 type value precision 85.73950211030831 type value recall 89.53430145217827 type BitextMining dataset metrics task config name revision split type lit_Latn-rus_Cyrl MTEB NTREXBitextMining (lit_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 90.28542814221332 type value f1 88.10249103814452 type value main_score 88.10249103814452 type value precision 87.17689323973752 type value recall 90.28542814221332 type BitextMining dataset metrics task config name revision split type mkd_Cyrl-rus_Cyrl MTEB NTREXBitextMining (mkd_Cyrl-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 95.04256384576865 type value f1 93.65643703650713 type value main_score 93.65643703650713 type value precision 93.02036387915207 type value recall 95.04256384576865 type BitextMining dataset metrics task config name revision split type nld_Latn-rus_Cyrl MTEB NTREXBitextMining (nld_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 95.39308963445168 type value f1 94.16207644800535 type value main_score 94.16207644800535 type value precision 93.582516632091 type value recall 95.39308963445168 type BitextMining dataset metrics task config name revision split type pol_Latn-rus_Cyrl MTEB NTREXBitextMining (pol_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 95.7436154231347 type value f1 94.5067601402103 type value main_score 94.5067601402103 type value precision 93.91587381071608 type value recall 95.7436154231347 type BitextMining dataset metrics task config name revision split type por_Latn-rus_Cyrl MTEB NTREXBitextMining (por_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 65.89884827240861 type value f1 64.61805459419219 type value main_score 64.61805459419219 type value precision 64.07119451106485 type value recall 65.89884827240861 type BitextMining dataset metrics task config name revision split type rus_Cyrl-arb_Arab MTEB NTREXBitextMining (rus_Cyrl-arb_Arab) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 94.2413620430646 type value f1 92.67663399861698 type value main_score 92.67663399861698 type value precision 91.94625271240193 type value recall 94.2413620430646 type BitextMining dataset metrics task config name revision split type rus_Cyrl-bel_Cyrl MTEB NTREXBitextMining (rus_Cyrl-bel_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 94.89233850776164 type value f1 93.40343849106993 type value main_score 93.40343849106993 type value precision 92.74077783341679 type value recall 94.89233850776164 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ben_Beng MTEB NTREXBitextMining (rus_Cyrl-ben_Beng) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 94.2914371557336 type value f1 92.62226673343348 type value main_score 92.62226673343348 type value precision 91.84610248706393 type value recall 94.2914371557336 type BitextMining dataset metrics task config name revision split type rus_Cyrl-bos_Latn MTEB NTREXBitextMining (rus_Cyrl-bos_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 95.69354031046569 type value f1 94.50418051319403 type value main_score 94.50418051319403 type value precision 93.95843765648473 type value recall 95.69354031046569 type BitextMining dataset metrics task config name revision split type rus_Cyrl-bul_Cyrl MTEB NTREXBitextMining (rus_Cyrl-bul_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 95.89384076114172 type value f1 94.66199298948423 type value main_score 94.66199298948423 type value precision 94.08028709731263 type value recall 95.89384076114172 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ces_Latn MTEB NTREXBitextMining (rus_Cyrl-ces_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 93.94091136705057 type value f1 92.3746731207923 type value main_score 92.3746731207923 type value precision 91.66207644800535 type value recall 93.94091136705057 type BitextMining dataset metrics task config name revision split type rus_Cyrl-deu_Latn MTEB NTREXBitextMining (rus_Cyrl-deu_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 95.94391587381071 type value f1 94.76214321482223 type value main_score 94.76214321482223 type value precision 94.20380570856285 type value recall 95.94391587381071 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ell_Grek MTEB NTREXBitextMining (rus_Cyrl-ell_Grek) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 95.44316474712068 type value f1 94.14788849941579 type value main_score 94.14788849941579 type value precision 93.54197963612084 type value recall 95.44316474712068 type BitextMining dataset metrics task config name revision split type rus_Cyrl-eng_Latn MTEB NTREXBitextMining (rus_Cyrl-eng_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 98.14722083124687 type value f1 97.57135703555333 type value main_score 97.57135703555333 type value precision 97.2959439158738 type value recall 98.14722083124687 type BitextMining dataset metrics task config name revision split type rus_Cyrl-fas_Arab MTEB NTREXBitextMining (rus_Cyrl-fas_Arab) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 94.64196294441662 type value f1 93.24653647137372 type value main_score 93.24653647137372 type value precision 92.60724419963279 type value recall 94.64196294441662 type BitextMining dataset metrics task config name revision split type rus_Cyrl-fin_Latn MTEB NTREXBitextMining (rus_Cyrl-fin_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 87.98197295943916 type value f1 85.23368385912201 type value main_score 85.23368385912201 type value precision 84.08159858835873 type value recall 87.98197295943916 type BitextMining dataset metrics task config name revision split type rus_Cyrl-fra_Latn MTEB NTREXBitextMining (rus_Cyrl-fra_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 96.24436654982473 type value f1 95.07093974294774 type value main_score 95.07093974294774 type value precision 94.49591053246536 type value recall 96.24436654982473 type BitextMining dataset metrics task config name revision split type rus_Cyrl-heb_Hebr MTEB NTREXBitextMining (rus_Cyrl-heb_Hebr) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 91.08662994491738 type value f1 88.5161074945752 type value main_score 88.5161074945752 type value precision 87.36187614755467 type value recall 91.08662994491738 type BitextMining dataset metrics task config name revision split type rus_Cyrl-hin_Deva MTEB NTREXBitextMining (rus_Cyrl-hin_Deva) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 95.04256384576865 type value f1 93.66382907694876 type value main_score 93.66382907694876 type value precision 93.05291270238692 type value recall 95.04256384576865 type BitextMining dataset metrics task config name revision split type rus_Cyrl-hrv_Latn MTEB NTREXBitextMining (rus_Cyrl-hrv_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 95.14271407110667 type value f1 93.7481221832749 type value main_score 93.7481221832749 type value precision 93.10930681736892 type value recall 95.14271407110667 type BitextMining dataset metrics task config name revision split type rus_Cyrl-hun_Latn MTEB NTREXBitextMining (rus_Cyrl-hun_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 90.18527791687532 type value f1 87.61415933423946 type value main_score 87.61415933423946 type value precision 86.5166400394242 type value recall 90.18527791687532 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ind_Latn MTEB NTREXBitextMining (rus_Cyrl-ind_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 93.69053580370556 type value f1 91.83608746453012 type value main_score 91.83608746453012 type value precision 90.97145718577868 type value recall 93.69053580370556 type BitextMining dataset metrics task config name revision split type rus_Cyrl-jpn_Jpan MTEB NTREXBitextMining (rus_Cyrl-jpn_Jpan) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 89.48422633950926 type value f1 86.91271033534429 type value main_score 86.91271033534429 type value precision 85.82671626487351 type value recall 89.48422633950926 type BitextMining dataset metrics task config name revision split type rus_Cyrl-kor_Hang MTEB NTREXBitextMining (rus_Cyrl-kor_Hang) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 88.4827240861292 type value f1 85.35080398375342 type value main_score 85.35080398375342 type value precision 83.9588549490903 type value recall 88.4827240861292 type BitextMining dataset metrics task config name revision split type rus_Cyrl-lit_Latn MTEB NTREXBitextMining (rus_Cyrl-lit_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 90.33550325488233 type value f1 87.68831819157307 type value main_score 87.68831819157307 type value precision 86.51524906407231 type value recall 90.33550325488233 type BitextMining dataset metrics task config name revision split type rus_Cyrl-mkd_Cyrl MTEB NTREXBitextMining (rus_Cyrl-mkd_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 95.94391587381071 type value f1 94.90402270071775 type value main_score 94.90402270071775 type value precision 94.43915873810715 type value recall 95.94391587381071 type BitextMining dataset metrics task config name revision split type rus_Cyrl-nld_Latn MTEB NTREXBitextMining (rus_Cyrl-nld_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 92.98948422633951 type value f1 91.04323151393756 type value main_score 91.04323151393756 type value precision 90.14688699716241 type value recall 92.98948422633951 type BitextMining dataset metrics task config name revision split type rus_Cyrl-pol_Latn MTEB NTREXBitextMining (rus_Cyrl-pol_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 94.34151226840261 type value f1 92.8726422967785 type value main_score 92.8726422967785 type value precision 92.19829744616925 type value recall 94.34151226840261 type BitextMining dataset metrics task config name revision split type rus_Cyrl-por_Latn MTEB NTREXBitextMining (rus_Cyrl-por_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 86.17926890335504 type value f1 82.7304882287356 type value main_score 82.7304882287356 type value precision 81.28162481817964 type value recall 86.17926890335504 type BitextMining dataset metrics task config name revision split type rus_Cyrl-slk_Latn MTEB NTREXBitextMining (rus_Cyrl-slk_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 92.7391086629945 type value f1 90.75112669003506 type value main_score 90.75112669003506 type value precision 89.8564513436822 type value recall 92.7391086629945 type BitextMining dataset metrics task config name revision split type rus_Cyrl-slv_Latn MTEB NTREXBitextMining (rus_Cyrl-slv_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 92.8893340010015 type value f1 91.05992321816058 type value main_score 91.05992321816058 type value precision 90.22589439715128 type value recall 92.8893340010015 type BitextMining dataset metrics task config name revision split type rus_Cyrl-spa_Latn MTEB NTREXBitextMining (rus_Cyrl-spa_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 96.49474211316975 type value f1 95.4715406442998 type value main_score 95.4715406442998 type value precision 94.9799699549324 type value recall 96.49474211316975 type BitextMining dataset metrics task config name revision split type rus_Cyrl-srp_Cyrl MTEB NTREXBitextMining (rus_Cyrl-srp_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 81.07160741111667 type value f1 76.55687285507015 type value main_score 76.55687285507015 type value precision 74.71886401030116 type value recall 81.07160741111667 type BitextMining dataset metrics task config name revision split type rus_Cyrl-srp_Latn MTEB NTREXBitextMining (rus_Cyrl-srp_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 95.14271407110667 type value f1 93.73302377809138 type value main_score 93.73302377809138 type value precision 93.06960440660991 type value recall 95.14271407110667 type BitextMining dataset metrics task config name revision split type rus_Cyrl-swa_Latn MTEB NTREXBitextMining (rus_Cyrl-swa_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 94.79218828242364 type value f1 93.25988983475212 type value main_score 93.25988983475212 type value precision 92.53463528626273 type value recall 94.79218828242364 type BitextMining dataset metrics task config name revision split type rus_Cyrl-swe_Latn MTEB NTREXBitextMining (rus_Cyrl-swe_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 95.04256384576865 type value f1 93.58704723752295 type value main_score 93.58704723752295 type value precision 92.91437155733601 type value recall 95.04256384576865 type BitextMining dataset metrics task config name revision split type rus_Cyrl-tam_Taml MTEB NTREXBitextMining (rus_Cyrl-tam_Taml) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 93.28993490235354 type value f1 91.63912535469872 type value main_score 91.63912535469872 type value precision 90.87738750983617 type value recall 93.28993490235354 type BitextMining dataset metrics task config name revision split type rus_Cyrl-tur_Latn MTEB NTREXBitextMining (rus_Cyrl-tur_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 93.74061091637456 type value f1 91.96628275746953 type value main_score 91.96628275746953 type value precision 91.15923885828742 type value recall 93.74061091637456 type BitextMining dataset metrics task config name revision split type rus_Cyrl-ukr_Cyrl MTEB NTREXBitextMining (rus_Cyrl-ukr_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 95.99399098647972 type value f1 94.89567684860624 type value main_score 94.89567684860624 type value precision 94.37072275079286 type value recall 95.99399098647972 type BitextMining dataset metrics task config name revision split type rus_Cyrl-vie_Latn MTEB NTREXBitextMining (rus_Cyrl-vie_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 91.4371557336004 type value f1 88.98681355366382 type value main_score 88.98681355366382 type value precision 87.89183775663496 type value recall 91.4371557336004 type BitextMining dataset metrics task config name revision split type rus_Cyrl-zho_Hant MTEB NTREXBitextMining (rus_Cyrl-zho_Hant) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 92.7891837756635 type value f1 90.79047142141783 type value main_score 90.79047142141783 type value precision 89.86980470706058 type value recall 92.7891837756635 type BitextMining dataset metrics task config name revision split type rus_Cyrl-zul_Latn MTEB NTREXBitextMining (rus_Cyrl-zul_Latn) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 87.43114672008012 type value f1 84.04618833011422 type value main_score 84.04618833011422 type value precision 82.52259341393041 type value recall 87.43114672008012 type BitextMining dataset metrics task config name revision split type slk_Latn-rus_Cyrl MTEB NTREXBitextMining (slk_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 95.34301452178268 type value f1 94.20392493502158 type value main_score 94.20392493502158 type value precision 93.67384409948257 type value recall 95.34301452178268 type BitextMining dataset metrics task config name revision split type slv_Latn-rus_Cyrl MTEB NTREXBitextMining (slv_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 92.23835753630446 type value f1 90.5061759305625 type value main_score 90.5061759305625 type value precision 89.74231188051918 type value recall 92.23835753630446 type BitextMining dataset metrics task config name revision split type spa_Latn-rus_Cyrl MTEB NTREXBitextMining (spa_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 96.54481722583876 type value f1 95.54665331330328 type value main_score 95.54665331330328 type value precision 95.06342847604739 type value recall 96.54481722583876 type BitextMining dataset metrics task config name revision split type srp_Cyrl-rus_Cyrl MTEB NTREXBitextMining (srp_Cyrl-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 83.62543815723585 type value f1 80.77095672699816 type value main_score 80.77095672699816 type value precision 79.74674313056886 type value recall 83.62543815723585 type BitextMining dataset metrics task config name revision split type srp_Latn-rus_Cyrl MTEB NTREXBitextMining (srp_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 94.44166249374061 type value f1 93.00733206591994 type value main_score 93.00733206591994 type value precision 92.37203026762366 type value recall 94.44166249374061 type BitextMining dataset metrics task config name revision split type swa_Latn-rus_Cyrl MTEB NTREXBitextMining (swa_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 90.23535302954431 type value f1 87.89596482636041 type value main_score 87.89596482636041 type value precision 86.87060227370694 type value recall 90.23535302954431 type BitextMining dataset metrics task config name revision split type swe_Latn-rus_Cyrl MTEB NTREXBitextMining (swe_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 95.44316474712068 type value f1 94.1896177599733 type value main_score 94.1896177599733 type value precision 93.61542313470206 type value recall 95.44316474712068 type BitextMining dataset metrics task config name revision split type tam_Taml-rus_Cyrl MTEB NTREXBitextMining (tam_Taml-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 89.68452679018529 type value f1 87.37341160650037 type value main_score 87.37341160650037 type value precision 86.38389402285247 type value recall 89.68452679018529 type BitextMining dataset metrics task config name revision split type tur_Latn-rus_Cyrl MTEB NTREXBitextMining (tur_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 93.89083625438157 type value f1 92.33892505424804 type value main_score 92.33892505424804 type value precision 91.63125640842216 type value recall 93.89083625438157 type BitextMining dataset metrics task config name revision split type ukr_Cyrl-rus_Cyrl MTEB NTREXBitextMining (ukr_Cyrl-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 96.14421632448673 type value f1 95.11028447433054 type value main_score 95.11028447433054 type value precision 94.62944416624937 type value recall 96.14421632448673 type BitextMining dataset metrics task config name revision split type vie_Latn-rus_Cyrl MTEB NTREXBitextMining (vie_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 93.79068602904357 type value f1 92.14989150392256 type value main_score 92.14989150392256 type value precision 91.39292271740945 type value recall 93.79068602904357 type BitextMining dataset metrics task config name revision split type zho_Hant-rus_Cyrl MTEB NTREXBitextMining (zho_Hant-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 89.13370055082625 type value f1 86.51514618639217 type value main_score 86.51514618639217 type value precision 85.383920035898 type value recall 89.13370055082625 type BitextMining dataset metrics task config name revision split type zul_Latn-rus_Cyrl MTEB NTREXBitextMining (zul_Latn-rus_Cyrl) ed9a4403ed4adbfaf4aab56d5b2709e9f6c3ba33 test mteb/NTREX type value accuracy 81.17175763645467 type value f1 77.72331766047338 type value main_score 77.72331766047338 type value precision 76.24629555848075 type value recall 81.17175763645467 type BitextMining dataset metrics task config name revision split type ru MTEB OpusparcusPC (ru) 9e9b1f8ef51616073f47f306f7f47dd91663f86a test.full GEM/opusparcus type value cosine_accuracy 73.09136420525657 type value cosine_accuracy_threshold 87.70400881767273 type value cosine_ap 86.51938550599533 type value cosine_f1 80.84358523725834 type value cosine_f1_threshold 86.90648078918457 type value cosine_precision 73.24840764331209 type value cosine_recall 90.19607843137256 type value dot_accuracy 73.09136420525657 type value dot_accuracy_threshold 87.7040147781372 type value dot_ap 86.51934769946833 type value dot_f1 80.84358523725834 type value dot_f1_threshold 86.90648078918457 type value dot_precision 73.24840764331209 type value dot_recall 90.19607843137256 type value euclidean_accuracy 73.09136420525657 type value euclidean_accuracy_threshold 49.590304493904114 type value euclidean_ap 86.51934769946833 type value euclidean_f1 80.84358523725834 type value euclidean_f1_threshold 51.173269748687744 type value euclidean_precision 73.24840764331209 type value euclidean_recall 90.19607843137256 type value main_score 86.51976811057995 type value manhattan_accuracy 73.40425531914893 type value manhattan_accuracy_threshold 757.8278541564941 type value manhattan_ap 86.51976811057995 type value manhattan_f1 80.92898615453328 type value manhattan_f1_threshold 778.3821105957031 type value manhattan_precision 74.32321575061526 type value manhattan_recall 88.8235294117647 type value max_ap 86.51976811057995 type value max_f1 80.92898615453328 type value max_precision 74.32321575061526 type value max_recall 90.19607843137256 type value similarity_accuracy 73.09136420525657 type value similarity_accuracy_threshold 87.70400881767273 type value similarity_ap 86.51938550599533 type value similarity_f1 80.84358523725834 type value similarity_f1_threshold 86.90648078918457 type value similarity_precision 73.24840764331209 type value similarity_recall 90.19607843137256 type PairClassification dataset metrics task config name revision split type russian MTEB PublicHealthQA (russian) main test xhluca/publichealth-qa type value main_score 79.303 type value map_at_1 61.538000000000004 type value map_at_10 74.449 type value map_at_100 74.687 type value map_at_1000 74.687 type value map_at_20 74.589 type value map_at_3 73.333 type value map_at_5 74.256 type value mrr_at_1 61.53846153846154 type value mrr_at_10 74.44871794871794 type value mrr_at_100 74.68730304304074 type value mrr_at_1000 74.68730304304074 type value mrr_at_20 74.58857808857809 type value mrr_at_3 73.33333333333333 type value mrr_at_5 74.25641025641025 type value nauc_map_at_1000_diff1 61.375798048778506 type value nauc_map_at_1000_max 51.37093181241067 type value nauc_map_at_1000_std 41.735794471409015 type value nauc_map_at_100_diff1 61.375798048778506 type value nauc_map_at_100_max 51.37093181241067 type value nauc_map_at_100_std 41.735794471409015 type value nauc_map_at_10_diff1 61.12796039757213 type value nauc_map_at_10_max 51.843445267118014 type value nauc_map_at_10_std 42.243121474939365 type value nauc_map_at_1_diff1 66.39100974909151 type value nauc_map_at_1_max 44.77165601342703 type value nauc_map_at_1_std 32.38542979413408 type value nauc_map_at_20_diff1 61.16611123434347 type value nauc_map_at_20_max 51.52605092407306 type value nauc_map_at_20_std 41.94787773313971 type value nauc_map_at_3_diff1 61.40157474408937 type value nauc_map_at_3_max 51.47230077853947 type value nauc_map_at_3_std 42.63540269440141 type value nauc_map_at_5_diff1 61.07631147583098 type value nauc_map_at_5_max 52.02626939341523 type value nauc_map_at_5_std 42.511607332150334 type value nauc_mrr_at_1000_diff1 61.375798048778506 type value nauc_mrr_at_1000_max 51.37093181241067 type value nauc_mrr_at_1000_std 41.735794471409015 type value nauc_mrr_at_100_diff1 61.375798048778506 type value nauc_mrr_at_100_max 51.37093181241067 type value nauc_mrr_at_100_std 41.735794471409015 type value nauc_mrr_at_10_diff1 61.12796039757213 type value nauc_mrr_at_10_max 51.843445267118014 type value nauc_mrr_at_10_std 42.243121474939365 type value nauc_mrr_at_1_diff1 66.39100974909151 type value nauc_mrr_at_1_max 44.77165601342703 type value nauc_mrr_at_1_std 32.38542979413408 type value nauc_mrr_at_20_diff1 61.16611123434347 type value nauc_mrr_at_20_max 51.52605092407306 type value nauc_mrr_at_20_std 41.94787773313971 type value nauc_mrr_at_3_diff1 61.40157474408937 type value nauc_mrr_at_3_max 51.47230077853947 type value nauc_mrr_at_3_std 42.63540269440141 type value nauc_mrr_at_5_diff1 61.07631147583098 type value nauc_mrr_at_5_max 52.02626939341523 type value nauc_mrr_at_5_std 42.511607332150334 type value nauc_ndcg_at_1000_diff1 60.54821630436157 type value nauc_ndcg_at_1000_max 52.584328363863634 type value nauc_ndcg_at_1000_std 43.306961101645946 type value nauc_ndcg_at_100_diff1 60.54821630436157 type value nauc_ndcg_at_100_max 52.584328363863634 type value nauc_ndcg_at_100_std 43.306961101645946 type value nauc_ndcg_at_10_diff1 58.800340278109886 type value nauc_ndcg_at_10_max 55.31050771670664 type value nauc_ndcg_at_10_std 46.40931672942848 type value nauc_ndcg_at_1_diff1 66.39100974909151 type value nauc_ndcg_at_1_max 44.77165601342703 type value nauc_ndcg_at_1_std 32.38542979413408 type value nauc_ndcg_at_20_diff1 58.88690479697946 type value nauc_ndcg_at_20_max 54.19269661177923 type value nauc_ndcg_at_20_std 45.39305589413174 type value nauc_ndcg_at_3_diff1 59.61866351451574 type value nauc_ndcg_at_3_max 54.23992718744033 type value nauc_ndcg_at_3_std 46.997379274101 type value nauc_ndcg_at_5_diff1 58.70739588066225 type value nauc_ndcg_at_5_max 55.76766902539152 type value nauc_ndcg_at_5_std 47.10553115762958 type value nauc_precision_at_1000_diff1 100.0 type value nauc_precision_at_1000_max 100.0 type value nauc_precision_at_1000_std 100.0 type value nauc_precision_at_100_diff1 .nan type value nauc_precision_at_100_max .nan type value nauc_precision_at_100_std .nan type value nauc_precision_at_10_diff1 35.72622112397501 type value nauc_precision_at_10_max 89.84297108673948 type value nauc_precision_at_10_std 86.60269192422707 type value nauc_precision_at_1_diff1 66.39100974909151 type value nauc_precision_at_1_max 44.77165601342703 type value nauc_precision_at_1_std 32.38542979413408 type value nauc_precision_at_20_diff1 29.188449183726433 type value nauc_precision_at_20_max 86.45729478231968 type value nauc_precision_at_20_std 86.45729478231968 type value nauc_precision_at_3_diff1 50.294126629236224 type value nauc_precision_at_3_max 68.98223127174579 type value nauc_precision_at_3_std 70.31195520376356 type value nauc_precision_at_5_diff1 39.648884288124385 type value nauc_precision_at_5_max 86.3409770687935 type value nauc_precision_at_5_std 83.74875373878356 type value nauc_recall_at_1000_diff1 .nan type value nauc_recall_at_1000_max .nan type value nauc_recall_at_1000_std .nan type value nauc_recall_at_100_diff1 .nan type value nauc_recall_at_100_max .nan type value nauc_recall_at_100_std .nan type value nauc_recall_at_10_diff1 35.72622112397516 type value nauc_recall_at_10_max 89.84297108673968 type value nauc_recall_at_10_std 86.60269192422749 type value nauc_recall_at_1_diff1 66.39100974909151 type value nauc_recall_at_1_max 44.77165601342703 type value nauc_recall_at_1_std 32.38542979413408 type value nauc_recall_at_20_diff1 29.188449183726323 type value nauc_recall_at_20_max 86.45729478231985 type value nauc_recall_at_20_std 86.45729478231985 type value nauc_recall_at_3_diff1 50.29412662923603 type value nauc_recall_at_3_max 68.98223127174562 type value nauc_recall_at_3_std 70.31195520376346 type value nauc_recall_at_5_diff1 39.64888428812445 type value nauc_recall_at_5_max 86.34097706879359 type value nauc_recall_at_5_std 83.74875373878366 type value ndcg_at_1 61.538000000000004 type value ndcg_at_10 79.303 type value ndcg_at_100 80.557 type value ndcg_at_1000 80.557 type value ndcg_at_20 79.732 type value ndcg_at_3 77.033 type value ndcg_at_5 78.818 type value precision_at_1 61.538000000000004 type value precision_at_10 9.385 type value precision_at_100 1.0 type value precision_at_1000 0.1 type value precision_at_20 4.769 type value precision_at_3 29.231 type value precision_at_5 18.462 type value recall_at_1 61.538000000000004 type value recall_at_10 93.84599999999999 type value recall_at_100 100.0 type value recall_at_1000 100.0 type value recall_at_20 95.38499999999999 type value recall_at_3 87.69200000000001 type value recall_at_5 92.308 type Retrieval dataset metrics task config name revision split type default MTEB RUParaPhraserSTS (default) 43265056790b8f7c59e0139acb4be0a8dad2c8f4 test merionum/ru_paraphraser type value cosine_pearson 64.73554596215753 type value cosine_spearman 70.45849652271855 type value euclidean_pearson 68.08069844834267 type value euclidean_spearman 70.45854872959124 type value main_score 70.45849652271855 type value manhattan_pearson 67.88325986519624 type value manhattan_spearman 70.21131896834542 type value pearson 64.73554596215753 type value spearman 70.45849652271855 type STS dataset metrics task config name revision split type default MTEB RiaNewsRetrieval (default) 82374b0bbacda6114f39ff9c5b925fa1512ca5d7 test ai-forever/ria-news-retrieval type value main_score 70.00999999999999 type value map_at_1 55.97 type value map_at_10 65.59700000000001 type value map_at_100 66.057 type value map_at_1000 66.074 type value map_at_20 65.892 type value map_at_3 63.74999999999999 type value map_at_5 64.84299999999999 type value mrr_at_1 55.88999999999999 type value mrr_at_10 65.55873015872977 type value mrr_at_100 66.01891495129716 type value mrr_at_1000 66.03538391493299 type value mrr_at_20 65.85351193431555 type value mrr_at_3 63.7133333333329 type value mrr_at_5 64.80483333333268 type value nauc_map_at_1000_diff1 65.95332946436318 type value nauc_map_at_1000_max 28.21204156197811 type value nauc_map_at_1000_std -13.139245767083743 type value nauc_map_at_100_diff1 65.94763105024367 type value nauc_map_at_100_max 28.212832170078205 type value nauc_map_at_100_std -13.131425849370665 type value nauc_map_at_10_diff1 65.88455089448388 type value nauc_map_at_10_max 28.13555838776792 type value nauc_map_at_10_std -13.326989827081023 type value nauc_map_at_1_diff1 69.31275711813979 type value nauc_map_at_1_max 26.386708520283758 type value nauc_map_at_1_std -14.434616447245464 type value nauc_map_at_20_diff1 65.91227032605677 type value nauc_map_at_20_max 28.20538655600886 type value nauc_map_at_20_std -13.191148834410274 type value nauc_map_at_3_diff1 66.0051677952641 type value nauc_map_at_3_max 28.25443420019022 type value nauc_map_at_3_std -13.893284109029558 type value nauc_map_at_5_diff1 65.89784348297898 type value nauc_map_at_5_max 28.26449765184183 type value nauc_map_at_5_std -13.506692912805008 type value nauc_mrr_at_1000_diff1 66.06599513750889 type value nauc_mrr_at_1000_max 28.191556650722287 type value nauc_mrr_at_1000_std -13.098487982930276 type value nauc_mrr_at_100_diff1 66.0602307977725 type value nauc_mrr_at_100_max 28.19235936624514 type value nauc_mrr_at_100_std -13.09069677716269 type value nauc_mrr_at_10_diff1 65.99546819079403 type value nauc_mrr_at_10_max 28.11556170120022 type value nauc_mrr_at_10_std -13.286711073897553 type value nauc_mrr_at_1_diff1 69.49541040517995 type value nauc_mrr_at_1_max 26.354622707276153 type value nauc_mrr_at_1_std -14.358839778104695 type value nauc_mrr_at_20_diff1 66.02427154257936 type value nauc_mrr_at_20_max 28.18509383563462 type value nauc_mrr_at_20_std -13.150543398429 type value nauc_mrr_at_3_diff1 66.11258119082618 type value nauc_mrr_at_3_max 28.239510722224004 type value nauc_mrr_at_3_std -13.857249251136269 type value nauc_mrr_at_5_diff1 66.00633786765626 type value nauc_mrr_at_5_max 28.244875152193032 type value nauc_mrr_at_5_std -13.467206028704434 type value nauc_ndcg_at_1000_diff1 65.02876183314446 type value nauc_ndcg_at_1000_max 29.109368390197194 type value nauc_ndcg_at_1000_std -11.56514359821697 type value nauc_ndcg_at_100_diff1 64.85837726893713 type value nauc_ndcg_at_100_max 29.19990133137256 type value nauc_ndcg_at_100_std -11.17450348161257 type value nauc_ndcg_at_10_diff1 64.53842705024796 type value nauc_ndcg_at_10_max 28.748734006088526 type value nauc_ndcg_at_10_std -12.331395505957063 type value nauc_ndcg_at_1_diff1 69.31275711813979 type value nauc_ndcg_at_1_max 26.386708520283758 type value nauc_ndcg_at_1_std -14.434616447245464 type value nauc_ndcg_at_20_diff1 64.59017606740504 type value nauc_ndcg_at_20_max 29.047332048898017 type value nauc_ndcg_at_20_std -11.746548770195954 type value nauc_ndcg_at_3_diff1 64.87900935713822 type value nauc_ndcg_at_3_max 28.953157521204403 type value nauc_ndcg_at_3_std -13.639947228880942 type value nauc_ndcg_at_5_diff1 64.61466953479034 type value nauc_ndcg_at_5_max 29.01899321868392 type value nauc_ndcg_at_5_std -12.85356404799802 type value nauc_precision_at_1000_diff1 48.85481417002382 type value nauc_precision_at_1000_max 57.129837326696375 type value nauc_precision_at_1000_std 37.889524999906435 type value nauc_precision_at_100_diff1 53.374672326788264 type value nauc_precision_at_100_max 43.819333062207974 type value nauc_precision_at_100_std 21.387064885769362 type value nauc_precision_at_10_diff1 57.66571169774445 type value nauc_precision_at_10_max 31.779694837242033 type value nauc_precision_at_10_std -6.6248399147180255 type value nauc_precision_at_1_diff1 69.31275711813979 type value nauc_precision_at_1_max 26.386708520283758 type value nauc_precision_at_1_std -14.434616447245464 type value nauc_precision_at_20_diff1 55.93570036001682 type value nauc_precision_at_20_max 34.98640173388743 type value nauc_precision_at_20_std -0.36518465159326174 type value nauc_precision_at_3_diff1 60.94100093991508 type value nauc_precision_at_3_max 31.422239034357673 type value nauc_precision_at_3_std -12.72576556537896 type value nauc_precision_at_5_diff1 59.450505195434054 type value nauc_precision_at_5_max 32.07638712418377 type value nauc_precision_at_5_std -10.024459103498598 type value nauc_recall_at_1000_diff1 48.854814170024184 type value nauc_recall_at_1000_max 57.129837326697164 type value nauc_recall_at_1000_std 37.88952499990672 type value nauc_recall_at_100_diff1 53.37467232678822 type value nauc_recall_at_100_max 43.8193330622079 type value nauc_recall_at_100_std 21.387064885769398 type value nauc_recall_at_10_diff1 57.66571169774447 type value nauc_recall_at_10_max 31.779694837242133 type value nauc_recall_at_10_std -6.62483991471789 type value nauc_recall_at_1_diff1 69.31275711813979 type value nauc_recall_at_1_max 26.386708520283758 type value nauc_recall_at_1_std -14.434616447245464 type value nauc_recall_at_20_diff1 55.93570036001682 type value nauc_recall_at_20_max 34.986401733887554 type value nauc_recall_at_20_std -0.3651846515931506 type value nauc_recall_at_3_diff1 60.94100093991499 type value nauc_recall_at_3_max 31.422239034357606 type value nauc_recall_at_3_std -12.725765565378966 type value nauc_recall_at_5_diff1 59.450505195434125 type value nauc_recall_at_5_max 32.07638712418387 type value nauc_recall_at_5_std -10.024459103498472 type value ndcg_at_1 55.97 type value ndcg_at_10 70.00999999999999 type value ndcg_at_100 72.20100000000001 type value ndcg_at_1000 72.65599999999999 type value ndcg_at_20 71.068 type value ndcg_at_3 66.228 type value ndcg_at_5 68.191 type value precision_at_1 55.97 type value precision_at_10 8.373999999999999 type value precision_at_100 0.9390000000000001 type value precision_at_1000 0.097 type value precision_at_20 4.3950000000000005 type value precision_at_3 24.46 type value precision_at_5 15.626000000000001 type value recall_at_1 55.97 type value recall_at_10 83.74000000000001 type value recall_at_100 93.87 type value recall_at_1000 97.49 type value recall_at_20 87.89 type value recall_at_3 73.38 type value recall_at_5 78.13 type Retrieval dataset metrics task config name revision split type default MTEB RuBQReranking (default) 2e96b8f098fa4b0950fc58eacadeb31c0d0c7fa2 test ai-forever/rubq-reranking type value main_score 71.44929565043827 type value map 71.44929565043827 type value mrr 77.78391820945014 type value nAUC_map_diff1 38.140840668080244 type value nAUC_map_max 27.54328688105381 type value nAUC_map_std 16.81572082284672 type value nAUC_mrr_diff1 44.51350415961509 type value nAUC_mrr_max 36.491182016669754 type value nAUC_mrr_std 22.47139593052269 type Reranking dataset metrics task config name revision split type default MTEB RuBQRetrieval (default) e19b6ffa60b3bc248e0b41f4cc37c26a55c2a67b test ai-forever/rubq-retrieval type value main_score 68.529 type value map_at_1 42.529 type value map_at_10 60.864 type value map_at_100 61.868 type value map_at_1000 61.907000000000004 type value map_at_20 61.596 type value map_at_3 55.701 type value map_at_5 58.78 type value mrr_at_1 60.57919621749409 type value mrr_at_10 70.55614188149649 type value mrr_at_100 70.88383816664494 type value mrr_at_1000 70.89719252668833 type value mrr_at_20 70.79839750105347 type value mrr_at_3 68.4594168636722 type value mrr_at_5 69.67100078802214 type value nauc_map_at_1000_diff1 40.67438785660885 type value nauc_map_at_1000_max 32.79981738507424 type value nauc_map_at_1000_std -6.873402600044831 type value nauc_map_at_100_diff1 40.65643664443284 type value nauc_map_at_100_max 32.81594799919249 type value nauc_map_at_100_std -6.8473246794498195 type value nauc_map_at_10_diff1 40.39048268484908 type value nauc_map_at_10_max 32.403242161479525 type value nauc_map_at_10_std -7.344413799841244 type value nauc_map_at_1_diff1 44.36306892906905 type value nauc_map_at_1_max 25.61348630699028 type value nauc_map_at_1_std -8.713074613333902 type value nauc_map_at_20_diff1 40.530326570124615 type value nauc_map_at_20_max 32.74028319323205 type value nauc_map_at_20_std -7.008180779820569 type value nauc_map_at_3_diff1 40.764924859364044 type value nauc_map_at_3_max 29.809671682025336 type value nauc_map_at_3_std -9.205620202725564 type value nauc_map_at_5_diff1 40.88599496021476 type value nauc_map_at_5_max 32.1701894666848 type value nauc_map_at_5_std -7.801251849010623 type value nauc_mrr_at_1000_diff1 48.64181373540728 type value nauc_mrr_at_1000_max 40.136947990653546 type value nauc_mrr_at_1000_std -7.250260497468805 type value nauc_mrr_at_100_diff1 48.63349902496212 type value nauc_mrr_at_100_max 40.14510559704008 type value nauc_mrr_at_100_std -7.228702374801103 type value nauc_mrr_at_10_diff1 48.58580560194813 type value nauc_mrr_at_10_max 40.15075599433366 type value nauc_mrr_at_10_std -7.267928771548688 type value nauc_mrr_at_1_diff1 51.47535097164919 type value nauc_mrr_at_1_max 38.23579750430856 type value nauc_mrr_at_1_std -9.187785187137633 type value nauc_mrr_at_20_diff1 48.58688378336222 type value nauc_mrr_at_20_max 40.13408744088299 type value nauc_mrr_at_20_std -7.283132775160146 type value nauc_mrr_at_3_diff1 48.66833005454742 type value nauc_mrr_at_3_max 40.07987333638038 type value nauc_mrr_at_3_std -7.738819947521418 type value nauc_mrr_at_5_diff1 48.76536305941537 type value nauc_mrr_at_5_max 40.381929739522185 type value nauc_mrr_at_5_std -7.592858318378928 type value nauc_ndcg_at_1000_diff1 41.67304442004693 type value nauc_ndcg_at_1000_max 35.84126926253235 type value nauc_ndcg_at_1000_std -4.78971011604655 type value nauc_ndcg_at_100_diff1 41.16918850185783 type value nauc_ndcg_at_100_max 36.082461962326505 type value nauc_ndcg_at_100_std -4.092442251697269 type value nauc_ndcg_at_10_diff1 40.300065598615205 type value nauc_ndcg_at_10_max 34.87866296788365 type value nauc_ndcg_at_10_std -5.866529277842453 type value nauc_ndcg_at_1_diff1 51.74612915209495 type value nauc_ndcg_at_1_max 37.71907067970078 type value nauc_ndcg_at_1_std -9.064124266098696 type value nauc_ndcg_at_20_diff1 40.493949850214584 type value nauc_ndcg_at_20_max 35.69331503650286 type value nauc_ndcg_at_20_std -4.995310342975443 type value nauc_ndcg_at_3_diff1 41.269443212112364 type value nauc_ndcg_at_3_max 32.572844460953334 type value nauc_ndcg_at_3_std -9.063015396458791 type value nauc_ndcg_at_5_diff1 41.37039652522888 type value nauc_ndcg_at_5_max 34.67416011393571 type value nauc_ndcg_at_5_std -7.106845569862319 type value nauc_precision_at_1000_diff1 -9.571769961090155 type value nauc_precision_at_1000_max 5.574782583417188 type value nauc_precision_at_1000_std 7.28333847923847 type value nauc_precision_at_100_diff1 -7.7405012003383735 type value nauc_precision_at_100_max 9.67745355070353 type value nauc_precision_at_100_std 9.327890294080992 type value nauc_precision_at_10_diff1 -1.006879647532931 type value nauc_precision_at_10_max 15.899825481231064 type value nauc_precision_at_10_std 4.2284084852153105 type value nauc_precision_at_1_diff1 51.74612915209495 type value nauc_precision_at_1_max 37.71907067970078 type value nauc_precision_at_1_std -9.064124266098696 type value nauc_precision_at_20_diff1 -4.982301544401409 type value nauc_precision_at_20_max 13.241674471380568 type value nauc_precision_at_20_std 7.052280133821539 type value nauc_precision_at_3_diff1 15.442614376387374 type value nauc_precision_at_3_max 25.12695418083 type value nauc_precision_at_3_std -3.1150066697920638 type value nauc_precision_at_5_diff1 8.381026072692444 type value nauc_precision_at_5_max 22.839056540604822 type value nauc_precision_at_5_std 1.5126905486524331 type value nauc_recall_at_1000_diff1 -0.8869709920433502 type value nauc_recall_at_1000_max 45.092324433377264 type value nauc_recall_at_1000_std 62.21264093315108 type value nauc_recall_at_100_diff1 16.036715011075714 type value nauc_recall_at_100_max 39.79963411771158 type value nauc_recall_at_100_std 28.41850069503361 type value nauc_recall_at_10_diff1 25.189622794479998 type value nauc_recall_at_10_max 30.82355277039427 type value nauc_recall_at_10_std 0.0964544736531047 type value nauc_recall_at_1_diff1 44.36306892906905 type value nauc_recall_at_1_max 25.61348630699028 type value nauc_recall_at_1_std -8.713074613333902 type value nauc_recall_at_20_diff1 20.43424504746087 type value nauc_recall_at_20_max 33.96010554649377 type value nauc_recall_at_20_std 6.900984030301936 type value nauc_recall_at_3_diff1 33.86531858793492 type value nauc_recall_at_3_max 27.725692256711188 type value nauc_recall_at_3_std -8.533124289305709 type value nauc_recall_at_5_diff1 32.006964557701686 type value nauc_recall_at_5_max 31.493370659289806 type value nauc_recall_at_5_std -4.8639793547793255 type value ndcg_at_1 60.461 type value ndcg_at_10 68.529 type value ndcg_at_100 71.664 type value ndcg_at_1000 72.396 type value ndcg_at_20 70.344 type value ndcg_at_3 61.550000000000004 type value ndcg_at_5 64.948 type value precision_at_1 60.461 type value precision_at_10 13.28 type value precision_at_100 1.555 type value precision_at_1000 0.164 type value precision_at_20 7.216 type value precision_at_3 33.077 type value precision_at_5 23.014000000000003 type value recall_at_1 42.529 type value recall_at_10 81.169 type value recall_at_100 93.154 type value recall_at_1000 98.18299999999999 type value recall_at_20 87.132 type value recall_at_3 63.905 type value recall_at_5 71.967 type Retrieval dataset metrics task config name revision split type default MTEB RuReviewsClassification (default) f6d2c31f4dc6b88f468552750bfec05b4b41b05a test ai-forever/ru-reviews-classification type value accuracy 61.17675781250001 type value f1 60.354535346041374 type value f1_weighted 60.35437313166116 type value main_score 61.17675781250001 type Classification dataset metrics task config name revision split type default MTEB RuSTSBenchmarkSTS (default) 7cf24f325c6da6195df55bef3d86b5e0616f3018 test ai-forever/ru-stsbenchmark-sts type value cosine_pearson 78.1301041727274 type value cosine_spearman 78.08238025421747 type value euclidean_pearson 77.35224254583635 type value euclidean_spearman 78.08235336582496 type value main_score 78.08238025421747 type value manhattan_pearson 77.24138550052075 type value manhattan_spearman 77.98199107904142 type value pearson 78.1301041727274 type value spearman 78.08238025421747 type STS dataset metrics task config name revision split type default MTEB RuSciBenchGRNTIClassification (default) 673a610d6d3dd91a547a0d57ae1b56f37ebbf6a1 test ai-forever/ru-scibench-grnti-classification type value accuracy 54.990234375 type value f1 53.537019057131374 type value f1_weighted 53.552745354520766 type value main_score 54.990234375 type Classification dataset metrics task config name revision split type default MTEB RuSciBenchGRNTIClusteringP2P (default) 673a610d6d3dd91a547a0d57ae1b56f37ebbf6a1 test ai-forever/ru-scibench-grnti-classification type value main_score 50.775228895355106 type value v_measure 50.775228895355106 type value v_measure_std 0.9533571150165796 type Clustering dataset metrics task config name revision split type default MTEB RuSciBenchOECDClassification (default) 26c88e99dcaba32bb45d0e1bfc21902337f6d471 test ai-forever/ru-scibench-oecd-classification type value accuracy 41.71875 type value f1 39.289100975858304 type value f1_weighted 39.29257829217775 type value main_score 41.71875 type Classification dataset metrics task config name revision split type default MTEB RuSciBenchOECDClusteringP2P (default) 26c88e99dcaba32bb45d0e1bfc21902337f6d471 test ai-forever/ru-scibench-oecd-classification type value main_score 45.10904808834516 type value v_measure 45.10904808834516 type value v_measure_std 1.0572643410157534 type Clustering dataset metrics task config name revision split type rus_Cyrl MTEB SIB200Classification (rus_Cyrl) a74d7350ea12af010cfb1c21e34f1f81fd2e615b test mteb/sib200 type value accuracy 66.36363636363637 type value f1 64.6940336621617 type value f1_weighted 66.43317771876966 type value main_score 66.36363636363637 type Classification dataset metrics task config name revision split type rus_Cyrl MTEB SIB200ClusteringS2S (rus_Cyrl) a74d7350ea12af010cfb1c21e34f1f81fd2e615b test mteb/sib200 type value main_score 33.99178497314711 type value v_measure 33.99178497314711 type value v_measure_std 4.036337464043786 type Clustering dataset metrics task config name revision split type ru MTEB STS22.v2 (ru) d31f33a128469b20e357535c39b82fb3c3f6f2bd test mteb/sts22-crosslingual-sts type value cosine_pearson 50.724322379215934 type value cosine_spearman 59.90449732164651 type value euclidean_pearson 50.227545226784024 type value euclidean_spearman 59.898906527601085 type value main_score 59.90449732164651 type value manhattan_pearson 50.21762139819405 type value manhattan_spearman 59.761039813759 type value pearson 50.724322379215934 type value spearman 59.90449732164651 type STS dataset metrics task config name revision split type ru MTEB STSBenchmarkMultilingualSTS (ru) 29afa2569dcedaaa2fe6a3dcfebab33d28b82e8c dev mteb/stsb_multi_mt type value cosine_pearson 78.43928769569945 type value cosine_spearman 78.23961768018884 type value euclidean_pearson 77.4718694027985 type value euclidean_spearman 78.23887044760475 type value main_score 78.23961768018884 type value manhattan_pearson 77.34517128089547 type value manhattan_spearman 78.1146477340426 type value pearson 78.43928769569945 type value spearman 78.23961768018884 type STS dataset metrics task config name revision split type default MTEB SensitiveTopicsClassification (default) 416b34a802308eac30e4192afc0ff99bb8dcc7f2 test ai-forever/sensitive-topics-classification type value accuracy 22.8125 type value f1 17.31969589593409 type value lrap 33.82412380642287 type value main_score 22.8125 type MultilabelClassification dataset metrics task config name revision split type default MTEB TERRa (default) 7b58f24536063837d644aab9a023c62199b2a612 dev ai-forever/terra-pairclassification type value cosine_accuracy 57.32899022801303 type value cosine_accuracy_threshold 85.32201051712036 type value cosine_ap 55.14264553720072 type value cosine_f1 66.83544303797468 type value cosine_f1_threshold 85.32201051712036 type value cosine_precision 54.54545454545454 type value cosine_recall 86.27450980392157 type value dot_accuracy 57.32899022801303 type value dot_accuracy_threshold 85.32201051712036 type value dot_ap 55.14264553720072 type value dot_f1 66.83544303797468 type value dot_f1_threshold 85.32201051712036 type value dot_precision 54.54545454545454 type value dot_recall 86.27450980392157 type value euclidean_accuracy 57.32899022801303 type value euclidean_accuracy_threshold 54.18117046356201 type value euclidean_ap 55.14264553720072 type value euclidean_f1 66.83544303797468 type value euclidean_f1_threshold 54.18117046356201 type value euclidean_precision 54.54545454545454 type value euclidean_recall 86.27450980392157 type value main_score 55.14264553720072 type value manhattan_accuracy 57.32899022801303 type value manhattan_accuracy_threshold 828.8480758666992 type value manhattan_ap 55.077974053622555 type value manhattan_f1 66.82352941176471 type value manhattan_f1_threshold 885.6784820556641 type value manhattan_precision 52.20588235294118 type value manhattan_recall 92.81045751633987 type value max_ap 55.14264553720072 type value max_f1 66.83544303797468 type value max_precision 54.54545454545454 type value max_recall 92.81045751633987 type value similarity_accuracy 57.32899022801303 type value similarity_accuracy_threshold 85.32201051712036 type value similarity_ap 55.14264553720072 type value similarity_f1 66.83544303797468 type value similarity_f1_threshold 85.32201051712036 type value similarity_precision 54.54545454545454 type value similarity_recall 86.27450980392157 type PairClassification dataset metrics task config name revision split type ru MTEB XNLI (ru) 09698e0180d87dc247ca447d3a1248b931ac0cdb test mteb/xnli type value cosine_accuracy 67.6923076923077 type value cosine_accuracy_threshold 87.6681923866272 type value cosine_ap 73.18693800863593 type value cosine_f1 70.40641099026904 type value cosine_f1_threshold 85.09706258773804 type value cosine_precision 57.74647887323944 type value cosine_recall 90.17595307917888 type value dot_accuracy 67.6923076923077 type value dot_accuracy_threshold 87.66818642616272 type value dot_ap 73.18693800863593 type value dot_f1 70.40641099026904 type value dot_f1_threshold 85.09706258773804 type value dot_precision 57.74647887323944 type value dot_recall 90.17595307917888 type value euclidean_accuracy 67.6923076923077 type value euclidean_accuracy_threshold 49.662476778030396 type value euclidean_ap 73.18693800863593 type value euclidean_f1 70.40641099026904 type value euclidean_f1_threshold 54.59475517272949 type value euclidean_precision 57.74647887323944 type value euclidean_recall 90.17595307917888 type value main_score 73.18693800863593 type value manhattan_accuracy 67.54578754578755 type value manhattan_accuracy_threshold 777.1001815795898 type value manhattan_ap 72.98861474758783 type value manhattan_f1 70.6842435655995 type value manhattan_f1_threshold 810.3782653808594 type value manhattan_precision 61.80021953896817 type value manhattan_recall 82.55131964809385 type value max_ap 73.18693800863593 type value max_f1 70.6842435655995 type value max_precision 61.80021953896817 type value max_recall 90.17595307917888 type value similarity_accuracy 67.6923076923077 type value similarity_accuracy_threshold 87.6681923866272 type value similarity_ap 73.18693800863593 type value similarity_f1 70.40641099026904 type value similarity_f1_threshold 85.09706258773804 type value similarity_precision 57.74647887323944 type value similarity_recall 90.17595307917888 type PairClassification dataset metrics task config name revision split type russian MTEB XNLIV2 (russian) 5b7d477a8c62cdd18e2fed7e015497c20b4371ad test mteb/xnli2.0-multi-pair type value cosine_accuracy 68.35164835164835 type value cosine_accuracy_threshold 88.48621845245361 type value cosine_ap 73.10205506215699 type value cosine_f1 71.28712871287128 type value cosine_f1_threshold 87.00399398803711 type value cosine_precision 61.67023554603854 type value cosine_recall 84.4574780058651 type value dot_accuracy 68.35164835164835 type value dot_accuracy_threshold 88.48622441291809 type value dot_ap 73.10191110714706 type value dot_f1 71.28712871287128 type value dot_f1_threshold 87.00399398803711 type value dot_precision 61.67023554603854 type value dot_recall 84.4574780058651 type value euclidean_accuracy 68.35164835164835 type value euclidean_accuracy_threshold 47.98704385757446 type value euclidean_ap 73.10205506215699 type value euclidean_f1 71.28712871287128 type value euclidean_f1_threshold 50.982362031936646 type value euclidean_precision 61.67023554603854 type value euclidean_recall 84.4574780058651 type value main_score 73.10205506215699 type value manhattan_accuracy 67.91208791208791 type value manhattan_accuracy_threshold 746.1360931396484 type value manhattan_ap 72.8954736175069 type value manhattan_f1 71.1297071129707 type value manhattan_f1_threshold 808.0789566040039 type value manhattan_precision 60.04036326942482 type value manhattan_recall 87.2434017595308 type value max_ap 73.10205506215699 type value max_f1 71.28712871287128 type value max_precision 61.67023554603854 type value max_recall 87.2434017595308 type value similarity_accuracy 68.35164835164835 type value similarity_accuracy_threshold 88.48621845245361 type value similarity_ap 73.10205506215699 type value similarity_f1 71.28712871287128 type value similarity_f1_threshold 87.00399398803711 type value similarity_precision 61.67023554603854 type value similarity_recall 84.4574780058651 type PairClassification dataset metrics task config name revision split type ru MTEB XQuADRetrieval (ru) 51adfef1c1287aab1d2d91b5bead9bcfb9c68583 validation google/xquad type value main_score 95.705 type value map_at_1 90.802 type value map_at_10 94.427 type value map_at_100 94.451 type value map_at_1000 94.451 type value map_at_20 94.446 type value map_at_3 94.121 type value map_at_5 94.34 type value mrr_at_1 90.80168776371308 type value mrr_at_10 94.42659567343111 type value mrr_at_100 94.45099347521871 type value mrr_at_1000 94.45099347521871 type value mrr_at_20 94.44574530017569 type value mrr_at_3 94.12095639943743 type value mrr_at_5 94.34036568213786 type value nauc_map_at_1000_diff1 87.40573202946949 type value nauc_map_at_1000_max 65.56220344468791 type value nauc_map_at_1000_std 8.865583291735863 type value nauc_map_at_100_diff1 87.40573202946949 type value nauc_map_at_100_max 65.56220344468791 type value nauc_map_at_100_std 8.865583291735863 type value nauc_map_at_10_diff1 87.43657080570291 type value nauc_map_at_10_max 65.71295628534446 type value nauc_map_at_10_std 9.055399339099655 type value nauc_map_at_1_diff1 88.08395824560428 type value nauc_map_at_1_max 62.92813192908893 type value nauc_map_at_1_std 6.738987385482432 type value nauc_map_at_20_diff1 87.40979818966589 type value nauc_map_at_20_max 65.59474346926105 type value nauc_map_at_20_std 8.944420599300914 type value nauc_map_at_3_diff1 86.97771892161035 type value nauc_map_at_3_max 66.14330030122467 type value nauc_map_at_3_std 8.62516327793521 type value nauc_map_at_5_diff1 87.30273362211798 type value nauc_map_at_5_max 66.1522476584607 type value nauc_map_at_5_std 9.780940862679724 type value nauc_mrr_at_1000_diff1 87.40573202946949 type value nauc_mrr_at_1000_max 65.56220344468791 type value nauc_mrr_at_1000_std 8.865583291735863 type value nauc_mrr_at_100_diff1 87.40573202946949 type value nauc_mrr_at_100_max 65.56220344468791 type value nauc_mrr_at_100_std 8.865583291735863 type value nauc_mrr_at_10_diff1 87.43657080570291 type value nauc_mrr_at_10_max 65.71295628534446 type value nauc_mrr_at_10_std 9.055399339099655 type value nauc_mrr_at_1_diff1 88.08395824560428 type value nauc_mrr_at_1_max 62.92813192908893 type value nauc_mrr_at_1_std 6.738987385482432 type value nauc_mrr_at_20_diff1 87.40979818966589 type value nauc_mrr_at_20_max 65.59474346926105 type value nauc_mrr_at_20_std 8.944420599300914 type value nauc_mrr_at_3_diff1 86.97771892161035 type value nauc_mrr_at_3_max 66.14330030122467 type value nauc_mrr_at_3_std 8.62516327793521 type value nauc_mrr_at_5_diff1 87.30273362211798 type value nauc_mrr_at_5_max 66.1522476584607 type value nauc_mrr_at_5_std 9.780940862679724 type value nauc_ndcg_at_1000_diff1 87.37823158814116 type value nauc_ndcg_at_1000_max 66.00874244792789 type value nauc_ndcg_at_1000_std 9.479929342875067 type value nauc_ndcg_at_100_diff1 87.37823158814116 type value nauc_ndcg_at_100_max 66.00874244792789 type value nauc_ndcg_at_100_std 9.479929342875067 type value nauc_ndcg_at_10_diff1 87.54508467181488 type value nauc_ndcg_at_10_max 66.88756470312894 type value nauc_ndcg_at_10_std 10.812624405397022 type value nauc_ndcg_at_1_diff1 88.08395824560428 type value nauc_ndcg_at_1_max 62.92813192908893 type value nauc_ndcg_at_1_std 6.738987385482432 type value nauc_ndcg_at_20_diff1 87.42097894104597 type value nauc_ndcg_at_20_max 66.37031898778943 type value nauc_ndcg_at_20_std 10.34862538094813 type value nauc_ndcg_at_3_diff1 86.50039907157999 type value nauc_ndcg_at_3_max 67.97798288917929 type value nauc_ndcg_at_3_std 10.162410286746852 type value nauc_ndcg_at_5_diff1 87.13322094568531 type value nauc_ndcg_at_5_max 68.08576118683821 type value nauc_ndcg_at_5_std 12.639637379592855 type value nauc_precision_at_1000_diff1 100.0 type value nauc_precision_at_1000_max 100.0 type value nauc_precision_at_1000_std 100.0 type value nauc_precision_at_100_diff1 100.0 type value nauc_precision_at_100_max 100.0 type value nauc_precision_at_100_std 100.0 type value nauc_precision_at_10_diff1 93.46711505595813 type value nauc_precision_at_10_max 100.0 type value nauc_precision_at_10_std 65.42573557179935 type value nauc_precision_at_1_diff1 88.08395824560428 type value nauc_precision_at_1_max 62.92813192908893 type value nauc_precision_at_1_std 6.738987385482432 type value nauc_precision_at_20_diff1 91.28948674127133 type value nauc_precision_at_20_max 100.0 type value nauc_precision_at_20_std 90.74278258632364 type value nauc_precision_at_3_diff1 82.64606115071832 type value nauc_precision_at_3_max 83.26201582412921 type value nauc_precision_at_3_std 23.334013491433762 type value nauc_precision_at_5_diff1 85.0867539350284 type value nauc_precision_at_5_max 96.57011448655484 type value nauc_precision_at_5_std 56.46869543426768 type value nauc_recall_at_1000_diff1 .nan type value nauc_recall_at_1000_max .nan type value nauc_recall_at_1000_std .nan type value nauc_recall_at_100_diff1 .nan type value nauc_recall_at_100_max .nan type value nauc_recall_at_100_std .nan type value nauc_recall_at_10_diff1 93.46711505595623 type value nauc_recall_at_10_max 100.0 type value nauc_recall_at_10_std 65.42573557180279 type value nauc_recall_at_1_diff1 88.08395824560428 type value nauc_recall_at_1_max 62.92813192908893 type value nauc_recall_at_1_std 6.738987385482432 type value nauc_recall_at_20_diff1 91.28948674127474 type value nauc_recall_at_20_max 100.0 type value nauc_recall_at_20_std 90.74278258632704 type value nauc_recall_at_3_diff1 82.64606115071967 type value nauc_recall_at_3_max 83.26201582413023 type value nauc_recall_at_3_std 23.334013491434007 type value nauc_recall_at_5_diff1 85.08675393502854 type value nauc_recall_at_5_max 96.57011448655487 type value nauc_recall_at_5_std 56.46869543426658 type value ndcg_at_1 90.802 type value ndcg_at_10 95.705 type value ndcg_at_100 95.816 type value ndcg_at_1000 95.816 type value ndcg_at_20 95.771 type value ndcg_at_3 95.11699999999999 type value ndcg_at_5 95.506 type value precision_at_1 90.802 type value precision_at_10 9.949 type value precision_at_100 1.0 type value precision_at_1000 0.1 type value precision_at_20 4.987 type value precision_at_3 32.658 type value precision_at_5 19.781000000000002 type value recall_at_1 90.802 type value recall_at_10 99.494 type value recall_at_100 100.0 type value recall_at_1000 100.0 type value recall_at_20 99.747 type value recall_at_3 97.975 type value recall_at_5 98.90299999999999 type Retrieval	mteb Sentence Transformers sentence-similarity sentence-transformers

Multilingual-E5-small

Multilingual E5 Text Embeddings: A Technical Report. Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei, arXiv 2024

This model has 12 layers and the embedding size is 384.

Usage

Below is an example to encode queries and passages from the MS-MARCO passage ranking dataset.

import torch.nn.functional as F

from torch import Tensor
from transformers import AutoTokenizer, AutoModel


def average_pool(last_hidden_states: Tensor,
                 attention_mask: Tensor) -> Tensor:
    last_hidden = last_hidden_states.masked_fill(~attention_mask[..., None].bool(), 0.0)
    return last_hidden.sum(dim=1) / attention_mask.sum(dim=1)[..., None]


# Each input text should start with "query: " or "passage: ", even for non-English texts.
# For tasks other than retrieval, you can simply use the "query: " prefix.
input_texts = ['query: how much protein should a female eat',
               'query: 南瓜的家常做法',
               "passage: As a general guideline, the CDC's average requirement of protein for women ages 19 to 70 is 46 grams per day. But, as you can see from this chart, you'll need to increase that if you're expecting or training for a marathon. Check out the chart below to see how much protein you should be eating each day.",
               "passage: 1.清炒南瓜丝 原料:嫩南瓜半个 调料:葱、盐、白糖、鸡精 做法: 1、南瓜用刀薄薄的削去表面一层皮,用勺子刮去瓤 2、擦成细丝(没有擦菜板就用刀慢慢切成细丝) 3、锅烧热放油,入葱花煸出香味 4、入南瓜丝快速翻炒一分钟左右,放盐、一点白糖和鸡精调味出锅 2.香葱炒南瓜 原料:南瓜1只 调料:香葱、蒜末、橄榄油、盐 做法: 1、将南瓜去皮,切成片 2、油锅8成热后,将蒜末放入爆香 3、爆香后,将南瓜片放入,翻炒 4、在翻炒的同时,可以不时地往锅里加水,但不要太多 5、放入盐,炒匀 6、南瓜差不多软和绵了之后,就可以关火 7、撒入香葱,即可出锅"]

tokenizer = AutoTokenizer.from_pretrained('intfloat/multilingual-e5-small')
model = AutoModel.from_pretrained('intfloat/multilingual-e5-small')

# Tokenize the input texts
batch_dict = tokenizer(input_texts, max_length=512, padding=True, truncation=True, return_tensors='pt')

outputs = model(**batch_dict)
embeddings = average_pool(outputs.last_hidden_state, batch_dict['attention_mask'])

# normalize embeddings
embeddings = F.normalize(embeddings, p=2, dim=1)
scores = (embeddings[:2] @ embeddings[2:].T) * 100
print(scores.tolist())

Supported Languages

This model is initialized from microsoft/Multilingual-MiniLM-L12-H384 and continually trained on a mixture of multilingual datasets. It supports 100 languages from xlm-roberta, but low-resource languages may see performance degradation.

Training Details

Initialization: microsoft/Multilingual-MiniLM-L12-H384

First stage: contrastive pre-training with weak supervision

Dataset	Weak supervision	# of text pairs
Filtered mC4	(title, page content)	1B
CC News	(title, news content)	400M
NLLB	translation pairs	2.4B
Wikipedia	(hierarchical section title, passage)	150M
Filtered Reddit	(comment, response)	800M
S2ORC	(title, abstract) and citation pairs	100M
Stackexchange	(question, answer)	50M
xP3	(input prompt, response)	80M
Miscellaneous unsupervised SBERT data	-	10M

Second stage: supervised fine-tuning

Dataset	Language	# of text pairs
MS MARCO	English	500k
NQ	English	70k
Trivia QA	English	60k
NLI from SimCSE	English	<300k
ELI5	English	500k
DuReader Retrieval	Chinese	86k
KILT Fever	English	70k
KILT HotpotQA	English	70k
SQuAD	English	87k
Quora	English	150k
Mr. TyDi	11 languages	50k
MIRACL	16 languages	40k

For all labeled datasets, we only use its training set for fine-tuning.

For other training details, please refer to our paper at https://arxiv.org/pdf/2402.05672.

Benchmark Results on Mr. TyDi

Model	Avg MRR@10		ar	bn	en	fi	id	ja	ko	ru	sw	te	th
BM25	33.3		36.7	41.3	15.1	28.8	38.2	21.7	28.1	32.9	39.6	42.4	41.7
mDPR	16.7		26.0	25.8	16.2	11.3	14.6	18.1	21.9	18.5	7.3	10.6	13.5
BM25 + mDPR	41.7		49.1	53.5	28.4	36.5	45.5	35.5	36.2	42.7	40.5	42.0	49.2
multilingual-e5-small	64.4		71.5	66.3	54.5	57.7	63.2	55.4	54.3	60.8	65.4	89.1	70.1
multilingual-e5-base	65.9		72.3	65.0	58.5	60.8	64.9	56.6	55.8	62.7	69.0	86.6	72.7
multilingual-e5-large	70.5		77.5	73.2	60.8	66.8	68.5	62.5	61.6	65.8	72.7	90.2	76.2

MTEB Benchmark Evaluation

Check out unilm/e5 to reproduce evaluation results on the BEIR and MTEB benchmark.

Support for Sentence Transformers

Below is an example for usage with sentence_transformers.

from sentence_transformers import SentenceTransformer
model = SentenceTransformer('intfloat/multilingual-e5-small')
input_texts = [
    'query: how much protein should a female eat',
    'query: 南瓜的家常做法',
    "passage: As a general guideline, the CDC's average requirement of protein for women ages 19 to 70 i     s 46 grams per day. But, as you can see from this chart, you'll need to increase that if you're expecting or traini     ng for a marathon. Check out the chart below to see how much protein you should be eating each day.",
    "passage: 1.清炒南瓜丝 原料:嫩南瓜半个 调料:葱、盐、白糖、鸡精 做法: 1、南瓜用刀薄薄的削去表面一层皮     ,用勺子刮去瓤 2、擦成细丝(没有擦菜板就用刀慢慢切成细丝) 3、锅烧热放油,入葱花煸出香味 4、入南瓜丝快速翻炒一分钟左右,     放盐、一点白糖和鸡精调味出锅 2.香葱炒南瓜 原料:南瓜1只 调料:香葱、蒜末、橄榄油、盐 做法: 1、将南瓜去皮,切成片 2、油     锅8成热后,将蒜末放入爆香 3、爆香后,将南瓜片放入,翻炒 4、在翻炒的同时,可以不时地往锅里加水,但不要太多 5、放入盐,炒匀      6、南瓜差不多软和绵了之后,就可以关火 7、撒入香葱,即可出锅"
]
embeddings = model.encode(input_texts, normalize_embeddings=True)

Package requirements

pip install sentence_transformers~=2.2.2

Contributors: michaelfeil

FAQ

1. Do I need to add the prefix "query: " and "passage: " to input texts?

Yes, this is how the model is trained, otherwise you will see a performance degradation.

Here are some rules of thumb:

• Use "query: " and "passage: " correspondingly for asymmetric tasks such as passage retrieval in open QA, ad-hoc information retrieval.

• Use "query: " prefix for symmetric tasks such as semantic similarity, bitext mining, paraphrase retrieval.

• Use "query: " prefix if you want to use embeddings as features, such as linear probing classification, clustering.

2. Why are my reproduced results slightly different from reported in the model card?

Different versions of transformers and pytorch could cause negligible but non-zero performance differences.

3. Why does the cosine similarity scores distribute around 0.7 to 1.0?

This is a known and expected behavior as we use a low temperature 0.01 for InfoNCE contrastive loss.

For text embedding tasks like text retrieval or semantic similarity, what matters is the relative order of the scores instead of the absolute values, so this should not be an issue.

Citation

If you find our paper or models helpful, please consider cite as follows:

@article{wang2024multilingual,
  title={Multilingual E5 Text Embeddings: A Technical Report},
  author={Wang, Liang and Yang, Nan and Huang, Xiaolong and Yang, Linjun and Majumder, Rangan and Wei, Furu},
  journal={arXiv preprint arXiv:2402.05672},
  year={2024}
}

Limitations

Long texts will be truncated to at most 512 tokens.