PL-MTEB

Polish Massive Text Embedding Benchmark leaderboard evaluating embedding models across Polish classification, clustering, pair classification, semantic textual similarity, and retrieval tasks.

22rows
average_main_scoreprimary metric
2026-05-06sampled

Metadata

Metrics

Average Main Score, Evaluated Tasks, Classification Average, Clustering Average, PairClassification Average, STS Average, Retrieval Average, CBD, PolEmo2.0-IN, PolEmo2.0-OUT, AllegroReviews, PAC, MassiveIntentClassification, MassiveScenarioClassification, SciField, EightTagsClustering, PlscClusteringS2S, PlscClusteringP2P, WikinewsPlClusteringS2S, WikinewsPlClusteringP2P, SICK-E-PL, PpcPC, CDSC-E, PSC, SICK-R-PL, CDSC-R, STS22, ArguAna-PL, DBPedia-PL, FiQA-PL, HotpotQA-PL, MSMARCO-PL, NFCorpus-PL, NQ-PL, Quora-PL, SCIDOCS-PL, SciFact-PL, TRECCOVID-PL, SciDefRetrieval

Latest Results

Rank Subject Average Main Score Model Match Provenance Sampled
1 Alibaba-NLP/gte-Qwen2-7B-instruct 65.86 Imported 2026-05-06
2 BAAI/bge-multilingual-gemma2 64.72 Imported 2026-05-06
3 Alibaba-NLP/gte-Qwen2-1.5B-instruct 62.85 Imported 2026-05-06
4 sdadas/mmlw-roberta-large 61.87 Imported 2026-05-06
5 sdadas/mmlw-roberta-base 59.79 Imported 2026-05-06
6 sdadas/mmlw-e5-large 59.74 Imported 2026-05-06
7 OrlikB/KartonBERT-USE-base-v1 59.04 Imported 2026-05-06
8 sdadas/mmlw-e5-base 58.54 Imported 2026-05-06
9 intfloat/multilingual-e5-large 58.50 Imported 2026-05-06
10 BAAI/bge-m3 57.19 Imported 2026-05-06
11 sdadas/mmlw-e5-small 54.88 Imported 2026-05-06
12 intfloat/multilingual-e5-base 54.79 Imported 2026-05-06
13 intfloat/multilingual-e5-small 53.49 Imported 2026-05-06
14 ipipan/silver-retriever-base-v1 52.72 Imported 2026-05-06
15 sdadas/st-polish-paraphrase-from-mpnet 51.90 Imported 2026-05-06
16 sdadas/st-polish-paraphrase-from-distilroberta 51.35 Imported 2026-05-06
17 ibm-granite/granite-embedding-278m-multilingual 48.02 Imported 2026-05-06
18 paraphrase-multilingual-mpnet-base-v2 47.94 Imported 2026-05-06
19 paraphrase-multilingual-MiniLM-L12-v2 45.71 Imported 2026-05-06
20 ibm-granite/granite-embedding-107m-multilingual 44.95 Imported 2026-05-06
21 LaBSE 44.64 Imported 2026-05-06
22 distiluse-base-multilingual-cased-v2 41.83 Imported 2026-05-06