PTEB

Persian Text Embedding Benchmark leaderboard evaluating embedding models across Persian pair classification, retrieval, reranking, intent, scenario, and sentiment tasks.

19rows
average_scoreprimary metric
2026-05-06sampled

Metadata

ID
pteb
Category
Language
Release
2024-08-15

Metrics

Average Score, FarsTail Pair Classification, MIRACL Reranking, Wikipedia Multilingual Reranking, NeuCLIR 2023 Retrieval, MIRACL Retrieval, Wikipedia Multilingual Retrieval, MASSIVE Intent Classification, MASSIVE Scenario Classification, Multilingual Sentiment Classification, Persian Food Sentiment Classification

Latest Results

Rank Subject Average Score Model Match Provenance Sampled
1 jinaai/jina-embeddings-v3 70.69 — Imported 2026-05-06
2 intfloat/multilingual-e5-large 70.60 — Imported 2026-05-06
3 PartAI/Tooka-SBERT-V2-Large 70.54 — Imported 2026-05-06
4 PartAI/Tooka-SBERT-V2-Small 69.48 — Imported 2026-05-06
5 intfloat/multilingual-e5-base 68.54 — Imported 2026-05-06
6 Alibaba-NLP/gte-multilingual-base 67.48 — Imported 2026-05-06
7 openai text-embedding-3-large 65.77 — Imported 2026-05-06
8 PartAI/Tooka-SBERT 62.11 — Imported 2026-05-06
9 sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 55.26 — Imported 2026-05-06
10 sentence-transformers/LaBSE 54.78 — Imported 2026-05-06
11 openai text-embedding-3-small 54.44 — Imported 2026-05-06
12 openai text-embedding-ada-002 53.83 — Imported 2026-05-06
13 m3hrdadfi/bert-zwnj-wnli-mean-tokens 42.82 — Imported 2026-05-06
14 m3hrdadfi/roberta-zwnj-wnli-mean-tokens 41.71 — Imported 2026-05-06
15 myrkur/sentence-transformer-parsbert-fa 39.06 — Imported 2026-05-06
16 WhereIsAI/UAE-Large-V1 37.78 — Imported 2026-05-06
17 intfloat/e5-large-v2 34.45 — Imported 2026-05-06
18 intfloat/e5-base-v2 32.84 — Imported 2026-05-06
19 thenlper/gte-large 32.65 — Imported 2026-05-06