-
Notifications
You must be signed in to change notification settings - Fork 628
Pull requests: embeddings-benchmark/mteb
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
fix: drop duplicate train documents in SyntheticText2SQL corpus
#4846
opened Jun 22, 2026 by
fzowl
Contributor
Loading…
Wave 7b integration
new model
Questions related to adding a new model to the benchmark
#4841
opened Jun 20, 2026 by
debashishc
•
Draft
dataset: Added NANOBEIR Extended Benchmark
new benchmark
Issues related to adding a new benchmark
#4837
opened Jun 19, 2026 by
ayush1298
Collaborator
Loading…
model: Add LFM2.5 and LFM2 models
new model
Questions related to adding a new model to the benchmark
#4835
opened Jun 19, 2026 by
ayush1298
Collaborator
Loading…
6 of 7 tasks
feat: add VllmEndpointWrapper for HTTP-based vLLM servers
#4834
opened Jun 18, 2026 by
maryamtahhan
Loading…
model: Add SPLADE-Code sparse retrieval models (naver/splade-code-06B, splade-code-8B)
#4828
opened Jun 18, 2026 by
fzowl
Contributor
Loading…
model: Add Prism reranker models (infgrad/Prism-Qwen3.5-Reranker)
new model
Questions related to adding a new model to the benchmark
#4823
opened Jun 17, 2026 by
fzowl
Contributor
Loading…
fix: Add MockTask for testing new model implementations
#4814
opened Jun 15, 2026 by
ayush1298
Collaborator
Loading…
Add perplexity-ai/pplx-embed-v1-late-0.6b model meta
new model
Questions related to adding a new model to the benchmark
#4813
opened Jun 14, 2026 by
wgu9
Loading…
Add topk-io/Iso-ModernColBERT model meta
new model
Questions related to adding a new model to the benchmark
#4812
opened Jun 14, 2026 by
wgu9
Loading…
fix qwen3 implementation to match authors implementation
repro
question and issues related to reproducibility
benchmark: Add Slovak tasks and SK-MTEB benchmark (MTEB(slk, v1))
new benchmark
Issues related to adding a new benchmark
#4788
opened Jun 9, 2026 by
andrejridzik
Contributor
Loading…
7 of 8 tasks
perf: clone extracted video frames to prevent DataLoader shared memory bloat
#4747
opened May 27, 2026 by
deep9539
Contributor
Loading…
[MVEB] Add STARBench video-centric QA task
new dataset
Issues related to adding a new task or dataset
video
video extension
#4746
opened May 27, 2026 by
yaswanth169
Contributor
Loading…
[MVEB] Add MVBench video-centric QA task
new dataset
Issues related to adding a new task or dataset
video
video extension
#4745
opened May 27, 2026 by
yaswanth169
Contributor
Loading…
task: add BRIGHT-Pro retrieval (7 StackExchange domains)
new benchmark
Issues related to adding a new benchmark
stale
#4651
opened May 10, 2026 by
yilunzhao
Contributor
Loading…
4 of 5 tasks
dataset: downsample MIRACLReranking using MIRACLRetrievalHardNegatives
#4380
opened Apr 15, 2026 by
fzoll
Contributor
Loading…
5 tasks done
ProTip!
Updated in the last three days: updated:>2026-06-19.