sl4dk1yRETRIEVAL STUDY
RAG Retrieval Research
A Russian-language Mr. TyDi retrieval study with an evaluation on the original 9.6-million-document corpus and a separate reduced-collection comparison.
Reduced-collection TEST
On 995 TEST queries, BGE-M3 scored Recall@10 0.861307 and nDCG@10 0.692026. E5 scored 0.813065 and 0.641458.
Interpretation
The one-million-document collection was built partly from positive TEST qrels and historical retrieval runs. Results are conditional on that collection and do not establish performance on the full corpus. The public repository preserves the metrics, runs and protocol.
View public repository ↗