MS MARCO(Microsoft Machine Reading Comprehension) is a large scale dataset focused on machine reading comprehension, question answering, and passage ranking. A variant of this task will be the part of TREC and AFIRM 2019. For Updates about TREC 2019 please follow This Repository Passage Reranking task Task Given a query q and a the 1000 most relevant passages P = p1, p2, p3,... p1000, as retrieved by BM25 a succeful system is expected to rerank the most relevant passage as high as possible. For this task not all 1000 relevant items have a human labeled relevant passage. Evaluation will be done using MRR
28b3693958
This pr is auto merged as it contains a mandatory file and is opened for more than 10 days. |
||
|---|---|---|
| Baselines | ||
| Leaderboard Results | ||
| .gitignore | ||
| DL Track Overview TREC2019.pptx | ||
| GenerateData.script | ||
| LICENSE | ||
| README.md | ||
| SECURITY.md | ||
| _config.yml | ||
| generateBERTPassageEmbedding.py | ||
| generate_qrel.py | ||
| get_all_passages.py | ||
| getstats.py | ||
| makeidf.py | ||
| makeqidpid.py | ||
| ms_marco_eval.py | ||
| run.sh | ||
| selected2document.py | ||
| stats.txt | ||
| subsample.py | ||
README.md
To participate in the MS MARCO Passage Ranking leaderboard, please go here: https://microsoft.github.io/msmarco/Submission.