MSMARCO-Passage-Ranking

MS MARCO(Microsoft Machine Reading Comprehension) is a large scale dataset focused on machine reading comprehension, question answering, and passage ranking. A variant of this task will be the part of TREC and AFIRM 2019. For Updates about TREC 2019 please follow This Repository Passage Reranking task Task Given a query q and a the 1000 most relevant passages P = p1, p2, p3,... p1000, as retrieved by BM25 a succeful system is expected to rerank the most relevant passage as high as possible. For this task not all 1000 relevant items have a human labeled relevant passage. Evaluation will be done using MRR

Перейти к файлу

Bhaskar Mitra a79a9d52a7 Update README.md		2022-01-03 11:12:39 -05:00
Baselines	added word vocab small	2020-03-04 14:02:28 -08:00
Leaderboard Results	Create TF-Ranking+BERT-Ensemble03302020.txt	2020-03-30 13:21:22 -07:00
.gitignore	.gitignore{	2019-05-16 16:59:15 -07:00
DL Track Overview TREC2019.pptx	Adding results	2020-01-09 13:16:50 -08:00
GenerateData.script	adding files	2019-05-16 17:08:14 -07:00
LICENSE	Initial commit	2019-05-15 11:45:03 -07:00
README.md	Update README.md	2022-01-03 11:12:39 -05:00
_config.yml	adding files	2019-05-16 17:08:14 -07:00
generateBERTPassageEmbedding.py	adding files	2019-05-16 17:08:14 -07:00
generate_qrel.py	adding files	2019-05-16 17:08:14 -07:00
get_all_passages.py	adding files	2019-05-16 17:08:14 -07:00
getstats.py	adding files	2019-05-16 17:08:14 -07:00
makeidf.py	adding files	2019-05-16 17:08:14 -07:00
makeqidpid.py	adding files	2019-05-16 17:08:14 -07:00
ms_marco_eval.py	Adding Leaderboard	2019-08-21 13:07:38 -07:00
run.sh	Adding Leaderboard	2019-08-21 13:07:38 -07:00
selected2document.py	Add files via upload	2020-01-16 11:09:51 -08:00
stats.txt	adding files	2019-05-16 17:08:14 -07:00
subsample.py	adding files	2019-05-16 17:08:14 -07:00

README.md

To participate in the MS MARCO Passage Ranking leaderboard, please go here: https://microsoft.github.io/msmarco/Submission.