Workshop at EMNLP-IJCNLP 2019
November 4th, 2019
Room MR 201B-C
Machine Reading for Question Answering (MRQA) has become an important testbed for evaluating how well computer systems understand human language, as well as a crucial technology for industry applications such as search engines and dialog systems. Successful MRQA systems must deal with a wide range of important phenomena, including syntactic attachments, coreference links, and entailment. Recognizing the potential of MRQA as a comprehensive language understanding benchmark, the research community has recently created a multitude of large-scale datasets over text sources such as Wikipedia (WikiReading, SQuAD, WikiHop), news and other articles (CNN/Daily Mail, NewsQA, RACE), fictional stories (MCTest, CBT, NarrativeQA), and general web sources (MS MARCO, TriviaQA, SearchQA). These new datasets have in turn inspired an even wider array of new question answering systems.
Despite this rapid progress, there is much to understand about these datasets and systems. While in-domain test accuracy has been improving rapidly on these datasets, systems struggle to generalize gracefully when tested on new domains and datasets. The ideal MRQA system is not only accurate on in-domain data, but is also interpretable, robust to distributional shift, able to abstain from answering when there is no adequate answer, and capable of making logical inferences (e.g., via entailment and multi-sentence reasoning). Meanwhile, the diversity of recent datasets calls for an analysis of the various natural language phenomena (e.g., coreference, paraphrase, entailment, multi-step reasoning) these datasets present.
We seek submissions on the following topics:
We seek submissions of at least 4 and at most 8 pages, not including citations. All submissions will be reviewed in a single track, regardless of length. Please format your papers using the standard ACL style files. Submission is electronic via the Softconf START system.
We accept two types of submissions:
We allow submissions that are also under review in other venues, but please note that many conferences do not allow it, so make sure that you do not violate their policy as well.
We do not enforce anonymity period. We do not restrict posting on preprint servers such as arXiv at any point of time.
All submission deadlines are 11:59 PM GMT -12 (anywhere in the world).