Context This dataset presents the first set of 20 tasks for testing text understanding and reasoning in the bAbI project. The tasks are described in detail in the paper: **Jason Weston, Antoine Bordes, Sumit Chopra, Alexander M. Rush, Bart van Merri?nboer, Armand Joulin and Tomas Mikolov.** [Towards AI Complete Question Answering: A Set of Prerequisite Toy Tasks, arXiv:1502.05698.](https://arxiv.org/pdf/1502.05698.pdf) Please also see the following slides: [Antoine Bordes Artificial Tasks for Artificial Intelligence, ICLR keynote, 2015.](http://www.thespermwhale.com/jaseweston/babi/abordes-ICLR.pdf) The aim is that each task tests a unique aspect of text and reasoning, and hence test different capabilities of learning models. More tasks are planned in the future to capture more aspects. Content **Training Set Size:** For each task, there are 1000 questions for training, and 1000 for testing. However, we emphasize that the goal is to use as little data as possible to do well on the tasks (i.e. if you can use less than 1000 that’s even better) — and without resorting to engineering task-specific tricks that will not generalize to other tasks, as they may not be of much use subsequently. Note that the aim during evaluation is to use the _same_ learner across all tasks to evaluate its skills and capabilities. **Supervision Signal:** Further while the MemNN results in the paper use full supervision (including of the supporting facts) results with weak supervision would also be ultimately preferable as this kind of data is easier to collect. Hence results of that form are very welcome. E.g. [this paper](https://arxiv.org/pdf/1503.08895.pdf) does include weakly supervised results. For the reasons above there are currently several directories: 1) en/ — the tasks in English, readable by humans. 2) hn/ — the tasks in Hindi, readable by humans. 3) shuffled/ — the same tasks with shuffled letters so they are not readable by humans, and for existing parsers and taggers cannot be used in a straight-forward fashion to leverage extra resources– in this case the learner is more forced to rely on the given training data. This mimics a learner being first presented a language and having to learn from scratch. 4) en-10k/ shuffled-10k/ and hn-10k/ — the same tasks in the three formats, but with 10,000 training examples, rather than 1000 training examples. Note the results in the paper use 1000 training examples. **Versions:** Some small updates since the original release have been made (see the README in the data download for more details). You can also get v1.0 and v1.1 [here](https://research.fb.com/downloads/babi/). Acknowledgements We wouldn't be here without the help of others. If you owe any attributions or thanks, include them here along with any citations of past research. Inspiration The aim is to encourage the machine learning community to work on, and develop more, of these tasks. References - https://research.fb.com/downloads/babi/