Context The affNIST dataset for machine learning is based on the well-known MNIST dataset. MNIST, however, has become quite a small set, given the power of today's computers, with their multiple CPU's and sometimes GPU's. affNIST is made by taking images from MNIST and applying various reasonable affine transformations to them. In the process, the images become 40x40 pixels large, with significant translations involved, so much of the challenge for the models is to learn that a digit means the same thing in the upper right corner as it does in the lower left corner. Research into "capsules" has suggested that it is beneficial to directly model the position (or more general "pose") in which an object is found. affNIST aims to facilitate that by providing the exact transformation that has been applied to make each data case, as well as the original 28x28 image. This allows one to train a model to normalize the input, or to at least recognize in which ways it has been deformed from a more normal image. Another effect of the transformations is that there is simply much more data: every original MNIST image has been transformed in many different ways. In theory it's an infinite dataset; in practice it's based on 70,000 originals and I've made 32 randomly chosen transformed versions of each original (a different 32 for each original), leading to a total of about two million training + validation cases. Here are some examples. The left column shows the original MNIST digit (centered in a 40x40 image), and the other 16 columns show transformed versions. Acknowledgements https://www.cs.toronto.edu/~tijmen/affNIST/ If you have any published work that uses affNIST, please let me know and I'll place a link to it here. Neural networks enjoy having much training data, but computers can sometimes find it a bit hefty. To make the download easier, I've provided ZIP'd versions of the files. However, after you unzip that, it's still big. In case your computer finds it easier to load just a little bit of training data at a time (my computer certainly does), I've also made the data available split up in batches. Each batch contains one transformation of every MNIST original. I made 32 different transformation of each MNIST training case, meaning that there are about two million training / validation data cases. If you'd like to use more, e.g. 64 different transformations, please let me know. The affNIST dataset is made freely available, without restrictions, to whoever wishes to use it, in the hope that it may help advance machine learning research, but without any warranty.