When using large set of images for training neural networks (>10000, size 250 x 250 each) the time to read the images is quite long. My first approach was to use the DataSet functionality of Mathematica but saving large DataSets seems to consume all system memory (16GB) not reaching completion.
Is it possible to use the REC format as used in MxNet? And if so, how to do it?