# Is it possible to parallelize reading in Mathematica?

I have a gigantic data file that needs to be processed. I am reading it in chunks using ReadList with an InputStream. In my configuration ReadList has a maximum reading speed of 30 MB/s. I was thinking of opening multiple streams from the same file and reading from them simultaneously, so that it can be done a little bit faster:

stream1=OpenRead["data.txt"]
stream2=stream1
Skip[stream2,String,5000000]


and then

tp = Parallelize[

• Have you tried Join @@ ParallelMap[ReadList[#, Real, 5000000] &, {stream1, stream2}]? – Michael E2 Feb 3 '18 at 13:37