I have a very large text file which file size is nearly 100GB and contents is like a CSV file as follows
0.00234567, 3.45e-2 0x6 0.00234789, 1.23e-2 0x6 0.00234967, 2.13e-3 0x7 ...many lines... 0.00567323, 4.12e-1 0x6 ...many lines...
I want to extract some lines which match simple conditions from the text file and export the lines to another text or csv file.
My problem is the file size of the input text file much exceeds that of my computer’s RAM(16GB); I cannot
Import the file on a notebook.
Is there any circumvent of this problem?
For example, read the input text file partially from the beginning, execute the selection, export the selected lines and repeat this sequence until all the lines of the input text file read.
Any advise will be appreciated. Thank you in advance.