Order of importing data from files

Question

I have many text files numbered from 1 to 1 million in numerical order. Within each text file is 5 columns of data (TAB spaced) with many rows. I effectively want to take the minimum value from each column from each file and then plot them on a graph in order of the file name so that i can see how the minimum value of each column changes as the file name increases. This is my current code

This seems to work for me however it is plotting the results in the wrong order as i think it is reading the file names not in a numerical order but numerical order of each character so this order 1,10,1000,10000,2,20,30. Which is muddling up the order of the alldata matrix i'm creating. I am pretty new to mathematica so i apologise if anything i have done seems an odd way of going about it. My second issue is speed somewhere i think it is changing the values to floating point numbers with many .0000s which is slowing down the process.

My files are named 1.txt, 2.txt, ect...

Thank you for your time.

Answer 1

The problem here stems from the filenames being in alphabetical order. If you separate the numbers from the ".txt" suffix with StringSplit, you can use ToExpression to get Mathematica to treat them as numbers and put them in numerical order. Then use Ordering to put the original list of filenames in the same order as the list of numbers.

filelist = {"1.dat", "10.dat", "2.dat", "100.dat", "20.dat",
   "3.dat", "1000.dat"}

{"1.dat", "10.dat", "2.dat", "100.dat", "20.dat", "3.dat", "1000.dat"}

numberlist = 
 ToExpression[StringSplit[filelist, ".dat"][[All, 1]]]

{1, 10, 2, 100, 20, 3, 1000}

orderednumbers = {filelist, numberlist}[[All, 
    Ordering@numberlist]][[1]]

{"1.dat", "2.dat", "3.dat", "10.dat", "20.dat", "100.dat", "1000.dat"}

I think that part is really the crux of your problem. From there you can call whatever part of the file you want. Hope that helps!