138 reputation
5
bio website researchgate.net/profile/…
location Vienna, Austria
age 32
visits member for 8 months
seen Nov 5 '13 at 14:49

Risk Manager at Raiffeisen Capital Management

External Lecturer at Vienna University of Technology


Nov
5
awarded  Scholar
Nov
5
accepted Speeding up Import and Export in CSV format
Nov
5
comment Speeding up Import and Export in CSV format
@RunnyKine Thanks for your solution. I prefer the pure Mathematica solution. It tremendously speeded up my routines.
Nov
5
comment Speeding up Import and Export in CSV format
@george2079 First I export from mathematica, then I call an R batch file (with some statistics which I only found in R ... and I am an R user mainly) and then R exports the results (a shrunken covariance matrix) and mathematica imports again and proceeds. It was done using csv so far. It would be a pity to change much of the 100+ lines of code.
Nov
5
comment Speeding up Import and Export in CSV format
@RunnyKine I am far from a routined mathematica user. I am a mathematician and I would like to have the data in a matrix like form. In fact I have a pretty lengthy program and I just change the import/export part in the beginning and I would like to keep the rest as it is. Thus output/input just as Export/Import leaves the data would be best.
Nov
4
awarded  Student
Nov
4
comment Speeding up Import and Export in CSV format
@LeonidShifrin Thanks for the link. The answers author says that his code is more memory efficient but slower. I don't have explicite memory problems but the run time is a pain.
Nov
4
awarded  Editor
Nov
4
comment Speeding up Import and Export in CSV format
I edited the question and posted 2 links to my gdrive. One with a small example and one with the true size.
Nov
4
revised Speeding up Import and Export in CSV format
added 285 characters in body
Nov
4
comment Speeding up Import and Export in CSV format
Can I attach the original 40 MB file here ...? This would be the true problem size. Alternatively I can attach a much smaller version.
Nov
4
comment Speeding up Import and Export in CSV format
First I would like to takle the export. For this one could use the random number example provided. I would like to combine Export and ExportString in order to speed up the export. If it is correct for the toy example then it should be alright for the big data. Is this enough info for you?
Nov
4
asked Speeding up Import and Export in CSV format
Nov
4
awarded  Autobiographer
Nov
4
awarded  Supporter