Skip to main content
replaced http://mathematica.stackexchange.com/ with https://mathematica.stackexchange.com/
Source Link

This question is related to the following:

Speeding up Import and Export in CSV formatSpeeding up Import and Export in CSV format

Stream CSV or TSV filesStream CSV or TSV files

Reading periodic elements from a large fileReading periodic elements from a large file

I have a set of very large CSV files (a few hundred MB), a sample file is available here. RAM limitations make it quite cumbersome to use Import.

I am only interested in a subset of data from the file:

  • I want to read data from just a few columns
  • I want to read data from every 256th row starting with the 3rd row
     columns = {3, 4, 5, 8, 12}; first = 3; step = 256;

I am interested in methods that minimize memory and speed up import.

This question is related to the following:

Speeding up Import and Export in CSV format

Stream CSV or TSV files

Reading periodic elements from a large file

I have a set of very large CSV files (a few hundred MB), a sample file is available here. RAM limitations make it quite cumbersome to use Import.

I am only interested in a subset of data from the file:

  • I want to read data from just a few columns
  • I want to read data from every 256th row starting with the 3rd row
     columns = {3, 4, 5, 8, 12}; first = 3; step = 256;

I am interested in methods that minimize memory and speed up import.

This question is related to the following:

Speeding up Import and Export in CSV format

Stream CSV or TSV files

Reading periodic elements from a large file

I have a set of very large CSV files (a few hundred MB), a sample file is available here. RAM limitations make it quite cumbersome to use Import.

I am only interested in a subset of data from the file:

  • I want to read data from just a few columns
  • I want to read data from every 256th row starting with the 3rd row
     columns = {3, 4, 5, 8, 12}; first = 3; step = 256;

I am interested in methods that minimize memory and speed up import.

Improved formatting
Source Link
m_goldberg
  • 108.1k
  • 16
  • 104
  • 259

This question is related to the following:

Speeding up Import and Export in CSV format

Stream CSV or TSV files

Reading periodic elements from a large file

I have a set of very large CSV files (a few hundred MB), a sample file is available here. RAM limitations make it quite cumbersome to use Import.

I am only interested in a subset of data from the file:

  • I want to read data from just a few columns

    I want to read data from just a few columns
  • I want to read data from every 256th row starting with the 3rd row

      columns = {3, 4, 5, 8, 12}; first = 3; step = 256;
    
    I want to read data from every 256th row starting with the 3rd row
     columns = {3, 4, 5, 8, 12}; first = 3; step = 256;

InterestedI am interested in methods that minimize memory and speed up import.

This question is related to the following:

Speeding up Import and Export in CSV format

Stream CSV or TSV files

Reading periodic elements from a large file

I have a set of very large CSV files (a few hundred MB), a sample file is available here. RAM limitations make it quite cumbersome to use Import.

I am only interested in a subset of data from the file:

  • I want to read data from just a few columns

  • I want to read data from every 256th row starting with the 3rd row

      columns = {3, 4, 5, 8, 12}; first = 3; step = 256;
    

Interested in methods that minimize memory and speed up import.

This question is related to the following:

Speeding up Import and Export in CSV format

Stream CSV or TSV files

Reading periodic elements from a large file

I have a set of very large CSV files (a few hundred MB), a sample file is available here. RAM limitations make it quite cumbersome to use Import.

I am only interested in a subset of data from the file:

  • I want to read data from just a few columns
  • I want to read data from every 256th row starting with the 3rd row
     columns = {3, 4, 5, 8, 12}; first = 3; step = 256;

I am interested in methods that minimize memory and speed up import.

deleted 6 characters in body
Source Link
m_goldberg
  • 108.1k
  • 16
  • 104
  • 259

This question is related to the following:

Speeding up Import and Export in CSV format

Stream CSV or TSV files

Reading periodic elements from a large file

I have a set of very large CSV files (a few hundred MB), a sample file is available here. RAM limitations make it quite cumbersome to use Import.

I am only interested in a subset of data from the file:

  • I want to read data from just a few columns

  • I want to read data from every 256th row starting with the 3rd row

      columns = {3, 4, 5, 8, 12};
      first = 3; step =256;= 256;
    

Interested in methods that minimize memory and speed up import.

This question is related to the following:

Speeding up Import and Export in CSV format

Stream CSV or TSV files

Reading periodic elements from a large file

I have a set of very large CSV files (a few hundred MB), a sample file is available here. RAM limitations make it quite cumbersome to use Import.

I am only interested in a subset of data from the file:

  • I want to read data from just a few columns

  • I want to read data from every 256th row starting with the 3rd row

      columns ={3,4,5,8,12};
      first = 3; step =256;
    

Interested in methods that minimize memory and speed up import.

This question is related to the following:

Speeding up Import and Export in CSV format

Stream CSV or TSV files

Reading periodic elements from a large file

I have a set of very large CSV files (a few hundred MB), a sample file is available here. RAM limitations make it quite cumbersome to use Import.

I am only interested in a subset of data from the file:

  • I want to read data from just a few columns

  • I want to read data from every 256th row starting with the 3rd row

      columns = {3, 4, 5, 8, 12}; first = 3; step = 256;
    

Interested in methods that minimize memory and speed up import.

Source Link
Pam
  • 1.9k
  • 11
  • 25
Loading