Skip to main content
added 204 characters in body
Source Link
Alexey Popkov
  • 62.3k
  • 7
  • 154
  • 375

P.S. Another shortcoming of the CSV importer which may be considered as a bug both in "TextDelimiters" and "LineSeparators":


P.S. Another shortcoming of the CSV importer which may be considered as a bug both in "TextDelimiters" and "LineSeparators":

added 47 characters in body
Source Link
Alexey Popkov
  • 62.3k
  • 7
  • 154
  • 375

Diagnosis

A workaround

Diagnosis

A workaround

added 493 characters in body
Source Link
Alexey Popkov
  • 62.3k
  • 7
  • 154
  • 375

According to the Documentation, the "TextDelimiters" option determines "string or list of strings used to delimit non-numeric fields.""Table" format (as well as "CSV" and "TSV")

  • Stores numerical and textual information, formatted as a table.

and for separating textual information from numerical in these data formats we have

  • Import and Export option:
    "TextDelimiters"Automatic string or list of strings used to delimit non-numeric fields

Based on this I would consider the following behavior as a bug:

Tracing the evaluation shows that Import removes the substrings specified via "TextDelimiters" before converting the fields which match (a kindan analog of) NumberString into numbers. The correct behaviorimplementation would be to remove the delimiters after converting numeric fields into numbers.

Double-quote characters delimiting text fields are not imported by default.

  • Double-quote characters delimiting text fields are not imported by default.

According to the Documentation, the "TextDelimiters" option determines "string or list of strings used to delimit non-numeric fields." Based on this I would consider the following behavior as a bug:

Tracing the evaluation shows that Import removes the "TextDelimiters" before converting fields which match (a kind of) NumberString into numbers. The correct behavior would be to remove the delimiters after converting numeric fields into numbers.

Double-quote characters delimiting text fields are not imported by default.

According to the Documentation, the "Table" format (as well as "CSV" and "TSV")

  • Stores numerical and textual information, formatted as a table.

and for separating textual information from numerical in these data formats we have

  • Import and Export option:
    "TextDelimiters"Automatic string or list of strings used to delimit non-numeric fields

Based on this I consider the following behavior as a bug:

Tracing the evaluation shows that Import removes the substrings specified via "TextDelimiters" before converting the fields which match (an analog of) NumberString into numbers. The correct implementation would be to remove the delimiters after converting numeric fields into numbers.

  • Double-quote characters delimiting text fields are not imported by default.
added 924 characters in body
Source Link
Alexey Popkov
  • 62.3k
  • 7
  • 154
  • 375
Loading
added 363 characters in body
Source Link
Alexey Popkov
  • 62.3k
  • 7
  • 154
  • 375
Loading
added 1 character in body
Source Link
Alexey Popkov
  • 62.3k
  • 7
  • 154
  • 375
Loading
added 322 characters in body
Source Link
Alexey Popkov
  • 62.3k
  • 7
  • 154
  • 375
Loading
added 7 characters in body
Source Link
Alexey Popkov
  • 62.3k
  • 7
  • 154
  • 375
Loading
added 41 characters in body
Source Link
Alexey Popkov
  • 62.3k
  • 7
  • 154
  • 375
Loading
added 395 characters in body
Source Link
Alexey Popkov
  • 62.3k
  • 7
  • 154
  • 375
Loading
added 395 characters in body
Source Link
Alexey Popkov
  • 62.3k
  • 7
  • 154
  • 375
Loading
Source Link
Alexey Popkov
  • 62.3k
  • 7
  • 154
  • 375
Loading