Questions about getting data, files, images etc. from various formats into a form that can be read, tranformed and manipulated by Mathematica

learn more… | top users | synonyms

4
votes
0answers
77 views

File Formats for Scientific Data

I have a simulation written in another language which currently just dumps all its data (doubles, lists of doubles, lists of lists of doubles) in lines in ASCII, and then I read it into Mathematica by ...
4
votes
0answers
156 views

How to speed up import of large csv table?

Loading less than 2 gB of csv data took 5.29 hours: ...
4
votes
0answers
51 views

Import succesful when file manually deleted

apparently Import keeps an imported file i the cache and doesn't complain for some time if a file is deleted manually from the system and then it is imported. If the file is deleted from within ...
4
votes
0answers
111 views

Monitor progress of ZIP file extraction

Importing a ZIP file containing potentially many individual files in a (custom) format using Import[filename, {{"*"}, "Gaussian"}] takes quite a while. How can I ...
4
votes
0answers
160 views

Problem with FTP import in V10

Mathematica V10 returns an error when download directory. URLFetch :: invhttp: "FTP: could not retrieve (RETR failed) the specified file." V9 successfully retrieves the same reference. This ...
4
votes
0answers
113 views

Import Excel data forcing links (ie workbooks) to be updated

We have noticed importing data from an Excel spreadsheet doesn’t update links. The problem with this is if you import a spreadsheet that comprises of linked workbooks data and those workbooks have ...
4
votes
0answers
199 views

Single image import from stack via FTP connection

Background I would like to create a CDF document that is embedded on a webpage. The CDF will contain some image display ...
4
votes
0answers
269 views

Strange behavior of undocumented RawArray and ArrayObject expressions

I discovered several strange results and inconsistencies while trying to understand what undocumented RawArray and ArrayObject ...
3
votes
3answers
4k views

Importing multiple files using a for-loop

once again I am stuck solving a seemingly easy problem :( I would like to make a List of tables by importing data from several txt-Files. Importing the data into a table works so far and I am able to ...
3
votes
2answers
928 views

video image recognition [closed]

Has anybody experience with video and image recognition? I've made a video of two teams playing soccer. Now I would like to translate each soccer-player to a (x,y) coordinate and follow them during ...
3
votes
3answers
324 views

URLFetch functionality for a Persian website

I want to fetch the content of a Persian website. I tried URLFetch["http://www.tsetmc.com/"] Why is Mathematica unable to recode the characters in the results ...
3
votes
2answers
2k views

Importing .txt or .csv financial data

I am trying to import some financial data exported from Excel. You can find the relevant file here : Text File or CSV File This is what the data looks like in Excel : Using the following code to ...
3
votes
4answers
908 views

Importing or reading data in binary format 212

I have a binary data file in format 212, and I want to import the file into Mathematica. How do I read or import binary format 212? I almost have no direct experience of working with any binary format....
3
votes
2answers
308 views

Equivalent of Matlab's uigetfile in Mathematica

I was wondering if there an equivalent of the "uigetfile" Matlab function to use it in Mathematica. To be more precise, I want to read many Excel files and I don't want to type a static path; instead,...
3
votes
3answers
469 views

Support for Compressed Sparse Column sparse matrix representation

Is there native support for Compressed Sparse Column (CSC) format for sparse matrices, like importing and manipulating them?
3
votes
3answers
1k views

Import data from first/last 100 rows of a file

If one wants import data from the first three rows of a file "myfile.data", one can use the command Import["myfile.data",{"Data",{1,2,3},All}]; However, if I ...
3
votes
3answers
684 views

Why does a certain CSV file import properly into LibreOffice but not into Mathematica 10.0?

I'm working on a project involving data manipulation and it involves working with CSV files. I know that the files are properly formatted as when I import them into LibreOffice, all of the columns ...
3
votes
2answers
1k views

How can I remove text headers when importing a numeric table

I have a file let's say 1.txt having numbers like: fgdgfdg fhdfdh 0.000105533 1.00E-04 0.222281 1.00E-04 0.444456 1.00E-04 0.666631 1.00E-04 asdas ddfdsfsd 0.111193 0.166733 ...
3
votes
2answers
202 views

How to import 12-bit TIFF image

I have a CMOS camera which records images at 12 bit resolution. The camera software allows to save them as 12-bit TIFs. However, Mathematica cannot import this: ...
3
votes
2answers
2k views

3D scatter plot from a txt file

I have a txt file with space-delimited x, y, z coordinates of several points. The points are organized into groups of unequal size; the groups are delimited by skipping a line, like this: ...
3
votes
2answers
230 views

Why are dictionary keys reordered upon JSON import?

After importing a JSON file, Mathematica changed the order of the fields. For example, I downloaded a sample file from: http://api.openweathermap.org/data/2.5/find?lat=55.5&lon=37.5&cnt=10 I ...
3
votes
2answers
532 views

Convert imported PDF to an image

I've looked through the forum and have not seen an answer for this. I would like to be able to import a pdf document in which each page contains an QR code. I want to then use the Barcode reader ...
3
votes
2answers
329 views

Import multiple files from folder in order of date added

I have a folder that contains certain files I want to import. In my case those are .png files. As all the files I want to import contain the phrase "accum" in their filenames, I can use ...
3
votes
1answer
181 views

Run Command Not Executing Node

How do I make the following command work in Mathematia? Import["!\"C:\\Program Files\\nodejs\\node.exe\" -p console.log('test')", "Text"] I don't get any output ...
3
votes
3answers
106 views

Why does Import[#, “ImageLinks”]& fail?

I'm having difficulty with Importing urls embedded in a site (with and without pagination). This command: ...
3
votes
2answers
117 views

Importing multiple tables within a single file

Suppose I have a file with multiple tables, each separated by a line beak, like this: ...
3
votes
2answers
122 views

How to Import This XYZ format file

Here is the .XYZ format file NP3D.XYZ Somehow i cannot import this file.It return an error box :- "Cannot Import Data As XYZ Format." it contains 1000 snapshot of 10 Carbon particles coordinate ...
3
votes
2answers
105 views

How do I run 1-855 data points( imported from excel sheet) into a formula to obtain value for each data point?

I am very new to Mathematica and I just couldn't figure out the solution for the following problem. I have two columns in an Excel file. I have imported the 1st column as ...
3
votes
2answers
217 views

Import[] exception possibly caused by ToString[] behaviour which I cannot explain

Let me just start by pointing out I'm a new StackExchange user as well as a new Mathematica user (started today!) I mention this as a context to my ineptitude :) I am attempting to read through a ...
3
votes
1answer
373 views

How to sample n frames from a movie file?

I'm looking to import 100 image frames from an mp4 video file at roughly evenly spaced intervals. As $ImportFormats shows, Mathematica can handle Movie files: .avi, .mov, .qt, .flv Multiframe ...
3
votes
2answers
90 views

Manipulation of .csv imported data — no blanks in either of two lists

Above is a .csv file. I am trying to construct two lists of male and female math test scores such that only districts which include info for both male and female students are included i.e. neither ...
3
votes
2answers
301 views

How to read non-standard-format data into Mathematica from a file

I would like to read non-standard-format data into Mathematica from a file. How can this be achieved? For example, how can I read the following text file of data into Mathematica: ...
3
votes
1answer
437 views

how to delete specific data from text file and then update it

I have a large text file. I read data from text file one at a time and check whether data agree with my condition. If not I want to delete that data in text file and update it. For example say my ...
3
votes
2answers
470 views

Extracting a single layer from a SHP file

I have an ESRI ShapeFile (SHP) that I've loaded. It has a number of layers which I can see the names of by using: Import["file.shp", "LayerNames"] I get ...
3
votes
1answer
367 views

Exporting lists to files

I am trying to write a program which will generate a list of objects and then exports it in a separate file and clears its memory. As an example I tried the following ...
3
votes
2answers
130 views

Take a specific part of a matrix imported from a .xls

i would like to know if there are any ways to link headings of a table i had imported with the data in the table itself. I imported a matrix from an excel file and i want to take a specific part of it....
3
votes
1answer
107 views

How to import several files at once?

I tried to import multiple files at once. Following this topic my code is files = FileNames["*.phz", NotebookDirectory[]] neki = Import[#, "Table"] & /@ files ...
3
votes
1answer
497 views

Easiest way to parse semi-structured text file

I have a plain text file with some data. I need two things: Be able to extract certain values for the various field, e.g. to extract the 'Mean Dose [%]', that is to extract number ...
3
votes
1answer
435 views

Plotting with ColorFunction -> GrayLevel - no black

This is probably a fairly trivial question, yet I have been unable to find an answer - help would be much appreciated! :) I am trying to plot a 28 x 28 matrix (tabulated data given here), containing ...
3
votes
1answer
1k views

How do I read a CSV file and remove comments from it

I have very recently started using Mathematica 9.0 Home Edition and am trying to understand it as best I can so please be tolerant ;). I have a file of data (sugar.csv) which contains blood sugar ...
3
votes
2answers
164 views

Importing CSV with multiline text fields

Here is a valid CSV: a1,b1,c1,d1,"e1 e1 e1" a2,b2,"c2 c2 c2",d2,e2 It has two rows and five columns, and contains two fields with embedded CRLF. (See the CSV ...
3
votes
1answer
259 views

Import a table from a text file or string

XYScan produces results in the following form (as *.txt): ...
3
votes
2answers
104 views

Most efficient way of splitting a file into length-prefixed blocks

Let's say I have a really big file (>100MB) that consists of length-prefixed blocks, i.e. the first byte of each byte block indicates the length of the rest of the block. This is a simplified example ...
3
votes
2answers
690 views

How to export a table of complex numbers?

I'm having problems exporting a table of complex numbers. I have: ...
3
votes
1answer
359 views

Importing numerical values from a PDF file

I need the numerical values from pdf files like this one. When I use the usual Import command, the PDF imports, but pages of images. How can Mathematica be used ...
3
votes
2answers
160 views

how to convert string output into executable commands

temp = (layer = #; layerS = ToString[#]; StringForm["Import[\"drainCdg_gdat0``\",\"Table\"]", layerS]) & /@ {1, 2, 3} how to get the output of ...
3
votes
1answer
740 views

Read and filter a text file without importing

I have a large text file of a million sections. Each section contains A lines of header and B lines of numeric data. I want to read the first and last line of B from each section (to have a list of 2 ...
3
votes
2answers
289 views

Since installing mathematica 9 I can't import certain tiffs

I have a notebook written in Mathematica 8 in which I imported Tiff images and everything worked fine. Since I installed Mathematica 9, I get the error: ...
3
votes
1answer
303 views

Efficiently importing XPM matrix data into Mathematica

The XPM file format is an image file format. Although it is primarily intended for icon pixmaps, it can also be used to store matrix data. For example, the GROMACS chemical simulation package uses ...
3
votes
1answer
155 views

RawJSON vs JSON format

It has been very recently, since the release of version 10.3.0 I think, that Import/Export and ImportString/ExportString functions accept a format parameter with the value of "RawJSON". The ...