Questions about getting data, files, images etc. from various formats into a form that can be read, tranformed and manipulated by Mathematica

learn more… | top users | synonyms

4
votes
1answer
211 views

how can i associate the headings of columns/rows with content of itself and then recall what i want after i've imported the excel file in mathematica

Hello, i make another try... I have to import a file like this below (it is an excel file, i show you just the beginnig. it should have thousend of rows and columns). After i've imported the file i ...
4
votes
1answer
96 views

Importing large datasets using streams

I work with large data sets with 22 columns and up to a million rows. Each row contains one observation with several variables. All variables are numbers. Simplyfied example: 1, 1, 2, 3, 4, 5, 6,...
4
votes
1answer
119 views

Parsing subscripts when loading package files via the FrontEnd

I am working on some code, and have found it easier to use a Mathematica package because it is easier to run via command-line (lightweight) it allows for easier source versioning (Git), and it ...
4
votes
2answers
53 views

NaNs in tabular data and import performance

I'm working with some data files that are just too large for Import. I tried using ReadList, specifying either ...
4
votes
1answer
185 views

Import audio in uLaw format?

How do I import a uLaw-format audio file into Mathematica? Here's an example: hello-world.ulaw For reference, here's the same file in wav format: hello-world.wav As I understand it, the uLaw ...
4
votes
0answers
78 views

File Formats for Scientific Data

I have a simulation written in another language which currently just dumps all its data (doubles, lists of doubles, lists of lists of doubles) in lines in ASCII, and then I read it into Mathematica by ...
4
votes
0answers
159 views

How to speed up import of large csv table?

Loading less than 2 gB of csv data took 5.29 hours: ...
4
votes
0answers
51 views

Import succesful when file manually deleted

apparently Import keeps an imported file i the cache and doesn't complain for some time if a file is deleted manually from the system and then it is imported. If the file is deleted from within ...
4
votes
0answers
112 views

Monitor progress of ZIP file extraction

Importing a ZIP file containing potentially many individual files in a (custom) format using Import[filename, {{"*"}, "Gaussian"}] takes quite a while. How can I ...
4
votes
0answers
162 views

Problem with FTP import in V10

Mathematica V10 returns an error when download directory. URLFetch :: invhttp: "FTP: could not retrieve (RETR failed) the specified file." V9 successfully retrieves the same reference. This ...
4
votes
0answers
114 views

Import Excel data forcing links (ie workbooks) to be updated

We have noticed importing data from an Excel spreadsheet doesn’t update links. The problem with this is if you import a spreadsheet that comprises of linked workbooks data and those workbooks have ...
4
votes
0answers
201 views

Single image import from stack via FTP connection

Background I would like to create a CDF document that is embedded on a webpage. The CDF will contain some image display ...
4
votes
0answers
273 views

Strange behavior of undocumented RawArray and ArrayObject expressions

I discovered several strange results and inconsistencies while trying to understand what undocumented RawArray and ArrayObject ...
3
votes
3answers
5k views

Importing multiple files using a for-loop

once again I am stuck solving a seemingly easy problem :( I would like to make a List of tables by importing data from several txt-Files. Importing the data into a table works so far and I am able to ...
3
votes
2answers
953 views

video image recognition [closed]

Has anybody experience with video and image recognition? I've made a video of two teams playing soccer. Now I would like to translate each soccer-player to a (x,y) coordinate and follow them during ...
3
votes
3answers
327 views

URLFetch functionality for a Persian website

I want to fetch the content of a Persian website. I tried URLFetch["http://www.tsetmc.com/"] Why is Mathematica unable to recode the characters in the results ...
3
votes
2answers
2k views

Importing .txt or .csv financial data

I am trying to import some financial data exported from Excel. You can find the relevant file here : Text File or CSV File This is what the data looks like in Excel : Using the following code to ...
3
votes
4answers
918 views

Importing or reading data in binary format 212

I have a binary data file in format 212, and I want to import the file into Mathematica. How do I read or import binary format 212? I almost have no direct experience of working with any binary format....
3
votes
2answers
312 views

Equivalent of Matlab's uigetfile in Mathematica

I was wondering if there an equivalent of the "uigetfile" Matlab function to use it in Mathematica. To be more precise, I want to read many Excel files and I don't want to type a static path; instead,...
3
votes
3answers
472 views

Support for Compressed Sparse Column sparse matrix representation

Is there native support for Compressed Sparse Column (CSC) format for sparse matrices, like importing and manipulating them?
3
votes
3answers
1k views

Import data from first/last 100 rows of a file

If one wants import data from the first three rows of a file "myfile.data", one can use the command Import["myfile.data",{"Data",{1,2,3},All}]; However, if I ...
3
votes
3answers
701 views

Why does a certain CSV file import properly into LibreOffice but not into Mathematica 10.0?

I'm working on a project involving data manipulation and it involves working with CSV files. I know that the files are properly formatted as when I import them into LibreOffice, all of the columns ...
3
votes
2answers
1k views

How can I remove text headers when importing a numeric table

I have a file let's say 1.txt having numbers like: fgdgfdg fhdfdh 0.000105533 1.00E-04 0.222281 1.00E-04 0.444456 1.00E-04 0.666631 1.00E-04 asdas ddfdsfsd 0.111193 0.166733 ...
3
votes
2answers
2k views

3D scatter plot from a txt file

I have a txt file with space-delimited x, y, z coordinates of several points. The points are organized into groups of unequal size; the groups are delimited by skipping a line, like this: ...
3
votes
2answers
231 views

Why are dictionary keys reordered upon JSON import?

After importing a JSON file, Mathematica changed the order of the fields. For example, I downloaded a sample file from: http://api.openweathermap.org/data/2.5/find?lat=55.5&lon=37.5&cnt=10 I ...
3
votes
2answers
560 views

Convert imported PDF to an image

I've looked through the forum and have not seen an answer for this. I would like to be able to import a pdf document in which each page contains an QR code. I want to then use the Barcode reader ...
3
votes
2answers
335 views

Import multiple files from folder in order of date added

I have a folder that contains certain files I want to import. In my case those are .png files. As all the files I want to import contain the phrase "accum" in their filenames, I can use ...
3
votes
1answer
185 views

Run Command Not Executing Node

How do I make the following command work in Mathematia? Import["!\"C:\\Program Files\\nodejs\\node.exe\" -p console.log('test')", "Text"] I don't get any output ...
3
votes
3answers
107 views

Why does Import[#, “ImageLinks”]& fail?

I'm having difficulty with Importing urls embedded in a site (with and without pagination). This command: ...
3
votes
2answers
117 views

Importing multiple tables within a single file

Suppose I have a file with multiple tables, each separated by a line beak, like this: ...
3
votes
1answer
72 views

How to import Byte values of 8bit gray scale image

I have the following image (8bit, gray scale, 1600*1200 pixels): What confuses me: 1. Dimensions[Import[imageFileName, "Byte"]] gives ...
3
votes
2answers
139 views

How to Import This XYZ format file

Here is the .XYZ format file NP3D.XYZ Somehow i cannot import this file.It return an error box :- "Cannot Import Data As XYZ Format." it contains 1000 snapshot of 10 Carbon particles coordinate ...
3
votes
2answers
105 views

How do I run 1-855 data points( imported from excel sheet) into a formula to obtain value for each data point?

I am very new to Mathematica and I just couldn't figure out the solution for the following problem. I have two columns in an Excel file. I have imported the 1st column as ...
3
votes
1answer
405 views

How to sample n frames from a movie file?

I'm looking to import 100 image frames from an mp4 video file at roughly evenly spaced intervals. As $ImportFormats shows, Mathematica can handle Movie files: .avi, .mov, .qt, .flv Multiframe ...
3
votes
2answers
219 views

Import[] exception possibly caused by ToString[] behaviour which I cannot explain

Let me just start by pointing out I'm a new StackExchange user as well as a new Mathematica user (started today!) I mention this as a context to my ineptitude :) I am attempting to read through a ...
3
votes
2answers
91 views

Manipulation of .csv imported data — no blanks in either of two lists

Above is a .csv file. I am trying to construct two lists of male and female math test scores such that only districts which include info for both male and female students are included i.e. neither ...
3
votes
2answers
311 views

How to read non-standard-format data into Mathematica from a file

I would like to read non-standard-format data into Mathematica from a file. How can this be achieved? For example, how can I read the following text file of data into Mathematica: ...
3
votes
1answer
446 views

how to delete specific data from text file and then update it

I have a large text file. I read data from text file one at a time and check whether data agree with my condition. If not I want to delete that data in text file and update it. For example say my ...
3
votes
2answers
476 views

Extracting a single layer from a SHP file

I have an ESRI ShapeFile (SHP) that I've loaded. It has a number of layers which I can see the names of by using: Import["file.shp", "LayerNames"] I get ...
3
votes
1answer
375 views

Exporting lists to files

I am trying to write a program which will generate a list of objects and then exports it in a separate file and clears its memory. As an example I tried the following ...
3
votes
2answers
189 views

Importing CSV with multiline text fields

Here is a valid CSV: a1,b1,c1,d1,"e1 e1 e1" a2,b2,"c2 c2 c2",d2,e2 It has two rows and five columns, and contains two fields with embedded CRLF. (See the CSV ...
3
votes
2answers
131 views

Take a specific part of a matrix imported from a .xls

i would like to know if there are any ways to link headings of a table i had imported with the data in the table itself. I imported a matrix from an excel file and i want to take a specific part of it....
3
votes
1answer
109 views

How to import several files at once?

I tried to import multiple files at once. Following this topic my code is files = FileNames["*.phz", NotebookDirectory[]] neki = Import[#, "Table"] & /@ files ...
3
votes
1answer
508 views

Easiest way to parse semi-structured text file

I have a plain text file with some data. I need two things: Be able to extract certain values for the various field, e.g. to extract the 'Mean Dose [%]', that is to extract number ...
3
votes
1answer
456 views

Plotting with ColorFunction -> GrayLevel - no black

This is probably a fairly trivial question, yet I have been unable to find an answer - help would be much appreciated! :) I am trying to plot a 28 x 28 matrix (tabulated data given here), containing ...
3
votes
1answer
1k views

How do I read a CSV file and remove comments from it

I have very recently started using Mathematica 9.0 Home Edition and am trying to understand it as best I can so please be tolerant ;). I have a file of data (sugar.csv) which contains blood sugar ...
3
votes
1answer
291 views

Import a table from a text file or string

XYScan produces results in the following form (as *.txt): ...
3
votes
2answers
104 views

Most efficient way of splitting a file into length-prefixed blocks

Let's say I have a really big file (>100MB) that consists of length-prefixed blocks, i.e. the first byte of each byte block indicates the length of the rest of the block. This is a simplified example ...
3
votes
2answers
701 views

How to export a table of complex numbers?

I'm having problems exporting a table of complex numbers. I have: ...
3
votes
1answer
379 views

Importing numerical values from a PDF file

I need the numerical values from pdf files like this one. When I use the usual Import command, the PDF imports, but pages of images. How can Mathematica be used ...