Questions about getting data, files, images etc. from various formats into a form that can be read, tranformed and manipulated by Mathematica

learn more… | top users | synonyms

7
votes
1answer
413 views

Converting XMLElement objects to plain text

Short version: How can I convert an XMLElement that represents part of a HTML document to plain text? Long version: The more general problem is extracting ...
25
votes
3answers
2k views

How to read data file quickly?

I have a tab separated value file with 10 million rows each of which has three tab separated values. The first value is a string, the second an integer, and the third another string. How to read ...
8
votes
2answers
4k views

Import selected columns from a tab delimited text file

I have a very huge file (1GB) from which I desire to import only the 5th column. It is a tab delimited text file with a .txt extension. Can you please help me with ...
1
vote
1answer
303 views

Importing 2d array of files

I would like to import multiple files to a 2d array. I know to get a list of files I can do myfiles=FileNames["*.txt"] alldata=Import/@myfiles Is it possible to ...
6
votes
2answers
798 views

Why does importing a URL fail the second time and produce a FetchURL::conopen error?

I have Mathematica code that uses Import[] to download URLs. I noticed that first time I use the Import[] command it works. ...
2
votes
1answer
134 views

Implementing a For (?) or series or loop (?) for individual results for every x to n

I'm working on improving a modeling formula and have spreadsheets worth of data to use, but my work so far has been quite tedious. I'm essentially pulling 20 rows of data from each separate sheet of a ...
3
votes
2answers
195 views

Import[] exception possibly caused by ToString[] behaviour which I cannot explain

Let me just start by pointing out I'm a new StackExchange user as well as a new Mathematica user (started today!) I mention this as a context to my ineptitude :) I am attempting to read through a ...
0
votes
1answer
777 views

Can an Interpolation function be 'saved'? [duplicate]

Possible Duplicate: Save interpolated function I am importing tables with sizes of 100k - 500k rows and 4 columns. The larger the table, the slower my Mathematica runs for all computations ...
11
votes
4answers
1k views

Import[ ] drops leading zeros from data when importing a CSV file

I need to load data from the CSV file shown below. Import[ ] drops the leading zeros in column 3 when it imports the CSV file, but they are security identifiers, and I need them. ReadList[ ] ...
2
votes
2answers
193 views

Import[] bug (video)?

I have the following code: frames = Import["myvideo.avi",{"Frames",{50,60,70}}]; This imports frames 1,2, and 3 of the video, not 50,60 and 70. It imports the ...
10
votes
1answer
549 views

How to import date (YYYY-MM-DD) data from a file?

I have a file with data in form {date, value}: 2010-05-19 17 2010-05-20 20 ...
-1
votes
1answer
2k views

How to specify DataRange in a ListPlot with an imported set of data

So I've been trying to import a large set of data (6900 point pairs) from an excel (.xls) file. The Exel file has 2 columns of numeric data. I've also been trying to plot this data, but when I do, it ...
0
votes
1answer
117 views

Importing RSS to Notebook: How to get images instead of long ugly links?

This question on importing news headlines via a RSS feed reminded me of an old question I've been meaning to ask. Past attempts at finding a use for Mathematica's RSS to Notebook capabilities were ...
7
votes
1answer
842 views

Import file from FTP site

I would like to Import files from an FTP site. The code below works on a test site: file = Import["ftp://test:test@ftp.secureftp-test.com/pigs.xml"]; But when I ...
4
votes
2answers
973 views

How to process .vtk file

I want to extract the cluster of points inside 3D box, is there any way one can do this in Mathematica?
6
votes
2answers
686 views

Trying to extract information from an MDB file. Import is too slow

I am running a Linux box and as usual the documentation for this type of box is not great. I am trying to open up and extract and possibly include later on information from a "mdb" file. The file ...
3
votes
3answers
593 views

How can I change the CDF which imports the data and uses it, without execution of code

I am making an application which first imports the data from the Excel file and then uses it in the deployment of a CDF. But is it possible to change the data of the Excel file and see its ...
10
votes
2answers
3k views

How to get Matlab data imported with the same dimensions?

I have some Matlab image data with the following dimensions (output is from Matlab): >> size(im) ans = 86 86 3 45 The data imports just fine ...
6
votes
1answer
589 views

Import numeric values from XML

I am trying to import data from an XML file and then perform calculations on those numeric values. When I import the data the values seem to be stored as strings. I tried using a ToExpression ...
6
votes
1answer
317 views

ESRI shape files

ESRI shape files (shp): importing the polygon data can yield a very large list. It is computationally intensive rendering the polygon. I have been trying to convert to ...
4
votes
1answer
279 views

Attaching WolframAlpha data

I have used WolframAlpha since it was launched (now a pro member) but am new to Mathematica 8. Is there a way to automatically add data from WA to a Mathematica dataset? For example, what if I ...
3
votes
1answer
306 views

Exporting lists to files

I am trying to write a program which will generate a list of objects and then exports it in a separate file and clears its memory. As an example I tried the following ...
4
votes
1answer
374 views

Importing tabular data that has been exported from Evernote

In Evernote you can embed HTML tables in the note. You can then export them to an xml format with the extension enex. I am trying to get the data from the table imported into Mathematica. Here is the ...
3
votes
1answer
436 views

Importing file with UCS-2 Little Endian codification

I'm trying to import a text file with UCS-2 Little Endian codification but I can't read it correctly. There's any hidden option to read this files ?? I'd tried with ...
3
votes
1answer
248 views

Efficiently importing XPM matrix data into Mathematica

The XPM file format is an image file format. Although it is primarily intended for icon pixmaps, it can also be used to store matrix data. For example, the GROMACS chemical simulation package uses ...
3
votes
1answer
614 views

Mathematica PDF import and fonts

I am trying to put nice LaTeX labels on my Mathematica plots. I can do this manually, or by introducing an extra GNUPlot step into my workflow, but it would streamline the process considerably if ...
5
votes
1answer
563 views

Open data file from CDFPlayer?

Using a CDF program running in CDF Player, is it possible to use a system dialog box, or even just an Import statement such as Import["*.CSV"], to import data from a text or comma separated file on a ...
10
votes
1answer
344 views

Possible to import Excel formatted text?

Is it possible to import Excel text markup such as underlines? For example: Yet ...
5
votes
1answer
217 views

How to import numbers or protected signs from .txt?

I'm new here, so please apologize any formal errors. I stumbled upon a somewhat simple problem. I want to import plain numbers or protected signs like Pi, ...
4
votes
2answers
523 views

Importing array with complex numbers

This is probably an easy question: I am exporting the results from a longer calculation into a dat-File, then I set the cell to non-evaluatable and put an Import in front, so I can later work with the ...
5
votes
2answers
2k views

Converting numbers to integers

I've read the available documentation but I still haven't found an NumberForm -> Integer function yet. No result in this site's search, either. Does it exist? ...
6
votes
1answer
1k views

When do I use Mathematica, when do I use Gephi, and how do I use them together?

Mathematica has great operations for analyzing graphs but when the graphs are a bit bigger, Gephi seems to be more efficient (at least on my computer) at drawing and analyzing, i.e. visualizing the ...
6
votes
2answers
877 views

How can I open an Excel file and modify it in Mathematica?

I wanted to ask how can I view an Excel file from a Mathematica notebook and modify it. I have seen a similar question, Open Excel file with Mathematica, but the answer involves .NET. Is there any ...
1
vote
1answer
496 views

Interpolate specific columns of data

I have a txt file with 3 columns of data: x y1 y2 How do I import the file then create 2 functions, one interpolated with {x,y1} values and the other interpolated with {x,y2} values? This ...
2
votes
0answers
623 views

Can not Import PDF

I try to import PDF and extract text from it Import["D:\\Vegetarian MS.pdf", {"PDF", "Plaintext"}] but with some files I have a problem like this ...
9
votes
2answers
990 views

How can I animate a set of points imported from file?

I have an external program which generates a set of data - X points at the time t1, X points at the time t2 and so on. These points are stored in CSV file and I can change the format if necessary. ...
6
votes
2answers
308 views

How to process binary-encoded data without writing to file and importing?

I am consuming a webservice through NETLink that returns data directly in the response as a gzipped csv file. I can successfully process the data like this: ...
4
votes
1answer
2k views

Importing CSV financial data in Mathematica

I am trying to import a CSV file in Mathematica 8 with the aim of charting it with the TradingChart command. This is what I have done : ...
5
votes
1answer
777 views

Efficiently exporting many images as a video

I have many .gif images and I would like to export them as a single video file (I prefer .mov, but any video format is fine). But what if I have several tens of megabytes of .gif images? Is it ...
13
votes
2answers
548 views

How to monitor the progress of Read?

I use f = OpenRead["largefile.m"] x = Read[f]; Close[f]; to read in a Mathematica expression from a large file largefile.m ...
9
votes
2answers
256 views
5
votes
2answers
276 views

How to remove an expression from a file?

To read in expressions from a file, one can do ReadList[file, Expression, 3]. How to do the opposite, i.e. remove a number of expressions from a file, modifying ...
3
votes
3answers
386 views

Support for Compressed Sparse Column sparse matrix representation

Is there native support for Compressed Sparse Column (CSC) format for sparse matrices, like importing and manipulating them?
18
votes
1answer
643 views

When importing GIF animation, how to find the correct list of “DisplayDurations”?

When importing GIF animations with variable frame durations, the settings for "DisplayDurations" are not recovered correctly. As an example, I'm using the movie from this earlier question: Here I'm ...
13
votes
3answers
1k views

How to scrape the headlines from New York Times and Wall Street Journal?

How to scrape headlines from New York Times, Wall Street Journal main pages to create datasets similar to this service? Importing HTML from nyt.com (HTML4) results in a ...
6
votes
3answers
228 views

How can I read in specific information from a TeX-file?

I have several TeX-files and they contain information of the form ...
7
votes
1answer
135 views

Using Differences on data: trouble with floats and doubles

Consider the following data set (after I have run FullForm), which is imported from a file (stored typically as 10.040): ...
7
votes
1answer
2k views

Import DCD (CHARMM/NAMD binary trajectory) file

How can one import the coordinates stored in a binary CHARMM/NAMD DCD file? This is the structure of the file: ...
5
votes
2answers
493 views
2
votes
1answer
253 views

How to solve issue with exporting / importing data to and from Excel

Background ( simplified ): When I export data to Excel like ...