Questions about getting data, files, images etc. from various formats into a form that can be read, tranformed and manipulated by Mathematica

learn more… | top users | synonyms

1
vote
1answer
80 views

Downloading a number of images from a web site as a list

For a MachineLearning project I need to form a training set using images taken from the web page containing lots of them. Like, for example this one. It would be very convenient, if all the images ...
9
votes
2answers
209 views

Inconsistent behavior of undocumented Encode->Import->StringToStream->Get on password-locked stream

Let's save a definition. Encode it with password/key and Get it again. We will not use Get ...
29
votes
4answers
2k views

How can I import a huge CSV file quickly?

I have two CSV files, each one is around 1 GB of data. When I use Import["file.csv"], it takes a very, very, long time to import the data. So how can I accelerate ...
1
vote
1answer
95 views

HDF5 file managing for dummies

I am new to HDF5 format and I am also not hundred percent confident with Mathematica. I have googled to find out examples to deal with HDF5 files in Mathematica but couldn't find one that work out for ...
11
votes
2answers
783 views

Google Image Search in Notebook?

How can I use Google's image API to custom search for images and import them all?
4
votes
0answers
77 views

File Formats for Scientific Data

I have a simulation written in another language which currently just dumps all its data (doubles, lists of doubles, lists of lists of doubles) in lines in ASCII, and then I read it into Mathematica by ...
0
votes
1answer
59 views

file import from website failed (Http status code 403 returned) [closed]

I failed import an xls file from website in Mathematica but got no problem to download it directly using chrome. Can anyone help me solve the problem? Thanks. The detailed situation is listed as the ...
4
votes
1answer
95 views

Importing large datasets using streams

I work with large data sets with 22 columns and up to a million rows. Each row contains one observation with several variables. All variables are numbers. Simplyfied example: 1, 1, 2, 3, 4, 5, 6,...
10
votes
3answers
132 views
10
votes
1answer
153 views

Is there an efficient way to load a large list to Mathematica from R within Rlink?

I'm working on something that involves using both R and Mathematica. For this something, I first generate a large R list (1000 matrices, each 200x1000, mixed integer and real values) and then need to ...
2
votes
0answers
126 views

Animate FromQuarternionTo3DRotation nb file with 4 quarternion values

I have a csv file. Inside the csv file, there are few rows of 4 quartenion values. I would like to animate the quarternion nb in http://demonstrations.wolfram.com/FromQuaternionTo3DRotation/ I ...
3
votes
0answers
102 views

Use of MuPad code into mathematica

Does somebody have experiences so as to transform a MuPad code into a notebook into Mathematica? I would like to export equations written in MuPad to Mathematica.
1
vote
0answers
68 views

Import using POST method and web-page drill down

A response to a previous question about invoking the POST method via Mathematica was most informative in trying to further understand the intricacies of using the POST Method to obtain tabular data ...
28
votes
3answers
2k views

How to manipulate web pages on Mathematica?

I wanted to input some data on this page through Mathematica. Then I would press the "buscar" button also through Mathematica coding and get the results on Mathematica. The most similar post I've ...
1
vote
0answers
36 views

How to test if Import was successful? [duplicate]

I am importing and processing a bunch of files. Sometimes, for whatever reason, some of these files are not successfully imported so I'm looking for a way to Abort ...
0
votes
1answer
130 views

Importing and manipulating data in HDF format

I have two matrices A1 and A2 in HDF format. I use the following code to import them. ...
2
votes
1answer
80 views

Extract arguments from MeshRegion created by STL import

I've been trying to extract points and polygons from a MeshRegion expression created by importing an STL file. At first I thought I could use a simple ReplaceAll as shown below: ...
9
votes
1answer
506 views

Mathematica doesn't read .mat file

Bug introduced in 6.0 and fixed in 10.2 (July 29, 2015) To be honest, I don't know if the problem is with Mathematica, or with the file; it's been generated by PicoScope, a PC-based oscilloscope ...
1
vote
1answer
96 views

Multiple Import and Export of Images

I wrote a program that imports an image and creates three new images, for example "black and white" or "grey scaled". My problem is that i work with around 200 images and it takes a long time to ...
0
votes
1answer
63 views

Exported picture has less MB than imported

I have to duplicate a picture several times – and each time the duplicate shall have another name. I do this with mathematica 10 with the following easy code: ...
0
votes
1answer
90 views

How to import columns of data (.mat file)

I have a two 100x2 .mat file and I would like to get the elements stored as pairwise entries i.e. something like data = [{a1,b1},{a2,b2}..{a100,b100}]. Can someone help me do this efficiently?
1
vote
0answers
70 views

How to import and export msgpack?

MessagePack is an efficient binary serialization format, I find it much better than JSON. There is currently (as of v10.3) no support for this in Mathematica. Does anyone know of third party ...
0
votes
1answer
349 views

How to open *.sif files with Mathematica [duplicate]

While I am processing my data collect from an Andor EM-CCD, I find it diffcult to import the file into mathematica. I think mathematica can open this kind of files since that Matlab can open it. So if ...
4
votes
2answers
108 views

Reading an ASCII file mixing text and numerics in Mathematica

We have a sequence of large data files (LAMMPS dump files) which begin like this: ...
1
vote
0answers
49 views
2
votes
0answers
93 views

Confocal Microscopy

Is it possible to direcly import Nikon ND2 files (e.g Confocal microscope 2D or 3D stacks files)? Otherwise how can we import TIFFs of 3D stack and process it as a single "entity" so to speak? ...
2
votes
1answer
99 views

How to download tables from a url?

I'm trying to import all the tables on a website, this one in particular: https://aws.amazon.com/ec2/pricing/ For local files that are already tabular, ...
3
votes
2answers
117 views

Troubles importing date and time from CSV file

I'm trying to import CSV file with the following format: 20150803 00:00:01.649,1.09675,1.09678 using this code: ...
2
votes
1answer
120 views

Fourier of List

I have such a problem. I try to evaluate and plot the spectrum of large list, and this is what I get: ...
4
votes
2answers
124 views

Import Data different column length

Lets assume, i have this data.txt file. s1/km t1/h s2/km t2/h 20 1 40 1 40 2 80 2 60 3 I define myself a function ...
2
votes
3answers
110 views

Importing and saving .csv files as variables with the original filebasenames

I have a modest number of .csv files that I want to import into mathematica. I would like to save their contents as their filebasename for use throughout my notebook, but I am running into errors as ...
0
votes
0answers
69 views

How to prevent space trimming when importing HTML with ImportString?

I am importing a HTML-formatted string with ImportString[string, "HTML"] to properly parse all HTML-escaped characters like ...
2
votes
1answer
92 views

Understanding the discrepancy between txt file import and export times, and possibly speeding up Import

I attempted to import a very short .txt file string using the Import command: ...
3
votes
1answer
269 views

Import a table from a text file or string

XYScan produces results in the following form (as *.txt): ...
0
votes
0answers
29 views

Save lists to re-open with Mathematica [duplicate]

I want to save a result of a computation in a file to re-open then in Mathematica in a new session. What is the most efficient and simple way to do this? To be specific, I am using ...
0
votes
1answer
192 views

Network/Graph Visualization read edgelist

I have what it seems to be a very trivial question, but after searching for hours I was not able to find an answer, so I am asking here. I have an edgelist for a graph, a 2 column csv file with id1,...
2
votes
1answer
192 views

Dynamic importing of json file is not refreshing

Running Dynamic[Refresh[Import["foo.json"], UpdateInterval->1]] or json := Import["foo.json"] then ...
2
votes
1answer
43 views

Import variable assignments from external files into different contexts

(I use Mathematica 9.0.1 on OS X 10.10.5.) I have two text files. One is named file1.txt with the contents a = 4 b = 15 c = 23 ...
1
vote
1answer
226 views

Import camera parameters and data from *.sif image files? [closed]

By default, Andor's line of scientific cameras saves data in an apparently undocumented *.sif format. Are there any Mathematica packages or code that can help import these data? I've inherited an ...
1
vote
0answers
86 views

Import a column of data, make a sum on them [closed]

I import a data file, then do calculation on it and after that I want to sum on my output data. Here is my sample code: ...
1
vote
2answers
68 views

How do I import a non-directed graph in graphml format?

I have created a graph with undirected edges, and I'm trying to import it into Mathematica. However, when I import it, I get directed edges. ...
0
votes
1answer
37 views

Import n'th data from a file and do calculation on it [closed]

I want to import a n'th data from a data file and then do some calculation on it. Here is may sample code: ss = Import["myfile.data", {"Words", 3}] gg = ss + 1 ...
0
votes
0answers
60 views

Using Import during initialization, i.e., in an init.m file

I am trying to import a list of directories from a file during initialization. I wrote a package that defines a function to import the file. When I test the function in a notebook or execute the <...
1
vote
1answer
310 views

How to scrape image search engines?

I'd like to download highest resolution images possible from the search results like these: ...
3
votes
3answers
107 views

Why does Import[#, “ImageLinks”]& fail?

I'm having difficulty with Importing urls embedded in a site (with and without pagination). This command: ...
0
votes
0answers
61 views

Automatic import of Maple expressions into Mathematica using MathML

I'm would like to automate a process so as to convert Maple expression into Mathematica expression. For the moment, thanks to the function ...
2
votes
1answer
60 views

Import tabular text data

I have a text file created with a bash script I wanted to read the data avoiding the first line. I have written few dirty codes, but I wondered if anybody can do it in fewest possible nice one ...
8
votes
1answer
279 views

Import converter that can import, split, and compress files?

I'm working with a data format that prescribes separate header and data files, so for instance "file.hdr" and "file.dat". They ...
2
votes
0answers
142 views

import of a opj file (Origin)

Is there a way to import a file of opj-type? Or do you know a package to convert the data? The Import[] function seems not to know this format.