Questions about getting data, files, images etc. from various formats into a form that can be read, tranformed and manipulated by Mathematica

learn more… | top users | synonyms

2
votes
1answer
1k views

Using variables in file names during import/export [duplicate]

I have 23 .csv files named as 0.csv, 1.csv.... I'd like to import those files one by one, perform some manipulation on the data and finally export it as "i+20".csv. "i" is the variable which in my ...
8
votes
1answer
581 views

How to execute JavaScipt on a webpage and then import the result on OSX?

I would like to import data from this page through Mathematica, http://www.oddsportal.com/soccer/netherlands/eredivisie/ . I tried importing through the default Import function ...
4
votes
0answers
160 views

Problem with FTP import in V10

Mathematica V10 returns an error when download directory. URLFetch :: invhttp: "FTP: could not retrieve (RETR failed) the specified file." V9 successfully retrieves the same reference. This ...
6
votes
1answer
3k views

Reading csv/xlsx data into Mathematica with column headings as list names

It's old question. However, I could not find satisfactory answer. Decided to post this question. I have a .csv file with column heading. How can I import this ...
9
votes
2answers
1k views

Exporting data from Excel into Mathematica using clipboard

I know that it's possible to import Excel data into Mathematica using the Import command, as we can see in this post. But some times, I need just to do some fast ...
12
votes
2answers
741 views

Parsing a CSV file using Interpreter

The new Interpreter functionality in version 10 looks like it has the potential to make parsing custom data formats very easy. I'm trying to create a CSV parser. ...
1
vote
1answer
145 views

GIF file breaking Import

I'm working with a large number of historical image files and am playing around with extracting dominant colours, faces, etc. with Mathematica 10. Occasionally, however, I am running into files that ...
6
votes
1answer
442 views

Operations on online files via public URL access

I need Mathematica to access an online public directory via some URL (fake in this case) http://example.com/images and perform operations similar to those Mathematica can do on OS directories and ...
4
votes
1answer
371 views

How to clean up messy data

The start of my question is about one specific situation - I have some erroneous lat/long values in a dataset which I need to clean up. But I'd like it to cover the overall topic of cleaning up messy ...
2
votes
2answers
379 views

Overwriting first line of large file

As mentioned, I wish to read the first line of a file, and if needed, overwrite it with a new string. The aim is to have a CSV with a list of possible elements. Example: ...
4
votes
2answers
897 views

Check Google PageRank for a given URL

Does anyone know how to write a Mathematica function that returns the Google PageRank of a given URL? I found a tutorial for achieving this in a bash script here, but I have no idea how to port this ...
2
votes
1answer
88 views

How to read from /dev/random?

I am looking to read a few bytes from /dev/random on OS X and Linux. The simplest approach fails on both operating systems (see below). Why? What is a workaround?...
6
votes
2answers
317 views

Lookup in Inverse Symbolic Calculator+ from Mathematica

There is a useful feature in WolframAlpha that allows to find a possible closed form for approximate numeric values. It can be used, for example, to guess the value of an integral that Mathematica ...
37
votes
4answers
4k views

Importing videos in Mathematica

Mathematica's Import command is purportedly able to import .AVI files. However, I find that many files that I want to import do only result in MMA showing a blank ...
15
votes
1answer
348 views

Why does ImportString[“1c”, “Table”] eat the letter c?

I have some whitespace-separated matrix data that I read with Import[..., "Table"]. The data contained mixed strings and numbers (the strings are for row and ...
3
votes
2answers
329 views

Import multiple files from folder in order of date added

I have a folder that contains certain files I want to import. In my case those are .png files. As all the files I want to import contain the phrase "accum" in their filenames, I can use ...
-1
votes
3answers
127 views

How do i import a list of files, choosing the name

I have this list of files, i'm using FileNames[{"*.txt"}, NotebookDirectory[]] to import it, but i just want the ones without inelastic on the name. How can i select just by the name? Thanks {"10....
6
votes
2answers
461 views

SemanticImport mis-interprets CSV

SemanticImport misinterprets rows with trailing blanks. Note the commas in the 2nd column: SemanticImport["https://docs.google.com/spreadsheet/pub?key=0Ati-...
0
votes
1answer
196 views

Loading and processing five files at a time from a directory containing many, many files

I have 3000 files (for example: aa101.csv, aa108.csv, aa120.csv, ...) and I need to process them. I need to load five files from a folder, process them, and export them to new list in Excel. Then I ...
1
vote
0answers
125 views

Datastream to Mathematica

I currently use data from Thomson Reuters Datastream. With an add-in in Excel, the data can be requested. Because I need to use the data in Mathematica, and I need to update the data frequently: Is it ...
2
votes
1answer
200 views

diff-able text-only notebooks?

I would like to save my Mathematica notebooks as plain-text documents, so that I can keep them under git version control. I thought that ...
7
votes
3answers
2k views

How do I save/export a list so that it can later be easily imported as a list again?

I have a couple of big lists (each of them contains elements that are themselves lists of two elements, i.e. an element of each list that I have is of the form {x, y}) that I want to save/export. ...
3
votes
1answer
105 views

Registering/detecting an importer by file name extension

I've developed an importer and exporter for FreeSurfer's MGH/MGZ file format; the specific format isn't important, but I was ...
6
votes
1answer
361 views

Reading specific entries from a CSV file

This question is related to the following: Speeding up Import and Export in CSV format Stream CSV files Reading periodic elements from a large file I have a set of very large CSV files (a few ...
4
votes
1answer
214 views

Importing malformed XML: Import[… “XMLObject”] vs ImportString[…, “XML”]

It appears that Import[ url , "XMLObject" ] is more forgiving of improperly formatted XML than ImportString[ string, "XML"]. For ...
6
votes
1answer
180 views

Can I read Chinese characters with ReadList correctly?

Just try this example: Export["a.txt", "这乱码问题该怎么解决呢\n***\n怎么解决嘛"] ReadList["a.txt", Record] ...
2
votes
2answers
113 views

Importing Data and Devoting Their Names to Them

There are some files in a directory. I have used of SetDiroctory to access all of them. SetDirectory["C:\\Users\\SE7EN\\Desktop\\mathematica\\test"]; I can visit ...
2
votes
2answers
64 views

How to prevent conversion of number forms to numbers in Import [ webpage, “Data” ]?

I have tabular data on a webpage. It looks like this: Import["http://mfvonh.me/numericalTable.html", "Plaintext"] 1.0 1.1 3.53 However, I have ...
0
votes
1answer
68 views

Importing colors from file

I just tried something straightforward (for me): ...
7
votes
1answer
602 views

How can I recover the source code from cdf file?

by a mistake I have deleted the nb file by which the CDF was generated. All required definitions were in one cell. If I remember the code looked like this: ...
0
votes
1answer
61 views

Importing a Matrix whit different column numbers depending on the row

I have a bunch of coordinates given in a file. The file contains Startpoints and Endpoints of arrows in columns(Example): ...
2
votes
2answers
190 views

Animation of moving rectangles in 2D from data file

I am not very familiar with mathematica but I know the basics so I thought I give it a try. For a project I have to animate rectangles moving around in 2D (later also 3D). The data come from a C ...
4
votes
1answer
175 views

Order imported files by their alteration date

Probably a very easy question, but I could not find the answer, so it would be very nice if you can help me: Let us say I have 10 files, all with the extension .dat...
10
votes
1answer
382 views

Wikipedia People only search

I am trying to search people from Wikipedia(For example .*John.* in REGEX). The following query is close, but it isn't generalized like ...
-1
votes
1answer
99 views

How to draw a network from a dataset reporting the labels of nodes of every link?

I have a dataset in format .txt of a directed network, containing a matrix A of dimension ...
0
votes
1answer
266 views

Importing a text file into a matrix format

I am attempting to perform a comparison of pseudorandom number generation with the RAND Corporation's "A Million Random Digits with 100,000 Normal Deviates" for a Computational Physics course. I have ...
21
votes
4answers
2k views

How to efficiently import videos

I need to do frame-by-frame analysis of videos. I can import the video files I need, but each file is too large to import at once. I can use the ...
1
vote
1answer
66 views

How should my data be formatted for use with BetweennessCentrality?

A few weeks ago I asked this question. I am trying to upload my data which is an adjacency list for an undirected, unweighed graph and find the betweenness centrality. At the time I tried to use the ...
1
vote
1answer
256 views

How do I upload a graph as an adjacency list and find the betweenness centrality?

I have an undirected simple graph in a .txt file formatted as an adjacency list like this: 100 200 200 300 300 400 500 600 700 800 900 ... Every number is a node ...
1
vote
1answer
184 views

Importing adjacency matrix from file of 0/1 arrays

Is it possible to import adjacency matrix for graph representation, from simple text file with NxN (rows x columns) of 0s/1s: 0 1 0 0 1 0 1 1 0 1 0 0 0 1 0 0
5
votes
1answer
458 views

windrose with data from Excel

How to Import data from excel and use them to Plot windrose instead? Example, {{Strength, Angle(degrees)}..} ...
1
vote
1answer
316 views

Import CSV with “Numeric”->True and “DateStringFormat” problem

The CSV file linked below has 3 columns: "PT_ID" (char 4), "PHYS_ID" (char 2) and "VISIT_START_TIME" (varchar eg "0:00:15" hours minutes seconds) "https://docs.google.com/spreadsheet/pub?key=...
3
votes
1answer
438 views

Plotting with ColorFunction -> GrayLevel - no black

This is probably a fairly trivial question, yet I have been unable to find an answer - help would be much appreciated! :) I am trying to plot a 28 x 28 matrix (tabulated data given here), containing ...
2
votes
1answer
188 views

Text analysis and loops

I need a loop for a text analysis involving about 1000 papers (identical structure of all papers) I have these two commands to read all the papers into memory. ...
19
votes
1answer
560 views

Gravatars/identicons with Mathematica

The default avatar/identicon is based on an MD5 hash of your e-mail address. With some e-mail providers (e.g., GMail) the address gmailuser+foo@gmail.com is still ...
2
votes
1answer
424 views

Importing data from excel and assigning a variable to each of its columns

How should I assign variables to the data imported from excel containing 3 columns which are time, mean and standard deviation. I want to perform operations on the three variables to get new variables....
0
votes
2answers
152 views

How can I troubleshoot a PDF that fails to import?

I'm trying to import a PDF file whose text I'd like to parse, but I'm getting an error with no explanation: ...
9
votes
2answers
3k views

Difficulties with Importing PDFs in Mathematica

I am trying to import a group of PDFs that I have downloaded (it is in the realm of 1,000+). They are a group of doctoral dissertations that I'm trying to automatically extract bibliographic ...
0
votes
0answers
34 views

relative directory paths within a mathematica package/what directory does a mathematica package see as local? [duplicate]

I have a package that gets loaded in many notebooks I use, with Import[pathToLibraryDirectory<> "toolkit.m"]; This toolkit in turn loads some Excel ...