Questions tagged [data-acquisition]
Questions on the use of Mathematica to capture data from external sources.
112
questions
40
votes
2
answers
3k
views
How to make a curve selectable from a scaned image and convert it to a list of coordinates
I have a scanned image (binary-ized):
Is there any way to reduce one of these curved lines (full or dotted) to a series of its coordinates (e.g., sampling interval of 0.01 on x-axis)?
I've read ...
- 633
33
votes
2
answers
7k
views
Streaming Data into Mathematica from a serial port
I'm attempting to see if I can capture an incoming stream of data being transmitted remotely from an arduino device into Mathematica.
The plan is to connect some temperature probes to the Arduino, ...
- 9,258
27
votes
1
answer
381
views
Getting Mathematica.SE reputation data
I'm asking the following on behalf of Mr.Wizard.
On StackOverflow I used the old v1.0 SO API and Mathematica to obtain user reputation data. Now we are no longer a tag on StackOverflow and the v2.1 ...
- 65.5k
23
votes
3
answers
2k
views
Download xkcd Click and Drag comic
Inspired by the recent question about xkcd styled plots I started looking at xkcd again and I came across a comic titled Click and Drag. And if you do that, you start exploring a larger drawing. A ...
- 269k
23
votes
1
answer
2k
views
Using ImageCapture to access a USB webcam in linux
Is it possible to access a USB webcam through Mathmatica on Linux? When I run
ImageCapture[]
I get the following output
...
- 231
23
votes
1
answer
4k
views
Is it possible to extract data from an EPS plot not generated in Mathematica?
I want to extract data from an EPS plot not generated in Mathematica and replot it. In general is it possible to extract data from plots in any formats in Mathematica? I searched but unfortunately ...
- 1,057
22
votes
1
answer
2k
views
How to use WikiMapia as GeoServer?
I wish to use the Wikimapia map as background in GeoGraphics. According to the Wikimapia Docs, Wikimapia's URL is encoded as follows:
An example Wikimapia URL is
...
- 61.3k
22
votes
1
answer
892
views
Capturing Data from an Android Phone
Is there a way to capture Data from an android phone to be later analyzed in Mathematica?
- 9,258
19
votes
1
answer
2k
views
Release the web camera after using CurrentImage[]
CurrentImage[] will capture an image from the webcam. It is even possible to create a live video in the notebook using
...
- 232k
19
votes
2
answers
2k
views
Data acquisition from a Measurement Computing USB device
I would like to use Mathematica 9 for to acquire data from a Measurement Computing (MC) USB-201 analog to digital (and other) device for classroom demonstration. I do not have a budget to buy LabView ...
- 191
16
votes
3
answers
9k
views
How to request financial data from Yahoo's YQL and Quandl?
How can I download historical data from Yahoo ? Although Mathematica's FinancialData function uses Yahoo it could be useful to have more control on how to retrieve data from Yahoo's YQL.
Edit ...
- 11k
14
votes
2
answers
756
views
COVID-19 Wolfram Data Repository Retrieval
I'm using this dataset to check out the data on new COVID-19 cases. But there are two issues:
Two days ago it was working great and it had data up to March 13; 1 day lag. Now when I run the cell in ...
- 1,721
14
votes
1
answer
815
views
Detecting and counting signals in list data: checking pulse rate
Hope this isn't too much of a basic question: I'm looking for some Mathematica functions, but I don't know which ones.
Background
I recently read about a simple technique for reading your body's ...
- 24.2k
13
votes
2
answers
595
views
Extracting data from analog screen photograph
I'm using an analog profilometer from the 1970s and need a way to digitize the data and the only way is through a photograph.
I've searched but all I could find was how to extract data from computer ...
- 133
13
votes
1
answer
279
views
Performance-driven approach to using Big Data without killing the hard-drive
Situation
A calculation has to be done in which the amount of data is too much to fit into memory. Fortunately, only a part of the overall data set has to be known at a time. The preprocessing is ...
- 842
12
votes
3
answers
702
views
Is it possible to import data from Google Analytics?
Using Mathematica, is it possible to pull data directly from Google Analytics? Unfortunately, GA exports messy csv files, and I was wondering if there was a direct ...
- 223
11
votes
2
answers
2k
views
Mathematica TCP socket client toward Trading Platform
I'd like to connect Mathematica with my Italian electronic trading platform.
To connect I need to open a TCP socket client towards the trading platform and send a string command.
The high-level ...
- 689
11
votes
1
answer
862
views
How can I extract data from a diagram?
Below you will see a diagram containing three curves.
How can I extract data points from the three colored curves? I need to use the original data.
- 111
10
votes
3
answers
751
views
How to make a picture grid of all Nobel Laureates in physics?
I want to make a picture grid of all Nobel Laureates in physics using mathematica. Later I wanna print this picture grid on a big wall!
The first thought I came up with is to exploit the powerful ...
- 16.9k
10
votes
1
answer
285
views
Importing Graphics from an Online Paper
I'm trying to reproduce a few graphs in Mathematica after running my Fortran code. Ideally, I want exact quantitative agreement with the results already published in the literature. For example, I am ...
- 980
10
votes
3
answers
2k
views
Web scraping and multi-threading in Mathematica
I'm working in some web scraping using Mathematica, and today, to speed-up the process, I used bash commands (xargs with parallel options with curl and wget) using ...
- 26k
10
votes
1
answer
944
views
Direct Pressure Data Acquisition with Mathematica and Arduino
Mathematica can upload code to the Arduino and read/write values to pins, execute commands, etc. Im trying to use this to do Direct Data Acquisition with a pressure sensor.
Here is the link to the ...
- 101
9
votes
2
answers
781
views
What's the fastest way to read a simple numerical list?
I have a large .txt file for which I need to do some data analysis. I've been working on it for a while, and the analysis part has got faster and faster so that most of the evaluation time is now ...
- 291
9
votes
1
answer
430
views
Does GeoGraphics support Elliptical Mercator projection?
When working on the answer to this question I found that GeoGraphics seemingly uses by default the Spherical Mercator projection (also known as "Web Mercator") ...
- 61.3k
9
votes
1
answer
380
views
Is it possible to construct a function to make a poor man's Mathematica database?
I have a function that is set up to write to a database with 10-20 standard variables with 10 fields each, but the application is going to a place where database access is not available. Can ...
- 4,478
8
votes
4
answers
313
views
Data Entry via 2D Graphic (formerly: Using a Slider2D to add data points to a list)
This bit of code sets up a list with the first entry already in it -- {{1,1}}:
...
- 321
8
votes
2
answers
210
views
Is it possible to verify the accuracy of a file downloaded using URLFetch
Objective:
I am trying to save a HTML file using the URLFetch function (native to Mathematica 9 onward).
Sometimes the file is huge.
Question:
Is there a way to check/verify (using the headers or ...
- 2,128
8
votes
2
answers
176
views
How can I recover a graph from a graphical output in a notebook after resetting the kernel?
I have an old Mathematica notebook with an output for a graph structure $G$ I would like to recover. However, the routine for building up the graph is stochastic, so I can't simply rerun the code.
...
- 221
7
votes
1
answer
1k
views
Access wi-fi raw data
I would like to know if anyone has any idea of how to access live wi-fi raw data from my computer (in monitor and promicuous mode).
I would like to develop a code to get the MAC address of every ...
- 343
7
votes
1
answer
430
views
Importing a Wikipedia Table as a Dataset?
I am trying to import this table from Wikipedia into Mathematica as a Dataset. The fields I'm interested are Name, ...
- 3,095
7
votes
1
answer
2k
views
Using PutAppend to write large data files
I have a loop which computes a table, tab, of results at each iteration. This table is usually very large and I would like to use ...
- 395
7
votes
1
answer
736
views
Using sockets to connect to a trading platform
I'm trying to use Binance's API. The following works:
...
- 14.1k
7
votes
1
answer
639
views
How to Debug Missing[NotAvailable] error for Social Media Data
I get a Missing[NotAvailable] error message when trying to access Social Media Data using SocialMediaData["Facebook", "Friends"] ...
- 171
6
votes
3
answers
633
views
Import data from a current web session?
Consider opening a web session such as (Mathematica 11.3)
session = StartExternalSession["WebDriver-Chrome"];
ffoxdo[cmd_] := ExternalEvaluate[session, cmd];
...
- 11.9k
6
votes
1
answer
1k
views
How to plot a list of value from a .dat file?
So I received from a professor a .dat file, which does contain a quite large amount of points. The problem is this: this file is structured as I'm going to show in figure below:
The first value at ...
- 767
6
votes
2
answers
2k
views
Merging Vertices of a Graph and adding up the edges weights
I have a Weighted Graph of g which looks like this.
...
- 1,225
6
votes
1
answer
220
views
Export Data from several tabs in a website
Here is the website from the official federation:
http://results.ittf.link/index.php?option=com_fabrik&view=list&listid=36&Itemid=158
I want to export the Data (the table). There are ...
- 1,751
6
votes
1
answer
1k
views
How to make Import[...., "Table"] not convert strings to numbers and not convert numbers to strings?
Bug introduced in 8 or earlier and persisting through 11.2.0
I have to to use ...
- 135k
6
votes
0
answers
179
views
Connecting to Twitter API Manually in Mathematica to Pull Down All Followers of a Specified User (e.g. More than 5,000)
I have been going through old StackExchange threads to see how to potentially use Mathematica's built-in connection/authentication to the Twitter API to connect to it manually, and access some ...
- 81
6
votes
0
answers
184
views
How to deal with WebServices error "any is not supported in sequence"?
I am trying to aquire data through Mathematica's WebServices and this example works just fine:
...
- 1,995
5
votes
3
answers
3k
views
Importing CSV with multiline text fields
Bug introduced in 8 or earlier and fixed in 11.2.0
Here is a valid CSV:
a1,b1,c1,d1,"e1
e1
e1"
a2,b2,"c2
c2
c2",d2,e2
It has two rows and five ...
- 173
5
votes
1
answer
383
views
webscraping: Wolfram notebook vs browser
In the Netherlands there is a website Funda.nl There you can find all houses for sale or for rent. I used webscraping as a tool to collect data for analyse-purpose. The script I used is like:
...
- 2,585
5
votes
1
answer
109
views
Getting error message with Search on arXiv electronic preprint database
Just installed Mathematica v10.3 which has the new option to use arXiv, the electronic database. However I get an error message using
...
- 3,188
5
votes
1
answer
914
views
How to get the list of links in a Wikipedia article in order of appearance
I can get a list of links in a Wikipedia article using WikipediaData:
...
- 7,797
5
votes
1
answer
2k
views
Excel DDE Link: reading and writing in real time
I'm wondering if it is possible to link Excel and Mathematica in real time, so that Mathematica can be used as a computing and "storage" tool. Suppose I have an Excel spreadsheet with an active DDE ...
- 3,298
5
votes
0
answers
123
views
Download binary file bypassing Import/Export? [duplicate]
Possible Duplicate:
Downloading files without using Import
While attempting to answer my own question I realized that I don't know a way to simply download a binary file to a specified folder ...
- 269k
4
votes
4
answers
1k
views
How to efficiently read blank line separated data file into list of lists
For example, I have a test.dat file with contents as below:
1 2
3 4
5 6
11 22
33 44
55 66
(Note that there could be ...
- 16.9k
4
votes
2
answers
235
views
How to import a COVID-19 data table from a website into a Mathematica notebook
This link https://www.worldometers.info/coronavirus/ provides daily cases of COVID-19 across all the countries. Is there an easy way to retrieve this table into a Mathematica notebook?
I tried:
...
- 5,271
4
votes
1
answer
236
views
Why is there a lot of noise in the Wolfram Blockchain?
I tried to look into the transaction history of the Wolfram Blockchain. I tried this:-
...
- 3,439
4
votes
1
answer
111
views
How to find the block number of a transaction in a Wolfram Blockchain?
For example, in block 1004 of the Wolfram Blockchain, I can get the 4th transaction's ID by using the following code:-
...
- 3,439