Questions tagged [data-acquisition]

Questions on the use of Mathematica to capture data from external sources.

Filter by
Sorted by
Tagged with
6
votes
1answer
186 views

Importing a Wikipedia Table as a Dataset?

I am trying to import this table from Wikipedia into Mathematica as a Dataset. The fields I'm interested are Name, ...
0
votes
0answers
26 views

Using URLExecute[] for online data acquisition

On the United Parcel Service website(UPS) there is a form where you can enter a zip code and it will return a color coded map that shows shipping times from that zip code. I am trying to use ...
3
votes
0answers
37 views

How to obtain surface shading data from a 3D plot?

Suppose I have a graphical output like this: Is it possible to obtain the shading data (generated by lighting simulation) at each point on the surface with respect to the local co-ordinate chart of ...
0
votes
0answers
74 views

Scrape data from Google

my question is general. I would like to search a term on Google and scrape all the results, including the dates of publishing, if there are. I know that it is possible to scrape a website - following ...
1
vote
1answer
35 views

Interactively extracting arbitrary portion of elements from a 2D list

I have a 2D list which can be plotted as follows: Image 1 Based on the plotted image, I would like to select some of the shapes on the image and extract the data for further analysis, for example, ...
1
vote
1answer
58 views

How to change the allowed formats in Import[…]? [closed]

I want to read data from files with an unusual extension with the Import function. However, the following message appears: The data is well organized, when I rename the extension to ".dat" ...
1
vote
0answers
45 views

Wikipedia Edits History: how to split edit history and comments

I am trying to import Wikipedia Edit History. The code that I am using is the following: ...
5
votes
3answers
260 views

Import data from a current web session?

Consider opening a web session such as (Mathematica 11.3) session = StartExternalSession["WebDriver-Chrome"]; ffoxdo[cmd_] := ExternalEvaluate[session, cmd]; ...
2
votes
0answers
63 views

Flight information data

I would like to write a program that automatically checks whether a given flight number is correct and the corresponding departure and arrival times. Is there any function from the Wolfram Language ...
1
vote
1answer
118 views

Plot Serial data from Arduino with time date problem

My WM code reads Arduino data from three analog sensors. My code successfully captured the data from the buffer and add the date of capture using the Now[] function....
0
votes
0answers
48 views

Extract data (digitise) from graph with various line formats

I am attempting to extract the data points from the graph below: -axis titles and axis lines are removed for digitising simplicity- I have tried using a range of graph digtisers (i.e. datathief, ...
11
votes
1answer
589 views

How can I extract data from a diagram?

Below you will see a diagram containing three curves. How can I extract data points from the three colored curves? I need to use the original data.
5
votes
1answer
209 views

webscraping: Wolfram notebook vs browser

In the Netherlands there is a website Funda.nl There you can find all houses for sale or for rent. I used webscraping as a tool to collect data for analyse-purpose. The script I used is like: ...
6
votes
1answer
115 views

Export Data from several tabs in a website

Here is the website from the official federation: http://results.ittf.link/index.php?option=com_fabrik&view=list&listid=36&Itemid=158 I want to export the Data (the table). There are ...
0
votes
0answers
149 views

HTTPRequest and Verbose cURL (curl -vX …)

Using CouchDB, Windows 10, M11.3 This curl command works fine at the command line, curl -X PUT http://127.0.0.1:5984/dbName and this works fine with ...
4
votes
0answers
103 views

Connecting to Twitter API Manually in Mathematica to Pull Down All Followers of a Specified User (e.g. More than 5,000)

I have been going through old StackExchange threads to see how to potentially use Mathematica's built-in connection/authentication to the Twitter API to connect to it manually, and access some ...
4
votes
1answer
196 views

Why is there a lot of noise in the Wolfram Blockchain?

I tried to look into the transaction history of the Wolfram Blockchain. I tried this:- ...
4
votes
1answer
81 views

How to find the block number of a transaction in a Wolfram Blockchain?

For example, in block 1004 of the Wolfram Blockchain, I can get the 4th transaction's ID by using the following code:- ...
3
votes
1answer
131 views

Convert a colormap image into data values according to a legend

I have this image that I want to turn into data using this gradient black being 0, white being 1, and all the colors in between accordingly, so I could later use ...
2
votes
2answers
179 views
1
vote
1answer
47 views

Pulling Tabular Data from a Website

I am trying to extract data from this website by simply using ...
0
votes
0answers
46 views

I want to perform mean of a set of data after importing these data from computer in mathematica. But unable. pls help

I have used the following code in mathematica to perform mean to set of data. ...
0
votes
1answer
51 views

Fine control of AudioRecord

I use an external sound card (Fireface UCX) for data acquisition, generating stimulus .wav files with Mathematica, using Audacity to simultaneously play the stimulus and record several channels of ...
6
votes
1answer
509 views

Using sockets to connect to a trading platform

I'm trying to use Binance's API. The following works: ...
8
votes
2answers
320 views

What's the fastest way to read a simple numerical list?

I have a large .txt file for which I need to do some data analysis. I've been working on it for a while, and the analysis part has got faster and faster so that most of the evaluation time is now ...
13
votes
2answers
476 views

Extracting data from analog screen photograph

I'm using an analog profilometer from the 1970s and need a way to digitize the data and the only way is through a photograph. I've searched but all I could find was how to extract data from computer ...
1
vote
1answer
337 views

Extract data from an image of a density plot?

I have a density plot in image form and would like to extract the data points from it. How would I go about using Mathematica to accomplish this? My ideal output ...
6
votes
1answer
961 views

How to plot a list of value from a .dat file?

So I received from a professor a .dat file, which does contain a quite large amount of points. The problem is this: this file is structured as I'm going to show in figure below: The first value at ...
0
votes
0answers
79 views

Problems with Importing a pdf from an url

I have to process a lot of information from different pdf. I already have the code to download all the files, but i'm stuck in the part where i have to open the files with "Import". For example: http:...
1
vote
0answers
31 views

Monitor and record ethernet port upload speeds

Can I use Mathematica to monitor and record ethernet port upload speeds? I briefly looked at DeviceStream; not sure if that can be made to work or if that's the ...
0
votes
1answer
268 views

How to make a reducer in mathematica (mapreduce)

I want to make a toy mapreduce demonstration in Mathematica using iterator. Iterator allows to simulate real case when we get input row by row, not nowing in advance how many rows are there in source....
4
votes
4answers
419 views

How to efficiently read blank line separated data file into list of lists

For example, I have a test.dat file with contents as below: 1 2 3 4 5 6 11 22 33 44 55 66 (Note that there could be ...
3
votes
1answer
207 views

Parsing JavaScript Script from XML Trees

I've been trying to parse some script written in JavaScript while scraping a website, and am a little confused what functions are needed to get this done in Mathematica. I imported the data using <...
1
vote
2answers
293 views

Smooth curves in a raster image

I have a *.bmp image, e.g. this one: I need to smooth boundaries of the thick curves and save it in a vector graphics form. Is there a simple way how to do that in Mathematica 10? I know it is ...
4
votes
1answer
716 views

How to make Import[…, “Table”] not convert strings to numbers and not convert numbers to strings?

Bug introduced in 8 or earlier and persisting through 11.2.0 I have to to use r = Import["foo.txt", "Table", "FieldSeparators" -> {","}] since my data is Table ...
10
votes
1answer
195 views

Performance-driven approach to using Big Data without killing the hard-drive

Situation A calculation has to be done in which the amount of data is too much to fit into memory. Fortunately, only a part of the overall data set has to be known at a time. The preprocessing is ...
1
vote
1answer
130 views

Extract region analytic expression from an image

I need to extract the bounds of the yellow and green regions in the picture at the end of the post. I need only to reproduce these regions on mathematica. I tried with the algorithm described here ...
1
vote
0answers
43 views

Importing data from Plot [duplicate]

Is it somehow possible to extract the datapoints from a plot imported from an image? i know it is possible to do that from a plot you made in the current session of mathematica, but i'm not sure if ...
2
votes
0answers
94 views

List, Association, and Dataset, according to what principles to choose which one to use?

List, Association and Dataset are three 'objects' that can be used to store data in MMA. So ...
9
votes
1answer
204 views

Importing Graphics from an Online Paper

I'm trying to reproduce a few graphs in Mathematica after running my Fortran code. Ideally, I want exact quantitative agreement with the results already published in the literature. For example, I am ...
1
vote
3answers
182 views

Importing data from notepad to mathematica

I have a set of numbers in notepad that I want to import into Mathematica as a list. I could do this manually, but it will take forever, and my hands are getting tired. My issue is that I'm trying to ...
10
votes
3answers
670 views

How to make a picture grid of all Nobel Laureates in physics?

I want to make a picture grid of all Nobel Laureates in physics using mathematica. Later I wanna print this picture grid on a big wall! The first thought I came up with is to exploit the powerful ...
3
votes
0answers
164 views

How do I get my ZWO ASI120MM astro-camera to work in MMA?

I am using Windows 10 + MMA 10.4.1. I bought a ZWO ASI120MM astro camera which I want to use as a guiding camera during astrophotography. From this site (http://astronomy-imaging-camera.com/software/) ...
3
votes
1answer
648 views

extract data from a graph image

How do I convert the following image graph into data (if possible into function)? I checked this answer and found that my problem is grid and plot have same color.
4
votes
3answers
2k views

Importing CSV with multiline text fields

Bug introduced in 8 or earlier and fixed in 11.2.0 Here is a valid CSV: a1,b1,c1,d1,"e1 e1 e1" a2,b2,"c2 c2 c2",d2,e2 It has two rows and five columns, and ...
4
votes
0answers
357 views

How can I import from a usb webcam on the raspberry pi?

I'm trying to set up a raspberry pi as a webcam server and I need to import images into a Mathematica notebook on the raspberry pi. I tried using CurrentImage[] ...
5
votes
1answer
328 views

How to get the list of links in a Wikipedia article in order of appearance

I can get a list of links in a Wikipedia article using WikipediaData: ...
10
votes
1answer
838 views

Direct Pressure Data Acquisition with Mathematica and Arduino

Mathematica can upload code to the Arduino and read/write values to pins, execute commands, etc. Im trying to use this to do Direct Data Acquisition with a pressure sensor. Here is the link to the ...
1
vote
1answer
149 views

Downloading a number of images from a web site as a list

For a MachineLearning project I need to form a training set using images taken from the web page containing lots of them. Like, for example this one. It would be very convenient, if all the images ...
1
vote
0answers
133 views

Problem with FindDevices[“Camera”] [closed]

I have a problem with FindDevices["Camera"] function. When I try to execute it I get this: ...