Questions tagged [web-access]

Questions about using Mathematica for accessing web sites and using such functions as URLFetch and URLSave.

Filter by
Sorted by
Tagged with
0
votes
0answers
54 views

Yahoo groups is going away: how can I download the old messages?

It looks like all the old email messages from my group are stored in web pages with URLs that look like this: ...
0
votes
0answers
22 views

Using URLExecute[] for online data acquisition

On the United Parcel Service website(UPS) there is a form where you can enter a zip code and it will return a color coded map that shows shipping times from that zip code. I am trying to use ...
1
vote
0answers
82 views

Writing to ElasticSearch [duplicate]

Could someone kindly direct me to suitable documentation, Wolfram or otherwise, to connect Mathematica to an ElasticSearch instance. I don't need anything complicated just sufficient to write a record ...
2
votes
2answers
96 views

Can WebExcute click on a button on a webpage that has been created with Javascript?

In an effort to explore the new WebExecute capabilities in Version 12 I have created a simple algorithm to download some data that are stored on an external server and displayed on a webpage. I am ...
6
votes
1answer
416 views

Can Mathematica run javascript on a website?

One way of running Javascript on a website is to use for instance Greasemonkey. By any chance, would it be possible to execute Javascript commands from Mathematica?
10
votes
1answer
117 views

Mathematica 12: Failure with URLRead

Bug introduced in 12.0 The following HTTP request fails to submit the body under version 12, but works in Mathematica 11: ...
11
votes
1answer
269 views

How to work with ElasticSearch in Mathematica?

Steps to install and run ElasticSearch: install Java (64-bit): https://www.java.com/en/download/manual.jsp download ElasticSearch (https://www.elastic.co/start) and extract archive in ...
13
votes
1answer
208 views

Can I trust URLSubmit?

Bug introduced in 11.2 or earlier and persists through V12.0 [CASE:4026293] confirmed Let's create 10 asynchronous requests which just check if the site is there. ...
2
votes
1answer
73 views

How to extract audio from a Youtube video

Is it possible to extract audio from a Youtube video using Mathematica? I have looked at this post and figured out that it is impossible to download videos with the Youtube API. Are there any possible ...
11
votes
2answers
1k views

Temporarily simulate being offline programmatically

Today I am running Mathematica from a computer that is permanently connected to our university network. Because of a number of reasons, I am not allowed to disconnect my computer from our network. My ...
7
votes
1answer
749 views

web scraping images

I am trying to load player profile pictures from the following page: https://www.transfermarkt.com/manchester-united/startseite/verein/985/saison_id/2006# I use the following code: ...
5
votes
1answer
327 views

Mathematica equivalent of a curl snippet

Is there any documentation anywhere on how to convert an invocation of curl into the Mathematica equivalent (using for example ...
1
vote
1answer
58 views

Unable to use the Import[] function to get the clickable hyperlinks of a page

I can get the hyperlinks of the Google search result of "Wolfram" by using the following code: Import["https://www.google.nl/search?q=Wolfram", "Hyperlinks"] Now ...
3
votes
1answer
191 views

FetchUrl status forbbiden when using Wolfram Alpha query

Strange thing here. If I try this with Free-form input: Sqrt[(2^t*Log[2])^2/(1 - 2^(2*t))] I have no problem... But if I try the same expression in the Wolfram ...
50
votes
1answer
3k views

Google Map in Notebooks?

GoogleMaps are implemented as HTML and Javascript code which can be viewed by a web browser. Is it possible to load this map into the Mathematica notebook, which obviously means for example that <...
0
votes
0answers
31 views

How do I import changing/dynamic data on a webpage?

A remote device (sensor) is sending measurements (that I get in JSON format) to a given URL and is sending new measurements (data points) every couple of minutes. I cannot share the URL but the ...
12
votes
0answers
190 views

Is it possible to search the web by image from Mathematica?

Is it possible to perform a web search based on an image input? There are several services that provide this: Google, Bing, TinEye, and maybe others. I am not sure which can be accessed ...
4
votes
2answers
76 views

“Accept” header in HTTP request for DOI Content Negotiation

I am trying to get the .bib info from a DOI, following the guide here. Basically, I wish to run ...
7
votes
1answer
88 views

Using URLExecute to login to website

One of my students is doing summer research for a local company to help analyze some of their data. Trouble is, the web interface they provide for downloading the data only allows one to download one ...
2
votes
0answers
54 views

What could cause an “Uncaught Throw[$Failed,CURLLink`Utilities`Exception] returned to top level.” error message?

I am running a program in Mathematica that uses web browser automation, and is also connected to my email account. The program runs fine for a while, but after a few hours, I end up getting the ...
0
votes
0answers
32 views

Verify that a document matches a URL

Writing: Quiet[Length[Import["http://www.africau.edu/images/default/sample.pdf"]]] I get: 2 while writing: ...
5
votes
1answer
156 views

How to click a button to upload local file with WebExecute?

A webpage has a "browse" button to open the filesystem to select a file and upload it, in html it looks like this: ...
2
votes
0answers
33 views

How to overcome the threshold 500 ExternalLinks for downloading of the WikipediaData?

The command, for instance, WikipediaData["Global warming", "ExternalLinks"] gives me 500 links only, as so as ...
1
vote
0answers
40 views

How to use EmbedCode with CloudDeploy correctly?

I ran EmbedCode[CloudDeploy[Manipulate[Plot[Sin[x + c], {x, -6, 6}], {c, -1, 1}]]] based on this instruction and obtained the html code for embedding as below:- <...
4
votes
3answers
136 views

Find and load all ResourceFunctions as top level functions?

I would like to be able to use ResourceFunction's as top-level symbols: The reason being that some of them are so useful it would be really great not to have to ...
3
votes
2answers
253 views

Number of line in website [closed]

I want to download the content of the website(contains text) and only a few lines from the content (from a specific number of the line up to the last line minus specific offset). Unfortunately, I do ...
1
vote
0answers
24 views

WebImageSearch for images of high resolution?

Is there a way to specify a minimal image dimension when using WebImageSearch? Since it costs money I don't want to do a large search and then filter the results. ...
3
votes
2answers
82 views

WebExecute timeout

There isn't much tuning freedom available in the WebExecute method. If a page takes too long to load you only see a spinner or a blank for CapturePage. Does someone ...
2
votes
1answer
52 views

How can I deal with a 502 error? [closed]

I am working on a program that interfaces with a web API. Mathematica runs perfectly fine for a few hours and then, after a while, will sometimes return: The request to URL https://api.polygon.io/...
8
votes
1answer
2k views

Download Youtube Videos

Is there a way to display or download youtube videos in Mathematica. Youtube is HTML5 enabled so I am hopeful there might be an easy way.
2
votes
1answer
125 views

How can I convert $\TeX$ image to Wolfram expression via MathPix

Mathpix is a tool which can covert $\TeX$ image to $\TeX$ expression, they also say they can return a string which is compatible with the Wolfram Alpha engine if possible. I found their documentation ...
8
votes
1answer
207 views

Scrape AJAX Website with Webdriver

I hope the new Webdriver functionality can help as the normal Import and HTTPRequest don't work. The sites I have found are a ...
9
votes
1answer
268 views

Import data from dynamically generated webpage

I'm trying to get data from a web-page data=Import["https://stats.nba.com/team/1610612738/traditional/", "Data"] It returns only a textual information. ...
2
votes
1answer
134 views

Deleting missing values from a dataset

I wanted to create a dataset of all UFO sightings in April of 2018. The AssociationThread doesn't want to work, because some of the entries are missing value, what ...
1
vote
1answer
130 views

How to get URL request response in Mathematica?

I am considering the following link: https://myimmitracker.com/en/ca/trackers/consolidated-e-apr-tracker-express-entry-permanent-residency-application It produces the following page with a table in ...
1
vote
0answers
41 views

Chrome drive broken? [closed]

I tried this external session, as Import["Url"] is sometimes blocked by websites. But it is down now, and I really don't know why. My computer is Dell XPS 13 with ...
1
vote
2answers
79 views

What info is exchanged when using Import[url]?

When using Import with a url what information is broadcasted/sent to the receiving end of the request and is it possible to monitor/modify that information?
1
vote
0answers
39 views

How to access image from ethernet camera [duplicate]

I have a Edimax IC-3140W ethernet security camera. It acts as a web host where the video feed can be viewed in a browser. Navigating to its ip address http://ip.ip.ip.ip, it will ask for a password ...
11
votes
2answers
157 views

How to show Plots or Graphics in mini MMA HTTP Server?

I learned some codes to make a mini HTTP server in MMA way here. ...
0
votes
0answers
41 views

Scraping Images that are Directly Embedded in a Webpage or Dynamic?

I need to scrape URLs for photo albums like Flickr and Facebook for images from a certain event. I'm trying to use Import["link", "Images"], as shown at https://...
6
votes
1answer
377 views

Opening Mathematica file in Google drive

I have a Mathematica file in my Google drive. There is no option to open the Mathematica file directly, without downloading it. Is it possible to directly open the file from Google drive?
3
votes
0answers
63 views

How to connect to ncbi databases for text search? MathIOmica authoring instructions now do not work [closed]

Mias's suplementary material in the notebook MmaBioinfo_Ch4_Databases contains a code for search the snp related to autism ...
2
votes
0answers
78 views

create interactive local site with backgroud mathematica calculations

This may be a bit of a weird question but I cannot figure out if this is possible. I need to write a program at work that can be used interactively. By that I mean, it will have several parameters ...
3
votes
1answer
97 views

Importing data from an https server

When trying to import data from an https request I get the following error message. ...
5
votes
1answer
201 views

webscraping: Wolfram notebook vs browser

In the Netherlands there is a website Funda.nl There you can find all houses for sale or for rent. I used webscraping as a tool to collect data for analyse-purpose. The script I used is like: ...
6
votes
1answer
111 views

Export Data from several tabs in a website

Here is the website from the official federation: http://results.ittf.link/index.php?option=com_fabrik&view=list&listid=36&Itemid=158 I want to export the Data (the table). There are ...
5
votes
1answer
147 views

How can I tally users on the Wolfram Challenges leaderboard?

Wolfram Challenges has a leaderboard that features users that have completed the challenges in the 'best' way, according to specified criteria like efficiency or shortness of code. Can I use ...
3
votes
2answers
461 views

Mathematica Import functions fails for data download from website

I am trying to download some data from a website that uses "java enabling" to tell me that I cannot download the data. Using Import[ "website...", "Data"] I get ...
21
votes
1answer
207 views

Upload from Mathematica to YouTube

I'd like to take some little videos I made in Mathematica and put them on YouTube. Is there a way to do this?
8
votes
1answer
211 views

A tour of AWSLink?

Seems like there are a lot of useful functions in this undocumented package AWSLink: Any developers on here that can demo it a bit?