Questions tagged [web-access]

Questions about using Mathematica for accessing web sites and using such functions as URLFetch and URLSave.

Filter by
Sorted by
Tagged with
4
votes
1answer
59 views

How to send keys to the element in focus with WebExecute

Exploring the WebExecute function, I would like to know how can I send key (or TypeElement) to the element in focus. Here is a toy code using Google. ...
0
votes
1answer
31 views

URLDownload(and URLSave, Import) “Error while processing content unencoding”

I'm downloading a file of exactly 1000K-size (https://gitee.com/WolframPaclet1/WolframPacletExtreme1/raw/master/Paclets/MXNetResources-WIN64-12.0.37.paclet.601) with ...
1
vote
1answer
47 views

How to use WebExecute to retrieve WebElementObject HTML?

I know that I can use WebExecute to retrieve WebElementObject text, as in this example: ...
0
votes
0answers
49 views

429 error when importing webpage

I am interested in checking which of my favorite groceries are on special at which supermarket before going to the shops (to know which items to buy from which supermarket) but every time I try to ...
2
votes
2answers
105 views

Bug in WebExecute TypeElement with diacritics characters

When using WebExecute TypeElement, I get $Failed if I have a diacritics character in the ...
3
votes
1answer
80 views

Can Delayed FormFunction redirect to itself (with body)

I want a FormFunction to show a history of inputs, by default an empty list. But once the submit is hit, the form should be reloaded with the history shown on top. ...
0
votes
0answers
30 views

Cannot launch Chrome or Firefox Driver with StartWebSession[]

The Mathematica 12 in my computer cannot launch Chrome or Firefox session correctly. The first error message is ...
1
vote
1answer
79 views

Basic API Key authentication not working with URLExecute

I am a newbie with RESTful APIs and have never tried accessing one from inside Mathematica. I am trying to access the Companies House API, in the UK. The following command works fine from the Terminal ...
5
votes
0answers
169 views

Decompose website into rectangular grid?

I'd like to take an image of a website and decompose it into a rectangular clustering of dominant pixels like this: What I've tried so far There are a few existing webpage segmentation solutions: ...
8
votes
0answers
166 views

Guide to capturing the complete image of given urls?

I'm trying to use WebImage[] to capture the complete image of a website (yes, it might be very tall). I seem to be having some issues with it: How to attempt to capture a complete image of the ...
3
votes
0answers
76 views

Make Mathematica aware of private root certificate authority

I have a private root certificate authority and when I use functions like URLRead[] to connect to a local HTTPS endpoint, I have to add ...
4
votes
2answers
197 views

SSL errors when using URLFetch or URLSave in versions 8 or 9

It seems that with Mathematica 8 and 9 it is not possible anymore to download files from SSL encrypted urls. In my case (Fedora 30) on Mathematica 8 (it has no ...
2
votes
1answer
235 views

URLSave in Mathematica 10 and 11 on Linux [closed]

It seems that URLSave doesn't work as expected with https links in Mathematica 10.4 on Linux. At least in my case (Fedora 30) for ...
2
votes
1answer
93 views

Convert Plot to Base64 [closed]

My goal is to get a Base64 string directly from a plot (or any Graphics object) in Mathematica such that, when using a Base64 decoder online, such as this one, I ...
4
votes
1answer
110 views

Using WebExecute to automatically download data

With WebExcute, I have been able to get access to a particular url https://www.hkex.com.hk/eng/sorc/options/statistics_hv_iv.aspx However, in this url, there is a quite a number of stock code that ...
4
votes
0answers
178 views

Privacy in web-queries [closed]

The question What information is sent to Wolfram Research when loading or working with Mathematica? describes the information sent to Wolfram's servers in routine Mathematica usage (Documentation ...
3
votes
0answers
114 views

How to use Mathematica in Chrome extension?

Now that the wolfram engine is free (for developers), I'd like to know how to use it within a chrome extension. It's easy to make a chrome extension, which is essentially just a JSON file with some ...
0
votes
0answers
68 views

Yahoo groups is going away: how can I download the old messages?

It looks like all the old email messages from my group are stored in web pages with URLs that look like this: ...
0
votes
0answers
29 views

Using URLExecute[] for online data acquisition

On the United Parcel Service website(UPS) there is a form where you can enter a zip code and it will return a color coded map that shows shipping times from that zip code. I am trying to use ...
10
votes
1answer
192 views

Mathematica 12: Failure with URLRead

Bug introduced in 12.0 The following HTTP request fails to submit the body under version 12, but works in Mathematica 11: ...
11
votes
1answer
312 views

How to work with ElasticSearch in Mathematica?

Steps to install and run ElasticSearch: install Java (64-bit): https://www.java.com/en/download/manual.jsp download ElasticSearch (https://www.elastic.co/start) and extract archive in ...
3
votes
2answers
186 views

Can WebExcute click on a button on a webpage that has been created with Javascript?

In an effort to explore the new WebExecute capabilities in Version 12 I have created a simple algorithm to download some data that are stored on an external server and displayed on a webpage. I am ...
1
vote
0answers
85 views

Writing to ElasticSearch [duplicate]

Could someone kindly direct me to suitable documentation, Wolfram or otherwise, to connect Mathematica to an ElasticSearch instance. I don't need anything complicated just sufficient to write a record ...
2
votes
1answer
108 views

How to extract audio from a Youtube video

Is it possible to extract audio from a Youtube video using Mathematica? I have looked at this post and figured out that it is impossible to download videos with the Youtube API. Are there any possible ...
11
votes
2answers
1k views

Temporarily simulate being offline programmatically

Today I am running Mathematica from a computer that is permanently connected to our university network. Because of a number of reasons, I am not allowed to disconnect my computer from our network. My ...
7
votes
1answer
784 views

web scraping images

I am trying to load player profile pictures from the following page: https://www.transfermarkt.com/manchester-united/startseite/verein/985/saison_id/2006# I use the following code: ...
5
votes
1answer
382 views

Mathematica equivalent of a curl snippet

Is there any documentation anywhere on how to convert an invocation of curl into the Mathematica equivalent (using for example ...
1
vote
1answer
81 views

Unable to use the Import[] function to get the clickable hyperlinks of a page

I can get the hyperlinks of the Google search result of "Wolfram" by using the following code: Import["https://www.google.nl/search?q=Wolfram", "Hyperlinks"] Now ...
0
votes
0answers
37 views

How do I import changing/dynamic data on a webpage?

A remote device (sensor) is sending measurements (that I get in JSON format) to a given URL and is sending new measurements (data points) every couple of minutes. I cannot share the URL but the ...
5
votes
2answers
126 views

“Accept” header in HTTP request for DOI Content Negotiation

I am trying to get the .bib info from a DOI, following the guide here. Basically, I wish to run ...
7
votes
1answer
161 views

Using URLExecute to login to website

One of my students is doing summer research for a local company to help analyze some of their data. Trouble is, the web interface they provide for downloading the data only allows one to download one ...
2
votes
0answers
76 views

What could cause an “Uncaught Throw[$Failed,CURLLink`Utilities`Exception] returned to top level.” error message?

I am running a program in Mathematica that uses web browser automation, and is also connected to my email account. The program runs fine for a while, but after a few hours, I end up getting the ...
0
votes
0answers
37 views

Verify that a document matches a URL

Writing: Quiet[Length[Import["http://www.africau.edu/images/default/sample.pdf"]]] I get: 2 while writing: ...
2
votes
0answers
35 views

How to overcome the threshold 500 ExternalLinks for downloading of the WikipediaData?

The command, for instance, WikipediaData["Global warming", "ExternalLinks"] gives me 500 links only, as so as ...
1
vote
0answers
64 views

How to use EmbedCode with CloudDeploy correctly?

I ran EmbedCode[CloudDeploy[Manipulate[Plot[Sin[x + c], {x, -6, 6}], {c, -1, 1}]]] based on this instruction and obtained the html code for embedding as below:- <...
5
votes
1answer
274 views

How to click a button to upload local file with WebExecute?

A webpage has a "browse" button to open the filesystem to select a file and upload it, in html it looks like this: ...
6
votes
3answers
160 views

Find and load all ResourceFunctions as top level functions?

I would like to be able to use ResourceFunction's as top-level symbols: The reason being that some of them are so useful it would be really great not to have to ...
3
votes
2answers
259 views

Number of line in website [closed]

I want to download the content of the website(contains text) and only a few lines from the content (from a specific number of the line up to the last line minus specific offset). Unfortunately, I do ...
1
vote
0answers
27 views

WebImageSearch for images of high resolution?

Is there a way to specify a minimal image dimension when using WebImageSearch? Since it costs money I don't want to do a large search and then filter the results. ...
3
votes
2answers
108 views

WebExecute timeout

There isn't much tuning freedom available in the WebExecute method. If a page takes too long to load you only see a spinner or a blank for CapturePage. Does someone ...
2
votes
1answer
59 views

How can I deal with a 502 error? [closed]

I am working on a program that interfaces with a web API. Mathematica runs perfectly fine for a few hours and then, after a while, will sometimes return: The request to URL https://api.polygon.io/...
2
votes
1answer
178 views

Deleting missing values from a dataset

I wanted to create a dataset of all UFO sightings in April of 2018. The AssociationThread doesn't want to work, because some of the entries are missing value, what ...
8
votes
1answer
247 views

Scrape AJAX Website with Webdriver

I hope the new Webdriver functionality can help as the normal Import and HTTPRequest don't work. The sites I have found are a ...
1
vote
1answer
164 views

How to get URL request response in Mathematica?

I am considering the following link: https://myimmitracker.com/en/ca/trackers/consolidated-e-apr-tracker-express-entry-permanent-residency-application It produces the following page with a table in ...
1
vote
0answers
45 views

Chrome drive broken? [closed]

I tried this external session, as Import["Url"] is sometimes blocked by websites. But it is down now, and I really don't know why. My computer is Dell XPS 13 with ...
1
vote
2answers
86 views

What info is exchanged when using Import[url]?

When using Import with a url what information is broadcasted/sent to the receiving end of the request and is it possible to monitor/modify that information?
1
vote
0answers
43 views

How to access image from ethernet camera [duplicate]

I have a Edimax IC-3140W ethernet security camera. It acts as a web host where the video feed can be viewed in a browser. Navigating to its ip address http://ip.ip.ip.ip, it will ask for a password ...
9
votes
1answer
335 views

Import data from dynamically generated webpage

I'm trying to get data from a web-page data=Import["https://stats.nba.com/team/1610612738/traditional/", "Data"] It returns only a textual information. ...
11
votes
2answers
184 views

How to show Plots or Graphics in mini MMA HTTP Server?

I learned some codes to make a mini HTTP server in MMA way here. ...
3
votes
0answers
71 views

How to connect to ncbi databases for text search? MathIOmica authoring instructions now do not work [closed]

Mias's suplementary material in the notebook MmaBioinfo_Ch4_Databases contains a code for search the snp related to autism ...

1
2 3 4 5