Questions tagged [web-access]
Questions about using Mathematica for accessing web sites and using such functions as URLFetch and URLSave.
259
questions
2
votes
0
answers
118
views
How to get satellite image directly from Mathematica?
First, I get the image of the bands of the desired area from the site https://earthexplorer.usgs.gov/, then I import the images into Mathmatica by addressing them as below:
Select dataset directory:
<...
- 159
1
vote
0
answers
59
views
HTTPRequest append cookies data but not working
First I use
ClearCookies[All];
ck = URLRead @ HTTPRequest["https://wolfram.com",CookieFunction->Print]
to get an example of cookies. Then I save the ...
- 21
3
votes
1
answer
169
views
What does this error message about chromedriver mean?
I have been using WebSession to drive a Chrome browser for automation purposes. I'm running Mathematica 13.2 on Ubuntu Linux. Occasionally, my Chrome browser gets updated by an automatic OS process. ...
- 187
3
votes
1
answer
484
views
Access openai with HTTPRequest but body parameters seems not function
Using Mathematica 13.0 on Windows 10
codes are below
...
- 73
3
votes
1
answer
64
views
What crops the response from the SocketListen based web server?
I noticed that when the response length passes around 1k characters then it is cut at weird lengths: 424, 936 or 1448 characters.
Response is generated correctly but then it is cut so if the body was ...
Kuba♦
- 136k
1
vote
0
answers
99
views
Terms of use for functions that access data over the internet
Please excuse, as this is not a question about how to use a specific Mathematica function
or solve some specific problem with Mathematica. But, a correct and comprehensive answer might
be of interest ...
- 151
4
votes
1
answer
127
views
Is it possible to build a small web site with vanilla Mathematica? How about a web server?
Note: This question is not about WebMathematica. I speculate it is capable of doing everything about to be discussed.
With its diverse capabilities and near endless ...
- 2,397
6
votes
1
answer
225
views
Create a function that takes a symbol and searches wolfram documentation for the page and opens it
This is way over my pay-grade, so I have no idea where to start. I'm certain MMA has some very good internet capabilities, so it seems to me that it is possible.
This is really a 2-part question:
How ...
- 2,397
3
votes
1
answer
93
views
Implementing Web Form to collect data but users must authenticate first
I’m trying to implement a web form to collect data into a databin, but I need users authenticate first (nothing fancy, predefined usernames and password are fine), so I could collect every user data. ...
- 51
0
votes
1
answer
93
views
How to obtain stock information from a website
I want to obtain some information of stock markets from TradingView website.
For instance, let us access to S&P index chart through the URL,
https://www.tradingview.com/chart/?symbol=SP%3ASPX
Now, ...
- 405
3
votes
0
answers
52
views
How to insert input into Jupyter notebook using WebExecute
I started web session and opened a Jupyter notebook in it:
...
- 9,568
6
votes
1
answer
260
views
Make Mathematica input things on a website and take the data out
So I found a website that calculates polynomials that I need it intakes a word of a's and b's say aabba and outputs a polynomial. Here is the website: http://www.math.stonybrook.edu/~moira/NewApps/...
- 647
0
votes
1
answer
60
views
HTTPRequest result confusion
everyone!
I've been using Mathematica to progress through the problems of codeabbey.com, and I've picked up the first of "interactive" problems (Problem #176 - Say 100), which is sort of an ...
3
votes
2
answers
94
views
Character encoding of the output from URLExecute
Bug persisting through 13.1.0 [CASE:4932406]
I'm using URLExecute to fetch some data from the arXiv preprint server
but it seems that the encoding of the text I ...
- 3,487
1
vote
2
answers
979
views
Getting stock quotes from Yahoo Finance API in Mathematica
I have obtained a Yahoo Finance API key and would like to try it out by making a simple request from within Mathematica. Their tutorial page has some nice little example code snippets in various ...
- 123
1
vote
3
answers
226
views
Looking for a WebExecute workaround
A website opens properly with SystemOpen["url"] but fails to open properly with StartWebSession[] or ...
- 78
0
votes
0
answers
100
views
WebSearch Stopped Working
I've been using 'WebSearch' and 'WebImageSearch' quite a lot recently to sample images for my work. However, these functions suddenly stopped working. When I evaluate, for example,
...
- 4,147
0
votes
0
answers
56
views
scrape App Store web data
I want to scrape the privacy information of an app on the web store page.
For example, the Tiktok app information looks like this:
tiktok on us app store
I found that it's easy to scrape that ...
- 601
2
votes
1
answer
86
views
Get page source from active web session?
WebExecute allows to control a web browser through Mathematica. There are various actions one can perform programmatically through this function. However, I could ...
- 11.9k
1
vote
2
answers
92
views
Converting HTML Tables derived from URL's on the Web to Datasets 211112 Revisited
In a previous question [211112] that deals with importing data from a
Wikipedia table directly into a Dataset.
For the following data:
...
- 1,774
1
vote
0
answers
615
views
How to stream NSE option chain data into mathematica
I'm trying to stream option chain data into mathematica from the
url: https://www.nseindia.com/api/option-chain-indices?symbol=BANKNIFTY
...
- 403
1
vote
0
answers
72
views
How do I get access to the element which is inside a document in iframe?
If the element is not inside an iframe then the following works:
...
- 9,113
1
vote
0
answers
286
views
How to check the status of browser after every WebExecute command?
When executing commands using WebExecute on the $CurrentWebSession like follows:
...
- 9,113
3
votes
1
answer
272
views
How to select from a dropdown list in WebExecute?
After locating the dropdown using the XPath as follows:
element=First@WebExecute["LocateElements"->"XPath"->"..."];
How do I ...
- 9,113
2
votes
0
answers
116
views
BlockchainBlockData request limit exceeded
I'm trying to replicate this Blog entry on Bitcoin queries:
https://blog.wolfram.com/2021/05/25/sleuthing-darkside-crypto-ransom-payments-with-the-wolfram-language/
However, I don't get very far ...
- 601
6
votes
1
answer
499
views
How to continue with my Wolfram cloud basic?
I have this simple question but failed to find an answer on the internet.
So far (over a course of 6 months or so) I am using a free account called: Wolfram cloud basic. I use this to make some 3D ...
- 61
6
votes
2
answers
290
views
Is there a CryptocurrencyData alternative to FinancialData?
What's the easiest way to ingest time series data on cryptocurrencies into Mathematica?
I'm looking for up-to-date price, volume, and other properties for both major coins and altcoins.
- 3,581
1
vote
1
answer
110
views
interact with web pages with many hyperlinks and search for a specific name or phrase How?
I have this code that shows many hyperlinks
links = Import[
"http://www.liceobrainstorm.cl/wp-content/uploads/2020/07/",
"Hyperlinks"]
...
- 480
0
votes
0
answers
109
views
Scroll to end of page with WebExecute
I want to scrape the data from this url : https://www.cboe.com/us/indices/indicessearch/
In so doing , I need to scroll to the end of page. Is there a way to use WebExecute to scroll to end of page ? ...
- 187
13
votes
1
answer
286
views
Easily download SE posts as notebooks?
Is there a common method of grabbing an SE post or answer here as a formatted notebook so that you can immediately run it, instead of copy-pasting the code blocks?
I've heard SSE uses MarkdownSharp ...
- 31.2k
2
votes
0
answers
69
views
how to get world-wide COVID-19 data in a correct form
I have the following code for retrieving world-wide COVID-19 data.
...
- 5,470
2
votes
1
answer
529
views
How to import a google sheets file that requires account login?
How do I import a google sheets file that is in my google drive?
I tried the following:
...
- 9,113
1
vote
0
answers
69
views
Can Google Earth images be imported?
I've searched for code and found nothing. Is this a server handshake problem?
Below, GeoGraphics executes properly on wikimapia.org, but WebImage doesn't open earth.google.com to a coordinate.
...
- 583
4
votes
1
answer
151
views
Finding Vaccine Appointments in MA
Everyday I spend a crazy amount of time clicking though each maze of hyperlinks and forms on this horrendous site: https://vaxfinder.mass.gov/
Is there anyway that Mathematica can help speed up the ...
- 3,581
4
votes
0
answers
89
views
Socket not ready but data is available
Background
I am playing with https://github.com/arnoudbuzing/wolfram-server and I faced problems with requests that are slightly longer. I tried to narrow it down here.
Problem
This could be my ...
Kuba♦
- 136k
0
votes
1
answer
135
views
Import CSV data from internet to mathematica [closed]
This Link has data in CSV format for 2015 and other years. I would like to get the data for 2015 (by clicking on 2015) but the CSV data format has more rows than Excel can handle and therefore the ...
- 5,470
1
vote
2
answers
236
views
How to use Import to extract data from website?
I would like to extract data of surface properties and grain boundary properties for Cu polymorph #0 from the website: http://crystalium.materialsvirtuallab.org using Mathematica.
So far I tried with <...
- 494
3
votes
1
answer
130
views
Get file downloaded from click in WebSession?
I'm downloading a file by clicking a button from chrome with the WebDriver functionality:
...
- 31.2k
5
votes
2
answers
183
views
How to start an incognito web session?
Is this possible to do with StartWebSession, in either with Chrome or Firefox?
- 3,581
0
votes
0
answers
34
views
WebSessionObject from Process
StartWebSession creates a websession which can be controlled with many commands to automate web stuff. It is limited -- what if one wants to include arguments to ...
- 3,897
2
votes
1
answer
294
views
Using java-script code in Mathematica
I have the following HTML file stored on "C:\local.html":
...
- 9,568
4
votes
2
answers
362
views
How to monitor multiple async image downloads?
I have a few thousand image urls that I want to download asynchronously, how can I do that while monitoring progress? I'm really asking for 5 things:
Show dynamic progress in bar
Downloads must be ...
- 31.2k
0
votes
0
answers
32
views
Expanding website file display ---------show files in full format
Many times looking for some material I find websites that seem to use a format that does not allow the file name to be fully visible.
You download the file that you think it is and it turns out that ...
- 309
7
votes
2
answers
373
views
Curl analog with URLRead/Execute?
I have a working curl command:
curl https://myapp.herokuapp.com/doit -F filedata=@path/to/img.jpg
How do I write this in the modern way with ...
- 31.2k
5
votes
1
answer
306
views
How to send keys to the element in focus with WebExecute
Exploring the WebExecute function, I would like to know how can I send key (or TypeElement) to the element in focus. Here is a toy code using Google.
...
- 26.1k
1
vote
1
answer
288
views
URLDownload(and URLSave, Import) "Error while processing content unencoding"
I'm downloading a file of exactly 1000K-size (https://gitee.com/WolframPaclet1/WolframPacletExtreme1/raw/master/Paclets/MXNetResources-WIN64-12.0.37.paclet.601) with ...
- 732
3
votes
2
answers
236
views
Bug in WebExecute TypeElement with diacritics characters [Solved]
[Solved in 12.1.1]
When using WebExecute TypeElement, I get $Failed if I have a diacritics ...
- 26.1k
5
votes
1
answer
111
views
Can Delayed FormFunction redirect to itself (with body)
I want a FormFunction to show a history of inputs, by default an empty list. But once the submit is hit, the form should be reloaded with the history shown on top.
...
Kuba♦
- 136k
2
votes
0
answers
233
views
Cannot launch Chrome or Firefox Driver with StartWebSession[]
The Mathematica 12 in my computer cannot launch Chrome or Firefox session correctly. The first error message is
...
- 21
3
votes
1
answer
932
views
Basic API Key authentication not working with URLExecute
I am a newbie with RESTful APIs and have never tried accessing one from inside Mathematica. I am trying to access the Companies House API, in the UK. The following command works fine from the Terminal ...
- 475