Questions tagged [web-access]
Questions about using Mathematica for accessing web sites and using such functions as URLFetch and URLSave.
266 questions
4
votes
1
answer
348
views
How to select from a dropdown list in WebExecute?
After locating the dropdown using the XPath as follows:
element=First@WebExecute["LocateElements"->"XPath"->"..."];
How do I ...
CommunityBot
- 1
2
votes
2
answers
334
views
0
votes
0
answers
34
views
How to separate hyperlinks from the hyperlinked scripts
Given this list of 15 documents, I like to extract each one of the titles of 15 documents, document number, date of approval, date of activation, and the clickable hyperlink. Thereafter, represent the ...
- 6,409
1
vote
0
answers
61
views
2
votes
2
answers
107
views
46
votes
4
answers
5k
views
How to do http post in Mathematica?
The Import command lets you do a HTTP GET from a URL, like this
Import @ "http://merkosoncampus.com/wp-content/uploads/2011/05/higgs-boson.jpg"
This sends an ...
- 7,679
1
vote
1
answer
44
views
How to interact with a private browsing tab?
With session=StartWebSession["Firefox"] it seems I don't have any options to add, or do I?
I would like to operate in private browsing mode. If after ...
- 33.4k
1
vote
0
answers
79
views
Mathematica and Stock Market Historical Data from Alpaca
The following function successfully imports historical stock market data from Alpaca's Market Data API.
...
- 1,185
1
vote
0
answers
45
views
How to authenticate herself to the openai api service when using URLExecute? [closed]
I have tried the canonical example (with the real API Key)
...
- 1,782
15
votes
5
answers
680
views
Find and load all ResourceFunctions as top level functions?
I would like to be able to use ResourceFunction's as top-level symbols:
The reason being that some of them are so useful it would be really great not to have to ...
- 83.1k
10
votes
2
answers
398
views
Use Mathematica to save all citations from Google Scholar search
How can I save all citations from a Google Scholar search? For instance, in a search for "Radon transformation", there are about 35,500 results. I want to download all citations into a string - is ...
- 29.1k
4
votes
1
answer
425
views
How to extract audio from a Youtube video
Is it possible to extract audio from a Youtube video using Mathematica? I have looked at this post and figured out that it is impossible to download videos with the Youtube API. Are there any possible ...
- 1
13
votes
3
answers
5k
views
Use Alpha Vantage as an alternative to Yahoo FinancialData, and how to use financial indicators on these data
Alpha Vantage Inc. is a leading provider of free APIs in JSON and CSV formats for real-time and historical stock market data.
With the recent glitch of the Yahoo Finance API, and with ...
23
votes
2
answers
2k
views
Can Mathematica act like a web server?
I have a Mathematica program that modifies images that I would like to make available for other people to use through the web. The input is only one parameter. So, for example, I could run it as a ...
- 1,605
1
vote
3
answers
262
views
Looking for a WebExecute workaround
A website opens properly with SystemOpen["url"] but fails to open properly with StartWebSession[] or ...
- 306
3
votes
1
answer
240
views
What does this error message about chromedriver mean?
I have been using WebSession to drive a Chrome browser for automation purposes. I'm running Mathematica 13.2 on Ubuntu Linux. Occasionally, my Chrome browser gets updated by an automatic OS process. ...
- 1,860
3
votes
0
answers
149
views
How to get satellite image directly from Mathematica?
First, I get the image of the bands of the desired area from the site https://earthexplorer.usgs.gov/, then I import the images into Mathmatica by addressing them as below:
Select dataset directory:
<...
- 195
4
votes
1
answer
169
views
Is it possible to build a small web site with vanilla Mathematica? How about a web server?
Note: This question is not about WebMathematica. I speculate it is capable of doing everything about to be discussed.
With its diverse capabilities and near endless ...
- 1,605
1
vote
0
answers
126
views
HTTPRequest append cookies data but not working
First I use
ClearCookies[All];
ck = URLRead @ HTTPRequest["https://wolfram.com",CookieFunction->Print]
to get an example of cookies. Then I save the ...
- 83
6
votes
3
answers
2k
views
Bing daily wallpaper
Bing has nice images that change daily. How can we download them regularly and also maybe download an archive of previous images?
There is an extensive discussion here, can we implement it in ...
9
votes
2
answers
1k
views
Can Mathematica run javascript on a website?
One way of running Javascript on a website is to use for instance Greasemonkey. By any chance, would it be possible to execute Javascript commands from Mathematica?
- 1,605
9
votes
1
answer
455
views
Scrape AJAX Website with Webdriver
I hope the new Webdriver functionality can help as the normal Import and HTTPRequest don't work.
The sites I have found are a ...
3
votes
1
answer
564
views
Access openai with HTTPRequest but body parameters seems not function
Using Mathematica 13.0 on Windows 10
codes are below
...
- 83
22
votes
1
answer
295
views
Upload from Mathematica to YouTube
I'd like to take some little videos I made in Mathematica and put them on YouTube. Is there a way to do this?
- 551
3
votes
1
answer
71
views
What crops the response from the SocketListen based web server?
I noticed that when the response length passes around 1k characters then it is cut at weird lengths: 424, 936 or 1448 characters.
Response is generated correctly but then it is cut so if the body was ...
- 9,549
1
vote
0
answers
109
views
Terms of use for functions that access data over the internet
Please excuse, as this is not a question about how to use a specific Mathematica function
or solve some specific problem with Mathematica. But, a correct and comprehensive answer might
be of interest ...
- 259
17
votes
2
answers
406
views
Can I trust URLSubmit?
Bug introduced in 11.2 or earlier and solved in V13.2
[CASE:4026293] confirmed
Let's create 10 asynchronous requests which just check if the site is there.
...
- 8,727
3
votes
1
answer
101
views
Implementing Web Form to collect data but users must authenticate first
I’m trying to implement a web form to collect data into a databin, but I need users authenticate first (nothing fancy, predefined usernames and password are fine), so I could collect every user data. ...
- 456
6
votes
1
answer
244
views
Create a function that takes a symbol and searches wolfram documentation for the page and opens it
This is way over my pay-grade, so I have no idea where to start. I'm certain MMA has some very good internet capabilities, so it seems to me that it is possible.
This is really a 2-part question:
How ...
- 59.6k
0
votes
1
answer
143
views
How to obtain stock information from a website
I want to obtain some information of stock markets from TradingView website.
For instance, let us access to S&P index chart through the URL,
https://www.tradingview.com/chart/?symbol=SP%3ASPX
Now, ...
3
votes
0
answers
68
views
How to insert input into Jupyter notebook using WebExecute
I started web session and opened a Jupyter notebook in it:
...
- 25.1k
2
votes
1
answer
660
views
How to import a google sheets file that requires account login?
How do I import a google sheets file that is in my google drive?
I tried the following:
...
CommunityBot
- 1
3
votes
2
answers
100
views
Character encoding of the output from URLExecute
Bug persisting through 13.1.0 [CASE:4932406]
I'm using URLExecute to fetch some data from the arXiv preprint server
but it seems that the encoding of the text I ...
- 62.3k
6
votes
1
answer
274
views
Make Mathematica input things on a website and take the data out
So I found a website that calculates polynomials that I need it intakes a word of a's and b's say aabba and outputs a polynomial. Here is the website: http://www.math.stonybrook.edu/~moira/NewApps/...
- 138k
0
votes
1
answer
67
views
HTTPRequest result confusion
everyone!
I've been using Mathematica to progress through the problems of codeabbey.com, and I've picked up the first of "interactive" problems (Problem #176 - Say 100), which is sort of an ...
2
votes
2
answers
1k
views
Getting stock quotes from Yahoo Finance API in Mathematica
I have obtained a Yahoo Finance API key and would like to try it out by making a simple request from within Mathematica. Their tutorial page has some nice little example code snippets in various ...
- 725
59
votes
9
answers
3k
views
Is it possible to invoke the OEIS from Mathematica?
I had always wondered if there might be a way to write a function, which I'll call OEISData[], that more or less works as a curated data function for The On-Line ...
- 161
2
votes
0
answers
72
views
how to get world-wide COVID-19 data in a correct form
I have the following code for retrieving world-wide COVID-19 data.
...
14
votes
1
answer
977
views
How to implement a free version of WebImageSearch?
I really don't like functions that I have to pay for, if they can be implemented for free.
Is there a way to get around this pay-wall for WebImageSearch? Perhaps using some other free api or service?
...
- 31.8k
0
votes
0
answers
114
views
WebSearch Stopped Working
I've been using 'WebSearch' and 'WebImageSearch' quite a lot recently to sample images for my work. However, these functions suddenly stopped working. When I evaluate, for example,
...
- 4,953
0
votes
0
answers
62
views
scrape App Store web data
I want to scrape the privacy information of an app on the web store page.
For example, the Tiktok app information looks like this:
tiktok on us app store
I found that it's easy to scrape that ...
- 601
3
votes
0
answers
893
views
CryptoExchange API (yobit.net) and CloudFlare protection
I want execute http-request to yobit.net. For example:
https://yobit.net/api/3/info
In the browser you must wait 5 second for reload page first time without cookies from yobit.net
In Mathematica:
...
1
vote
0
answers
717
views
How to stream NSE option chain data into mathematica
I'm trying to stream option chain data into mathematica from the
url: https://www.nseindia.com/api/option-chain-indices?symbol=BANKNIFTY
...
- 413
3
votes
1
answer
104
views
Get page source from active web session?
WebExecute allows to control a web browser through Mathematica. There are various actions one can perform programmatically through this function. However, I could ...
- 401k
1
vote
2
answers
98
views
Converting HTML Tables derived from URL's on the Web to Datasets 211112 Revisited
In a previous question [211112] that deals with importing data from a
Wikipedia table directly into a Dataset.
For the following data:
...
- 8,727
1
vote
1
answer
356
views
URLDownload(and URLSave, Import) "Error while processing content unencoding"
I'm downloading a file of exactly 1000K-size (https://gitee.com/WolframPaclet1/WolframPacletExtreme1/raw/master/Paclets/MXNetResources-WIN64-12.0.37.paclet.601) with ...
CommunityBot
- 1
1
vote
0
answers
89
views
How do I get access to the element which is inside a document in iframe?
If the element is not inside an iframe then the following works:
...
- 9,751
1
vote
0
answers
326
views
How to check the status of browser after every WebExecute command?
When executing commands using WebExecute on the $CurrentWebSession like follows:
...
- 9,751
6
votes
2
answers
374
views
Is there a CryptocurrencyData alternative to FinancialData?
What's the easiest way to ingest time series data on cryptocurrencies into Mathematica?
I'm looking for up-to-date price, volume, and other properties for both major coins and altcoins.
- 38k
6
votes
1
answer
659
views
How to continue with my Wolfram cloud basic?
I have this simple question but failed to find an answer on the internet.
So far (over a course of 6 months or so) I am using a free account called: Wolfram cloud basic. I use this to make some 3D ...
