Skip to main content

Questions tagged [web-access]

Questions about using Mathematica for accessing web sites and using such functions as URLFetch and URLSave.

Filter by
Sorted by
Tagged with
1 vote
0 answers
18 views

How to authenticate herself to the openai api service when using URLExecute?

I have tried the canonical example (with the real API Key) ...
Slepecky Mamut's user avatar
3 votes
0 answers
134 views

How to get satellite image directly from Mathematica?

First, I get the image of the bands of the desired area from the site https://earthexplorer.usgs.gov/, then I import the images into Mathmatica by addressing them as below: Select dataset directory: <...
Erfan's user avatar
  • 169
1 vote
0 answers
91 views

HTTPRequest append cookies data but not working

First I use ClearCookies[All]; ck = URLRead @ HTTPRequest["https://wolfram.com",CookieFunction->Print] to get an example of cookies. Then I save the ...
Schwarzer's user avatar
3 votes
1 answer
211 views

What does this error message about chromedriver mean?

I have been using WebSession to drive a Chrome browser for automation purposes. I'm running Mathematica 13.2 on Ubuntu Linux. Occasionally, my Chrome browser gets updated by an automatic OS process. ...
Jim Marks's user avatar
  • 187
3 votes
1 answer
530 views

Access openai with HTTPRequest but body parameters seems not function

Using Mathematica 13.0 on Windows 10 codes are below ...
Schwarzer's user avatar
3 votes
1 answer
69 views

What crops the response from the SocketListen based web server?

I noticed that when the response length passes around 1k characters then it is cut at weird lengths: 424, 936 or 1448 characters. Response is generated correctly but then it is cut so if the body was ...
Kuba's user avatar
  • 137k
1 vote
0 answers
105 views

Terms of use for functions that access data over the internet

Please excuse, as this is not a question about how to use a specific Mathematica function or solve some specific problem with Mathematica. But, a correct and comprehensive answer might be of interest ...
Jürgen Böhm's user avatar
4 votes
1 answer
148 views

Is it possible to build a small web site with vanilla Mathematica? How about a web server?

Note: This question is not about WebMathematica. I speculate it is capable of doing everything about to be discussed. With its diverse capabilities and near endless ...
Jules Manson's user avatar
  • 2,467
6 votes
1 answer
231 views

Create a function that takes a symbol and searches wolfram documentation for the page and opens it

This is way over my pay-grade, so I have no idea where to start. I'm certain MMA has some very good internet capabilities, so it seems to me that it is possible. This is really a 2-part question: How ...
Jules Manson's user avatar
  • 2,467
3 votes
1 answer
98 views

Implementing Web Form to collect data but users must authenticate first

I’m trying to implement a web form to collect data into a databin, but I need users authenticate first (nothing fancy, predefined usernames and password are fine), so I could collect every user data. ...
eqzdavid's user avatar
0 votes
1 answer
121 views

How to obtain stock information from a website

I want to obtain some information of stock markets from TradingView website. For instance, let us access to S&P index chart through the URL, https://www.tradingview.com/chart/?symbol=SP%3ASPX Now, ...
cheese.burger's user avatar
3 votes
0 answers
62 views

How to insert input into Jupyter notebook using WebExecute

I started web session and opened a Jupyter notebook in it: ...
azerbajdzan's user avatar
  • 19.7k
6 votes
1 answer
266 views

Make Mathematica input things on a website and take the data out

So I found a website that calculates polynomials that I need it intakes a word of a's and b's say aabba and outputs a polynomial. Here is the website: http://www.math.stonybrook.edu/~moira/NewApps/...
2132123's user avatar
  • 657
0 votes
1 answer
62 views

HTTPRequest result confusion

everyone! I've been using Mathematica to progress through the problems of codeabbey.com, and I've picked up the first of "interactive" problems (Problem #176 - Say 100), which is sort of an ...
Κωστής Καρβουνιάρης's user avatar
3 votes
2 answers
97 views

Character encoding of the output from URLExecute

Bug persisting through 13.1.0 [CASE:4932406] I'm using URLExecute to fetch some data from the arXiv preprint server but it seems that the encoding of the text I ...
vsht's user avatar
  • 3,527
2 votes
2 answers
1k views

Getting stock quotes from Yahoo Finance API in Mathematica

I have obtained a Yahoo Finance API key and would like to try it out by making a simple request from within Mathematica. Their tutorial page has some nice little example code snippets in various ...
user143410's user avatar
1 vote
3 answers
249 views

Looking for a WebExecute workaround

A website opens properly with SystemOpen["url"] but fails to open properly with StartWebSession[] or ...
jcm's user avatar
  • 78
0 votes
0 answers
112 views

WebSearch Stopped Working

I've been using 'WebSearch' and 'WebImageSearch' quite a lot recently to sample images for my work. However, these functions suddenly stopped working. When I evaluate, for example, ...
sam wolfe's user avatar
  • 4,873
0 votes
0 answers
57 views

scrape App Store web data

I want to scrape the privacy information of an app on the web store page. For example, the Tiktok app information looks like this: tiktok on us app store I found that it's easy to scrape that ...
spore234's user avatar
  • 601
3 votes
1 answer
91 views

Get page source from active web session?

WebExecute allows to control a web browser through Mathematica. There are various actions one can perform programmatically through this function. However, I could ...
Kagaratsch's user avatar
1 vote
2 answers
95 views

Converting HTML Tables derived from URL's on the Web to Datasets 211112 Revisited

In a previous question [211112] that deals with importing data from a Wikipedia table directly into a Dataset. For the following data: ...
Stuart Poss's user avatar
  • 1,893
1 vote
0 answers
685 views

How to stream NSE option chain data into mathematica

I'm trying to stream option chain data into mathematica from the url: https://www.nseindia.com/api/option-chain-indices?symbol=BANKNIFTY ...
csk 7's user avatar
  • 403
1 vote
0 answers
83 views

How do I get access to the element which is inside a document in iframe?

If the element is not inside an iframe then the following works: ...
user13892's user avatar
  • 9,483
1 vote
0 answers
315 views

How to check the status of browser after every WebExecute command?

When executing commands using WebExecute on the $CurrentWebSession like follows: ...
user13892's user avatar
  • 9,483
3 votes
1 answer
313 views

How to select from a dropdown list in WebExecute?

After locating the dropdown using the XPath as follows: element=First@WebExecute["LocateElements"->"XPath"->"..."]; How do I ...
user13892's user avatar
  • 9,483
2 votes
0 answers
121 views

BlockchainBlockData request limit exceeded

I'm trying to replicate this Blog entry on Bitcoin queries: https://blog.wolfram.com/2021/05/25/sleuthing-darkside-crypto-ransom-payments-with-the-wolfram-language/ However, I don't get very far ...
spore234's user avatar
  • 601
6 votes
1 answer
579 views

How to continue with my Wolfram cloud basic?

I have this simple question but failed to find an answer on the internet. So far (over a course of 6 months or so) I am using a free account called: Wolfram cloud basic. I use this to make some 3D ...
Nguyen's user avatar
  • 61
6 votes
2 answers
344 views

Is there a CryptocurrencyData alternative to FinancialData?

What's the easiest way to ingest time series data on cryptocurrencies into Mathematica? I'm looking for up-to-date price, volume, and other properties for both major coins and altcoins.
user5601's user avatar
  • 3,675
1 vote
1 answer
115 views

interact with web pages with many hyperlinks and search for a specific name or phrase How?

I have this code that shows many hyperlinks links = Import[ "http://www.liceobrainstorm.cl/wp-content/uploads/2020/07/", "Hyperlinks"] ...
BeTDa's user avatar
  • 490
1 vote
0 answers
115 views

Scroll to end of page with WebExecute

I want to scrape the data from this url : https://www.cboe.com/us/indices/indicessearch/ In so doing , I need to scroll to the end of page. Is there a way to use WebExecute to scroll to end of page ? ...
Akcmok's user avatar
  • 197
14 votes
1 answer
293 views

Easily download SE posts as notebooks?

Is there a common method of grabbing an SE post or answer here as a formatted notebook so that you can immediately run it, instead of copy-pasting the code blocks? I've heard SSE uses MarkdownSharp ...
M.R.'s user avatar
  • 31.6k
2 votes
0 answers
71 views

how to get world-wide COVID-19 data in a correct form

I have the following code for retrieving world-wide COVID-19 data. ...
Tugrul Temel's user avatar
  • 6,233
2 votes
1 answer
623 views

How to import a google sheets file that requires account login?

How do I import a google sheets file that is in my google drive? I tried the following: ...
user13892's user avatar
  • 9,483
1 vote
0 answers
72 views

Can Google Earth images be imported?

I've searched for code and found nothing. Is this a server handshake problem? Below, GeoGraphics executes properly on wikimapia.org, but WebImage doesn't open earth.google.com to a coordinate. ...
Youvan's user avatar
  • 613
5 votes
1 answer
154 views

Finding Vaccine Appointments in MA

Everyday I spend a crazy amount of time clicking though each maze of hyperlinks and forms on this horrendous site: https://vaxfinder.mass.gov/ Is there anyway that Mathematica can help speed up the ...
user5601's user avatar
  • 3,675
4 votes
0 answers
96 views

Socket not ready but data is available

Background I am playing with https://github.com/arnoudbuzing/wolfram-server and I faced problems with requests that are slightly longer. I tried to narrow it down here. Problem This could be my ...
Kuba's user avatar
  • 137k
0 votes
1 answer
140 views

Import CSV data from internet to mathematica [closed]

This Link has data in CSV format for 2015 and other years. I would like to get the data for 2015 (by clicking on 2015) but the CSV data format has more rows than Excel can handle and therefore the ...
Tugrul Temel's user avatar
  • 6,233
2 votes
2 answers
275 views

How to use Import to extract data from website?

I would like to extract data of surface properties and grain boundary properties for Cu polymorph #0 from the website: http://crystalium.materialsvirtuallab.org using Mathematica. So far I tried with <...
Ferca's user avatar
  • 504
3 votes
1 answer
136 views

Get file downloaded from click in WebSession?

I'm downloading a file by clicking a button from chrome with the WebDriver functionality: ...
M.R.'s user avatar
  • 31.6k
5 votes
2 answers
186 views

How to start an incognito web session?

Is this possible to do with StartWebSession, in either with Chrome or Firefox?
user5601's user avatar
  • 3,675
0 votes
0 answers
34 views

WebSessionObject from Process

StartWebSession creates a websession which can be controlled with many commands to automate web stuff. It is limited -- what if one wants to include arguments to ...
Adam's user avatar
  • 3,956
2 votes
1 answer
323 views

Using java-script code in Mathematica

I have the following HTML file stored on "C:\local.html": ...
azerbajdzan's user avatar
  • 19.7k
4 votes
2 answers
372 views

How to monitor multiple async image downloads?

I have a few thousand image urls that I want to download asynchronously, how can I do that while monitoring progress? I'm really asking for 5 things: Show dynamic progress in bar Downloads must be ...
M.R.'s user avatar
  • 31.6k
0 votes
0 answers
32 views

Expanding website file display ---------show files in full format

Many times looking for some material I find websites that seem to use a format that does not allow the file name to be fully visible. You download the file that you think it is and it turns out that ...
juan muñoz's user avatar
7 votes
2 answers
389 views

Curl analog with URLRead/Execute?

I have a working curl command: curl https://myapp.herokuapp.com/doit -F filedata=@path/to/img.jpg How do I write this in the modern way with ...
M.R.'s user avatar
  • 31.6k
5 votes
1 answer
354 views

How to send keys to the element in focus with WebExecute

Exploring the WebExecute function, I would like to know how can I send key (or TypeElement) to the element in focus. Here is a toy code using Google. ...
Murta's user avatar
  • 26.3k
1 vote
1 answer
319 views

URLDownload(and URLSave, Import) "Error while processing content unencoding"

I'm downloading a file of exactly 1000K-size (https://gitee.com/WolframPaclet1/WolframPacletExtreme1/raw/master/Paclets/MXNetResources-WIN64-12.0.37.paclet.601) with ...
bcegkmqs23's user avatar
3 votes
2 answers
243 views

Bug in WebExecute TypeElement with diacritics characters [Solved]

[Solved in 12.1.1] When using WebExecute TypeElement, I get $Failed if I have a diacritics ...
Murta's user avatar
  • 26.3k
5 votes
1 answer
111 views

Can Delayed FormFunction redirect to itself (with body)

I want a FormFunction to show a history of inputs, by default an empty list. But once the submit is hit, the form should be reloaded with the history shown on top. ...
Kuba's user avatar
  • 137k
2 votes
0 answers
248 views

Cannot launch Chrome or Firefox Driver with StartWebSession[]

The Mathematica 12 in my computer cannot launch Chrome or Firefox session correctly. The first error message is ...
shrubbroom's user avatar

1
2 3 4 5 6