Questions tagged [web-access]

Questions about using Mathematica for accessing web sites and using such functions as URLFetch and URLSave.

Filter by
Sorted by
Tagged with
0 votes
0 answers
19 views

Access A Web API Using WebSession [closed]

I am trying to replicate in Wolfram Language the functionality of the following Python code which uses Selenium: ...
  • 307
2 votes
1 answer
175 views

Access openai with HTTPRequest but body parameters seems not function

Using Mathematica 13.0 on Windows 10 codes are below ...
3 votes
1 answer
59 views

What crops the response from the SocketListen based web server?

I noticed that when the response length passes around 1k characters then it is cut at weird lengths: 424, 936 or 1448 characters. Response is generated correctly but then it is cut so if the body was ...
  • 135k
1 vote
0 answers
95 views

Terms of use for functions that access data over the internet

Please excuse, as this is not a question about how to use a specific Mathematica function or solve some specific problem with Mathematica. But, a correct and comprehensive answer might be of interest ...
1 vote
0 answers
68 views

Is it possible to build a small web site with vanilla Mathematica? How about a web server?

Note: This question is not about WebMathematica. I speculate it is capable of doing everything about to be discussed. With its diverse capabilities and near endless ...
  • 2,337
6 votes
1 answer
214 views

Create a function that takes a symbol and searches wolfram documentation for the page and opens it

This is way over my pay-grade, so I have no idea where to start. I'm certain MMA has some very good internet capabilities, so it seems to me that it is possible. This is really a 2-part question: How ...
  • 2,337
2 votes
1 answer
87 views

Implementing Web Form to collect data but users must authenticate first

I’m trying to implement a web form to collect data into a databin, but I need users authenticate first (nothing fancy, predefined usernames and password are fine), so I could collect every user data. ...
0 votes
1 answer
63 views

How to obtain stock information from a website

I want to obtain some information of stock markets from TradingView website. For instance, let us access to S&P index chart through the URL, https://www.tradingview.com/chart/?symbol=SP%3ASPX Now, ...
3 votes
0 answers
40 views

How to insert input into Jupyter notebook using WebExecute

I started web session and opened a Jupyter notebook in it: ...
  • 5,915
6 votes
1 answer
238 views

Make Mathematica input things on a website and take the data out

So I found a website that calculates polynomials that I need it intakes a word of a's and b's say aabba and outputs a polynomial. Here is the website: http://www.math.stonybrook.edu/~moira/NewApps/...
  • 647
0 votes
1 answer
59 views

HTTPRequest result confusion

everyone! I've been using Mathematica to progress through the problems of codeabbey.com, and I've picked up the first of "interactive" problems (Problem #176 - Say 100), which is sort of an ...
3 votes
2 answers
84 views

Character encoding of the output from URLExecute

Bug persisting through 13.1.0 [CASE:4932406] I'm using URLExecute to fetch some data from the arXiv preprint server but it seems that the encoding of the text I ...
  • 3,427
1 vote
2 answers
715 views

Getting stock quotes from Yahoo Finance API in Mathematica

I have obtained a Yahoo Finance API key and would like to try it out by making a simple request from within Mathematica. Their tutorial page has some nice little example code snippets in various ...
1 vote
1 answer
151 views

Looking for a WebExecute workaround

A website opens properly with SystemOpen["url"] but fails to open properly with StartWebSession[] or ...
  • 78
0 votes
0 answers
85 views

WebSearch Stopped Working

I've been using 'WebSearch' and 'WebImageSearch' quite a lot recently to sample images for my work. However, these functions suddenly stopped working. When I evaluate, for example, ...
  • 4,362
0 votes
0 answers
47 views

scrape App Store web data

I want to scrape the privacy information of an app on the web store page. For example, the Tiktok app information looks like this: tiktok on us app store I found that it's easy to scrape that ...
  • 601
2 votes
1 answer
76 views

Get page source from active web session?

WebExecute allows to control a web browser through Mathematica. There are various actions one can perform programmatically through this function. However, I could ...
  • 11.7k
1 vote
2 answers
83 views

Converting HTML Tables derived from URL's on the Web to Datasets 211112 Revisited

In a previous question [211112] that deals with importing data from a Wikipedia table directly into a Dataset. For the following data: ...
  • 1,576
1 vote
0 answers
437 views

How to stream NSE option chain data into mathematica

I'm trying to stream option chain data into mathematica from the url: https://www.nseindia.com/api/option-chain-indices?symbol=BANKNIFTY ...
  • 403
1 vote
0 answers
62 views

How do I get access to the element which is inside a document in iframe?

If the element is not inside an iframe then the following works: ...
  • 8,667
1 vote
0 answers
235 views

How to check the status of browser after every WebExecute command?

When executing commands using WebExecute on the $CurrentWebSession like follows: ...
  • 8,667
3 votes
1 answer
197 views

How to select from a dropdown list in WebExecute?

After locating the dropdown using the XPath as follows: element=First@WebExecute["LocateElements"->"XPath"->"..."]; How do I ...
  • 8,667
2 votes
0 answers
113 views

BlockchainBlockData request limit exceeded

I'm trying to replicate this Blog entry on Bitcoin queries: https://blog.wolfram.com/2021/05/25/sleuthing-darkside-crypto-ransom-payments-with-the-wolfram-language/ However, I don't get very far ...
  • 601
6 votes
1 answer
416 views

How to continue with my Wolfram cloud basic?

I have this simple question but failed to find an answer on the internet. So far (over a course of 6 months or so) I am using a free account called: Wolfram cloud basic. I use this to make some 3D ...
  • 61
6 votes
2 answers
250 views

Is there a CryptocurrencyData alternative to FinancialData?

What's the easiest way to ingest time series data on cryptocurrencies into Mathematica? I'm looking for up-to-date price, volume, and other properties for both major coins and altcoins.
  • 3,637
1 vote
1 answer
103 views

interact with web pages with many hyperlinks and search for a specific name or phrase How?

I have this code that shows many hyperlinks links = Import[ "http://www.liceobrainstorm.cl/wp-content/uploads/2020/07/", "Hyperlinks"] ...
  • 480
0 votes
0 answers
84 views

Scroll to end of page with WebExecute

I want to scrape the data from this url : https://www.cboe.com/us/indices/indicessearch/ In so doing , I need to scroll to the end of page. Is there a way to use WebExecute to scroll to end of page ? ...
  • 187
13 votes
1 answer
282 views

Easily download SE posts as notebooks?

Is there a common method of grabbing an SE post or answer here as a formatted notebook so that you can immediately run it, instead of copy-pasting the code blocks? I've heard SSE uses MarkdownSharp ...
  • 30.8k
2 votes
0 answers
64 views

how to get world-wide COVID-19 data in a correct form

I have the following code for retrieving world-wide COVID-19 data. ...
  • 4,823
2 votes
1 answer
353 views

How to import a google sheets file that requires account login?

How do I import a google sheets file that is in my google drive? I tried the following: ...
  • 8,667
1 vote
0 answers
66 views

Can Google Earth images be imported?

I've searched for code and found nothing. Is this a server handshake problem? Below, GeoGraphics executes properly on wikimapia.org, but WebImage doesn't open earth.google.com to a coordinate. ...
  • 583
4 votes
1 answer
144 views

Finding Vaccine Appointments in MA

Everyday I spend a crazy amount of time clicking though each maze of hyperlinks and forms on this horrendous site: https://vaxfinder.mass.gov/ Is there anyway that Mathematica can help speed up the ...
  • 3,637
4 votes
0 answers
75 views

Socket not ready but data is available

Background I am playing with https://github.com/arnoudbuzing/wolfram-server and I faced problems with requests that are slightly longer. I tried to narrow it down here. Problem This could be my ...
  • 135k
0 votes
1 answer
122 views

Import CSV data from internet to mathematica [closed]

This Link has data in CSV format for 2015 and other years. I would like to get the data for 2015 (by clicking on 2015) but the CSV data format has more rows than Excel can handle and therefore the ...
  • 4,823
1 vote
2 answers
183 views

How to use Import to extract data from website?

I would like to extract data of surface properties and grain boundary properties for Cu polymorph #0 from the website: http://crystalium.materialsvirtuallab.org using Mathematica. So far I tried with <...
  • 464
3 votes
1 answer
118 views

Get file downloaded from click in WebSession?

I'm downloading a file by clicking a button from chrome with the WebDriver functionality: ...
  • 30.8k
5 votes
2 answers
175 views

How to start an incognito web session?

Is this possible to do with StartWebSession, in either with Chrome or Firefox?
  • 3,637
0 votes
0 answers
34 views

WebSessionObject from Process

StartWebSession creates a websession which can be controlled with many commands to automate web stuff. It is limited -- what if one wants to include arguments to ...
  • 3,206
2 votes
1 answer
225 views

Using java-script code in Mathematica

I have the following HTML file stored on "C:\local.html": ...
  • 5,915
4 votes
2 answers
342 views

How to monitor multiple async image downloads?

I have a few thousand image urls that I want to download asynchronously, how can I do that while monitoring progress? I'm really asking for 5 things: Show dynamic progress in bar Downloads must be ...
  • 30.8k
0 votes
0 answers
32 views

Expanding website file display ---------show files in full format

Many times looking for some material I find websites that seem to use a format that does not allow the file name to be fully visible. You download the file that you think it is and it turns out that ...
7 votes
2 answers
331 views

Curl analog with URLRead/Execute?

I have a working curl command: curl https://myapp.herokuapp.com/doit -F filedata=@path/to/img.jpg How do I write this in the modern way with ...
  • 30.8k
5 votes
1 answer
259 views

How to send keys to the element in focus with WebExecute

Exploring the WebExecute function, I would like to know how can I send key (or TypeElement) to the element in focus. Here is a toy code using Google. ...
  • 25.8k
1 vote
1 answer
248 views

URLDownload(and URLSave, Import) "Error while processing content unencoding"

I'm downloading a file of exactly 1000K-size (https://gitee.com/WolframPaclet1/WolframPacletExtreme1/raw/master/Paclets/MXNetResources-WIN64-12.0.37.paclet.601) with ...
3 votes
2 answers
229 views

Bug in WebExecute TypeElement with diacritics characters [Solved]

[Solved in 12.1.1] When using WebExecute TypeElement, I get $Failed if I have a diacritics ...
  • 25.8k
4 votes
1 answer
105 views

Can Delayed FormFunction redirect to itself (with body)

I want a FormFunction to show a history of inputs, by default an empty list. But once the submit is hit, the form should be reloaded with the history shown on top. ...
  • 135k
2 votes
0 answers
212 views

Cannot launch Chrome or Firefox Driver with StartWebSession[]

The Mathematica 12 in my computer cannot launch Chrome or Firefox session correctly. The first error message is ...
2 votes
1 answer
789 views

Basic API Key authentication not working with URLExecute

I am a newbie with RESTful APIs and have never tried accessing one from inside Mathematica. I am trying to access the Companies House API, in the UK. The following command works fine from the Terminal ...
  • 455
5 votes
0 answers
218 views

Decompose website into rectangular grid?

I'd like to take an image of a website and decompose it into a rectangular clustering of dominant pixels like this: What I've tried so far There are a few existing webpage segmentation solutions: ...
  • 30.8k
3 votes
0 answers
93 views

Make Mathematica aware of private root certificate authority

I have a private root certificate authority and when I use functions like URLRead[] to connect to a local HTTPS endpoint, I have to add ...
  • 1,039

1
2 3 4 5 6