Questions tagged [web-access]

Questions about using Mathematica for accessing web sites and using such functions as URLFetch and URLSave.

Filter by
Sorted by
Tagged with
4
votes
1answer
65 views

Finding Vaccine Appointments in MA

Everyday I spend a crazy amount of time clicking though each maze of hyperlinks and forms on this horrendous site: https://vaxfinder.mass.gov/ Is there anyway that Mathematica can help speed up the ...
30
votes
3answers
4k views

How to manipulate web pages on Mathematica?

I wanted to input some data on this page through Mathematica. Then I would press the "buscar" button also through Mathematica coding and get the results on Mathematica. The most similar post I've ...
7
votes
3answers
2k views

How to parse JSON

please forgive me if this is obvious, but I have some JSON: ...
4
votes
0answers
41 views

Socket not ready but data is available

Background I am playing with https://github.com/arnoudbuzing/wolfram-server and I faced problems with requests that are slightly longer. I tried to narrow it down here. Problem This could be my ...
0
votes
1answer
71 views

Import CSV data from internet to mathematica [closed]

This Link has data in CSV format for 2015 and other years. I would like to get the data for 2015 (by clicking on 2015) but the CSV data format has more rows than Excel can handle and therefore the ...
0
votes
1answer
99 views

URLDownload(and URLSave, Import) “Error while processing content unencoding”

I'm downloading a file of exactly 1000K-size (https://gitee.com/WolframPaclet1/WolframPacletExtreme1/raw/master/Paclets/MXNetResources-WIN64-12.0.37.paclet.601) with ...
12
votes
2answers
673 views

Opening Mathematica file in Google drive

I have a Mathematica file in my Google drive. There is no option to open the Mathematica file directly, without downloading it. Is it possible to directly open the file from Google drive?
1
vote
2answers
96 views

How to use Import to extract data from website?

I would like to extract data of surface properties and grain boundary properties for Cu polymorph #0 from the website: http://crystalium.materialsvirtuallab.org using Mathematica. So far I tried with <...
0
votes
0answers
30 views

Chrome keeps changing the default download folder, Can I use WebExecute to override or otherwise convince Chrome to accept my preference?

I have been pleased to find WebExecute for logging into web sites and downloading data that is updated daily from other sources, but Chrome keeps downloading the files to the factory default /download ...
3
votes
1answer
69 views

Get file downloaded from click in WebSession?

I'm downloading a file by clicking a button from chrome with the WebDriver functionality: ...
11
votes
3answers
5k views

Use Alpha Vantage as an alternative to Yahoo FinancialData, and how to use financial indicators on these data

Alpha Vantage Inc. is a leading provider of free APIs in JSON and CSV formats for real-time and historical stock market data. With the recent glitch of the Yahoo Finance API, and with ...
0
votes
0answers
40 views

Web crawler, where access is needed

I want to make a web crawler and download a bunch of files that are located in different directories on the website. Accessing the files need username and password input as well (the website is https:/...
5
votes
2answers
120 views

How to start an incognito web session?

Is this possible to do with StartWebSession, in either with Chrome or Firefox?
0
votes
0answers
21 views

WebSessionObject from Process

StartWebSession creates a websession which can be controlled with many commands to automate web stuff. It is limited -- what if one wants to include arguments to ...
2
votes
1answer
88 views

Using java-script code in Mathematica

I have the following HTML file stored on "C:\local.html": ...
3
votes
2answers
276 views

How to monitor multiple async image downloads?

I have a few thousand image urls that I want to download asynchronously, how can I do that while monitoring progress? I'm really asking for 5 things: Show dynamic progress in bar Downloads must be ...
0
votes
0answers
23 views

download all the files (pdf, doc, xls..etc _no photos) of a Facebook group just by putting a corresponding group link

I belong to many groups on facebookand in many of them many files are uploaded daily, it is possible with mathematica to download to my pc in a "group" folder all the files of a particular ...
0
votes
0answers
31 views

Expanding website file display ---------show files in full format

Many times looking for some material I find websites that seem to use a format that does not allow the file name to be fully visible. You download the file that you think it is and it turns out that ...
6
votes
2answers
184 views

Curl analog with URLRead/Execute?

I have a working curl command: curl https://myapp.herokuapp.com/doit -F filedata=@path/to/img.jpg How do I write this in the modern way with ...
7
votes
1answer
334 views

How to upload an image to the Stack Exchange Imgur account?

This is not a duplicate of How to call Imgur API. I tried to upload to imgur using its API, but (as my friends test) the API of imgur cannot be called in Chinese mainland. Then I found that ...
3
votes
2answers
165 views

Bug in WebExecute TypeElement with diacritics characters [Solved]

[Solved in 12.1.1] When using WebExecute TypeElement, I get $Failed if I have a diacritics ...
4
votes
1answer
82 views

How to send keys to the element in focus with WebExecute

Exploring the WebExecute function, I would like to know how can I send key (or TypeElement) to the element in focus. Here is a toy code using Google. ...
3
votes
1answer
278 views

FetchUrl status forbbiden when using Wolfram Alpha query

Strange thing here. If I try this with Free-form input: Sqrt[(2^t*Log[2])^2/(1 - 2^(2*t))] I have no problem... But if I try the same expression in the Wolfram ...
1
vote
0answers
69 views

Cannot launch Chrome or Firefox Driver with StartWebSession[]

The Mathematica 12 in my computer cannot launch Chrome or Firefox session correctly. The first error message is ...
2
votes
1answer
131 views

How to use WebExecute to retrieve WebElementObject HTML?

I know that I can use WebExecute to retrieve WebElementObject text, as in this example: ...
0
votes
0answers
82 views

429 error when importing webpage

I am interested in checking which of my favorite groceries are on special at which supermarket before going to the shops (to know which items to buy from which supermarket) but every time I try to ...
28
votes
3answers
8k views

Who is to blame: parsing UTF8 encoded JSON HTTPResponse fails

Bug introduced in 11.0 or earlier and persists through 12.0 (confirmed by WRI Support but read summary below) Answers summary I think we need a quick summary here to justify keeping bug. Original ...
5
votes
0answers
173 views

Decompose website into rectangular grid?

I'd like to take an image of a website and decompose it into a rectangular clustering of dominant pixels like this: What I've tried so far There are a few existing webpage segmentation solutions: ...
4
votes
1answer
95 views

Can Delayed FormFunction redirect to itself (with body)

I want a FormFunction to show a history of inputs, by default an empty list. But once the submit is hit, the form should be reloaded with the history shown on top. ...
2
votes
1answer
366 views

Uploading an image to a CloudDeploy Wolfram Language web app

I want to do image processing using the Wolfram Language on a web app hosted on the Wolfram Cloud. The user must be able to upload a PNG image to the Wolfram Cloud, how can I set this up? I've ...
1
vote
1answer
238 views

Basic API Key authentication not working with URLExecute

I am a newbie with RESTful APIs and have never tried accessing one from inside Mathematica. I am trying to access the Companies House API, in the UK. The following command works fine from the Terminal ...
8
votes
0answers
176 views

Guide to capturing the complete image of given urls?

I'm trying to use WebImage[] to capture the complete image of a website (yes, it might be very tall). I seem to be having some issues with it: How to attempt to capture a complete image of the ...
4
votes
2answers
292 views

SSL errors when using URLFetch or URLSave in versions 8 or 9

It seems that with Mathematica 8 and 9 it is not possible anymore to download files from SSL encrypted urls. In my case (Fedora 30) on Mathematica 8 (it has no ...
2
votes
1answer
118 views

Convert Plot to Base64 [closed]

My goal is to get a Base64 string directly from a plot (or any Graphics object) in Mathematica such that, when using a Base64 decoder online, such as this one, I ...
3
votes
0answers
83 views

Make Mathematica aware of private root certificate authority

I have a private root certificate authority and when I use functions like URLRead[] to connect to a local HTTPS endpoint, I have to add ...
2
votes
1answer
433 views

URLSave in Mathematica 10 and 11 on Linux [closed]

It seems that URLSave doesn't work as expected with https links in Mathematica 10.4 on Linux. At least in my case (Fedora 30) for ...
5
votes
1answer
139 views

Using WebExecute to automatically download data

With WebExcute, I have been able to get access to a particular url https://www.hkex.com.hk/eng/sorc/options/statistics_hv_iv.aspx However, in this url, there is a quite a number of stock code that ...
10
votes
1answer
206 views

Mathematica 12: Failure with URLRead

Bug introduced in 12.0 The following HTTP request fails to submit the body under version 12, but works in Mathematica 11: ...
4
votes
0answers
185 views

Privacy in web-queries [closed]

The question What information is sent to Wolfram Research when loading or working with Mathematica? describes the information sent to Wolfram's servers in routine Mathematica usage (Documentation ...
3
votes
0answers
152 views

How to use Mathematica in Chrome extension?

Now that the wolfram engine is free (for developers), I'd like to know how to use it within a chrome extension. It's easy to make a chrome extension, which is essentially just a JSON file with some ...
0
votes
0answers
77 views

Yahoo groups is going away: how can I download the old messages?

It looks like all the old email messages from my group are stored in web pages with URLs that look like this: ...
1
vote
0answers
85 views

Writing to ElasticSearch [duplicate]

Could someone kindly direct me to suitable documentation, Wolfram or otherwise, to connect Mathematica to an ElasticSearch instance. I don't need anything complicated just sufficient to write a record ...
4
votes
2answers
254 views

Can WebExcute click on a button on a webpage that has been created with Javascript?

In an effort to explore the new WebExecute capabilities in Version 12 I have created a simple algorithm to download some data that are stored on an external server and displayed on a webpage. I am ...
6
votes
1answer
704 views

Can Mathematica run javascript on a website?

One way of running Javascript on a website is to use for instance Greasemonkey. By any chance, would it be possible to execute Javascript commands from Mathematica?
12
votes
1answer
343 views

How to work with ElasticSearch in Mathematica?

Steps to install and run ElasticSearch: install Java (64-bit): https://www.java.com/en/download/manual.jsp download ElasticSearch (https://www.elastic.co/start) and extract archive in ...
13
votes
1answer
228 views

Can I trust URLSubmit?

Bug introduced in 11.2 or earlier and persists through V12.0 [CASE:4026293] confirmed Let's create 10 asynchronous requests which just check if the site is there. ...
2
votes
1answer
144 views

How to extract audio from a Youtube video

Is it possible to extract audio from a Youtube video using Mathematica? I have looked at this post and figured out that it is impossible to download videos with the Youtube API. Are there any possible ...
11
votes
2answers
1k views

Temporarily simulate being offline programmatically

Today I am running Mathematica from a computer that is permanently connected to our university network. Because of a number of reasons, I am not allowed to disconnect my computer from our network. My ...
7
votes
1answer
813 views

web scraping images

I am trying to load player profile pictures from the following page: https://www.transfermarkt.com/manchester-united/startseite/verein/985/saison_id/2006# I use the following code: ...
5
votes
1answer
415 views

Mathematica equivalent of a curl snippet

Is there any documentation anywhere on how to convert an invocation of curl into the Mathematica equivalent (using for example ...

1
2 3 4 5