Questions tagged [web-access]

Questions about using Mathematica for accessing web sites and using such functions as URLFetch and URLSave.

Filter by
Sorted by
Tagged with
50
votes
1answer
3k views

Google Map in Notebooks?

GoogleMaps are implemented as HTML and Javascript code which can be viewed by a web browser. Is it possible to load this map into the Mathematica notebook, which obviously means for example that <...
48
votes
8answers
2k views

Is it possible to invoke the OEIS from Mathematica?

I had always wondered if there might be a way to write a function, which I'll call OEISData[], that more or less works as a curated data function for The On-Line ...
44
votes
1answer
3k views

Web Browsing Automation with Mathematica

I want to build a bot to automate web browsing, this mean something like: filling forms press "submit" buttons find certain text inside pages and so on... How can I do this with Mathematica? The <...
43
votes
3answers
4k views

How to do http POST in Mathematica?

The Import command lets you do a HTTP GET from a URL, like this Import @ "http://merkosoncampus.com/wp-content/uploads/2011/05/higgs-boson.jpg" This sends an ...
30
votes
2answers
664 views

Reading from a socket stream

I noticed an undocumented socket package (SocketLink) in Mathematica (Using version 10, not sure when it was actually added) and wrote a barebones HTTP responder ...
29
votes
3answers
4k views

Export to Google Spreadsheet with OAuthAuthentication

Context I'm trying to setup a connection between Mathematica and Google Docs. Specifically, I would like to be able to export data to a Google Spreadsheet (Note: if the spreadsheet is public it's ...
25
votes
3answers
4k views

Who is to blame: parsing UTF8 encoded JSON HTTPResponse fails

Bug introduced in 11.0 or earlier and persists through 11.3 (confirmed by WRI Support but read summary below) Answers summary I think we need a quick summary here to justify keeping bug. Original ...
22
votes
1answer
809 views

Can Mathematica act like a web server?

I have a Mathematica program that modifies images that I would like to make available for other people to use through the web. The input is only one parameter. So, for example, I could run it as a ...
21
votes
1answer
207 views

Upload from Mathematica to YouTube

I'd like to take some little videos I made in Mathematica and put them on YouTube. Is there a way to do this?
19
votes
2answers
1k views

Encrypt the password used for SendMail

I want Mathematica to send me an email when the computation is finished. To that end, I have a cell with SendMail[...] which I place behind my computation in the ...
17
votes
1answer
271 views

How can I get every function a user has made on StackExchange?

Yesterday I was looking at one of Henrik Schumacher's answers and realizing that it'd be useful to some of these functions more accessible for reuse. Copy-and-paste is nice, but better would be a ...
16
votes
3answers
373 views

How do I put my packages into Dropbox

I don't want to necessarily put my packages in Mathematica's $UserBaseDirectory, which is on my local hard drive. Can I somehow tell Mathematica to look for ...
15
votes
1answer
555 views

Building a GitBook with Mathematica

GitBook is a fun little website that will take Markdown source material and build a little book out of it. How can I use Mathematica to build a GitBook with a minimum of effort?
15
votes
2answers
712 views

How do you submit an Input type of “file” using URLExecute?

I have to submit a form like as follows: <input type="file" name="jpgFile"> I can't seem to find any instructions on sending this in URLExecute. If I ...
14
votes
2answers
533 views

Does Mathematica support deep links?

So GitHub sent me on quite the journey, after it opened its desktop app from my browser. Copying the link I found something looking like: "github-mac://...". I ...
13
votes
3answers
466 views

Which external services are compatible with GeoServer?

Using the GeoServer option, it is possible to load map tiles from external services. Which services are compatible with ...
13
votes
3answers
1k views

How to use URLFetch for a https secure automated login?

UPDATE 9 March 2017: I added a bounty to this question, I think it is a hard and challenging problem and can prove that Mathematica is capable of almost anything. Sadly user1473011's answer does not ...
13
votes
1answer
208 views

Can I trust URLSubmit?

Bug introduced in 11.2 or earlier and persists through V12.0 [CASE:4026293] confirmed Let's create 10 asynchronous requests which just check if the site is there. ...
12
votes
3answers
708 views

Get title of a webpage only?

Is it possible to use Mathematica to obtain just the title of a webpage? (I mean the small amount of text that appears in the webpage tab at the top of a browser.) Every standard HTML page must have ...
12
votes
4answers
578 views

How do you get a list of filenames from a URL?

How would I get a list of filenames available at a URL? For example, list the files at: http://www1.ncdc.noaa.gov/pub/data/cmb/drought/weekly-palmers/2005/
12
votes
0answers
190 views

Is it possible to search the web by image from Mathematica?

Is it possible to perform a web search based on an image input? There are several services that provide this: Google, Bing, TinEye, and maybe others. I am not sure which can be accessed ...
11
votes
2answers
1k views

Temporarily simulate being offline programmatically

Today I am running Mathematica from a computer that is permanently connected to our university network. Because of a number of reasons, I am not allowed to disconnect my computer from our network. My ...
11
votes
2answers
157 views

How to show Plots or Graphics in mini MMA HTTP Server?

I learned some codes to make a mini HTTP server in MMA way here. ...
11
votes
2answers
1k views

Look up info associated with a given CAS chemical identifier from the NIST webbook & NCI CADD Chemical Identifier Resolver

I would like to retrieve information associated with a given CAS registry number (Chemical Abstracts Service nr) from the NIST webbook web site in Mathematica, using the provided API (e.g. for ...
11
votes
1answer
269 views

How to work with ElasticSearch in Mathematica?

Steps to install and run ElasticSearch: install Java (64-bit): https://www.java.com/en/download/manual.jsp download ElasticSearch (https://www.elastic.co/start) and extract archive in ...
11
votes
1answer
952 views

Parse website data that requires interaction with a form (POST)

I want to analyse Chilean elections data available in the official website. What I have returns the data for president (numbers are strings, to be parsed later). ...
10
votes
3answers
667 views

How to make a picture grid of all Nobel Laureates in physics?

I want to make a picture grid of all Nobel Laureates in physics using mathematica. Later I wanna print this picture grid on a big wall! The first thought I came up with is to exploit the powerful ...
10
votes
2answers
4k views

Use Alpha Vantage as an alternative to Yahoo FinancialData, and how to use financial indicators on these data

Alpha Vantage Inc. is a leading provider of free APIs in JSON and CSV formats for real-time and historical stock market data. With the recent glitch of the Yahoo Finance API, and with ...
10
votes
1answer
292 views

Connect to Socket opened by other applications

In Mathematica 11.2, there are new sockets functions that are potentially very useful in network programming. I'm trying to use it to communicate between Mathematica and some external program, but I'm ...
10
votes
1answer
608 views

How to implement a free version of WebImageSearch?

I really don't like functions that I have to pay for, if they can be implemented for free. Is there a way to get around this pay-wall for WebImageSearch? Perhaps using some other free api or service? ...
10
votes
1answer
118 views

Mathematica 12: Failure with URLRead

Bug introduced in 12.0 The following HTTP request fails to submit the body under version 12, but works in Mathematica 11: ...
10
votes
0answers
107 views

URL functions overload

All these functions seem capable of doing the same things: Import, URLFetch, URLSave, ...
9
votes
1answer
1k views

How to execute JavaScipt on a webpage and then import the result on OSX?

I would like to import data from this page through Mathematica, http://www.oddsportal.com/soccer/netherlands/eredivisie/ . I tried importing through the default Import function ...
9
votes
2answers
1k views

How can I commit files to Github by Mathematica?

How can I publish Notebooks to Github via using Mathematica? I'm on windows 8.1 x64, Mathematica 9. How can I upload the current notebook to Github? My function expected is: ...
9
votes
1answer
268 views

Import data from dynamically generated webpage

I'm trying to get data from a web-page data=Import["https://stats.nba.com/team/1610612738/traditional/", "Data"] It returns only a textual information. ...
8
votes
2answers
459 views

Lookup in Inverse Symbolic Calculator+ from Mathematica

There is a useful feature in WolframAlpha that allows to find a possible closed form for approximate numeric values. It can be used, for example, to guess the value of an integral that Mathematica ...
8
votes
1answer
416 views

Importing images from the web using ImportString & URLFetch

I can bring images from the web using the Import command like this: Import["http://blog.wolfram.com/wp-content/uploads/2008/06/se-30.jpg"] Sometimes the web ...
8
votes
1answer
296 views

What is the equivalent of curl?

The URL related functions have confused me yet again (I have v11.1)! What is the Mathematica equivalent for the following generic curl command? ...
8
votes
2answers
200 views

Is it possible to verify the accuracy of a file downloaded using URLFetch

Objective: I am trying to save a HTML file using the URLFetch function (native to Mathematica 9 onward). Sometimes the file is huge. Question: Is there a way to check/verify (using the headers or ...
8
votes
1answer
211 views

A tour of AWSLink?

Seems like there are a lot of useful functions in this undocumented package AWSLink: Any developers on here that can demo it a bit?
8
votes
1answer
792 views

More complete “MutipartData” POSTs using URLFetch

I'm trying to upload a file to a wiki using Mathematica's URLFetch. Some preliminary work is required - one needs to log in to the wiki, obtain an edit token, and ...
8
votes
1answer
186 views

How can I use multiple overlaid map layers (e.g. basemap, labels) in GeoGraphics?

We can use GeoServer to use map tiles from an external service. There are many compatible services: Which external services are compatible with GeoServer? These ...
8
votes
1answer
161 views

Inconsistent Authorization Dialog (401) handling

Bug introduced in V11 and fixed in 11.3 [CASE:3855554] was created [...] It does appear that the URLRead is not behaving correctly. I have forwarded an incident report to our developers with ...
8
votes
1answer
2k views

Download Youtube Videos

Is there a way to display or download youtube videos in Mathematica. Youtube is HTML5 enabled so I am hopeful there might be an easy way.
8
votes
1answer
207 views

Scrape AJAX Website with Webdriver

I hope the new Webdriver functionality can help as the normal Import and HTTPRequest don't work. The sites I have found are a ...
8
votes
1answer
102 views

HTTPRequest syntax problem

Bug introduced in V11.0 and persisting through 11.3 [CASE:3981157] confirmed ...
8
votes
1answer
194 views

Authentication dialog for URLDownload / URLSave

Bug introduced in 11.0 and persists through 11.3 The original problem is was fixed in V11.2 but since then it returns File[path/to/file/that/does/not/exits] ...
7
votes
1answer
749 views

web scraping images

I am trying to load player profile pictures from the following page: https://www.transfermarkt.com/manchester-united/startseite/verein/985/saison_id/2006# I use the following code: ...
7
votes
1answer
132 views

How to cache results of WebImageSearch?

Every call to WebImageSearch costs money (wolfram service credits), thus, I would like to page through results without having to redownload them. Given the ...
7
votes
1answer
153 views

Web search browser in Mathematica

How can we build a system to perform web searches (e.g. Google search) in a notebook so that it looks and functions like a normal search interface operating in the browser?