Questions tagged [web-access]

Questions about using Mathematica for accessing web sites and using such functions as URLFetch and URLSave.

Filter by
Sorted by
Tagged with
3
votes
2answers
112 views

Importing from an API that has non UTF-8 strings

I am new to both Mathematica and API's. I am trying to access a dictionary of player-ids to names from the website datdota.com, but some of them have chinese characters. relevant code: ...
8
votes
1answer
206 views

A tour of AWSLink?

Seems like there are a lot of useful functions in this undocumented package AWSLink: Any developers on here that can demo it a bit?
1
vote
1answer
140 views

Is it possible to embed HTML webpage in a Mathematica notebook?

I am trying to display a webpage as an iframe in Mathematica. The only option I have found is with EmbededHTML, but I can't get it to work for me. Example: <...
13
votes
1answer
204 views

Can I trust URLSubmit?

Bug introduced in 11.2 or earlier and persists through V12.0 [CASE:4026293] confirmed Let's create 10 asynchronous requests which just check if the site is there. ...
3
votes
1answer
175 views

FetchUrl status forbbiden when using Wolfram Alpha query

Strange thing here. If I try this with Free-form input: Sqrt[(2^t*Log[2])^2/(1 - 2^(2*t))] I have no problem... But if I try the same expression in the Wolfram ...
1
vote
0answers
67 views

Truncated tweets texts

I use the Twitter command twitter = ServiceConnect["Twitter", "New"] listTws = twitter["TweetSearch", "Query" -> "Trump", MaxItems -> 10]; For example, the ...
6
votes
1answer
70 views

How to CloudDeploy an APIFunction that takes audio as input?

I have a function whose argument is Audio and I'd like to deploy it as an API (and then call it from Python). This works as with ...
12
votes
3answers
705 views

Get title of a webpage only?

Is it possible to use Mathematica to obtain just the title of a webpage? (I mean the small amount of text that appears in the webpage tab at the top of a browser.) Every standard HTML page must have ...
4
votes
1answer
76 views

URLSubmit handling of query parameters

Bug introduced in 11.2 or earlier and persisting through 11.3 [CASE:4007421] confirmed myApi = CloudDeploy@APIFunction[{"i" -> "Real"}, #i &]; Why does ...
7
votes
1answer
96 views

How to programatically disable internet connectivity

Internet connectivity may cause slows evaluations or cause unexpected problems (particularly in GUIs) when working in an environment with slow Internet or no Internet access at all. I know how to ...
3
votes
0answers
705 views

CryptoExchange API (yobit.net) and CloudFlare protection

I want execute http-request to yobit.net. For example: https://yobit.net/api/3/info In the browser you must wait 5 second for reload page first time without cookies from yobit.net In Mathematica: ...
2
votes
0answers
60 views

Problem accessing NASA images

There seems to be a problem with the last version (11.2 on MacOS X) of Mathematica when trying to access NASA images and APIs using the ServiceConnect paclet here buit by b3m2a1. While paclet ...
1
vote
1answer
75 views

Problem with URLRead[] and URLSubmit[] on Linux

Update I originally thought there was something wrong with my usage of URLRead. But then I switched from my Mathematica instance on Ubuntu 17.10 to an instance on OS X 10.11 and it works fine on OS X....
1
vote
0answers
51 views

Using Iterators within the WebSearch Command

I am currently trying to use the WebSearch command within Mathematica to search names from a Dataset that I have already imported. The names that I am trying to search are located in the 4th column of ...
15
votes
1answer
551 views

Building a GitBook with Mathematica

GitBook is a fun little website that will take Markdown source material and build a little book out of it. How can I use Mathematica to build a GitBook with a minimum of effort?
2
votes
1answer
274 views

Need to generate a Hmac SHA512 string that is 88 characters long rather than 128 [duplicate]

I am trying to authenticate a http request using Mathematica, but i keep getting "Authentication failed" responses. I think the problem is that the Hmac SHA512 I generate is 128 characters long, and ...
2
votes
0answers
649 views

Execute `sendPhoto` to telegram using telegram-bot api

I was create telegram-bot using Mathematica. All the possibilities of telegram api can be found here. To send images, you can use method sendPhoto. To upload image ...
2
votes
1answer
91 views

Extract information from webpage

If you browse this page for instance, you'll notice at the bottom in gray, a line with Contributor: Name < email > Certainly for security reasons, the email does not appear in the source code. ...
3
votes
1answer
83 views

How to refresh or clear cached CloudObjects[]?

cross posted on community.wolfram.com Let's create an API which creates one file each time it is called/accessed: ...
8
votes
1answer
99 views

HTTPRequest syntax problem

Bug introduced in V11.0 and persisting through 11.3 [CASE:3981157] confirmed ...
1
vote
0answers
61 views

Upload notebook to the Cloud and add a download hyperlink in separate cloud objects

cross posted on community.wolfram.com Title say it all, I want to export _Notebook to cloud as a .nb file and make it available to download via hyperlink in different places. This is rather a code-...
3
votes
1answer
107 views

Dynamic WebImageSearch

I am a little bit lost here, I'd be really grateful if someone could help me. :) We are working on a "video" (actually images with transitions). We are having a list of specific words eg.: ...
1
vote
1answer
236 views

Error: Cannot import data as JSON format, Khan Academy API

Problem context I'm updating my working Mathematica Khan Academy reporting application. Since updating to 11.2 I'm having some errors importing via the Khan Academy API as JSON. Update: This ...
4
votes
3answers
2k views

Bing daily wallpaper

Bing has nice images that change daily. How can we download them regularly and also maybe download an archive of previous images? There is an extensive discussion here, can we implement it in ...
7
votes
1answer
148 views

Web search browser in Mathematica

How can we build a system to perform web searches (e.g. Google search) in a notebook so that it looks and functions like a normal search interface operating in the browser?
10
votes
1answer
596 views

How to implement a free version of WebImageSearch?

I really don't like functions that I have to pay for, if they can be implemented for free. Is there a way to get around this pay-wall for WebImageSearch? Perhaps using some other free api or service? ...
3
votes
0answers
65 views

URLDownloadSubmit is not asynchronous?

I'm trying to download a few thousand images (using an authenticated get request). This explanation of parallel downloading was a great answer to the problem of handling massive parallel asynchronous ...
3
votes
1answer
189 views

Paclet server down?

out and unable to connect to the paclet server and Mathematica asking me to log in. Is very annoying and gets worse. Do other users also have this problem?
1
vote
2answers
128 views

How to import only the data table from the census bureau

I have a project that requires me to import data from the census bureau and then take the average of the first two population columns https://www.census.gov/population/international/data/worldpop/...
2
votes
0answers
358 views

Can Mathematica run javascript on a website?

One way of running Javascript on a website is to use for instance Greasemonkey. By any chance, would it be possible to execute Javascript commands from Mathematica?
3
votes
1answer
605 views

API HTTP Request Signing using base64 encoding/decoding and HMAC (Cryptocurrencies Exchange, GDAX)

I am trying to access the GDAX API private methods which can be seen here, GDAX Documentation There is some great Python code that does it that I am trying to recreate in Mathematica. That code can ...
10
votes
2answers
4k views

Use Alpha Vantage as an alternative to Yahoo FinancialData, and how to use financial indicators on these data

Alpha Vantage Inc. is a leading provider of free APIs in JSON and CSV formats for real-time and historical stock market data. With the recent glitch of the Yahoo Finance API, and with ...
0
votes
1answer
75 views

How to detect a website is changed or not?

Such as I want to know the SE is change or not. This is my current method StringLength[Import["https://mathematica.stackexchange.com/"]] ...
10
votes
1answer
279 views

Connect to Socket opened by other applications

In Mathematica 11.2, there are new sockets functions that are potentially very useful in network programming. I'm trying to use it to communicate between Mathematica and some external program, but I'm ...
0
votes
0answers
319 views

“updating from wolfram research server”

I failed to get the information on a website after several attempts, every time Wolfram Mathematica returned "updating from wolfram research server". Could anyone give me any advise? Thanks a lot!!! ...
8
votes
1answer
180 views

How can I use multiple overlaid map layers (e.g. basemap, labels) in GeoGraphics?

We can use GeoServer to use map tiles from an external service. There are many compatible services: Which external services are compatible with GeoServer? These ...
13
votes
3answers
438 views

Which external services are compatible with GeoServer?

Using the GeoServer option, it is possible to load map tiles from external services. Which services are compatible with ...
4
votes
1answer
116 views

URLRead ignores content-encoding:gzip header

Background Taking an example from Decoding GZIP encoded Body, BodyBytes (ByteArray) and BodyBytesArray from URLRead: ...
25
votes
3answers
3k views

Who is to blame: parsing UTF8 encoded JSON HTTPResponse fails

Bug introduced in 11.0 or earlier and persists through 11.3 (confirmed by WRI Support but read summary below) Answers summary I think we need a quick summary here to justify keeping bug. Original ...
2
votes
0answers
77 views

How can I download the score page?

I want to login university educational administration system and download the score page (login->”教务管理信息系统”->”学生所学实际成绩”). A Chinese netizen provided an account number and password. Link: http://jwcas....
5
votes
1answer
288 views

APIFunction can not access HTTP request body when used with URLDispatcher

I noticed a strange behavior regarding the APIFunctionwhen used with URLDispatcher. It does not allow me to access the body of a ...
5
votes
1answer
141 views

Cloud CDF and HTTPRedirect

Cross posted on community.wolfram.com Question and requirements Is it possible to HTTPRedirect from a Cloud CDF via e.g. Button...
0
votes
0answers
43 views

Improve timing of URLExecute command?

I am using a ionosphere model that runs online, IRI2016. The URL gives me a table with usefull parameters like electron density in upper atmosphere. The URLExecute...
1
vote
0answers
70 views

Scraping XML Paragraphs with URLs

I've been working on scraping an article from CNBC. The link is here I want to scrape the main body, and the code I have so far is this: ...
1
vote
0answers
110 views

Why POST be replaced by GET in HTTP request? [closed]

I want to use Chinese Word Segmentation and find this API. sample case work: ...
0
votes
0answers
294 views

HTTP Status Code 403

I'm working with some scraping and have run into a bit of a problem. The website I am scraping is this: https://seekingalpha.com/symbol/CRM/stocktalks I am essentially trying to scrape the "stock ...
1
vote
0answers
79 views

Using Two Arguments on the Same Function

I'm having some trouble wrapping my head around how I would go about using two arguments in one function. In the first section of the code below, I have scraped some "tweets" on the Seeking Alpha ...
7
votes
1answer
492 views

Import the table from an html website

I would like to import the data (table) from this website: http://dr.ittf.com/ittf_ranking/ittf_team_ranking.html I don't know how to import and automatically change the date/year. Let's say, I want ...
1
vote
0answers
69 views

Deal with AJAX when importing websites

I'm currently planning to create a small package to enable Mathematica to manipulate WeChat, a extremely famous chatting software in China. The first step is to get the QRCode on the website, but the ...
3
votes
0answers
247 views

URLFetch parameters interfere with POST

(orig: URLFetch Multipart POST fails to post Body?) Update 2: So after much weeping and gnashing of teeth Mathematica deemed me worthy of figuring out (some of) what was going on. It turns out the ...