Questions tagged [web-access]
Questions about using Mathematica for accessing web sites and using such functions as URLFetch and URLSave.
266 questions
1
vote
1
answer
158
views
Problem with URLRead[] and URLSubmit[] on Linux
Update
I originally thought there was something wrong with my usage of URLRead. But then I switched from my Mathematica instance on Ubuntu 17.10 to an instance on OS X 10.11 and it works fine on OS X....
- 1,079
7
votes
1
answer
137
views
How to CloudDeploy an APIFunction that takes audio as input?
I have a function whose argument is Audio and I'd like to deploy it as an API (and then call it from Python). This works as with ...
- 138k
13
votes
3
answers
1k
views
Get title of a webpage only?
Is it possible to use Mathematica to obtain just the title of a webpage? (I mean the small amount of text that appears in the webpage tab at the top of a browser.)
Every standard HTML page must have ...
- 9,568
3
votes
1
answer
287
views
Parsing JavaScript Script from XML Trees
I've been trying to parse some script written in JavaScript while scraping a website, and am a little confused what functions are needed to get this done in Mathematica.
I imported the data using <...
- 1
8
votes
1
answer
271
views
How to programatically disable internet connectivity
Internet connectivity may cause slows evaluations or cause unexpected problems (particularly in GUIs) when working in an environment with slow Internet or no Internet access at all. I know how to ...
- 62.3k
2
votes
1
answer
1k
views
Need to generate a Hmac SHA512 string that is 88 characters long rather than 128 [duplicate]
I am trying to authenticate a http request using Mathematica, but i keep getting "Authentication failed" responses.
I think the problem is that the Hmac SHA512 I generate is 128 characters long, and ...
- 236k
2
votes
0
answers
57
views
Using Iterators within the WebSearch Command
I am currently trying to use the WebSearch command within Mathematica to search names from a Dataset that I have already imported. The names that I am trying to search are located in the 4th column of ...
- 81
2
votes
0
answers
91
views
Problem accessing NASA images
There seems to be a problem with the last version (11.2 on MacOS X) of Mathematica when trying to access NASA images and APIs using the ServiceConnect paclet here buit by b3m2a1.
While paclet ...
- 93
10
votes
0
answers
169
views
URL functions overload
All these functions seem capable of doing the same things: Import, URLFetch, URLSave, ...
- 62.3k
15
votes
1
answer
634
views
Building a GitBook with Mathematica
GitBook is a fun little website that will take Markdown source material and build a little book out of it.
How can I use Mathematica to build a GitBook with a minimum of effort?
- 47.1k
3
votes
1
answer
1k
views
API HTTP Request Signing using base64 encoding/decoding and HMAC (Cryptocurrencies Exchange, GDAX)
I am trying to access the GDAX API private methods which can be seen here, GDAX Documentation
There is some great Python code that does it that I am trying to recreate in Mathematica. That code can ...
- 436
14
votes
2
answers
557
views
Does Mathematica support deep links?
So GitHub sent me on quite the journey, after it opened its desktop app from my browser. Copying the link I found something looking like: "github-mac://...".
I ...
- 47.1k
3
votes
0
answers
436
views
URLFetch parameters interfere with POST
(orig: URLFetch Multipart POST fails to post Body?)
Update 2:
So after much weeping and gnashing of teeth Mathematica deemed me worthy of figuring out (some of) what was going on.
It turns out the ...
CommunityBot
- 1
3
votes
1
answer
168
views
Extract information from webpage
If you browse this page for instance, you'll notice at the bottom in gray, a line with
Contributor: Name < email >
Certainly for security reasons, the email does not appear in the source code. ...
- 14.5k
3
votes
1
answer
151
views
How to refresh or clear cached CloudObjects[]?
cross posted on community.wolfram.com
Let's create an API which creates one file each time it is called/accessed:
...
- 138k
7
votes
1
answer
526
views
curl in Mathematica, google link-shortener
I want to automatically get short links equivalents for things I CloudDeploy. I'd appreciate some tips on integrating command line workflow below into Mathematica ...
- 138k
4
votes
2
answers
235
views
Use URLFetch in init.m
I'm not able to use URLFetch in my $UserBaseDirectory/Kernel/Init.m as it always returns ...
- 25.5k
1
vote
0
answers
85
views
Upload notebook to the Cloud and add a download hyperlink in separate cloud objects
cross posted on community.wolfram.com
Title say it all, I want to export _Notebook to cloud as a .nb file and make it available to download via hyperlink in different places.
This is rather a code-...
CommunityBot
- 1
3
votes
1
answer
147
views
Dynamic WebImageSearch
I am a little bit lost here, I'd be really grateful if someone could help me. :) We are working on a "video" (actually images with transitions).
We are having a list of specific words eg.:
...
- 47.1k
17
votes
3
answers
430
views
How do I put my packages into Dropbox
I don't want to necessarily put my packages in Mathematica's $UserBaseDirectory, which is on my local hard drive. Can I somehow tell Mathematica to look for ...
5
votes
0
answers
250
views
Dropbox datastore
Dropbox seems to have a feature where it can be used as a database.
This would be really cool to use for memoized functions, that can be restored
on several computers and sessions.
I have a function ...
3
votes
1
answer
238
views
Paclet server down?
out and unable to connect to the paclet server and Mathematica asking me to log in. Is very annoying and gets worse. Do other users also have this problem?
- 138k
1
vote
1
answer
306
views
Error: Cannot import data as JSON format, Khan Academy API
Problem context
I'm updating my working Mathematica Khan Academy reporting application. Since updating to 11.2 I'm having some errors importing via the Khan Academy API as JSON. Update: This ...
6
votes
1
answer
565
views
Import information from a web URL that requires a username and password
I wish to use:
Import[link, "Plaintext"]
to get the plain text on a web page - however the webpage is on an internal network and requires a username and password ...
- 138k
8
votes
1
answer
240
views
Web search browser in Mathematica
How can we build a system to perform web searches (e.g. Google search) in a notebook so that it looks and functions like a normal search interface operating in the browser?
- 47.1k
4
votes
1
answer
167
views
URLRead ignores content-encoding:gzip header
Background
Taking an example from Decoding GZIP encoded Body, BodyBytes (ByteArray) and BodyBytesArray from URLRead:
...
- 138k
3
votes
0
answers
82
views
URLDownloadSubmit is not asynchronous?
I'm trying to download a few thousand images (using an authenticated get request). This explanation of parallel downloading was a great answer to the problem of handling massive parallel asynchronous ...
- 31.8k
1
vote
2
answers
162
views
How to import only the data table from the census bureau
I have a project that requires me to import data from the census bureau and then take the average of the first two population columns
https://www.census.gov/population/international/data/worldpop/...
- 12.8k
8
votes
1
answer
346
views
How can I use multiple overlaid map layers (e.g. basemap, labels) in GeoGraphics?
We can use GeoServer to use map tiles from an external service. There are many compatible services:
Which external services are compatible with GeoServer?
These ...
- 236k
16
votes
3
answers
838
views
Which external services are compatible with GeoServer?
Using the GeoServer option, it is possible to load map tiles from external services.
Which services are compatible with ...
- 236k
7
votes
1
answer
875
views
Accessing the Twitter API using Mathematica 11
The built-in social media functions are limited, so I'm using Twitter's web API for my work.
The following function worked for me when I was using versions of Mathematica earlier than 10.3.
...
CommunityBot
- 1
30
votes
3
answers
4k
views
Export to Google Spreadsheet with OAuthAuthentication
Context
I'm trying to setup a connection between Mathematica and Google Docs. Specifically, I would like to be able to export data to a Google Spreadsheet (Note: if the spreadsheet is public it's ...
- 47.1k
19
votes
2
answers
2k
views
Encrypt the password used for SendMail
I want Mathematica to send me an email when the computation is finished. To that end, I have a cell with SendMail[...] which I place behind my computation in the ...
0
votes
1
answer
84
views
How to detect a website is changed or not?
Such as I want to know the SE is change or not. This is my current method
StringLength[Import["https://mathematica.stackexchange.com/"]]
...
- 911
11
votes
1
answer
489
views
Connect to Socket opened by other applications
In Mathematica 11.2, there are new sockets functions that are potentially very useful in network programming. I'm trying to use it to communicate between Mathematica and some external program, but I'm ...
- 37.4k
0
votes
0
answers
733
views
"updating from wolfram research server"
I failed to get the information on a website after several attempts, every time Wolfram Mathematica returned "updating from wolfram research server". Could anyone give me any advise? Thanks a lot!!!
...
10
votes
2
answers
2k
views
How can I commit files to Github by Mathematica?
How can I publish Notebooks to Github via using Mathematica?
I'm on windows 8.1 x64, Mathematica 9.
How can I upload the current notebook to Github?
My function expected is: ...
CommunityBot
- 1
5
votes
1
answer
524
views
Decoding GZIP encoded Body, BodyBytes (ByteArray) and BodyBytesArray from URLRead
When calling the Stack Exchange API v2.2 using the new (Mma11) function URLRead we get a GZIP encoded Body in alternative formats: ...
- 138k
6
votes
1
answer
517
views
APIFunction can not access HTTP request body when used with URLDispatcher
I noticed a strange behavior regarding the APIFunctionwhen used with URLDispatcher. It does not allow me to access the body of a ...
- 47.1k
2
votes
0
answers
103
views
How can I download the score page?
I want to login university educational administration system and download the score page (login->”教务管理信息系统”->”学生所学实际成绩”). A Chinese netizen provided an account number and password.
Link: http://jwcas....
- 911
4
votes
1
answer
214
views
How do I use Mathematica to upload to Clyp?
Clyp is a service for hosting sound files that (as of now) doesn't require registration.
I'm wondering if it's possible to write a function that'll upload a Sound ...
2
votes
1
answer
838
views
Is there a better way to download images in parallel?
Is this the best way to batch save a list of image urls in parallel?
...
0
votes
0
answers
52
views
Improve timing of URLExecute command?
I am using a ionosphere model that runs online, IRI2016.
The URL gives me a table with usefull parameters like electron density in upper atmosphere.
The URLExecute...
1
vote
0
answers
104
views
Scraping XML Paragraphs with URLs
I've been working on scraping an article from CNBC. The link is here
I want to scrape the main body, and the code I have so far is this:
...
2
votes
1
answer
398
views
URLFetch Problem with the Size of HTTP Message Body [closed]
I am trying to transmit this string as an HTTP Message BODY
...
- 253
8
votes
1
answer
461
views
Importing images from the web using ImportString & URLFetch
I can bring images from the web using the Import command like this:
Import["http://blog.wolfram.com/wp-content/uploads/2008/06/se-30.jpg"]
Sometimes the web ...
- 253
8
votes
2
answers
211
views
Is it possible to verify the accuracy of a file downloaded using URLFetch
Objective:
I am trying to save a HTML file using the URLFetch function (native to Mathematica 9 onward).
Sometimes the file is huge.
Question:
Is there a way to check/verify (using the headers or ...
- 253
1
vote
0
answers
154
views
Why POST be replaced by GET in HTTP request? [closed]
I want to use Chinese Word Segmentation and find this API.
sample case work：
...
- 6,866
0
votes
0
answers
492
views
HTTP Status Code 403
I'm working with some scraping and have run into a bit of a problem. The website I am scraping is this: https://seekingalpha.com/symbol/CRM/stocktalks
I am essentially trying to scrape the "stock ...
- 647
1
vote
0
answers
92
views
Using Two Arguments on the Same Function
I'm having some trouble wrapping my head around how I would go about using two arguments in one function. In the first section of the code below, I have scraped some "tweets" on the Seeking Alpha ...
- 647