Podcast #128: We chat with Kent C Dodds about why he loves React and discuss what life was like in the dark days before Git. Listen now.

Questions tagged [web-access]

Questions about using Mathematica for accessing web sites and using such functions as URLFetch and URLSave.

43 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
12
votes
0answers
190 views

Is it possible to search the web by image from Mathematica?

Is it possible to perform a web search based on an image input? There are several services that provide this: Google, Bing, TinEye, and maybe others. I am not sure which can be accessed ...
10
votes
0answers
107 views

URL functions overload

All these functions seem capable of doing the same things: Import, URLFetch, URLSave, ...
7
votes
0answers
133 views

How to `URLEncode` spaces properly?

URLEncode encodes spaces as plus symbols, but this isn't what we want: The encoding used by default is based on a very early version of the general URI percent-...
5
votes
0answers
212 views

Dropbox datastore

Dropbox seems to have a feature where it can be used as a database. This would be really cool to use for memoized functions, that can be restored on several computers and sessions. I have a function ...
4
votes
0answers
100 views

Connecting to Twitter API Manually in Mathematica to Pull Down All Followers of a Specified User (e.g. More than 5,000)

I have been going through old StackExchange threads to see how to potentially use Mathematica's built-in connection/authentication to the Twitter API to connect to it manually, and access some ...
4
votes
0answers
64 views

Possible memory leak in URLRead? (MMA v11.3)

I was writing a API with a lot of http requests, when I noticed Mathematica was slowly using more and more memory, and after some debugging I think the culprit is ...
4
votes
0answers
239 views

How to convert a URLFetch to a URLRead or URLExecute?

Consider the following function: ...
3
votes
1answer
194 views

FetchUrl status forbbiden when using Wolfram Alpha query

Strange thing here. If I try this with Free-form input: Sqrt[(2^t*Log[2])^2/(1 - 2^(2*t))] I have no problem... But if I try the same expression in the Wolfram ...
3
votes
0answers
719 views

CryptoExchange API (yobit.net) and CloudFlare protection

I want execute http-request to yobit.net. For example: https://yobit.net/api/3/info In the browser you must wait 5 second for reload page first time without cookies from yobit.net In Mathematica: ...
3
votes
0answers
65 views

URLDownloadSubmit is not asynchronous?

I'm trying to download a few thousand images (using an authenticated get request). This explanation of parallel downloading was a great answer to the problem of handling massive parallel asynchronous ...
3
votes
0answers
260 views

URLFetch parameters interfere with POST

(orig: URLFetch Multipart POST fails to post Body?) Update 2: So after much weeping and gnashing of teeth Mathematica deemed me worthy of figuring out (some of) what was going on. It turns out the ...
3
votes
0answers
114 views

Use Mathematica inside web app?

My python code running in a Flask web application needs to return results from Mathematica, what is the best way to achieve this? Are there any examples of this having been done successfully?
3
votes
0answers
54 views

Ideas on source to learn the ins and outs of all Web Operations?

Since beginning to learn Mathematica a few months ago, I have been amazed by its capabilities. I have recently come across basic web operations such as URLFetch and I am interested in learning more. ...
2
votes
0answers
54 views

What could cause an “Uncaught Throw[$Failed,CURLLink`Utilities`Exception] returned to top level.” error message?

I am running a program in Mathematica that uses web browser automation, and is also connected to my email account. The program runs fine for a while, but after a few hours, I end up getting the ...
2
votes
0answers
33 views

How to overcome the threshold 500 ExternalLinks for downloading of the WikipediaData?

The command, for instance, WikipediaData["Global warming", "ExternalLinks"] gives me 500 links only, as so as ...
2
votes
0answers
78 views

create interactive local site with backgroud mathematica calculations

This may be a bit of a weird question but I cannot figure out if this is possible. I need to write a program at work that can be used interactively. By that I mean, it will have several parameters ...
2
votes
0answers
65 views

Problem accessing NASA images

There seems to be a problem with the last version (11.2 on MacOS X) of Mathematica when trying to access NASA images and APIs using the ServiceConnect paclet here buit by b3m2a1. While paclet ...
2
votes
0answers
713 views

Execute `sendPhoto` to telegram using telegram-bot api

I was create telegram-bot using Mathematica. All the possibilities of telegram api can be found here. To send images, you can use method sendPhoto. To upload image ...
2
votes
0answers
77 views

How can I download the score page?

I want to login university educational administration system and download the score page (login->”教务管理信息系统”->”学生所学实际成绩”). A Chinese netizen provided an account number and password. Link: http://jwcas....
2
votes
0answers
104 views

Retrieving a Portion of Webpage Code using URLFetch

The URLFetch command is very useful for pulling the entire html source of a given webpage, however, if one wanted to speed up the process, by only requesting a ...
2
votes
0answers
93 views

How to get the subdirectory of a ftp weblink?

For example, I can use FileNames["*",dir] to get all subdirectory under dir if dir is some directory of my local computer. Suppose that I want to get all ...
1
vote
0answers
40 views

How to use EmbedCode with CloudDeploy correctly?

I ran EmbedCode[CloudDeploy[Manipulate[Plot[Sin[x + c], {x, -6, 6}], {c, -1, 1}]]] based on this instruction and obtained the html code for embedding as below:- <...
1
vote
0answers
24 views

WebImageSearch for images of high resolution?

Is there a way to specify a minimal image dimension when using WebImageSearch? Since it costs money I don't want to do a large search and then filter the results. ...
1
vote
0answers
131 views

Download YouTube files using Mathematica

I am not that familiar with other languages, but I know Mathematica is powerful enough to excess webpage data (youtube copyright free database). I want to download sound effects from YouTube, but I ...
1
vote
0answers
69 views

Truncated tweets texts

I use the Twitter command twitter = ServiceConnect["Twitter", "New"] listTws = twitter["TweetSearch", "Query" -> "Trump", MaxItems -> 10]; For example, the ...
1
vote
0answers
52 views

Using Iterators within the WebSearch Command

I am currently trying to use the WebSearch command within Mathematica to search names from a Dataset that I have already imported. The names that I am trying to search are located in the 4th column of ...
1
vote
0answers
61 views

Upload notebook to the Cloud and add a download hyperlink in separate cloud objects

cross posted on community.wolfram.com Title say it all, I want to export _Notebook to cloud as a .nb file and make it available to download via hyperlink in different places. This is rather a code-...
1
vote
0answers
72 views

Scraping XML Paragraphs with URLs

I've been working on scraping an article from CNBC. The link is here I want to scrape the main body, and the code I have so far is this: ...
1
vote
0answers
79 views

Using Two Arguments on the Same Function

I'm having some trouble wrapping my head around how I would go about using two arguments in one function. In the first section of the code below, I have scraped some "tweets" on the Seeking Alpha ...
1
vote
0answers
71 views

Deal with AJAX when importing websites

I'm currently planning to create a small package to enable Mathematica to manipulate WeChat, a extremely famous chatting software in China. The first step is to get the QRCode on the website, but the ...
1
vote
0answers
36 views

Has anyone successfully connected to Google Contacts using ServiceConnect in V11?

When I call: googlecontacts = ServiceConnect["GoogleContacts"] The "Wolfram Connector" widget pops up and I click on "Sign in to Google Contacts" which directs me ...
1
vote
0answers
166 views

Make Mathematica input stuffs on websites

Main Question I'm currently making a web crawler, but I'll need to deal with login windows sometimes. All simple web crawlers created with Mathematica I've seen before cannot deal with input boxes or ...
1
vote
0answers
96 views

URLFetch meet the problem of 502

I'm using Mathematica10.0.2 on Win7 to write a crawler. Here is a piece of my code: ...
1
vote
0answers
95 views

Two-step web data submission

I am trying to automate the process of downloading data from my univ. webpage. I need to submit the form in the URL below. http://202.88.252.21/CuPbhavan/res_newregentry.php?id=4789 An inspection ...
1
vote
0answers
168 views

Import using POST method and web-page drill down

A response to a previous question about invoking the POST method via Mathematica was most informative in trying to further understand the intricacies of using the POST Method to obtain tabular data ...
0
votes
0answers
54 views

Yahoo groups is going away: how can I download the old messages?

It looks like all the old email messages from my group are stored in web pages with URLs that look like this: ...
0
votes
0answers
22 views

Using URLExecute[] for online data acquisition

On the United Parcel Service website(UPS) there is a form where you can enter a zip code and it will return a color coded map that shows shipping times from that zip code. I am trying to use ...
0
votes
0answers
31 views

How do I import changing/dynamic data on a webpage?

A remote device (sensor) is sending measurements (that I get in JSON format) to a given URL and is sending new measurements (data points) every couple of minutes. I cannot share the URL but the ...
0
votes
0answers
32 views

Verify that a document matches a URL

Writing: Quiet[Length[Import["http://www.africau.edu/images/default/sample.pdf"]]] I get: 2 while writing: ...
0
votes
0answers
41 views

Scraping Images that are Directly Embedded in a Webpage or Dynamic?

I need to scrape URLs for photo albums like Flickr and Facebook for images from a certain event. I'm trying to use Import["link", "Images"], as shown at https://...
0
votes
0answers
361 views

“updating from wolfram research server”

I failed to get the information on a website after several attempts, every time Wolfram Mathematica returned "updating from wolfram research server". Could anyone give me any advise? Thanks a lot!!! ...
0
votes
0answers
46 views

Improve timing of URLExecute command?

I am using a ionosphere model that runs online, IRI2016. The URL gives me a table with usefull parameters like electron density in upper atmosphere. The URLExecute...
0
votes
0answers
305 views

HTTP Status Code 403

I'm working with some scraping and have run into a bit of a problem. The website I am scraping is this: https://seekingalpha.com/symbol/CRM/stocktalks I am essentially trying to scrape the "stock ...