Questions tagged [web-access]
Questions about using Mathematica for accessing web sites and using such functions as URLFetch and URLSave.
2
votes
1answer
92 views
Deleting missing values from a dataset
I wanted to create a dataset of all UFO sightings in April of 2018. The
AssociationThread doesn't want to work, because some of the entries are missing value, what ...
8
votes
1answer
139 views
Scrape AJAX Website with Webdriver
I hope the new Webdriver functionality can help as the normal Import and HTTPRequest don't work.
The sites I have found are a ...
1
vote
1answer
88 views
How to get URL request response in Mathematica?
I am considering the following link:
https://myimmitracker.com/en/ca/trackers/consolidated-e-apr-tracker-express-entry-permanent-residency-application
It produces the following page with a table in ...
1
vote
0answers
38 views
Chrome drive broken? [closed]
I tried this external session, as Import["Url"] is sometimes blocked by websites. But it is down now, and I really don't know why. My computer is Dell XPS 13 with ...
1
vote
2answers
70 views
What info is exchanged when using Import[url]?
When using Import with a url what information is broadcasted/sent to the receiving end of the request and is it possible to monitor/modify that information?
1
vote
0answers
31 views
How to access image from ethernet camera [duplicate]
I have a Edimax IC-3140W ethernet security camera. It acts as a web host where the video feed can be viewed in a browser. Navigating to its ip address http://ip.ip.ip.ip, it will ask for a password ...
7
votes
1answer
188 views
Import data from dynamically generated webpage
I'm trying to get data from a web-page
data=Import["https://stats.nba.com/team/1610612738/traditional/", "Data"]
It returns only a textual information. ...
10
votes
2answers
96 views
How to show Plots or Graphics in mini MMA HTTP Server?
I learned some codes to make a mini HTTP server in MMA way here.
...
3
votes
0answers
48 views
How to connect to ncbi databases for text search? MathIOmica authoring instructions now do not work [closed]
Mias's suplementary material in the notebook MmaBioinfo_Ch4_Databases contains a code for search the snp related to autism
...
2
votes
0answers
72 views
create interactive local site with backgroud mathematica calculations
This may be a bit of a weird question but I cannot figure out if this is possible. I need to write a program at work that can be used interactively. By that I mean, it will have several parameters ...
1
vote
0answers
56 views
How can I convert $\TeX$ image to Wolfram expression via MathPix
Mathpix is a tool which can covert $\TeX$ image to $\TeX$ expression, they also say they can return a string which is compatible with the Wolfram Alpha engine if possible.
I found their documentation ...
5
votes
1answer
133 views
webscraping: Wolfram notebook vs browser
In the Netherlands there is a website Funda.nl There you can find all houses for sale or for rent. I used webscraping as a tool to collect data for analyse-purpose. The script I used is like:
...
5
votes
1answer
126 views
How can I tally users on the Wolfram Challenges leaderboard?
Wolfram Challenges has a leaderboard that features users that have completed the challenges in the 'best' way, according to specified criteria like efficiency or shortness of code.
Can I use ...
3
votes
1answer
75 views
Importing data from an https server
When trying to import data from an https request I get the following error message.
...
21
votes
1answer
190 views
Upload from Mathematica to YouTube
I'd like to take some little videos I made in Mathematica and put them on YouTube. Is there a way to do this?
6
votes
1answer
87 views
Export Data from several tabs in a website
Here is the website from the official federation:
http://results.ittf.link/index.php?option=com_fabrik&view=list&listid=36&Itemid=158
I want to export the Data (the table). There are ...
0
votes
0answers
36 views
Scraping Images that are Directly Embedded in a Webpage or Dynamic?
I need to scrape URLs for photo albums like Flickr and Facebook for images from a certain event.
I'm trying to use Import["link", "Images"], as shown at
https://...
4
votes
0answers
74 views
Connecting to Twitter API Manually in Mathematica to Pull Down All Followers of a Specified User (e.g. More than 5,000)
I have been going through old StackExchange threads to see how to potentially use Mathematica's built-in connection/authentication to the Twitter API to connect to it manually, and access some ...
5
votes
1answer
257 views
Opening Mathematica file in Google drive
I have a Mathematica file in my Google drive. There is no option to open the Mathematica file directly, without downloading it.
Is it possible to directly open the file from Google drive?
2
votes
2answers
125 views
Export an image as pdf that acts as a link mathematica
Anyone knows if it is possible to export an image as a pdf and this image should act as a link to a website when one clicks on it form within a pdf viewer ?
7
votes
1answer
199 views
Programmatic browser interaction: How to click on web-page and get new URL and list of links
In Mathematica it's easy to Import data from the web and perform all sort of Web Operations. But the later doesn't allow to simulate a more interactive browser ...
2
votes
1answer
73 views
Select the right XMLelement
I scrape data from a public website about houses for rent. All pages have the same structure. But the pages can differ in the amount of information.
Below I give two examples:
page/house 1:
...
3
votes
1answer
174 views
Getting data using webscraping (Obtaining links from search engine with redirect)
In the past I have used the function Import in relation with "Hyperlink" to collect hyperlinks and data from the internet.
For ...
1
vote
0answers
112 views
Download YouTube files using Mathematica
I am not that familiar with other languages, but I know Mathematica is powerful enough to excess webpage data (youtube copyright free database). I want to download sound effects from YouTube, but I ...
4
votes
0answers
55 views
Possible memory leak in URLRead? (MMA v11.3)
I was writing a API with a lot of http requests, when I noticed Mathematica was slowly using more and more memory, and after some debugging I think the culprit is ...
7
votes
1answer
140 views
Does Dropbox sync smartly notebook files? [duplicate]
It is said that Dropbox employs a Delta Sync technology where only the modified part of a file is updated through the internet. I was just wondering if it holds for notebook files.
I sometimes ...
4
votes
2answers
69 views
Pulling sections from a webpage
I'm trying to get specific sections from a webpage using Mathematica. I've started by importing the webpage, and getting the section "headers" that I want:
...
1
vote
0answers
56 views
How to I start viewing a YouTube Video at, say, 7 minutes in? [closed]
It is very easy to load and run a YouTube video, for example via:
...
7
votes
1answer
126 views
How to cache results of WebImageSearch?
Every call to WebImageSearch costs money (wolfram service credits), thus, I would like to page through results without having to redownload them.
Given the ...
15
votes
1answer
240 views
How can I get every function a user has made on StackExchange?
Yesterday I was looking at one of Henrik Schumacher's answers and realizing that it'd be useful to some of these functions more accessible for reuse. Copy-and-paste is nice, but better would be a ...
1
vote
1answer
70 views
HTTPRequest with multiple parameters
Want to use the API from this site.
I'm having trouble using the same parameters.
But I can do this with curl as shown on the site:
...
3
votes
2answers
99 views
Importing from an API that has non UTF-8 strings
I am new to both Mathematica and API's. I am trying to access a dictionary of player-ids to names from the website datdota.com, but some of them have chinese characters.
relevant code:
...
8
votes
1answer
182 views
A tour of AWSLink?
Seems like there are a lot of useful functions in this undocumented package AWSLink:
Any developers on here that can demo it a bit?
1
vote
1answer
93 views
Is it possible to embed HTML webpage in a Mathematica notebook?
I am trying to display a webpage as an iframe in Mathematica.
The only option I have found is with EmbededHTML, but I can't get it to work for me. Example:
<...
12
votes
1answer
163 views
Can I trust URLSubmit?
Bug introduced in 11.2 or earlier and persists through V11.3
[CASE:4026293] confirmed
Let's create 10 asynchronous requests which just check if the site is there.
...
3
votes
1answer
115 views
FetchUrl status forbbiden when using Wolfram Alpha query
Strange thing here.
If I try this with Free-form input:
Sqrt[(2^t*Log[2])^2/(1 - 2^(2*t))]
I have no problem... But if I try the same expression in the Wolfram ...
1
vote
0answers
63 views
Truncated tweets texts
I use the Twitter command
twitter = ServiceConnect["Twitter", "New"]
listTws = twitter["TweetSearch", "Query" -> "Trump", MaxItems -> 10];
For example, the ...
6
votes
1answer
62 views
How to CloudDeploy an APIFunction that takes audio as input?
I have a function whose argument is Audio and I'd like to deploy it as an API (and then call it from Python). This works as with ...
12
votes
3answers
694 views
Get title of a webpage only?
Is it possible to use Mathematica to obtain just the title of a webpage? (I mean the small amount of text that appears in the webpage tab at the top of a browser.)
Every standard HTML page must have ...
4
votes
1answer
73 views
URLSubmit handling of query parameters
Bug introduced in 11.2 or earlier and persisting through 11.3
[CASE:4007421] confirmed
myApi = CloudDeploy@APIFunction[{"i" -> "Real"}, #i &];
Why does ...
7
votes
1answer
81 views
How to programatically disable internet connectivity
Internet connectivity may cause slows evaluations or cause unexpected problems (particularly in GUIs) when working in an environment with slow Internet or no Internet access at all. I know how to ...
2
votes
0answers
644 views
CryptoExchange API (yobit.net) and CloudFlare protection
I want execute http-request to yobit.net. For example:
https://yobit.net/api/3/info
In the browser you must wait 5 second for reload page first time without cookies from yobit.net
In Mathematica:
...
2
votes
0answers
57 views
Problem accessing NASA images
There seems to be a problem with the last version (11.2 on MacOS X) of Mathematica when trying to access NASA images and APIs using the ServiceConnect paclet here buit by b3m2a1.
While paclet ...
1
vote
1answer
68 views
Problem with URLRead[] and URLSubmit[] on Linux
Update
I originally thought there was something wrong with my usage of URLRead. But then I switched from my Mathematica instance on Ubuntu 17.10 to an instance on OS X 10.11 and it works fine on OS X....
1
vote
0answers
50 views
Using Iterators within the WebSearch Command
I am currently trying to use the WebSearch command within Mathematica to search names from a Dataset that I have already imported. The names that I am trying to search are located in the 4th column of ...
15
votes
1answer
538 views
Building a GitBook with Mathematica
GitBook is a fun little website that will take Markdown source material and build a little book out of it.
How can I use Mathematica to build a GitBook with a minimum of effort?
2
votes
1answer
212 views
Need to generate a Hmac SHA512 string that is 88 characters long rather than 128 [duplicate]
I am trying to authenticate a http request using Mathematica, but i keep getting "Authentication failed" responses.
I think the problem is that the Hmac SHA512 I generate is 128 characters long, and ...
2
votes
0answers
538 views
Execute `sendPhoto` to telegram using telegram-bot api
I was create telegram-bot using Mathematica. All the possibilities of telegram api can be found here. To send images, you can use method sendPhoto. To upload image ...
2
votes
1answer
84 views
Extract information from webpage
If you browse this page for instance, you'll notice at the bottom in gray, a line with
Contributor: Name < email >
Certainly for security reasons, the email does not appear in the source code. ...
3
votes
1answer
73 views
How to refresh or clear cached CloudObjects[]?
cross posted on community.wolfram.com
Let's create an API which creates one file each time it is called/accessed:
...
