my question is general. I would like to search a term on Google and scrape all the results, including the dates of publishing, if there are.
I know that it is possible to scrape a website - following the policy, of course!, and not breaking the rules - by using Python or other softwares. Is it possible to do this in Mathematica?

enter image description here

UPDATE: By using ServiceConnect, I got this output:

results = ServiceExecute["GoogleCustomSearch", "Search", {"Query" -> "machine learning", "FileFormat" -> Entity["FileFormat", "PDF-1"]}]

enter image description here

  • 2
    $\begingroup$ Take a look at this. $\endgroup$ Sep 30 '19 at 14:19
  • $\begingroup$ I tried to use what you suggested, but it download an empty object (please see the post) $\endgroup$ Sep 30 '19 at 18:11
  • $\begingroup$ If this does not work for you results = ServiceExecute["GoogleCustomSearch", "Search", {"Query" -> "machine learning", MaxItems -> 10}] then most likely the credentials are not setup correctly. Follow the instructions here to get the search engine id and api key. $\endgroup$ Sep 30 '19 at 22:44

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.