How can I save all citations from a Google Scholar search? For instance, in a search for "Radon transformation", there are about 35,500 results. I want to download all citations into a string - is there a simple way to get Mathematica to do that? (And sorry, no, I haven't tried anything yet. Not sure where to start.)
$\begingroup$
$\endgroup$
6
-
1$\begingroup$ That surely would be against the fair use policy, wouldn't it? $\endgroup$– rhermansOct 13, 2015 at 17:39
-
$\begingroup$ @rhermans I don't know - I haven't checked that. I am certainly not intentionally trying to do something that breaks their rules - I figured it would be fair to try. If it is against fair use, then never mind. $\endgroup$– GregHOct 13, 2015 at 17:47
-
$\begingroup$ A few tens of queries surely are fine but 35K will make you noticed. $\endgroup$– rhermansOct 13, 2015 at 17:48
-
$\begingroup$ The policy states "Don’t misuse our Services. For example, don’t interfere with our Services or try to access them using a method other than the interface and the instructions that we provide." I was hoping to use MMA to automate the "interface interaction" process, but maybe that violates the policy. $\endgroup$– GregHOct 13, 2015 at 18:11
-
4$\begingroup$ @rhermans, In September 2014, the SDNY upheld TVEye’s affirmative defense of fair use with respect to its core function of indexing news clips in a searchable database. The court reasoned that this indexing function is transformative because it “converts copyrighted works into a research tool to further learning.” $\endgroup$– alancalvittiOct 13, 2015 at 20:52
|
Show 1 more comment
1 Answer
$\begingroup$
$\endgroup$
This could get you strated
gsq[str_String] := Block[{url},
url = "https://scholar.google.co.uk/scholar?hl=en&q=" <>
URLEncode[str] <> "&btnG=&as_sdt=1%2C5&as_sdtp=";
Cases[
Cases[
Import[url, "XMLObject"]
, XMLElement["div", {"id" -> "gs_ccl", "role" -> "main"}, ___],
Infinity]
, XMLElement["h3", {"class" -> "gs_rt"}, ___], Infinity]
]
Use "inspect element" in your browser to understand the div ids.
