This question already has an answer here:
I am trying to use Mathematica to analyze the data given by the Boston Marathon concerning running time, etc. The website http://registration.baa.org/2015/cf/Public/iframe_ResultsSearch.cfm gives a form for requesting data. One can get a lot by just selecting the Gender to be either M or F and requesting 1000 results. However, the data comes in just groups of 25. How can I use Mathematica to get all 1000 results without manually getting the data in groups of 25? Better yet ... how can I get info on all the runners, not just the top 1000?
I know this is not necessarily a Mathematica question, but Mathematica is my favorite tool for this kind of thing and I'm trying to figure out how to use it.
What I've done so far:
I can run a search - say, for Males and request 1000 results. When the first 25 results come up, I can view the page source and near the bottom their is a line that begins with
<input type="hidden" name="start" value="26"/>. By changing the value from
26 to say,
27, and saving the results as a webpage, I can see the results numbered 27 to 51 when I click on the "Next 25 Records" button. I don't know how to get Mathematica to submit this form for me, nor click through the "next results". This may just be a poor way of approaching the problem, and a more elegant method exists.