0
$\begingroup$

Updated to show more code

Can't seem to find a good post/answer to this so I'm asking the question.

I'm pulling data from the Swarm/Foursquare API, and it's paged (max 250 results per pull):

url = StringTemplate[
    "https://api.foursquare.com/v2/users/self/checkins?startTime=`a`&\
endTime=`b`&oauth_token=`c`&limit=250&offset=`d`&v=20220406"][<|
    "a" -> startTime, "b" -> endTime, "c" -> oauthToken, 
    "d" -> offset|>];
response = Import[url, "RawJSON"];
checkins = response[["response"]][["checkins"]][["items"]];
Until[Length[response[["response"]][["checkins"]][["items"]]] == 0,
 offset += 250;
 url = StringTemplate[
    "https://api.foursquare.com/v2/users/self/checkins?startTime=`a`&\
endTime=`b`&oauth_token=`c`&limit=250&offset=`d`&v=20220406"][<|
    "a" -> startTime, "b" -> endTime, "c" -> oauthToken, 
    "d" -> offset|>];
 response = Import[url, "RawJSON"];
 AppendTo[checkins, response[["response"]][["checkins"]][["items"]]]
 ]

I should have around 1,200 results. Instead, I have 256. What am I doing wrong here?

Improve this question
$\endgroup$
5
  • $\begingroup$ Are you having trouble only combining the results? Or do you need help with the logic to continue to download until there are no more results? $\endgroup$
    – Gustavo Delfino
    Sep 19, 2022 at 16:35
  • $\begingroup$ I updated the post to show the complete code I'm trying to use. $\endgroup$
    – Steven Buehler
    Sep 19, 2022 at 18:36
  • $\begingroup$ Figured out on my own. apparently have to go one at a time: ``` Do[ AppendTo[checkins, response[["response"]][["checkins"]][["items"]][i]], {i, 0, Length[response[["response"]][["checkins"]][["items"]]]} ] ``` $\endgroup$
    – Steven Buehler
    Sep 19, 2022 at 18:45
  • $\begingroup$ The problem is that you are appending the subsequent result lists as a single item to your list. You need to Join the two lists instead, so checkins = Join[checkins, response[["response", "checkins", "items"]]] should do the trick $\endgroup$
    – Lukas Lang
    Sep 20, 2022 at 8:22
  • $\begingroup$ Thank you, @LukasLang, that's more efficient than what I came up with. :-) $\endgroup$
    – Steven Buehler
    Sep 21, 2022 at 12:54

1 Answer 1

Reset to default
0
$\begingroup$

Apparently I have to go one at a time on the Append:

Do[
 AppendTo[checkins, 
  response[["response"]][["checkins"]][["items"]][i]],
 {i, 0, Length[response[["response"]][["checkins"]][["items"]]]}
 ]
Improve this answer
$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.