python的franme_Python的请求参数/处理API分页

I'm playing around with the Angel List (AL) API and want to pull all jobs in San San Francisco.

Since I couldn't find an active Python wrapper for the api (if I make any headway, I think I'd like to make my own), I'm using the requests library.

The AL API's results are paginated, and I can't figure out how to move beyond the first page of the results.

Here is my code:

import requests

r_sanfran = requests.get("https://api.angel.co/1/tags/1664/jobs").json()

r_sanfran.keys()

# returns [u'per_page', u'last_page', u'total', u'jobs', u'page']

r_sanfran['last_page']

#returns 16

r_sanfran['page']

# returns 1

I tried adding arguments to requests.get, but that didn't work. I also tried something really dumb - changing the value of the 'page' key like that was magically going to paginate for me.

eg. r_sanfran['page'] = 2

I'm guessing it's something relatively simple, but I can't seem to figure it out so any help would be awesome.

Thanks as always.

解决方案

Read last_page and make a get request for each page in the range:

import requests

r_sanfran = requests.get("https://api.angel.co/1/tags/1664/jobs").json()

num_pages = r_sanfran['last_page']

for page in range(2, num_pages + 1):

r_sanfran = requests.get("https://api.angel.co/1/tags/1664/jobs", params={'page': page}).json()

print r_sanfran['page']

# TODO: extract the data