之前寫了一篇在城市範圍內根據關鍵字爬取POI資料的部落格，由於一個城市的POI資料量太大，高德地圖介面容易返回錯誤資料，因此有個比較好的辦法就是藉助高德地圖POI搜尋中根據多邊形範圍或矩形範圍搜尋POI資料，具體分為兩個步驟：其一是將城市分為多個小矩形(得到左上和右下兩個頂點的座標即可)；二是根據得到的矩形座標呼叫高德地圖WEB API得到資料解析即可。這篇文章主要是記錄根據矩形範圍搜尋POI的流程，至於如何切分城市為矩形，我也還沒弄過，可以自行百度搜索解決。

     先看下爬取到的資料吧：

http://restapi.amap.com/v3/place/polygon?polygon=116.80708,31.449926,117.510206,32.247823&key=c5304f29d1a11f14c4fb29854a831ef0&extensions=all&offset=25&page=1&keywords=%E5%A4%A7%E5%AD%A6
 

引數說明：

               polygon：多邊形邊界範圍(或者是矩形左上和右下兩個頂點座標)

               key : 高德地圖web api申請的金鑰key

               extensions ：此項預設返回基本地址資訊；取值為all返回地址資訊、附近POI、道路以及道路交叉口資訊。

               offset ：分頁的頁大小

               page：請求的頁碼

其餘的具體引數介紹詳見文件說明。

可以在瀏覽器看到示例URL返回的資料。剩餘的就是迴圈獲取資料，然後解析入庫的事情了，挺簡單的。這裡就直接貼上程式碼了：

from urllib.parse import quote
from urllib import request
import json
import xlwt

# TODO
amap_web_key = '你申請的AK'  # 高德地圖官網申請的Web API KEY
filename = r'C:\study\hehe.xls'     # 爬取到的資料寫入的EXCEL路徑

# 矩形邊界集合
polygon_list = ['116.80708,31.449926,117.510206,32.247823','116.80708,31.449926,117.158643,31.8488745','116.80708,31.449926,116.9828615,31.64940025','116.9828615,31.449926,117.158643,31.64940025','116.80708,31.64940025,116.9828615,31.8488745','116.9828615,31.64940025,117.158643,31.8488745','117.158643,31.449926,117.510206,31.8488745','117.158643,31.449926,117.3344245,31.64940025','117.3344245,31.449926,117.510206,31.64940025','117.158643,31.64940025,117.3344245,31.8488745','117.158643,31.64940025,117.24653375,31.749137375','117.24653375,31.64940025,117.3344245,31.749137375','117.158643,31.749137375,117.24653375,31.8488745','117.24653375,31.749137375,117.3344245,31.8488745','117.3344245,31.64940025,117.510206,31.8488745','116.80708,31.8488745,117.158643,32.247823','117.158643,31.8488745,117.510206,32.247823','117.158643,31.8488745,117.3344245,32.04834875','117.3344245,31.8488745,117.510206,32.04834875','117.3344245,31.8488745,117.42231525,31.948611625','117.42231525,31.8488745,117.510206,31.948611625','117.3344245,31.948611625,117.42231525,32.04834875','117.42231525,31.948611625,117.510206,32.04834875','117.158643,32.04834875,117.3344245,32.247823','117.3344245,32.04834875,117.510206,32.247823']

# POI分類集合
#class_list = ['商城', '超級市場']
type_list = '060401|060402|060403|060404|060405|060406|060407|060408|060409|060411|060413|060414|060415|060100|060101|060102|060103'

poi_search_url = "http://restapi.amap.com/v3/place/polygon"  # URL

offset=25  # 分頁請求資料時的單頁大小

# 根據矩形座標獲取poi資料
def getpois(polygon, type_list):
    i = 1
    current_polygon_poi_list = []
    while True:  # 使用while迴圈不斷分頁獲取資料
        result = getpoi_page(polygon, i, type_list)
        result = json.loads(result)  # 將字串轉換為json

        #print('第', str(i),'頁，結果',result)

        if result['status'] is not '1':  # 介面返回的狀態不是1代表異常
            print('======爬取錯誤，返回資料：' + result)
            break
        pois = result['pois']
        if len(pois) < offset:  # 返回的資料不足分頁頁大小，代表資料爬取完
            current_polygon_poi_list.extend(pois)
            break
        current_polygon_poi_list.extend(pois)
        i += 1
    print('===========當前polygon：', polygon,',爬取到的資料數量：' ,str(len(current_polygon_poi_list)))

    return current_polygon_poi_list




# 單頁獲取pois
'''
http://restapi.amap.com/v3/place/polygon?polygon=116.80708,31.449926,117.510206,32.247823&key=c5304f29d1a11f14c4fb29854a831ef0&extensions=all&offset=5&page=1
'''
def getpoi_page(polygon, page, type_list):
    req_url = poi_search_url + "?key=" + amap_web_key + '&extensions=all&polygon=' + polygon + '&offset=' + str(offset) + '&types=' + type_list + '&page=' + str(page) + '&output=json'
    data = ''
    with request.urlopen(req_url) as f:
        data = f.read()
        data = data.decode('utf-8')
    return data

# 資料寫入excel
def write_to_excel(poilist, filename):
    # 一個Workbook物件，這就相當於建立了一個Excel檔案
    book = xlwt.Workbook(encoding='utf-8', style_compression=0)
    sheet = book.add_sheet('0', cell_overwrite_ok=True)
    # 第一行(列標題)
    sheet.write(0, 0, 'id')
    sheet.write(0, 1, 'name')
    sheet.write(0, 2, 'location')
    sheet.write(0, 3, 'type')
    for i in range(len(poilist)):
        sheet.write(i + 1, 0, poilist[i]['id'])
        sheet.write(i + 1, 1, poilist[i]['name'])
        sheet.write(i + 1, 2, poilist[i]['location'])
        sheet.write(i + 1, 3, poilist[i]['type'])
    book.save(filename)


all_poi_list = [] #爬取到的所有資料

for polgon in polygon_list:
    polygon_poi_list = getpois(polgon, type_list)
    all_poi_list.extend(polygon_poi_list)

print('爬取完成,總的數量', len(all_poi_list))
write_to_excel(all_poi_list, filename)
print('寫入成功')
 

自己執行的話需要修改的地方都在程式碼上方位置，具體的說明在程式碼中已有註釋。