先貼程式碼：

#coding=utf-8

import csv, os, re
import MySQLdb

_PATH = 'D:/bike_sharing_data/trip_data/trip_history/'
_TABLE_NAME = 'trip_history_raw'

filelist = os.listdir(_PATH)

conn = MySQLdb.connect(
    host='localhost',
    port=3306,
    user='root',
    passwd='****',
    db='bike_sharing'
)

cursor = conn.cursor()
pattern = re.compile(r'^20170[4-7]'
 
)

for filename in filelist:
    path = _PATH + filename
    print filename
    if pattern.match(filename):
        data = 'LOAD DATA LOCAL INFILE \''+ path +'\' INTO TABLE '+ _TABLE_NAME + ' FIELDS TERMINATED BY \',\' ENCLOSED BY \'"\' LINES TERMINATED BY \'\n\' IGNORE 1 LINES (tripduration, starttime, stoptime, start_station_id, @1, @2, @3, end_station_id, @4, @5, @6, @7, usertype, @8, @9);'
 

    else:
        data = 'LOAD DATA LOCAL INFILE \''+ path +'\' INTO TABLE '+ _TABLE_NAME + ' FIELDS TERMINATED BY \',\' ENCLOSED BY \'"\' LINES TERMINATED BY \'\r\n\' IGNORE 1 LINES (tripduration, starttime, stoptime, start_station_id, @1, @2, @3, end_station_id, @4, @5, @6, @7, usertype, @8, @9);'
 

    cursor.execute(data)
    conn.commit()

cursor.close()

這裡使用LOAD DATA的方式將資料匯入MySQL中，因為這種方法要比一行一行直接insert或者批量insert效率要高。

LOAD DATA格式：

LOAD DATA LOCAL INFILE 'path' 
    INTO TABLE '_TABLE_NAME'
    FIELDS TERMINATED BY ','
    ENCLOSED BY '"'
    LINES TERMINATED BY '\n'
    IGNORE 1 LINES
    (tripduration, starttime, stoptime, start_station_id, @1, @2, @3, end_station_id, @4, @5, @6, @7, usertype, @8, @9);

FIELDS TERMINATED BY ','：表示欄位分隔符；

ENCLOSED BY '"'：表示每個欄位由雙引號包圍；

LINES TERMINATED BY '\n'：表示行分隔符，在windows下需使用LINES TERMINATED BY '\r\n'，否則只能讀取奇數（或偶數）行；特別地，若csv檔案中不存在換行符，windows下要用TERMINATED BY '\n',否則無法插入資料；

IGNORE 1 LINES：表示忽略檔案的第一行，因為csv檔案的第一行是列名，所以插入資料時要忽略掉；

(tripduration, starttime, stoptime, start_station_id, @1, @2, @3, end_station_id, @4, @5, @6, @7, usertype, @8, @9)：當我們只需要將csv（或其他格式）檔案中的部分列匯入MySQL表中時，可以使用@a過濾掉其他列的資料；其中的列名為資料庫中表的列名，排列順序與csv檔案的列保持一致。