PCIe固態儲存與HDD普通硬碟效能對比測試

阿新 • • 發佈：2019-02-03

經過兩週的測試，得出以下結果

MySQL-OLTP測試結果：（50張表，每張表1000萬資料，1000個執行緒）

TPS：MySQL在PCIe固態儲存上執行是在HDD上執行的5.63倍

writes：MySQL在PCIe固態儲存上執行是在HDD上執行的5.58倍

reads：MySQL在PCIe固態儲存上執行是在HDD上執行的5.55倍

Response_time：MySQL在PCIe固態儲存上執行比在HDD上執行響應時間快44.45倍

Errors：MySQL在PCIe固態儲存上執行是在HDD上執行錯誤率低83.5倍

隨機IO測試結論：

PCIe固態儲存隨機讀寫IO處理能力是HDD隨機讀寫IO處理能力的20倍

以下是詳細測試過程

準備工作

作業系統：CentOS6.4 64位

D B：MySQL5.6.22 64位

硬盤：PCIe（Shannon Direct-IO 1.6TB）、HDD

測試工具：sysbench0.5

監控工具：zabix

一、安裝sysbench 0.5

sysbench 0.5相比0.4版本的主要變化是，oltp測試結合了lua指令碼，不需要修改原始碼，通過自定義lua指令碼就可以實現不同業務型別的測試。同時0.5相比0.4需要消耗更多的cpu資源。

更新和安裝依賴包

yum -y install gcc
yum -y install libtool

安裝bzr客戶端

yum -y install bzr

線上獲取0.5的版本,#下載到當前目錄,檔名為: sysbench_0.5

bzr branch lp:sysbench
cd sysbench_0.5/

執行命令：./autogen.sh，對環境進行清理
./autogen.sh

./configure --with-mysql-includes=/usr/local/mysqla/include/ --with-mysql-libs=/usr/local/mysqla/lib/
# with-mysql-includes 指定MySQL安裝目錄
# with-mysql-libs 指定MySQL lib所在目錄

make && make install

如果遇到以下錯誤

../libtool: line 841: X--tag=CC: command not found
../libtool: line 874: libtool: ignoring unknown tag : command not found
../libtool: line 841: X--mode=link: command not found
../libtool: line 1007: *** Warning: inferring the mode of operation is deprecated.: command not found
../libtool: line 1008: *** Future versions of Libtool will require --mode=MODE be specified.: command not found
../libtool: line 2234: X-g: command not found
../libtool: line 2234: X-O2: command not found
../libtool: line 1954: X-L/usr/local/mysqla/lib/: No such file or directory
../libtool: line 2403: Xsysbench: command not found
../libtool: line 2408: X: command not found
../libtool: line 2415: Xsysbench: command not found
../libtool: line 2550: X-lmysqlclient_r: command not found
../libtool: line 2550: X-lrt: command not found
../libtool: line 2550: X-lm: command not found
../libtool: line 2632: X-L/home/sysopt/src/sysbench-0.4.12/sysbench: No such file or directory
../libtool: line 2550: X-lmysqlclient_r: command not found
../libtool: line 2550: X-lrt: command not found
../libtool: line 2550: X-lm: command not found
../libtool: line 2632: X-L/home/sysopt/src/sysbench-0.4.12/sysbench: No such file or directory
../libtool: line 2550: X-lmysqlclient_r: command not found
../libtool: line 2550: X-lrt: command not found
../libtool: line 2550: X-lm: command not found

可能原因：

1、沒裝依賴包libtool

2、安裝的版本不對（libtool版本過舊）

3、其它原因

解決方法：

1、安裝依賴包libtool

2、libtoo更新到新版本

3、用autoreconf代替autogen.sh，方法如下:

autoreconf -i
configure
make
make install

安裝成功後可通過help命令檢視sysbench幫助

[[email protected] src]# sysbench --help
Missing required command argument.
Usage:
  sysbench [general-options]... --test=<test-name> [test-options]... command

General options:
  --num-threads=N             number of threads to use [1]#使用執行緒數量
  --max-requests=N            limit for total number of requests [10000]#請求數，預設為10000
  --max-time=N                limit for total execution time in seconds [0]#執行時間，預設為0表示表示不限制
  --forced-shutdown=STRING    amount of time to wait after --max-time before forcing shutdown [off]
  --thread-stack-size=SIZE    size of stack per thread [64K]
  --tx-rate=N                 target transaction rate (tps) [0]
  --report-interval=N         periodically report intermediate statistics with a specified interval in seconds. 0 disables intermediate reports [0]#0.5的新增引數（預設值0,表示禁用該功能）在指定的時間間隔報告測試資訊，<span style="font-size:12px;">不用等到執行結束時再得到反饋</span>
  --report-checkpoints=[LIST,...]dump full statistics and reset all counters at specified points in time. The argument is a list of comma-separated values representing the amount of time in seconds elapsed from start of test when report checkpoint(s) must be performed. Report checkpoints are off by default. []
  --test=STRING               test to run
  --debug=[on|off]            print more debugging info [off]
  --validate=[on|off]         perform validation checks where possible [off]
  --help=[on|off]             print help and exit
  --version=[on|off]          print version and exit [off]
  --rand-init=[on|off]        initialize random number generator [off]#初始化時生成隨機的資料，預設關閉
  --rand-type=STRING          random numbers distribution {uniform,gaussian,special,pareto} [special]
  --rand-spec-iter=N          number of iterations used for numbers generation [12]
  --rand-spec-pct=N           percentage of values to be treated as 'special' (for special distribution) [1]
  --rand-spec-res=N           percentage of 'special' values to use (for special distribution) [75]
  --rand-seed=N               seed for random number generator, ignored when 0 [0]
  --rand-pareto-h=N           parameter h for pareto distibution [0.2]

Log options:
  --verbosity=N      verbosity level {5 - debug, 0 - only critical messages} [3]

  --percentile=N      percentile rank of query response times to count [95]

Compiled-in tests:測試專案
  fileio - File I/O test   #磁碟IO測試
  cpu - CPU performance test  #CPU運算效能
  memory - Memory functions speed test #記憶體分配及傳輸速度
  threads - Threads subsystem performance test #POSIX執行緒效能
  mutex - Mutex performance test #互斥效能測試

Commands: prepare run cleanup help version

See 'sysbench --test=<name> help' for a list of options for each test.

二、測試

1.MySQL-OLTP測試

資料準備

[[email protected] sysbench_0.5]# sysbench --mysql-db=sbtest --num-threads=24 --mysql-engine-trx=yes --mysql-table-engine=innodb --rand-type=special --mysql-host=localhost --mysql-port=3307 --mysql-user=root --mysql-password= --mysql-socket=/data1/lib/mysql/mysql.sock --test=sysbench/tests/db/oltp.lua --oltp_tables_count=50 --oltp-table-size=10000000 --rand-init=on prepare

引數說明：
--mysql-db：指定在哪個資料庫建立測試表，預設為sbtest庫，需要提前建立好
--num-threads：使用多執行緒建立多表，節省準備時間
--mysql-engine-trx=yes 支援事務
--mysql-table-engine：指定儲存引擎，如myisam，innodb，heap，ndbcluster，bdb，maria，falcon，pbxt 預設InnoDB
--test=tests/db/oltp.lua 表示呼叫 tests/db/oltp.lua 指令碼進行 oltp 模式測試
--oltp_tables_count=10 表示會生成 10 個測試表
--oltp-table-size=1000000 表示每個測試表填充資料量為 1000000

--db-driver：指定驅動，預設為Mysql
--rand-init=on 表示每個測試表都是用隨機資料來填充的

#使用1000個執行緒開始測試，讀寫模式。
模擬對50個表併發OLTP測試，每個表1000萬行記錄，持續壓測時間為 1小時
[[email protected] sysbench_0.5]# sysbench --mysql-engine-trx=yes --mysql-table-engine=innodb --mysql-host=localhost --mysql-port=3307 --mysql-user=root --mysql-password= --mysql-socket=/data1/lib/mysql/mysql.sock --test=sysbench/tests/db/oltp.lua --oltp_tables_count=50 --oltp-table-size=100000000 --num-threads=1000 --oltp-read-only=off --report-interval=10 --rand-type=uniform --max-time=3600 --max-requests=0 --percentile=95 run >>/data1/sysbench-rw.txt

引數說明
--oltp-read-only=off 表示不要進行只讀測試，也就是會採用讀寫混合模式測試
--report-interval=10 表示每10秒輸出一次測試進度報告
--rand-type=uniform：資料分佈模式，special表示存在熱點資料，uniform表示非熱點資料模式: uniform(固定),gaussian(高斯),special(特定的),pareto(帕累託)
--max-time=3600 表示最大執行時長為 3600秒
--max-requests=0 表示總請求數為 0，因為上面已經定義了總執行時長，所以總請求數可以設定為 0；也可以只設定總請求數，不設定最大執行時長
--percentile=95 表示設定取樣比例，預設是 95%，即丟棄5%的長請求，在剩餘的95%裡取最大值

可選引數：
--oltp-point-selects：在一個事務裡面Point select的數量，預設為10
--oltp-range-size：range查詢的範圍大小，預設100，應該小於oltp-table-size
--oltp-simple-ranges：在一個事務裡面簡單range查詢的數量，預設1
--oltp-sum-ranges：在一個事務裡面SUM range查詢的數量，預設1
--oltp-order-ranges：在一個事務裡面ORDER range查詢的數量，預設1
--oltp-distinct-ranges：在一個事務裡面DISTINCT range查詢的數量，預設1

注意：我這裡將測試中輸出資訊存放到一個文字檔案裡，便於用監控展示成圖表形式，這樣更直觀

監控結果：

PCIe固態儲存-IO

HDD-IO

PCIe固態儲存-TPS

HDD-TPS

PCIe固態儲存-writes

HDD-Writes

PCIe固態儲存-reads

HDD-Reads

PCIe固態儲存-Response-time

HDD-Response_time

PCIe固態儲存-errors

HDD-Errors

結論：（監控引數相同的情況下--oltp_tables_count=50 --oltp-table-size=100000000 --num-threads=1000 --oltp-read-only=off --rand-type=uniform ）

TPS：MySQL在PCIe固態儲存上執行是在HDD上執行的5.63倍

writes：MySQL在PCIe固態儲存上執行是在HDD上執行的5.58倍

reads：MySQL在PCIe固態儲存上執行是在HDD上執行的5.55倍

Response_time：MySQL在PCIe固態儲存上執行比在HDD上執行響應時間快44.45倍

Errors：MySQL在PCIe固態儲存上執行是在HDD上執行錯誤率低83.5倍

2、隨機IO測試（這裡就不再上圖了）

資料準備（建立70G檔案）注意：檔案大小需要大於記憶體大小

sysbench --test=fileio --file-total-size=70G --file-test-mode=rndrw --init-rng=on --max-time=300 --max-requests=0 prepare

測試階段

sysbench --test=fileio --file-total-size=70G --file-test-mode=rndrw --init-rng=on --max-time=300 --max-requests=0 run

清楚測試資料

sysbench --test=fileio --file-total-size=70G --file-test-mode=rndrw --init-rng=on --max-time=300 --max-requests=0 clean

隨機讀寫混合

PCIe固態儲存

Operations performed: 1789098 reads, 1192732 writes, 3816704 Other= 6798534 Total

Read 27.299Gb Written 18.2Gb Total transferred 45.499Gb (155.3Mb/sec)

9939.43 Requests/sec executed

General statistics:

total time: 300.0001s

total number of events: 2981830

total time taken by event execution: 214.9376s

response time:

min: 0.00ms

avg: 0.07ms

max: 7.26ms

approx. 95 percentile: 0.23ms

Threads fairness:

events (avg/stddev): 2981830.0000/0.00

execution time (avg/stddev): 214.9376/0.00

HDD

Operations performed: 85851 reads, 57234 writes, 183040 Other =326125 Total

Read 1.31Gb Written 894.28Mb Totaltransferred 2.1833Gb (7.4523Mb/sec)

476.95 Requests/sec executed

General statistics:

total time: 300.0024s

total number of events: 143085

total time taken by event execution: 291.8164s

response time:

min: 0.01ms

avg: 2.04ms

max: 170.33ms

approx. 95 percentile: 5.22ms

Threads fairness:

events (avg/stddev): 143085.0000/0.00

execution time (avg/stddev): 291.8164/0.00

隨機寫

PCIe固態儲存

Operations performed: 0 reads, 10441500 writes, 13365074 Other =23806574 Total

Read 0b Written 159.32Gb Totaltransferred 159.32Gb (271.91Mb/sec)

17402.24 Requests/sec executed

General statistics:

total time: 600.0090s

total number of events: 10441500

total time taken by event execution: 168.8168s

response time:

min: 0.00ms

avg: 0.02ms

max: 0.71ms

approx. 95 percentile: 0.02ms

Threads fairness:

events (avg/stddev): 10441500.0000/0.00

execution time(avg/stddev): 168.8168/0.00

HDD

Operationsperformed: 0 reads, 427200 writes,546689 Other = 973889 Total

Read 0b Written 6.5186Gb Total transferred 6.5186Gb (11.125Mb/sec)

712.00 Requests/sec executed

Generalstatistics:

total time: 600.0002s

total number of events: 427200

total time taken by event execution:10.5053s

response time:

min: 0.01ms

avg: 0.02ms

max: 29.30ms

approx. 95 percentile: 0.03ms

Threadsfairness:

events (avg/stddev): 427200.0000/0.00

execution time (avg/stddev): 10.5053/0.00

隨機讀

PCIe固態儲存

Operationsperformed: 3898994 reads, 0 writes, 0Other = 3898994 Total

Read59.494Gb Written 0b Total transferred 59.494Gb (203.07Mb/sec)

12996.64Requests/sec executed

Generalstatistics:

total time: 300.0001s

total number of events: 3898994

total time taken by event execution:294.7603s

response time:

min: 0.00ms

avg: 0.08ms

max: 30.09ms

approx. 95 percentile: 0.24ms

Threadsfairness:

events (avg/stddev): 3898994.0000/0.00

execution time (avg/stddev): 294.7603/0.00

HDD

Operationsperformed: 131643 reads, 0 writes, 0Other = 131643 Total

Read2.0087Gb Written 0b Total transferred 2.0087Gb (6.8564Mb/sec)

438.81 Requests/sec executed

Generalstatistics:

total time: 300.0014s

total number of events: 131643

total time taken by event execution:299.7703s

response time:

min: 0.00ms

avg: 2.28ms

max: 121.94ms

approx. 95 percentile: 5.34ms

Threadsfairness:

events (avg/stddev): 131643.0000/0.00

execution time (avg/stddev): 299.7703/0.00

結論：

PCIe固態儲存隨機讀寫IO處理能力是HDD隨機讀寫IO處理能力的20倍

PCIe固態儲存與HDD普通硬碟效能對比測試

PCIe固態儲存與HDD普通硬碟效能對比測試

go-gob序列化/反序列化與讀寫檔案效能對比測試

MyISAM與InnoDB兩者之間區別與選擇,總結，效能對比

DocumentFragment物件詳解，與傳統DOM操作效能對比

ngx_lua與go高併發效能對比

evpp效能測試（2）: 與Boost.Asio進行吞吐量對比測試

HAWQ與Hive查詢效能對比測試

YDB與spark SQL在百億級資料上的效能對比測試

通過稀疏擴充套件資訊濾波實現SLAM,並與EKF-SLAM進行效能對比

Mysql資料庫Innodb與MyISAM的效能對比測試

紅黑樹與小根堆效能對比

tmpfs與ext3效能對比測試

POI與JXL的實戰效能對比

Quarkus框架入門之三：Quarkus與Spring Boot啟動效能對比

類與結構體效能對比測試——以封裝網路心跳包為例

ASP.NET Core 程序內與程序外的效能對比

Oracle Spatial分區應用研究之二：按縣分區與按省分區對比測試報告

Flutter和iOS原生效能對比測試

傳統、VHD、VHDX效能對比測試（轉帖）

java工作筆記：web 程式設計中關於jni和jna兩種工具操作和效能對比測試

PCIe固態儲存與HDD普通硬碟效能對比測試

相關推薦