sysbench tpcc-mysql_MySQL 常用工具sysbench/fio/tpcc等测试

为什么要压力测试

采购新设备，评估新设备性能

开发新项目，评估数据库容量

新系统上线前，预估/模拟数据库负载

更换数据库版本，评估性能变化

关注指标

CPU

%wait，%user，%sys

内存

只内存读写，不产生swap

IO

IOPS、 iowait、 svctm、 %util

数据库

TPS/TpmC、吞吏量(QPS)、响应时长、 InnoDB指标

影响因素

硬件

– CPU(省电模式、超线程、多核)

– 内存(镜像模式、 xen内核限制可用总内存大小)

– 阵列卡(BBU、 CACHE、条带、读写策略、 FW)

– 硬盘(SSD/SAS)

系统

– 内核参数(tcp相关)

– 文件系统

– IO调度器

MySQL

– TRANSACTION ISOLATION LEVEL

– Buffer pool

– Concurrency thread

– Redo log

– Binlog sync

– innodb_flush_log_at_trx_commit

----

可靠性测试

模拟意外事件

– 断电(硬件冷重启)

– RESET(硬件热重启)

– 阵列卡掉线

– 磁盘掉线

– REBOOT(系统重启)

– 正常关闭服务(kill -TERM)

– 异常关闭服务(kill -9)

– 磁盘空间满

– 删除文件

– 破坏性修改已打开文件

– …

长期极限高压

– 持续数小时、数天、数周运行高负载计算、 IO任务

– 考验服务器在高压下的性能波劢情况

– 考验硬件设备在高压下的稳定性表现

模拟恶劣环境

– 供电不稳

– 通风冷却不好

– 湿气大、灰尘多

注意事项

只在本地加压

压测数据量小

压测时间过短

压测模式太少

压力负载过大或过小

每轮测试完毕要净化环境

测试工具 sysbench，tpcc-mysql

#unzip sysbench-0.5.zip

yum install automake libaio libaio-devel libtool -y-----LOAD,CPU,QPS,TPS,CONNECT,IO,NET/IN,NET/OUT

[root@mysql5635 proc]#more loadavg

0.00 0.01 0.05 1/221 8408[root@mysql5635 proc]#cat /proc/cpuinfo

tar xvfz sysbench-0.4.12-1.1.tgz

./autogen.sh

./configure --prefix=/usr/local/sysbench --with-mysql-includes=/usr/local/mysql/include --with-mysql-libs=/usr/local/mysql/lib && make &&make install--cpu性能测试

./sysbench --help

./sysbench: error while loading shared libraries: libmysqlclient.so.18: cannot open shared object file: No such file or directory

[root@mysql5635 sysbench]#ls /usr/local/mysql/lib/|grep libmysqlclient.so.18

libmysqlclient.so.18libmysqlclient.so.18.1.0[root@mysql5635 sysbench]#echo "/usr/local/mysql/lib" >>/etc/ld.so.conf

[root@mysql5635 sysbench]#ldconfig

drivers/mysql/libsbmysql.a -L/usr/local/mysql/lib -lmysqlclient_r scripting/lua/src/liblua.a -ldl -lrt -laio -lm -pthread/usr/bin/ld: cannot find -lmysqlclient_r

fileio - 文件 I/O测试

cpu - CPU系能测试

memory - 内存功能速度测试

threads - 线程子系统系能测试

mutex - 互斥性能测试

运行

– sysbench --test=[mode] [other_options] prepare

– sysbench --test=[mode] [other_options] run

– sysbench --test=[mode] [other_options] cleanup

通用基准

– 最大请求数：5,000,000

– 并发线程数：8 ~ 512

基准 – OLTP

– mode=complex

– engine=innodb

– oltp-table-size=100,000,000

sysbench支持以下几种测试模式：

1、CPU运算性能

2、磁盘IO性能

3、调度程序性能

4、内存分配及传输速度

5、POSIX线程性能

6、数据库性能(OLTP基准测试)

测试用例

初始化测试库环境(总共10个测试表，每个表 100000 条记录，填充随机生成的数据)

./sysbench --mysql-host=127.0.0.1 --mysql-port=3317 --mysql-user=tpcc --mysql-password=*** \--test=tests/db/oltp.lua --oltp_tables_count=10 --oltp-table-size=100000 --rand-init=on prepare

--test=tests/db/oltp.lua 表示调用 tests/db/oltp.lua 脚本进行 oltp 模式测试

--oltp_tables_count=10 表示会生成 10 个测试表

--oltp-table-size=100000 表示每个测试表填充数据量为 100000

--rand-init=on 表示每个测试表都是用随机数据来填充的

真实测试场景中，数据表建议不低于10个，单表数据量不低于500万行，当然了，要视服务器硬件配置而定。如果是配备了SSD或者PCIE SSD这种高IOPS设备的话，则建议单表数据量最少不低于1亿行。

在上面初始化数据参数的基础上，再增加一些参数，即可开始进行测试了：

./sysbench --mysql-host=127.0.0.1 --mysql-port=3306 --mysql-user=tpcc \--mysql-password=**** --test=tests/db/oltp.lua --oltp_tables_count=10\--oltp-table-size=10000000 --num-threads=8 --oltp-read-only=off \--report-interval=10 --rand-type=uniform --max-time=3600\--max-requests=0 --percentile=99 run >> /tmp/2017080101.log

--num-threads=8 表示发起 8个并发连接

--oltp-read-only=off 表示不要进行只读测试，也就是会采用读写混合模式测试

--report-interval=10 表示每10秒输出一次测试进度报告

--rand-type=uniform 表示随机类型为固定模式，其他几个可选随机模式：uniform(固定),gaussian(高斯),special(特定的),pareto(帕累托)

--max-time=120 表示最大执行时长为 120秒

--max-requests=0 表示总请求数为 0，因为上面已经定义了总执行时长，所以总请求数可以设定为 0；也可以只设定总请求数，不设定最大执行时长

--percentile=99 表示设定采样比例，默认是 95%，即丢弃1%的长请求，在剩余的99%里取最大值

即：模拟 对10个表并发OLTP测试，每个表1000万行记录，持续压测时间为 1小时。

真实测试场景中，建议持续压测时长不小于30分钟，否则测试数据可能不具参考意义。

--oltp测试

--创建db

mysql> create database sbtest;

/data/soft/sysbench-0.5/sysbench/sysbench --test=/data/soft/sysbench-0.5/sysbench/tests/db/oltp.lua --oltp-table-size=5000000\--mysql-table-engine=innodb --mysql-user=system --mysql-password=**** --mysql-port=3306 --mysql-host=127.0.0.1 --mysql-db=sbtest \--max-requests=0 --max-time=600 --oltp-tables-count=10 --reportinterval=10 --oltp-read-only=off --num_threads=8prepare/data/soft/sysbench-0.5/sysbench/sysbench --test=/data/soft/sysbench-0.5/sysbench/tests/db/oltp.lua --oltp-table-size=5000000\--mysql-table-engine=innodb --mysql-user=system --mysql-password=**** --mysql-port=3306 --mysql-host=127.0.0.1 --mysql-db=sbtest \--max-requests=0 --max-time=600 --oltp-tables-count=10 --reportinterval=10 --oltp-read-only=off --num_threads=8 run >> /home/mysql/sysbench_20180806.log

测试结果解读如下：

[root@mysql5635 sysbench]#cat /home/mysql/sysbench.log

sysbench 0.5: multi-threaded system evaluation benchmark

Running the test with following options:

Number of threads:8Report intermediate results every10second(s)

Random number generator seed is0and will be ignored

Threads started!

-- 每10秒钟报告一次测试结果，tps、每秒读、每秒写、99%以上的响应时长统计

[ 10s] threads:8, tps: 194.81, reads/s: 2737.20, writes/s: 780.05, response time: 206.36ms (99%)

[ 20s] threads:8, tps: 213.60, reads/s: 2991.02, writes/s: 856.40, response time: 176.82ms (99%)

[ 30s] threads:8, tps: 233.90, reads/s: 3274.61, writes/s: 934.00, response time: 111.08ms (99%)

[ 40s] threads:8, tps: 224.40, reads/s: 3141.18, writes/s: 899.19, response time: 87.77ms (99%)

[ 50s] threads:8, tps: 229.70, reads/s: 3215.82, writes/s: 916.01, response time: 138.09ms (99%)

[ 60s] threads:8, tps: 238.98, reads/s: 3346.58, writes/s: 957.24, response time: 70.88ms (99%)

[ 70s] threads:8, tps: 225.50, reads/s: 3156.95, writes/s: 901.19, response time: 97.78ms (99%)

[ 80s] threads:8, tps: 232.51, reads/s: 3255.48, writes/s: 931.25, response time: 105.51ms (99%)

[ 90s] threads:8, tps: 230.79, reads/s: 3230.76, writes/s: 921.56, response time: 117.30ms (99%)

[ 100s] threads:8, tps: 232.91, reads/s: 3259.58, writes/s: 932.15, response time: 121.99ms (99%)

[ 110s] threads:8, tps: 244.60, reads/s: 3422.53, writes/s: 979.41, response time: 80.64ms (99%)

[ 120s] threads:8, tps: 234.39, reads/s: 3284.13, writes/s: 936.05, response time: 87.45ms (99%)

OLTP test statistics:

queries performed:

read:383124--读总数

write:109464--写总数

other:54732--其他操作总数(SELECT、INSERT、UPDATE、DELETE之外的操作，例如COMMIT等)

total:547320--全部总数

transactions:27366 (227.99 per sec.)--总事务数(每秒事务数)

deadlocks:0 (0.00 per sec.)--发生死锁总数

read/write requests: 492588 (4103.90 per sec.)--读写总数(每秒读写次数)

other operations:54732 (455.99 per sec.)--其他操作总数(每秒其他操作次数)

General statistics:--一些统计结果

total time:120.0291s--总耗时

total number of events:27366-共发生多少事务数

total time taken by event execution:959.7161s--所有事务耗时相加(不考虑并行因素)

response time:--响应时长统计

min:5.35ms--最小耗时

avg:35.07ms--平均耗时

max:455.91ms--最长耗时

approx.99 percentile: 116.12ms-- 超过99%平均耗时

Threads fairness:

events (avg/stddev): 3420.7500/15.36execution time (avg/stddev): 119.9645/0.02

--获取数据

sysbench --mysql-host=127.0.0.1 --mysql-port=3306 --mysql-user=system --mysql-password=**** --test=tests/db/oltp.lua --oltp_tables_count=3\--oltp-table-size=1000 --rand-init=on prepare

sysbench--mysql-host=127.0.0.1 --mysql-port=3306 --mysql-user=system --mysql-password='****' --test=tests/db/oltp.lua --oltp_tables_count=3\--oltp-table-size=1000 --num-threads=8 --oltp-read-only=off --report-interval=10 --rand-type=uniform --max-time=120 --max-requests=0\--percentile=99 run >> /home/mysql/sysbench.log

----20180905 浪潮服务器测试

#unzip sysbench-0.5.zip#yum install automake libaio libaio-devel libtool -y#./autogen.sh#./configure --prefix=/usr/local/sysbench --with-mysql-includes=/usr/local/mysql/include --with-mysql-libs=/usr/local/mysql/lib && make && make install

drv_mysql.c:37:19: fatal error: mysql.h: No such file or directory#yum install mysql-community-devel#./configure --prefix=/usr/local/sysbench --with-mysql-includes=/usr/include/mysql && make && make install

#echo "export PATH=$PATH:/usr/local/sysbench/bin/">>/etc/profile#source /etc/profile

[root@mysql1 sysbench-0.5]#sysbench

sysbench--test=/usr/local/sysbench/share/sysbench/oltp.lua --oltp-table-size=5000000\--mysql-table-engine=innodb --mysql-user=system --mysql-password=**** --mysql-port=3306 --mysql-host=127.0.0.1 --mysql-db=sbtest \--max-requests=0 --max-time=600 --oltp-tables-count=10 --reportinterval=10 --oltp-read-only=off --num_threads=8prepare

sysbench--test=/usr/local/sysbench/share/sysbench/oltp.lua --oltp-table-size=5000000\--mysql-table-engine=innodb --mysql-user=system --mysql-password=**** --mysql-port=3306 --mysql-host=127.0.0.1 --mysql-db=sbtest \--max-requests=0 --max-time=600 --oltp-tables-count=10 --reportinterval=10 --oltp-read-only=off --num_threads=8 run >> /home/mysql/sysbench_20180906.log

sysbench--test=/usr/local/sysbench/share/sysbench/oltp.lua --oltp-table-size=5000000\--mysql-table-engine=innodb --mysql-user=system --mysql-password=***** --mysql-port=3306 --mysql-host=127.0.0.1 --mysql-db=sbtest \--max-requests=0 --max-time=600 --oltp-tables-count=10 --reportinterval=10 --oltp-read-only=off --num_threads=8 cleanup

--20190403

[root@localhost sysbench-0.5]#sysbench

sysbench: error while loading shared libraries: libmysqlclient.so.20: cannot open shared object file: No such file or directory

[root@localhost sysbench-0.5]#ll /usr/local/mysql/lib/libmysqlclient.so.20

lrwxrwxrwx. 1 mysql mysql 25 Apr 3 15:37 /usr/local/mysql/lib/libmysqlclient.so.20 -> libmysqlclient.so.20.3.11[root@localhost sysbench-0.5]#ln -s /usr/local/mysql/lib/libmysqlclient.so.20 /usr/lib64/libmysqlclient.so.20

tpcc--mysql--去掉外键,添加主键自增

https://github.com/yejr/tpcc-mysql-autoinc-pk

[root@mysql1 soft]#unzip tpcc-mysql-autoinc-pk-master.zip

[root@mysql1 tpcc-mysql-autoinc-pk-master]#cd src/

[root@mysql1 src]#make

cc -w -O2 -g -I. `mysql_config --include` -c load.c/bin/sh: mysql_config: 未找到命令

load.c:18:19: 致命错误：mysql.h：没有那个文件或目录

load.c:18:19: error: mysql.h: No such file or directory

[root@hongquan1 src]#cp /usr/local/mysql/include/mysql.h .

[root@hongquan1 src]#ln -s /usr/local/mysql/bin/mysql /usr/bin

[root@hongquan1 src]#make

cc -w -O2 -g -I. `mysql_config --include` -c load.c/bin/sh: mysql_config: command not found

[root@hongquan1 src]#export PATH=/usr/local/mysql/bin:$PATH

[root@hongquan1 src]#make

[root@hongquan1 src]#cd ..

[root@hongquan1 tpcc-mysql-autoinc-pk-master]#ll

total 268

-rw-r--r-- 1 root root 1621 Mar 21 2017add_fkey_idx.sql-rw-r--r-- 1 root root 6457 Mar 21 2017 create_table-autoinc-pk.sql-rw-r--r-- 1 root root 477 Mar 21 2017load.sh-rw-r--r-- 1 root root 851 Mar 21 2017README-rw-r--r-- 1 root root 5534 Mar 21 2017README.md-rw-r--r-- 1 root root 1602 Mar 21 2017run_tpcc.sh

drwxr-xr-x 2 root root 4096 Mar 21 2017schema2

drwxr-xr-x 5 root root 4096 Mar 21 2017scripts

drwxr-xr-x 2 root root 4096 Aug 13 10:10src-rwxr-xr-x 1 root root 62899 Aug 13 10:10tpcc_load-rw-r--r-- 1 root root 2193 Mar 21 2017tpcc_load_parallel.sh-rwxr-xr-x 1 root root 157354 Aug 13 10:10tpcc_start

[root@mysql1 tpcc-mysql-autoinc-pk-master]#chown -R mysql:mysql /data/soft/tpcc-mysql-autoinc-pk-master

[mysql@mysql1 ~]$ mysqladmin -usystem -****' -h127.0.0.1 -P3306 create tpcc

[mysql@mysql1 ~]$ mysql -usystem -p'mysql' -h127.0.0.1 -P3306 -f tpcc < create_table-autoinc-pk.sql

加载数据

[root@mysql1 tpcc-mysql-autoinc-pk-master]#./tpcc_load 192.168.19.87:3306 tpcc system "*****" 10

[root@mysql1 tpcc-mysql-autoinc-pk-master]#time ./tpcc_start -h 192.168.19.87 -P 3306 -d tpcc -usystem -****' -w 10 -c 32 -r 120 -l 600 -f tpcc_mysql_2018081301

--tpcc-mysql

http://blog.chinaunix.net/uid-26896862-id-3188313.html

--tpcc使用说明

下载TPCC-MySQL

[root@12crac1 software]#yum install bzr -y

[root@12crac1 software]#bzr branch lp:~percona-dev/perconatools/tpcc-mysql

You have not informed bzr of your Launchpad ID, and you must dothis to

write to Launchpad or access private data. See"bzr help launchpad-login".

Branched48revision(s).

[root@12crac1 software]#export PATH=/usr/local/mysql/bin:$PATH

[root@12crac1 software]#cd tpcc-mysql/src/

[root@12crac1 src]#make

cc -w -O2 -g -I. `mysql_config --include` -c load.c

[root@12crac1 src]#cd ..

[root@12crac1 tpcc-mysql]#ll

-rwxr-xr-x 1 root root 61199 Mar 30 23:38 tpcc_load--用于初始化数据-rwxr-xr-x 1 root root 155934 Mar 30 23:38 tpcc_start--用于执行基准测试

基本配置

[root@12crac1 ~]#su - mysql

[mysql@12crac1 ~]$ cd /data/software/tpcc-mysql/[mysql@12crac1 src]$mysqladmin create tpcc

mysql>create database tpcc;

– create_table.sql-创建数据表

– add_fkey_idx.sql – 创建索引及外键

[mysql@12crac1 tpcc-mysql]$ mysql -h 127.0.0.1 -usystem -pmysql tpcc < create_table.sql

[mysql@12crac1 tpcc-mysql]$ mysql -h 127.0.0.1 -usystem -pmysql tpcc < add_fkey_idx.sql

mysql>show tables;+----------------+

| Tables_in_tpcc |

+----------------+

| customer |

| district |

| history |

| item |

| new_orders |

| order_line |

| orders |

| stock |

| warehouse |初始化加载数据

– tpcc_load db_host db_name db_user db_passwd

db_warehouse_num

– 例如：tpcc_load localhost tpcc1000 user passwd1000运行OLTP测试

– ./tpcc_start -h localhost -d tpcc1000 -u root -p '***' -w 1000

-c 32 -r 120 -l 3600 -f ./tpcc_mysql_20120314

基准-OLTP

– warehouse= 1000– max connection= 8 ~ 512– warm up= 120(s)

– run time/duration = 3600(s)

测试用例

./tpcc_start -h host -d db -u user -p passwd -w 500 -c 128 -r 120 -l 3600

-w warehose/仓库数-c concurrent threads/并发线程-r warmup/数据预热时长-l during time/持续加压时长

[mysql@12crac1 tpcc-mysql]$ ./tpcc_load 127.0.0.1:3306 tpcc system "****" 10./tpcc_load: error while loading shared libraries: libmysqlclient.so.18: cannot open shared object file: No such file or directory

[root@12crac1 tpcc-mysql]#ln -s /usr/local/mysql/lib/libmysqlclient.so.18 /usr/lib64/libmysqlclient.so.18

--初始化数据

./tpcc_load 127.0.0.1:3306 tpcc system "***" 2./tpcc_start -h 127.0.0.1 -d tpcc -usystem -p "***" -w 2 -c 2 -r 100 -l 300 >tpcc.out

[root@12crac1 tpcc-mysql]#vim load.sh

介绍一下各个参数的用法-h server_host: 服务器名-P port : 端口号，默认为3306-d database_name: 数据库名-u mysql_user : 用户名-p mysql_password : 密码-w warehouses: 仓库的数量-c connections : 线程数，默认为1-r warmup_time : 热身时间，单位:s，默认为10s ,热身是为了将数据加载到内存。-l running_time: 测试时间，单位:s，默认为20s--建议半个小时或一个小时 3600

-i report_interval: 指定生成报告间隔时长-freport_file: 测试结果输出文件

[root@12crac1 tpcc-mysql]#./tpcc_start -h 127.0.0.1 -d tpcc -usystem -p "***" -w 10 -c 10 -r 100 -l 300 -f /home/mysql/tpcc_mysql.log -t /home/mysql/tpcc_mysql.rtx

./tpcc_start -h 127.0.0.1 -d tpcc -usystem -p "***" -w 10 -c 10 -r 1200 -l 3600 >tpcc.out

sc--成功,lt--延迟,rt--重试,fl--失败

http://blog.chinaunix.net/uid-26896862-id-3563600.html--tpc 输出详情

STOPPING THREADS..........

[0] sc:33640 lt:5 rt:0 fl:0[1] sc:33648 lt:0 rt:0 fl:0[2] sc:3364 lt:0 rt:0 fl:0[3] sc:3364 lt:0 rt:0 fl:0[4] sc:3364 lt:0 rt:0 fl:0

in 300sec.

[0] sc:33640 lt:5 rt:0 fl:0[1] sc:33648 lt:0 rt:0 fl:0[2] sc:3364 lt:0 rt:0 fl:0[3] sc:3364 lt:0 rt:0 fl:0[4] sc:3364 lt:0 rt:0 fl:0(all must be [OK])

[transaction percentage]

Payment:43.48% (>=43.0%) [OK]

Order-Status: 4.35% (>= 4.0%) [OK]

Delivery:4.35% (>= 4.0%) [OK]

Stock-Level: 4.35% (>= 4.0%) [OK]

[response time (at least90%passed)]

New-Order: 99.99%[OK]

Payment:100.00%[OK]

Order-Status: 100.00%[OK]

Delivery:100.00%[OK]

Stock-Level: 100.00%[OK]

6729.000TpmC--TpmC 整体性能指标，本系统每分钟能够处理的订单数量,tpcc没有收集系统性能指标--使用gnuplot生成图表

[root@12crac1 mysql]#yum install -y gnuplot

[root@12crac1 mysql]#gnuplot

[root@12crac1 mysql]#rm -f /var/run/yum.pid

[root@12crac1 mysql]#yum install -y gnuplot-x11

[root@12crac1 scripts]#chmod +x analyze.sh

[root@12crac1 scripts]#./analyze.sh /home/mysql/tpcc_mysql1.log /home/mysql/tpcc_20160331.res

Defined /home/mysql/tpcc_20160331.res

[root@12crac1 scripts]#pwd

/data/software/tpcc-mysql/scripts

[root@12crac1 mysql]#vim log.conf

[root@12crac1 mysql]#more log.conf

set terminal gif small size 480,360 #指定输出成gif图片，且图片大小为550×25

set output "tcpp.gif" #指定输出gif图片的文件名

set title "MySQL Performance" #图片标题

set style data lines #显示网格

set xlabel "Time/s" #X轴标题

set ylabel "Data" #Y轴标题

set grid #显示网格

plot \"tpcc_20160331.res" using 1:2 title "Total throughput"with lines

运行生成tcpp.gif：#cat log.conf | gnuplot

---20160415./tpcc_start -h 127.0.0.1 -d tpcc -usystem -p "mysql" -w 10 -c 10 -r 100 -l 300 >tpcc.out

[root@12crac1 scripts]#./analyze.sh /data/software/tpcc-mysql/tpcc.out >/home/mysql/tpcc_test.txt

[root@12crac1 mysql]#cat log.conf |gnuplot

Could not find/open font when opening font "arial", using internal non-scalable font

[root@12crac1 mysql]#more tpcc_test.txt

1 1.403000

0 0.000000

fio在Linux系统下使用比较方便，iometer在window系统下使用比较方便，Orion是oracle的IO测试软件，可在没有安装oracle数据库的情况下模拟oracle数据库场景的读写。

--下载fio源码包

--检查aio依赖包

[root@12crac1 ~]#rpm -qa|grep aio

libaio-devel-0.3.107-10.el6.x86_64

libaio-0.3.107-10.el6.x86_64

[root@12crac1 software]#tar xvfz fio-2.1.10.tar.gz

[root@12crac1 fio-2.1.10]#./configure

[root@12crac1 fio-2.1.10]#make -j

[root@12crac1 fio-2.1.10]#ll |grep fio

-rwxr-xr-x 1 root root 3164335 Mar 30 22:48fio

[root@12crac1 fio-2.1.10]#./fio --help

fio-2.1.10[root@12crac1 fio-2.1.10]#./fio --cmdhelp

[root@12crac1 fio-2.1.10]#./fio --enghelp

--output--output-format=x--crctest Test speed of checksum functions--cpuclock-test Perform test/validation of CPU clock--runtime Runtime inseconds

[root@12crac1 fio-2.1.10]#./fio -filename=/data/ -direct=1 -iodepth 1 -rw=read -ioengine=psync \

-bs=16k -size=100G -numjob=10 -runtime=10 -group_reporting -name=mytest --output-format=json

fio: pid=0, err=21/file:filesetup.c:63, func=unlink, error=Is a directory

fio是用来对裸设备做测试的，所以你的-filename参数不能使用目录，而应该使用硬盘分区

fio是一个非常灵活的io测试工具

说明：

filename=/dev/sdb1 测试文件名称，通常选择需要测试的盘的data目录。

direct=1测试过程绕过机器自带的buffer。使测试结果更真实,是否使用directIO。

rw=randwrite 测试随机写的I/O

rw=randrw 测试随机写和读的I/O

bs=16k 单次io的块文件大小为16k

bsrange=512-2048同上，提定数据块的大小范围

size=5g 本次的测试文件大小为5g，以每次4k的io进行测试,每个线程写入数据量。

numjobs=30本次的测试线程为30.

runtime=1000测试时间为1000秒，如果不写则一直将5g文件分4k每次写完为止。

ioengine=psync io引擎使用pync方式

rwmixwrite=30 在混合读写的模式下，写占30%group_reporting 关于显示结果的，汇总每个进程的信息。

此外

lockmem=1g 只使用1g内存进行测试。

zero_buffers 用0初始化系统buffer。

nrfiles=8每个进程生成文件的数量-thread：使用pthread_create创建线程，另一种是fork创建进程。进程的开销比线程要大，一般都采用thread测试。

ios=所有group总共执行的IO数.

merge=总共发生的IO合并数.

ticks=Number of ticks we kept the disk busy.

io_queue=花费在队列上的总共时间.

util=磁盘利用率

[root@12crac1 fio-2.1.10]#./fio -filename=/dev/sda -direct=1 -iodepth 1 -rw=read -ioengine=psync -bs=16k -size=100G -numjob=10 -runtime=10 -group_reporting -name=mytest --output-format=json

{"fio version" : "fio-2.1.10","jobs": [

{"jobname" : "mytest","groupid" : 0,"error" : 0,"read": {"io_bytes" : 2159952,"bw" : 215973,"iops" : 13498,"runtime" : 10001,"slat": {"min" : 0,"max" : 0,"mean" : 0.00,"stddev" : 0.00....

[root@12crac1 fio-2.1.10]#./fio -filename=/dev/sda -direct=1 -iodepth 1 -rw=read -ioengine=psync -bs=16k -size=100G -numjob=10 -runtime=10 -group_reporting -name=mytest

mytest: (g=0): rw=read, bs=16K-16K/16K-16K/16K-16K, ioengine=psync, iodepth=1...

fio-2.1.10Starting10processes

Jobs:10 (f=10): [RRRRRRRRRR] [100.0% done] [240.5MB/0KB/0KB /s] [15.4K/0/0iops] [eta 00m:00s]

mytest: (groupid=0, jobs=10): err= 0: pid=10322: Wed Mar 30 23:11:15 2016read : io=1931.7MB, bw=197775KB/s, iops=12360, runt=10001msec

clat (usec): min=75, max=95487, avg=767.47, stdev=1761.01lat (usec): min=77, max=95489, avg=777.35, stdev=1767.68clat percentiles (usec):| 1.00th=[ 133], 5.00th=[ 215], 10.00th=[ 270], 20.00th=[ 334],| 30.00th=[ 382], 40.00th=[ 430], 50.00th=[ 486], 60.00th=[ 564],| 70.00th=[ 668], 80.00th=[ 836], 90.00th=[ 1192], 95.00th=[ 1896],| 99.00th=[ 4832], 99.50th=[ 7328], 99.90th=[23680], 99.95th=[38144],| 99.99th=[60160]

bw (KB/s): min= 8399, max=32608, per=9.95%, avg=19677.21, stdev=5373.64lat (usec) :100=0.12%, 250=7.92%, 500=44.10%, 750=23.21%, 1000=10.76%lat (msec) :2=9.29%, 4=3.18%, 10=1.08%, 20=0.19%, 50=0.11%lat (msec) :100=0.03%cpu : usr=0.05%, sys=11.29%, ctx=133572, majf=0, minf=382IO depths :1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%submit :0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%complete :0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%issued : total=r=123622/w=0/d=0, short=r=0/w=0/d=0latency : target=0, window=0, percentile=100.00%, depth=1Run status group0(all jobs):

READ: io=1931.7MB, aggrb=197775KB/s, minb=197775KB/s, maxb=197775KB/s, mint=10001msec, maxt=10001msec

Disk stats (read/write):

sda: ios=122254/23, merge=0/25, ticks=54655/70, in_queue=54000, util=95.92%

==20180823

wget http://brick.kernel.dk/snaps/fio-2.2.5.tar.gz

yum install libaio-devel

随机读：(可直接用，向磁盘写一个2G文件，10线程，随机读1分钟，给出结果)

fio-filename=/tmp/test_randread -direct=1 -iodepth 1 -thread -rw=randread -ioengine=psync -bs=16k -size=2G -numjobs=10 -runtime=60 -group_reporting -name=mytest

read 顺序读

write 顺序写

rw,readwrite 顺序混合读写

randwrite 随机写

randread 随机读

randrw 随机混合读写

./fio -filename=/dev/sda -direct=1 -iodepth 1 -rw=read -ioengine=psync -bs=16k -size=100G -numjob=10 -runtime=10 -group_reporting -name=mytest

./fio -filename=/dev/sda -direct=1 -iodepth 1 -thread -rw=randrw -rwmixread=70 -ioengine=psync -bs=16k -size=200G -numjobs=30 -runtime=100 -group_reporting -name=mytest1

./fio -filename=/data -direct=1 -iodepth 1 -rw=read -ioengine=psync -bs=16k -size=100G -numjob=10 -runtime=10 -group_reporting -name=mytest

./fio -filename=/data/ -direct=1 -iodepth 1 -rw=randrw -ioengine=psync -bs=16k -size=100G -numjob=10 -runtime=10 -group_reporting -name=mytest --output-format=json

./fio -filename=/data/ -direct=1 -iodepth 1 -rw=read -ioengine=psync -bs=16k -size=100G -numjob=10 -runtime=10 -group_reporting -name=mytest --output-format=json--iops

[root@mysqlhq fio-2.2.5]#./fio -filename=/dev/mapper/kylin-home -direct=1 -iodepth 1 -thread -rw=randrw -ioengine=psync -bs=16k -size=500m -numjobs=10 -runtime=10 -group_reporting -name=mytest --output-format=json

==118[root@hongquan1 fio-2.2.5]#./fio -filename=/dev/sda -direct=1 -iodepth 1 -thread -rw=randrw -rwmixread=70 -ioengine=psync -bs=16k -size=200G -numjobs=30 -runtime=100 -group_reporting -name=mytest1

mytest1: (g=0): rw=randrw, bs=16K-16K/16K-16K/16K-16K, ioengine=psync, iodepth=1...

fio-2.2.5Starting30threads

Jobs:30 (f=30): [m(30)] [100.0% done] [495KB/223KB/0KB /s] [30/13/0iops] [eta 00m:00s]

mytest1: (groupid=0, jobs=30): err= 0: pid=1359: Thu Aug 23 16:16:29 2018read : io=153456KB, bw=1531.3KB/s, iops=95, runt=100218msec

clat (usec): min=33, max=1776.9K, avg=230518.12, stdev=295161.54lat (usec): min=33, max=1776.9K, avg=230518.31, stdev=295161.57clat percentiles (usec):| 1.00th=[ 52], 5.00th=[ 82], 10.00th=[ 119], 20.00th=[ 290],| 30.00th=[28544], 40.00th=[83456], 50.00th=[144384], 60.00th=[203776],| 70.00th=[268288], 80.00th=[362496], 90.00th=[585728], 95.00th=[905216],| 99.00th=[1368064], 99.50th=[1449984], 99.90th=[1646592], 99.95th=[1712128],| 99.99th=[1777664]

bw (KB/s): min= 7, max= 677, per=3.92%, avg=60.01, stdev=46.19write: io=63520KB, bw=649029B/s, iops=39, runt=100218msec

clat (usec): min=40, max=1726.6K, avg=199873.39, stdev=299754.56lat (usec): min=41, max=1726.6K, avg=199874.13, stdev=299754.51clat percentiles (usec):| 1.00th=[ 56], 5.00th=[ 73], 10.00th=[ 87], 20.00th=[ 127],| 30.00th=[ 193], 40.00th=[ 354], 50.00th=[16320], 60.00th=[179200],| 70.00th=[248832], 80.00th=[342016], 90.00th=[552960], 95.00th=[872448],| 99.00th=[1384448], 99.50th=[1482752], 99.90th=[1695744], 99.95th=[1728512],| 99.99th=[1728512]

bw (KB/s): min= 7, max= 186, per=5.75%, avg=36.39, stdev=23.70lat (usec) :50=0.65%, 100=8.68%, 250=14.30%, 500=5.25%, 750=1.63%lat (usec) :1000=0.49%lat (msec) :2=0.69%, 4=0.68%, 10=1.39%, 20=1.03%, 50=4.08%lat (msec) :100=6.75%, 250=22.73%, 500=18.98%, 750=6.22%, 1000=2.55%lat (msec) :2000=3.90%cpu : usr=0.00%, sys=0.01%, ctx=13467, majf=0, minf=5IO depths :1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%submit :0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%complete :0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%issued : total=r=9591/w=3970/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0latency : target=0, window=0, percentile=100.00%, depth=1Run status group0(all jobs):

READ: io=153456KB, aggrb=1531KB/s, minb=1531KB/s, maxb=1531KB/s, mint=100218msec, maxt=100218msec

WRITE: io=63520KB, aggrb=633KB/s, minb=633KB/s, maxb=633KB/s, mint=100218msec, maxt=100218msec

Disk stats (read/write):

sda: ios=10366/4808, merge=2971/339, ticks=2457713/996312, in_queue=3471461, util=100.00%

==226Starting30threads

Jobs:30 (f=30): [m(30)] [0.0% done] [2157KB/1326KB/0KB /s] [134/82/0iops] [eta 04d:15h:34m:27s]

mytest1: (groupid=0, jobs=30): err= 0: pid=15910: Thu Aug 23 17:03:17 2018read : io=1174.1MB, bw=11987KB/s, iops=749, runt=100365msec

clat (usec): min=18, max=1509.4K, avg=39328.95, stdev=97965.98lat (usec): min=18, max=1509.4K, avg=39329.08, stdev=97965.99clat percentiles (usec):| 1.00th=[ 27], 5.00th=[ 38], 10.00th=[ 85], 20.00th=[ 5216],| 30.00th=[ 8512], 40.00th=[11584], 50.00th=[16064], 60.00th=[22144],| 70.00th=[30592], 80.00th=[43776], 90.00th=[74240], 95.00th=[124416],| 99.00th=[497664], 99.50th=[700416], 99.90th=[1335296], 99.95th=[1449984],| 99.99th=[1466368]

bw (KB/s): min= 10, max= 1238, per=3.81%, avg=456.55, stdev=290.27write: io=494432KB, bw=4926.4KB/s, iops=307, runt=100365msec

clat (usec): min=57, max=852603, avg=1574.68, stdev=19490.91lat (usec): min=57, max=852604, avg=1575.08, stdev=19490.91clat percentiles (usec):| 1.00th=[ 64], 5.00th=[ 70], 10.00th=[ 75], 20.00th=[ 82],| 30.00th=[ 89], 40.00th=[ 98], 50.00th=[ 111], 60.00th=[ 139],| 70.00th=[ 426], 80.00th=[ 636], 90.00th=[ 1624], 95.00th=[ 2448],| 99.00th=[ 6368], 99.50th=[19840], 99.90th=[346112], 99.95th=[464896],| 99.99th=[659456]

bw (KB/s): min= 8, max= 773, per=4.15%, avg=204.32, stdev=134.39lat (usec) :20=0.01%, 50=5.23%, 100=14.37%, 250=8.37%, 500=2.12%lat (usec) :750=2.72%, 1000=1.01%lat (msec) :2=2.93%, 4=4.07%, 10=13.03%, 20=15.51%, 50=18.59%lat (msec) :100=7.23%, 250=3.06%, 500=1.04%, 750=0.40%, 1000=0.16%lat (msec) :2000=0.16%cpu : usr=0.02%, sys=0.05%, ctx=106098, majf=0, minf=7IO depths :1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%submit :0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%complete :0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%issued : total=r=75194/w=30902/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0latency : target=0, window=0, percentile=100.00%, depth=1Run status group0(all jobs):

READ: io=1174.1MB, aggrb=11987KB/s, minb=11987KB/s, maxb=11987KB/s, mint=100365msec, maxt=100365msec

WRITE: io=494432KB, aggrb=4926KB/s, minb=4926KB/s, maxb=4926KB/s, mint=100365msec, maxt=100365msec

Disk stats (read/write):

sda: ios=75535/30918, merge=1152/5, ticks=2952491/48125, in_queue=3007268, util=100.00%

==145mytest1: (groupid=0, jobs=30): err= 0: pid=29172: Thu Aug 23 17:27:52 2018read : io=1471.8MB, bw=14105KB/s, iops=881, runt=106844msec

clat (usec): min=19, max=8208.3K, avg=30723.67, stdev=167017.33lat (usec): min=19, max=8208.3K, avg=30723.84, stdev=167017.33clat percentiles (usec):| 1.00th=[ 25], 5.00th=[ 29], 10.00th=[ 34], 20.00th=[ 45],| 30.00th=[ 61], 40.00th=[ 118], 50.00th=[ 676], 60.00th=[ 6432],| 70.00th=[17024], 80.00th=[38144], 90.00th=[80384], 95.00th=[120320],| 99.00th=[244736], 99.50th=[428032], 99.90th=[1728512], 99.95th=[5079040],| 99.99th=[6193152]

bw (KB/s): min= 1, max= 1937, per=4.38%, avg=617.23, stdev=324.41write: io=625072KB, bw=5850.4KB/s, iops=365, runt=106844msec

clat (usec): min=59, max=8208.4K, avg=3492.90, stdev=64545.70lat (usec): min=60, max=8208.4K, avg=3517.20, stdev=64601.41clat percentiles (usec):| 1.00th=[ 69], 5.00th=[ 80], 10.00th=[ 90], 20.00th=[ 113],| 30.00th=[ 219], 40.00th=[ 450], 50.00th=[ 494], 60.00th=[ 548],| 70.00th=[ 700], 80.00th=[ 988], 90.00th=[ 2160], 95.00th=[ 3984],| 99.00th=[35584], 99.50th=[123392], 99.90th=[552960], 99.95th=[667648],| 99.99th=[1003520]

bw (KB/s): min= 1, max= 1052, per=4.54%, avg=265.60, stdev=152.50lat (usec) :20=0.01%, 50=17.05%, 100=14.41%, 250=8.37%, 500=8.76%lat (usec) :750=8.01%, 1000=3.49%lat (msec) :2=4.48%, 4=3.92%, 10=5.43%, 20=5.85%, 50=8.23%lat (msec) :100=6.78%, 250=4.44%, 500=0.41%, 750=0.11%, 1000=0.04%lat (msec) :2000=0.13%, >=2000=0.06%cpu : usr=0.19%, sys=0.22%, ctx=133273, majf=0, minf=19IO depths :1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%submit :0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%complete :0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%issued : total=r=94192/w=39067/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0latency : target=0, window=0, percentile=100.00%, depth=1Run status group0(all jobs):

READ: io=1471.8MB, aggrb=14105KB/s, minb=14105KB/s, maxb=14105KB/s, mint=106844msec, maxt=106844msec

WRITE: io=625072KB, aggrb=5850KB/s, minb=5850KB/s, maxb=5850KB/s, mint=106844msec, maxt=106844msec

Disk stats (read/write):

sda: ios=94438/39072, merge=49/0, ticks=2855388/142114, in_queue=2997516, util=95.88%