这是一个创建于 2197 天前的主题，其中的信息可能已经有所发展或是发生改变。
腾讯官网说高速云硬盘 iops 性能为 1500-4500，但是用 fio 实测随机写的 IOPS 才几百-1000。这是被坑了吗？？？
测阿里和华为的都能到 2000.
截取腾讯的两个测试:
测试一
---------------------------------------------------
[centos ~]$ fio -filename=test/randw -iodepth=64 -ioengine=libaio -direct=1 -rw=randwrite -bs=4k -size=4G -numjobs=64 -runtime=20 -group_reporting -name=test-rand-write
test-rand-write: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
...
fio-3.1
Starting 64 processes
test-rand-write: Laying out IO file (1 file / 4096MiB)
Jobs: 64 (f=64): [w(64)][100.0%][r=0KiB/s,w=2624KiB/s][r=0,w=656 IOPS][eta 00m:00s]
test-rand-write: (groupid=0, jobs=64): err= 0: pid=3964: Sat Nov 24 08:43:40 2018
write: IOPS=736, BW=2946KiB/s (3017kB/s)(58.6MiB/20363msec)
slat (usec): min=3, max=1994.3k, avg=85405.28, stdev=331000.31
clat (msec): min=18, max=18100, avg=4578.87, stdev=2672.72
lat (msec): min=18, max=18850, avg=4664.28, stdev=2698.58
clat percentiles (msec):
| 1.00th=[ 284], 5.00th=[ 902], 10.00th=[ 1401], 20.00th=[ 2106],
| 30.00th=[ 2903], 40.00th=[ 3406], 50.00th=[ 4329], 60.00th=[ 4799],
| 70.00th=[ 5805], 80.00th=[ 7013], 90.00th=[ 8490], 95.00th=[ 9866],
| 99.00th=[11476], 99.50th=[12013], 99.90th=[13758], 99.95th=[14697],
| 99.99th=[17113]
bw ( KiB/s): min= 8, max= 819, per=4.33%, avg=127.49, stdev=132.69, samples=688
iops : min= 2, max= 204, avg=31.75, stdev=33.05, samples=688
lat (msec) : 20=0.03%, 50=0.01%, 100=0.04%, 250=0.87%, 500=2.94%
lat (msec) : 750=0.59%, 1000=1.40%, 2000=13.32%, >=2000=80.80%
cpu : usr=0.00%, sys=0.03%, ctx=4468, majf=0, minf=1920
IO depths : 1=0.4%, 2=0.9%, 4=1.7%, 8=3.4%, 16=6.8%, 32=13.7%, >=64=73.1%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.6%, >=64=0.0%
issued rwt: total=0,14997,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=2946KiB/s (3017kB/s), 2946KiB/s-2946KiB/s (3017kB/s-3017kB/s), io=58.6MiB (61.4MB), run=20363-20363msec
Disk stats (read/write):
vda: ios=0/14943, merge=0/524, ticks=0/5045718, in_queue=5364674, util=99.90%
+++++++++++++++++++++++++++++++++++
测试二
---------------------------------------------------
[centos ~]$ fio -filename=test/randw10 -iodepth=64 -ioengine=libaio -direct=1 -rw=randwrite -bs=4k -size=10G -numjobs=64 -runtime=30 -group_reporting -name=test-rand-write
test-rand-write: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
...
fio-3.1
Starting 64 processes
test-rand-write: Laying out IO file (1 file / 10240MiB)
Jobs: 64 (f=64): [w(64)][100.0%][r=0KiB/s,w=2874KiB/s][r=0,w=718 IOPS][eta 00m:00s]
test-rand-write: (groupid=0, jobs=64): err= 0: pid=5158: Sat Nov 24 09:14:02 2018
write: IOPS=711, BW=2846KiB/s (2914kB/s)(84.3MiB/30334msec)
slat (usec): min=4, max=1904.4k, avg=88800.88, stdev=325223.55
clat (msec): min=32, max=17506, avg=5050.25, stdev=2674.58
lat (msec): min=32, max=17506, avg=5139.05, stdev=2704.30
clat percentiles (msec):
| 1.00th=[ 300], 5.00th=[ 1183], 10.00th=[ 1603], 20.00th=[ 2601],
| 30.00th=[ 3406], 40.00th=[ 4111], 50.00th=[ 4933], 60.00th=[ 5470],
| 70.00th=[ 6477], 80.00th=[ 7215], 90.00th=[ 8557], 95.00th=[ 9463],
| 99.00th=[12147], 99.50th=[12953], 99.90th=[14429], 99.95th=[16308],
| 99.99th=[17113]
bw ( KiB/s): min= 7, max= 600, per=3.89%, avg=110.61, stdev=112.30, samples=1271
iops : min= 1, max= 150, avg=27.55, stdev=27.99, samples=1271
lat (msec) : 50=0.02%, 100=0.04%, 250=0.69%, 500=1.14%, 750=0.75%
lat (msec) : 1000=0.94%, 2000=10.03%, >=2000=86.41%
cpu : usr=0.00%, sys=0.02%, ctx=6972, majf=0, minf=1919
IO depths : 1=0.3%, 2=0.6%, 4=1.2%, 8=2.4%, 16=4.7%, 32=9.5%, >=64=81.3%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.4%, >=64=0.0%
issued rwt: total=0,21580,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=2846KiB/s (2914kB/s), 2846KiB/s-2846KiB/s (2914kB/s-2914kB/s), io=84.3MiB (88.4MB), run=30334-30334msec
Disk stats (read/write):
vda: ios=0/21421, merge=0/809, ticks=0/7509384, in_queue=8050259, util=100.00%
腾讯磁盘配置：
可用区 上海四区
硬盘类型 高性能云硬盘
硬盘属性 系统盘
云硬盘容量 50G
测阿里和华为的都能到 2000.
截取腾讯的两个测试:
测试一
---------------------------------------------------
[centos ~]$ fio -filename=test/randw -iodepth=64 -ioengine=libaio -direct=1 -rw=randwrite -bs=4k -size=4G -numjobs=64 -runtime=20 -group_reporting -name=test-rand-write
test-rand-write: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
...
fio-3.1
Starting 64 processes
test-rand-write: Laying out IO file (1 file / 4096MiB)
Jobs: 64 (f=64): [w(64)][100.0%][r=0KiB/s,w=2624KiB/s][r=0,w=656 IOPS][eta 00m:00s]
test-rand-write: (groupid=0, jobs=64): err= 0: pid=3964: Sat Nov 24 08:43:40 2018
write: IOPS=736, BW=2946KiB/s (3017kB/s)(58.6MiB/20363msec)
slat (usec): min=3, max=1994.3k, avg=85405.28, stdev=331000.31
clat (msec): min=18, max=18100, avg=4578.87, stdev=2672.72
lat (msec): min=18, max=18850, avg=4664.28, stdev=2698.58
clat percentiles (msec):
| 1.00th=[ 284], 5.00th=[ 902], 10.00th=[ 1401], 20.00th=[ 2106],
| 30.00th=[ 2903], 40.00th=[ 3406], 50.00th=[ 4329], 60.00th=[ 4799],
| 70.00th=[ 5805], 80.00th=[ 7013], 90.00th=[ 8490], 95.00th=[ 9866],
| 99.00th=[11476], 99.50th=[12013], 99.90th=[13758], 99.95th=[14697],
| 99.99th=[17113]
bw ( KiB/s): min= 8, max= 819, per=4.33%, avg=127.49, stdev=132.69, samples=688
iops : min= 2, max= 204, avg=31.75, stdev=33.05, samples=688
lat (msec) : 20=0.03%, 50=0.01%, 100=0.04%, 250=0.87%, 500=2.94%
lat (msec) : 750=0.59%, 1000=1.40%, 2000=13.32%, >=2000=80.80%
cpu : usr=0.00%, sys=0.03%, ctx=4468, majf=0, minf=1920
IO depths : 1=0.4%, 2=0.9%, 4=1.7%, 8=3.4%, 16=6.8%, 32=13.7%, >=64=73.1%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.4%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.6%, >=64=0.0%
issued rwt: total=0,14997,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=2946KiB/s (3017kB/s), 2946KiB/s-2946KiB/s (3017kB/s-3017kB/s), io=58.6MiB (61.4MB), run=20363-20363msec
Disk stats (read/write):
vda: ios=0/14943, merge=0/524, ticks=0/5045718, in_queue=5364674, util=99.90%
+++++++++++++++++++++++++++++++++++
测试二
---------------------------------------------------
[centos ~]$ fio -filename=test/randw10 -iodepth=64 -ioengine=libaio -direct=1 -rw=randwrite -bs=4k -size=10G -numjobs=64 -runtime=30 -group_reporting -name=test-rand-write
test-rand-write: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
...
fio-3.1
Starting 64 processes
test-rand-write: Laying out IO file (1 file / 10240MiB)
Jobs: 64 (f=64): [w(64)][100.0%][r=0KiB/s,w=2874KiB/s][r=0,w=718 IOPS][eta 00m:00s]
test-rand-write: (groupid=0, jobs=64): err= 0: pid=5158: Sat Nov 24 09:14:02 2018
write: IOPS=711, BW=2846KiB/s (2914kB/s)(84.3MiB/30334msec)
slat (usec): min=4, max=1904.4k, avg=88800.88, stdev=325223.55
clat (msec): min=32, max=17506, avg=5050.25, stdev=2674.58
lat (msec): min=32, max=17506, avg=5139.05, stdev=2704.30
clat percentiles (msec):
| 1.00th=[ 300], 5.00th=[ 1183], 10.00th=[ 1603], 20.00th=[ 2601],
| 30.00th=[ 3406], 40.00th=[ 4111], 50.00th=[ 4933], 60.00th=[ 5470],
| 70.00th=[ 6477], 80.00th=[ 7215], 90.00th=[ 8557], 95.00th=[ 9463],
| 99.00th=[12147], 99.50th=[12953], 99.90th=[14429], 99.95th=[16308],
| 99.99th=[17113]
bw ( KiB/s): min= 7, max= 600, per=3.89%, avg=110.61, stdev=112.30, samples=1271
iops : min= 1, max= 150, avg=27.55, stdev=27.99, samples=1271
lat (msec) : 50=0.02%, 100=0.04%, 250=0.69%, 500=1.14%, 750=0.75%
lat (msec) : 1000=0.94%, 2000=10.03%, >=2000=86.41%
cpu : usr=0.00%, sys=0.02%, ctx=6972, majf=0, minf=1919
IO depths : 1=0.3%, 2=0.6%, 4=1.2%, 8=2.4%, 16=4.7%, 32=9.5%, >=64=81.3%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.4%, >=64=0.0%
issued rwt: total=0,21580,0, short=0,0,0, dropped=0,0,0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
WRITE: bw=2846KiB/s (2914kB/s), 2846KiB/s-2846KiB/s (2914kB/s-2914kB/s), io=84.3MiB (88.4MB), run=30334-30334msec
Disk stats (read/write):
vda: ios=0/21421, merge=0/809, ticks=0/7509384, in_queue=8050259, util=100.00%
腾讯磁盘配置：
可用区 上海四区
硬盘类型 高性能云硬盘
硬盘属性 系统盘
云硬盘容量 50G
 |
1
Radeon 2018-11-24 09:24:29 +08:00
确实。我昨天试过一次密集写入，IOUtil 到了 100%以后，写入速度竟然只有 6MB/s，我都不敢相信
|
 |
3
aliehuhu 2018-11-24 11:01:56 +08:00
 |
 |
4
opengps 2018-11-24 20:28:48 +08:00
云服务器硬盘的 iops 一向都很低
|
 |
5
mydns 2018-11-24 20:55:27 +08:00
还不如普通盘
普通盘在压缩打包文件的时候 不影响网站访问； 高性能云硬盘在压缩打包文件的时候，网站访问明显变慢 |
Select Language