Это уже на "затюненом" RAID-10 со stripe 4K. Кегел Арт рекомендовал 32K (надо попробовать будет, наверное).
С fio не работал раньше, пока ещё не вкурил на что там надо хорошо смотреть.
Случайная запись:
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.
17.
18.
19.
20.
21.
22.
23.
24.
25.
26.
27.
28.
29.
30.
31.
32.
33.
34.
35.
36.
37.
38.
39.
40.
41.
42.
43.
44.
45.
46.
47.
48.
49.
50.
51.
52.
53.
54.
55.
# fio -name iops -rw=randwrite -bs=4096 -size=10G -iodepth=20 -runtime=100 -directory /mnt/backup/ -ioengine libaio -direct=1
iops: (g=0): rw=randwrite, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=20
2.0.8
Starting 1 process
Jobs: 1 (f=1): [w] [100.0% done] [0K/19632K /s] [0 /4908 iops] [eta 00m:00s]
iops: (groupid=0, jobs=1): err= 0: pid=9730
write: io=1965.2MB, bw=20121KB/s, iops=5030 , runt=100011msec
slat (usec): min=4 , max=21257 , avg=20.78, stdev=32.03
clat (usec): min=47 , max=55412 , avg=3950.78, stdev=3909.24
lat (usec): min=87 , max=55442 , avg=3971.92, stdev=3909.21
clat percentiles (usec):
| 1.00th=[ 106], 5.00th=[ 118], 10.00th=[ 189], 20.00th=[ 788],
| 30.00th=[ 1752], 40.00th=[ 2480], 50.00th=[ 2960], 60.00th=[ 3696],
| 70.00th=[ 4640], 80.00th=[ 5984], 90.00th=[ 8640], 95.00th=[11584],
| 99.00th=[18304], 99.50th=[21632], 99.90th=[30336], 99.95th=[34560],
| 99.99th=[43776]
bw (KB/s) : min=18776, max=30968, per=100.00%, avg=20129.48, stdev=900.59
lat (usec) : 50=0.01%, 100=0.57%, 250=10.06%, 500=4.23%, 750=4.27%
lat (usec) : 1000=4.26%
lat (msec) : 2=9.05%, 4=31.21%, 10=29.07%, 20=6.56%, 50=0.71%
lat (msec) : 100=0.01%
cpu : usr=2.79%, sys=12.16%, ctx=456948, majf=0, minf=22
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=100.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued : total=r=0/w=503073/d=0, short=r=0/w=0/d=0
Run status group 0 (all jobs):
WRITE: io=1965.2MB, aggrb=20120KB/s, minb=20120KB/s, maxb=20120KB/s, mint=100011msec, maxt=100011msec
Disk stats (read/write):
dm-112: ios=0/502163, merge=0/0, ticks=0/1981951, in_queue=1982106, util=100.00%, aggrios=0/503075, aggrmerge=0/0, aggrticks=0/0, aggrin_queue=0, aggrutil=0.00%
md127: ios=0/503075, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=0/45735, aggrmerge=0/0, aggrticks=0/138211, aggrin_queue=138187, aggrutil=66.37%
sdk: ios=0/45531, merge=0/0, ticks=0/114481, in_queue=114452, util=54.04%
sds: ios=0/45960, merge=0/0, ticks=0/156132, in_queue=156098, util=60.76%
sdr: ios=0/46012, merge=0/0, ticks=0/153010, in_queue=152983, util=60.30%
sdl: ios=0/45531, merge=0/0, ticks=0/128348, in_queue=128338, util=56.28%
sdo: ios=0/45561, merge=0/0, ticks=0/139896, in_queue=139865, util=57.92%
sde: ios=0/45559, merge=0/0, ticks=0/120147, in_queue=120102, util=55.70%
sdp: ios=0/45561, merge=0/0, ticks=0/139265, in_queue=139245, util=57.49%
sdv: ios=0/45641, merge=0/0, ticks=0/234999, in_queue=234980, util=66.37%
sdc: ios=0/46006, merge=0/0, ticks=0/123699, in_queue=123670, util=56.17%
sdu: ios=0/45641, merge=0/0, ticks=0/122273, in_queue=122254, util=55.24%
sdt: ios=0/45960, merge=0/0, ticks=0/125016, in_queue=124993, util=56.28%
sdn: ios=0/45868, merge=0/0, ticks=0/125965, in_queue=125947, util=56.84%
sdd: ios=0/46006, merge=0/0, ticks=0/120682, in_queue=120671, util=55.45%
sdj: ios=0/45946, merge=0/0, ticks=0/136672, in_queue=136657, util=57.82%
sdq: ios=0/46012, merge=0/0, ticks=0/126220, in_queue=126196, util=56.87%
sdg: ios=0/45255, merge=0/0, ticks=0/108591, in_queue=108563, util=51.92%
sdh: ios=0/45255, merge=0/0, ticks=0/105655, in_queue=105638, util=50.70%
sdf: ios=0/45559, merge=0/0, ticks=0/163564, in_queue=163548, util=61.45%
sdw: ios=0/45747, merge=0/0, ticks=0/124047, in_queue=124023, util=55.75%
sdm: ios=0/45868, merge=0/0, ticks=0/130654, in_queue=130630, util=57.11%
sdi: ios=0/45946, merge=0/0, ticks=0/206888, in_queue=206852, util=64.47%
sdx: ios=0/45747, merge=0/0, ticks=0/134441, in_queue=134426, util=57.18%
Случайное чтение:
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12.
13.
14.
15.
16.
17.
18.
19.
20.
21.
22.
23.
24.
25.
26.
27.
28.
29.
30.
31.
32.
33.
34.
35.
36.
37.
38.
39.
40.
41.
42.
43.
44.
45.
46.
47.
48.
49.
50.
51.
52.
53.
54.
# fio -name iops -rw=randread -bs=4096 -size=10G -iodepth=20 -runtime=100 -directory /mnt/backup/ -ioengine libaio -direct=1
iops: (g=0): rw=randread, bs=4K-4K/4K-4K, ioengine=libaio, iodepth=20
2.0.8
Starting 1 process
Jobs: 1 (f=1): [r] [100.0% done] [10825K/0K /s] [2706 /0 iops] [eta 00m:00s]
iops: (groupid=0, jobs=1): err= 0: pid=9738
read : io=1060.4MB, bw=10857KB/s, iops=2714 , runt=100014msec
slat (usec): min=5 , max=62 , avg=17.97, stdev=10.95
clat (usec): min=53 , max=75504 , avg=7348.04, stdev=4623.14
lat (usec): min=64 , max=75514 , avg=7366.29, stdev=4623.15
clat percentiles (usec):
| 1.00th=[ 1368], 5.00th=[ 2040], 10.00th=[ 2640], 20.00th=[ 3728],
| 30.00th=[ 4768], 40.00th=[ 5728], 50.00th=[ 6688], 60.00th=[ 7648],
| 70.00th=[ 8512], 80.00th=[ 9536], 90.00th=[12480], 95.00th=[15936],
| 99.00th=[24704], 99.50th=[28544], 99.90th=[38144], 99.95th=[42752],
| 99.99th=[52992]
bw (KB/s) : min=10360, max=11264, per=100.00%, avg=10863.46, stdev=175.12
lat (usec) : 100=0.04%, 250=0.01%, 500=0.01%, 750=0.02%, 1000=0.11%
lat (msec) : 2=4.50%, 4=17.86%, 10=60.56%, 20=14.67%, 50=2.22%
lat (msec) : 100=0.02%
cpu : usr=1.30%, sys=5.56%, ctx=247413, majf=0, minf=43
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=100.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
issued : total=r=271456/w=0/d=0, short=r=0/w=0/d=0
Run status group 0 (all jobs):
READ: io=1060.4MB, aggrb=10856KB/s, minb=10856KB/s, maxb=10856KB/s, mint=100014msec, maxt=100014msec
Disk stats (read/write):
dm-112: ios=270924/1, merge=0/0, ticks=1993241/124, in_queue=1993531, util=100.00%, aggrios=271456/1, aggrmerge=0/0, aggrticks=0/0, aggrin_queue=0, aggrutil=0.00%
md127: ios=271456/1, merge=0/0, ticks=0/0, in_queue=0, util=0.00%, aggrios=12338/2, aggrmerge=0/0, aggrticks=90778/58, aggrin_queue=90832, aggrutil=71.03%
sdk: ios=13356/2, merge=0/0, ticks=95331/50, in_queue=95379, util=70.09%
sds: ios=13385/2, merge=0/0, ticks=97509/49, in_queue=97555, util=70.73%
sdr: ios=11409/2, merge=0/0, ticks=86883/92, in_queue=86973, util=59.55%
sdl: ios=11284/2, merge=0/0, ticks=84944/36, in_queue=84979, util=58.72%
sdo: ios=13300/2, merge=0/0, ticks=96774/49, in_queue=96821, util=70.66%
sde: ios=13279/2, merge=0/0, ticks=96010/79, in_queue=96088, util=70.37%
sdp: ios=11241/2, merge=0/0, ticks=83951/39, in_queue=83990, util=58.65%
sdv: ios=11438/2, merge=0/0, ticks=85296/45, in_queue=85335, util=59.10%
sdc: ios=13385/3, merge=0/0, ticks=95120/124, in_queue=95237, util=70.40%
sdu: ios=13416/2, merge=0/0, ticks=97323/39, in_queue=97356, util=70.87%
sdt: ios=11338/2, merge=0/0, ticks=84452/43, in_queue=84492, util=58.82%
sdn: ios=11299/2, merge=0/0, ticks=86569/65, in_queue=86628, util=59.28%
sdd: ios=11391/3, merge=0/0, ticks=87483/46, in_queue=87525, util=59.69%
sdj: ios=11429/2, merge=0/0, ticks=87268/70, in_queue=87334, util=59.13%
sdq: ios=13404/2, merge=0/0, ticks=96123/72, in_queue=96193, util=70.62%
sdg: ios=13282/2, merge=0/0, ticks=92335/39, in_queue=92368, util=69.10%
sdh: ios=10979/2, merge=0/0, ticks=81466/62, in_queue=81522, util=57.08%
sdf: ios=11335/2, merge=0/0, ticks=86368/57, in_queue=86420, util=59.21%
sdw: ios=13471/2, merge=0/0, ticks=97238/67, in_queue=97303, util=70.77%
sdm: ios=13347/2, merge=0/0, ticks=96347/53, in_queue=96395, util=71.03%
sdi: ios=13402/2, merge=0/0, ticks=95233/55, in_queue=95288, util=70.40%
sdx: ios=11286/2, merge=0/0, ticks=87094/47, in_queue=87136, util=59.98%
В /mnt/backup примаунчен кусок с RAID-10 |
