跳至正文
Wener Notes

Benchmark

约 8 分钟阅读

Disk

  • 场景
    • 顺序读写 （吞吐量，常用单位为 MB/s）：文件在硬盘上存储位置是连续的。
      • 适用场景：大文件拷贝（比如视频音乐）。速度即使很高，对数据库性能也没有参考价值。
    • 4K 随机读写 （IOPS，常用单位为次）：在硬盘上随机位置读写数据，每次 4KB。
      • 适用场景：操作系统运行、软件运行、数据库。
  • 复杂压测考虑使用 fio
bash
apk add hdparm

# 简单的文件写入性能
# 因为写入的 0 需要注意底层系统是否会进行压缩
dd if=/dev/zero of=test conv=fdatasync bs=384k count=1k status=progress
rm -f test

hdparm -I /dev/sda  # 磁盘信息
hdparm -Tt /dev/sda # 磁盘性能

cd "/usr/local/share/ca-certificates" && curl "https://s3.amazonaws.com/rds-downloads/rds-combined-ca-bundle.pem" | csplit -f "rds-" - '/-----BEGIN CERTIFICATE-----/' '{*}'

http

ab

Network

bash
# 速度检测
# 服务端
nc -v -v -l -n -p 8000 | pv > /dev/null
# 客户端
time yes | pv | nc -v -v -n 192.168.1.1 8000 > /dev/null

# 简单的 TCP/IP 延时测试
# 服务端
nc -v -v -n -k -l 8000 | pv > /dev/null
# 客户端
# 计算接收和发送时间
nmap --packet-trace -p 8000 192.168.1.2

# qperf
# ==========
apk add --no-cache -X http://mirrors.aliyun.com/alpine/edge/testing qperf
# 服务端
qperf
# 客户端
# _bw 带宽, _lat 延迟, 协议支持 rds, sctp, sdp, tcp, udp
qperf 192.168.2.2 tcp_bw tcp_lat
# 万兆 tcp_bw: 1.12 GB/sec tcp_lat: 23.9 us
# 千兆 tcp_bw: 117 MB/sec tcp_lat: 41.6 us

# iperf
# ==========
# https://iperf.fr/
apk add iperf3
iperf3 -s
iperf3 -c 192.168.1.2

sysbench

  • 內建测试
    • fileio: a filesystem-level benchmark
    • cpu: a simple CPU benchmark
    • memory: a memory access benchmark
    • threads: a thread-based scheduler benchmark
    • mutex: a POSIX mutex benchmark
bash
# macOS
brew install sysbench --without-mysql
# AlpineLinux
apk add sysbench

# build from source
git clone --depth=1 https://github.com/akopytov/sysbench
cd sysbench
./autogen.sh
./configure --without-mysql --prefix $PWD/dist
make -j 8
make install

# 默认 --threads=1 --time=10 --warmup-time=0
sysbench cpu run
sysbench cpu run --threads=$(nproc) --warmup-time=10 --time=20
# 查看测试相关帮助
sysbench memory help
# 默认 --memory-block-size=1K --memory-total-size=100G --memory-oper=write --memory-access-mode=seq
sysbench memory run
sysbench memory run --memory-oper=read --memory-access-mode=rnd
# 默认 --file-num=128 --file-block-size=16384 --file-total-size=2G --file-io-mode=sync --file-rw-ratio=1.5
# --file-test-mode seqwr, seqrewr, seqrd, rndrd, rndwr, rndrw
# --file-io-mode sync,async,mmap
sysbench fileio prepare
sysbench fileio run --file-test-mode=rndwr --threads=$(nproc) --warmup-time=10 --time=20

cryptsetup benchmark

bash
apk add cryptsetup
cryptsetup benchmark

Intel Xeon E5-2660 v2 (20) @ 3.000GHz

text
PBKDF2-sha1       431868 iterations per second for 256-bit key
PBKDF2-sha256     652911 iterations per second for 256-bit key
PBKDF2-sha512     451972 iterations per second for 256-bit key
PBKDF2-ripemd160  309497 iterations per second for 256-bit key
PBKDF2-whirlpool  173146 iterations per second for 256-bit key
argon2i       5 iterations, 1048576 memory, 4 parallel threads (CPUs) for 256-bit key (requested 2000 ms time)
argon2id      5 iterations, 1048576 memory, 4 parallel threads (CPUs) for 256-bit key (requested 2000 ms time)
#     Algorithm |       Key |      Encryption |      Decryption
        aes-cbc        128b       360.1 MiB/s      1103.8 MiB/s
    serpent-cbc        128b        44.6 MiB/s       177.5 MiB/s
    twofish-cbc        128b       108.6 MiB/s       206.2 MiB/s
        aes-cbc        256b       262.2 MiB/s       859.0 MiB/s
    serpent-cbc        256b        51.6 MiB/s       177.1 MiB/s
    twofish-cbc        256b       113.7 MiB/s       202.7 MiB/s
        aes-xts        256b       972.3 MiB/s       967.8 MiB/s
    serpent-xts        256b       165.3 MiB/s       169.1 MiB/s
    twofish-xts        256b       187.9 MiB/s       193.4 MiB/s
        aes-xts        512b       782.2 MiB/s       778.0 MiB/s
    serpent-xts        512b       177.1 MiB/s       168.4 MiB/s
    twofish-xts        512b       190.9 MiB/s       187.9 MiB/s

Intel Xeon E5-2666 v3 (40) @ 3.500GHz

text
PBKDF2-sha1      1046483 iterations per second for 256-bit key
PBKDF2-sha256    1495828 iterations per second for 256-bit key
PBKDF2-sha512    1201117 iterations per second for 256-bit key
PBKDF2-ripemd160  659481 iterations per second for 256-bit key
PBKDF2-whirlpool  450419 iterations per second for 256-bit key
argon2i       4 iterations, 1048576 memory, 4 parallel threads (CPUs) for 256-bit key (requested 2000 ms time)
argon2id      4 iterations, 1048576 memory, 4 parallel threads (CPUs) for 256-bit key (requested 2000 ms time)
#     Algorithm |       Key |      Encryption |      Decryption
        aes-cbc        128b       511.0 MiB/s      2380.8 MiB/s
    serpent-cbc        128b        78.9 MiB/s       532.0 MiB/s
    twofish-cbc        128b       147.6 MiB/s       339.5 MiB/s
        aes-cbc        256b       428.3 MiB/s      1758.8 MiB/s
    serpent-cbc        256b        82.6 MiB/s       513.0 MiB/s
    twofish-cbc        256b       172.7 MiB/s       330.4 MiB/s
        aes-xts        256b      1845.8 MiB/s      2082.5 MiB/s
    serpent-xts        256b       486.0 MiB/s       452.9 MiB/s
    twofish-xts        256b       311.6 MiB/s       312.9 MiB/s
        aes-xts        512b      1670.7 MiB/s      1651.7 MiB/s
    serpent-xts        512b       481.1 MiB/s       459.3 MiB/s
    twofish-xts        512b       311.0 MiB/s       303.7 MiB/s

stress-ng

text
stress-ng --metrics-brief --cpu $(nproc) -t 1m
text
setting to a 60 second run per stressor
dispatching hogs: 40 cpu
stressor       bogo ops real time  usr time  sys time   bogo ops/s     bogo ops/s
                          (secs)    (secs)    (secs)   (real time) (usr+sys time)
cpu             2096887     60.00   2212.41      0.35     34947.11         947.63
successful run completed in 60.01s (1 min, 0.01 secs)

AMD EPYC 7601 (128) @ 2.200GHz

text
PBKDF2-sha1       752206 iterations per second for 256-bit key
PBKDF2-sha256    1353001 iterations per second for 256-bit key
PBKDF2-sha512     644088 iterations per second for 256-bit key
PBKDF2-ripemd160  442064 iterations per second for 256-bit key
PBKDF2-whirlpool  378820 iterations per second for 256-bit key
argon2i       4 iterations, 1048576 memory, 4 parallel threads (CPUs) for 256-bit key (requested 2000 ms time)
argon2id      4 iterations, 1048576 memory, 4 parallel threads (CPUs) for 256-bit key (requested 2000 ms time)
#     Algorithm |       Key |      Encryption |      Decryption
        aes-cbc        128b       872.1 MiB/s      2663.1 MiB/s
    serpent-cbc        128b        80.5 MiB/s       316.1 MiB/s
    twofish-cbc        128b       174.3 MiB/s       320.9 MiB/s
        aes-cbc        256b       697.7 MiB/s      2286.4 MiB/s
    serpent-cbc        256b        88.4 MiB/s       316.0 MiB/s
    twofish-cbc        256b       182.1 MiB/s       320.9 MiB/s
        aes-xts        256b      2222.5 MiB/s      2224.5 MiB/s
    serpent-xts        256b       287.5 MiB/s       290.9 MiB/s
    twofish-xts        256b       293.0 MiB/s       296.7 MiB/s
        aes-xts        512b      1905.1 MiB/s      1897.8 MiB/s
    serpent-xts        512b       294.1 MiB/s       291.3 MiB/s
    twofish-xts        512b       296.6 MiB/s       295.8 MiB/s

sysbench

bash
sysbench cpu run --threads=$(nproc) --cpu-max-prime=20000
text
sysbench 1.0.20 (using bundled LuaJIT 2.1.0-beta2)

Running the test with following options:
Number of threads: 128
Initializing random number generator from current time


Prime numbers limit: 20000

Initializing worker threads...

Threads started!

CPU speed:
    events per second: 30864.15

General statistics:
    total time:                          10.0046s
    total number of events:              308833

Latency (ms):
         min:                                    1.78
         avg:                                    4.06
         max:                                  114.08
         95th percentile:                        4.10
         sum:                              1253151.81

Threads fairness:
    events (avg/stddev):           2412.7578/60.50
    execution time (avg/stddev):   9.7902/0.15

stress-ng

bash
stress-ng --metrics-brief --cpu $(nproc) -t 1m
text
setting to a 60 second run per stressor
dispatching hogs: 128 cpu
stressor       bogo ops real time  usr time  sys time   bogo ops/s     bogo ops/s
                          (secs)    (secs)    (secs)   (real time) (usr+sys time)
cpu             6770087     60.00   7654.65      0.01    112830.66         884.44
successful run completed in 60.03s (1 min, 0.03 secs)

Explain Benchmark

  • 怎么表达性能变化
  • 怎么表达性能 提升/下降
  • 延迟、内存、CPU、准确度

例子

  • 延迟降低 20%: 100ms -> 80ms
  • p95 延迟降低 35%: 200ms -> 130ms
  • p99 延迟降低 18%: 450ms -> 370ms
  • 吞吐量提升 40%: 10k req/s -> 14k req/s
  • QPS 提升 2.1x: 9k -> 19k
  • 吞吐量相同但资源占用下降: 12k req/s (CPU 70% -> 52%)
  • CPU 平均使用率降低 25%: 80% -> 60%
  • CPU 峰值降低 30pp (百分比点): 95% -> 65%
  • 单请求 CPU 时间降低 33%: 3ms -> 2ms
  • 内存常驻集(RSS)降低 28%: 700MB -> 504MB
  • Heap 使用峰值降低 45%: 1.1GB -> 0.6GB
  • GC 次数降低 50%: 40/min -> 20/min
  • GC 总暂停时间降低 60%: 500ms/min -> 200ms/min
  • 磁盘顺序写吞吐提升 22%: 450MB/s -> 550MB/s
  • 随机 4K IOPS 提升 55%: 18k -> 28k
  • 网络带宽利用率提升 15%: 8.0Gbps -> 9.2Gbps
  • 单链接握手时间降低 25%: 40ms -> 30ms
  • 数据库查询平均耗时降低 37%: 27ms -> 17ms
  • 热路径函数调用次数减少 42%: 120 调用/req -> 70 调用/req
  • 锁等待时间降低 65%: 200µs -> 70µs
  • 任务调度延迟(p99)降低 50%: 2ms -> 1ms
  • TPS 提升 33%: 3,000 -> 4,000
  • 错误率降低 80%: 0.5% -> 0.1%
  • 可用性提升: 99.5% -> 99.95% (年不可用时间 ~44h -> ~4.4h)
  • 模型推理延迟降低 45%: 110ms -> 60ms
  • 模型精度(Top-1) 提升 2.3pp: 91.2% -> 93.5%
  • 每核性能提升 30%: 5k req/s/核 -> 6.5k req/s/核
  • 成本/吞吐 降低 38%: 120/10kreq/s−>120/10k req/s -> 75/10k req/s
  • 单请求能耗降低 25%: 40mJ -> 30mJ
  • 冷启动时间降低 70%: 500ms -> 150ms
  • 部署包体积降低 55%: 180MB -> 81MB
  • 启动内存占用降低 40%: 150MB -> 90MB
  • 重试次数降低 60%: 50/min -> 20/min
  • 队列排队时间(p90)降低 50%: 200ms -> 100ms
  • 端到端流水线吞吐提升 2x: 1,000 items/min -> 2,000 items/min

表达规范:

  • 提升(%) = (新值 - 旧值) / 旧值 * 100%
  • 降低(%) = (旧值 - 新值) / 旧值 * 100%
  • 可强调倍率: 提升 2x / 3.5x
  • 区分百分比(%) 与 百分比点(pp)

组合表达示例:

  • p99 延迟 480ms -> 320ms (-33%), 吞吐 11k -> 13.2k (+20%), CPU 75% -> 62% (-13pp)

关联信息

反向链接、本文链接的其他页面和外部资料。

参考资料

GitHub5 条
其他外链8 条
最近更新commit b1c319a编辑

Augeas

上一页

Crontab

下一页