InferenceBenchmarker plots
Theme:
Light
Dark
vanilla
eagle-head
moe
Locust
Average Response Time
Median Response Time
Min Response Time
Max Response Time
50%
66%
75%
80%
90%
95%
98%
99%
99.9%
99.99%
100%
aiperf
avg
min
max
sum
p1
p5
p10
p25
p50
p75
p90
p95
p99
std