================================================================
NOSTR RELAY BENCHMARK AGGREGATE REPORT
================================================================
Generated: 2025-12-03T22:47:18+00:00
Benchmark Configuration:
  Events per test: 50000
  Concurrent workers: 24
  Test duration: 60s
  
Relays tested: 8

================================================================
SUMMARY BY RELAY
================================================================

Relay: rely-sqlite
----------------------------------------
Status: COMPLETED
Events/sec: 16694.18
Events/sec: 6270.43
Events/sec: 16694.18
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.339216ms
Bottom 10% Avg Latency: 779.552µs
Avg Latency: 1.281976ms
P95 Latency: 1.894111ms
P95 Latency: 2.087148ms
P95 Latency: 910.529µs

Relay: next-orly-badger
----------------------------------------
Status: COMPLETED
Events/sec: 17987.95
Events/sec: 6246.39
Events/sec: 17987.95
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.16914ms
Bottom 10% Avg Latency: 675.419µs
Avg Latency: 1.301155ms
P95 Latency: 1.605171ms
P95 Latency: 2.260728ms
P95 Latency: 911.513µs

Relay: next-orly-neo4j
----------------------------------------
Status: COMPLETED
Events/sec: 17437.04
Events/sec: 6060.82
Events/sec: 17437.04
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.250926ms
Bottom 10% Avg Latency: 735.971µs
Avg Latency: 1.493295ms
P95 Latency: 1.757814ms
P95 Latency: 2.404304ms
P95 Latency: 896.796µs

Relay: khatru-sqlite
----------------------------------------
Status: COMPLETED
Events/sec: 17531.15
Events/sec: 6335.87
Events/sec: 17531.15
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.233875ms
Bottom 10% Avg Latency: 707.713µs
Avg Latency: 1.239192ms
P95 Latency: 1.713051ms
P95 Latency: 1.880869ms
P95 Latency: 918.848µs

Relay: khatru-badger
----------------------------------------
Status: COMPLETED
Events/sec: 15958.89
Events/sec: 6352.78
Events/sec: 15958.89
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.414398ms
Bottom 10% Avg Latency: 791.675µs
Avg Latency: 1.183812ms
P95 Latency: 2.191322ms
P95 Latency: 1.80172ms
P95 Latency: 903.25µs

Relay: relayer-basic
----------------------------------------
Status: COMPLETED
Events/sec: 17757.23
Events/sec: 6227.33
Events/sec: 17757.23
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.193531ms
Bottom 10% Avg Latency: 679.232µs
Avg Latency: 1.304ms
P95 Latency: 1.679267ms
P95 Latency: 2.155365ms
P95 Latency: 930.632µs

Relay: strfry
----------------------------------------
Status: COMPLETED
Events/sec: 17794.50
Events/sec: 6252.01
Events/sec: 17794.50
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.192717ms
Bottom 10% Avg Latency: 676.594µs
Avg Latency: 1.270724ms
P95 Latency: 1.645564ms
P95 Latency: 2.251457ms
P95 Latency: 915.623µs

Relay: nostr-rs-relay
----------------------------------------
Status: COMPLETED
Events/sec: 17174.61
Events/sec: 6311.06
Events/sec: 17174.61
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.281647ms
Bottom 10% Avg Latency: 742.249µs
Avg Latency: 1.260479ms
P95 Latency: 1.836808ms
P95 Latency: 1.893887ms
P95 Latency: 922.647µs


================================================================
DETAILED RESULTS
================================================================

Individual relay reports are available in:
  - /reports/run_20251203_222024/khatru-badger_results.txt
  - /reports/run_20251203_222024/khatru-sqlite_results.txt
  - /reports/run_20251203_222024/next-orly-badger_results.txt
  - /reports/run_20251203_222024/next-orly-neo4j_results.txt
  - /reports/run_20251203_222024/nostr-rs-relay_results.txt
  - /reports/run_20251203_222024/relayer-basic_results.txt
  - /reports/run_20251203_222024/rely-sqlite_results.txt
  - /reports/run_20251203_222024/strfry_results.txt

================================================================
BENCHMARK COMPARISON TABLE
================================================================

Relay                Status     Peak Tput/s     Avg Latency     Success Rate   
----                 ------     -----------     -----------     ------------   
rely-sqlite          OK         16694.18        1.339216ms      100.0%         
next-orly-badger     OK         17987.95        1.16914ms       100.0%         
next-orly-neo4j      OK         17437.04        1.250926ms      100.0%         
khatru-sqlite        OK         17531.15        1.233875ms      100.0%         
khatru-badger        OK         15958.89        1.414398ms      100.0%         
relayer-basic        OK         17757.23        1.193531ms      100.0%         
strfry               OK         17794.50        1.192717ms      100.0%         
nostr-rs-relay       OK         17174.61        1.281647ms      100.0%         

================================================================
End of Report
================================================================
