================================================================
NOSTR RELAY BENCHMARK AGGREGATE REPORT
================================================================
Generated: 2025-11-20T06:19:54+00:00
Benchmark Configuration:
  Events per test: 50000
  Concurrent workers: 24
  Test duration: 60s
  
Relays tested: 8

================================================================
SUMMARY BY RELAY
================================================================

Relay: next-orly-badger
----------------------------------------
Status: COMPLETED
Events/sec: 17207.24
Events/sec: 6359.22
Events/sec: 17207.24
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.240424ms
Bottom 10% Avg Latency: 680.755µs
Avg Latency: 1.142716ms
P95 Latency: 1.987721ms
P95 Latency: 1.919402ms
P95 Latency: 858.138µs

Relay: next-orly-dgraph
----------------------------------------
Status: COMPLETED
Events/sec: 15975.41
Events/sec: 6275.40
Events/sec: 15975.41
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.379901ms
Bottom 10% Avg Latency: 705.38µs
Avg Latency: 1.177806ms
P95 Latency: 2.307115ms
P95 Latency: 2.062351ms
P95 Latency: 858.252µs

Relay: next-orly-neo4j
----------------------------------------
Status: COMPLETED
Events/sec: 18050.59
Events/sec: 6274.46
Events/sec: 18050.59
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.142811ms
Bottom 10% Avg Latency: 648.4µs
Avg Latency: 1.192885ms
P95 Latency: 1.69225ms
P95 Latency: 1.98103ms
P95 Latency: 864.535µs

Relay: khatru-sqlite
----------------------------------------
Status: COMPLETED
Events/sec: 16911.01
Events/sec: 6346.70
Events/sec: 16911.01
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.278879ms
Bottom 10% Avg Latency: 694.3µs
Avg Latency: 1.145501ms
P95 Latency: 2.058912ms
P95 Latency: 1.860934ms
P95 Latency: 857.964µs

Relay: khatru-badger
----------------------------------------
Status: COMPLETED
Events/sec: 18095.48
Events/sec: 6260.92
Events/sec: 18095.48
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.143282ms
Bottom 10% Avg Latency: 651.813µs
Avg Latency: 1.203274ms
P95 Latency: 1.721751ms
P95 Latency: 2.200764ms
P95 Latency: 865.67µs

Relay: relayer-basic
----------------------------------------
Status: COMPLETED
Events/sec: 17973.91
Events/sec: 6364.14
Events/sec: 17973.91
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.159149ms
Bottom 10% Avg Latency: 666.22µs
Avg Latency: 1.075436ms
P95 Latency: 1.737633ms
P95 Latency: 1.805733ms
P95 Latency: 865.831µs

Relay: strfry
----------------------------------------
Status: COMPLETED
Events/sec: 17906.42
Events/sec: 6245.55
Events/sec: 17906.42
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.165583ms
Bottom 10% Avg Latency: 663.03µs
Avg Latency: 1.143689ms
P95 Latency: 1.781377ms
P95 Latency: 2.088623ms
P95 Latency: 852.326µs

Relay: nostr-rs-relay
----------------------------------------
Status: COMPLETED
Events/sec: 18036.49
Events/sec: 6278.12
Events/sec: 18036.49
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.14847ms
Bottom 10% Avg Latency: 653.417µs
Avg Latency: 1.18248ms
P95 Latency: 1.723577ms
P95 Latency: 2.000325ms
P95 Latency: 849.41µs


================================================================
DETAILED RESULTS
================================================================

Individual relay reports are available in:
  - /reports/run_20251120_055257/khatru-badger_results.txt
  - /reports/run_20251120_055257/khatru-sqlite_results.txt
  - /reports/run_20251120_055257/next-orly-badger_results.txt
  - /reports/run_20251120_055257/next-orly-dgraph_results.txt
  - /reports/run_20251120_055257/next-orly-neo4j_results.txt
  - /reports/run_20251120_055257/nostr-rs-relay_results.txt
  - /reports/run_20251120_055257/relayer-basic_results.txt
  - /reports/run_20251120_055257/strfry_results.txt

================================================================
BENCHMARK COMPARISON TABLE
================================================================

Relay                Status     Peak Tput/s     Avg Latency     Success Rate   
----                 ------     -----------     -----------     ------------   
next-orly-badger     OK         17207.24        1.240424ms      100.0%         
next-orly-dgraph     OK         15975.41        1.379901ms      100.0%         
next-orly-neo4j      OK         18050.59        1.142811ms      100.0%         
khatru-sqlite        OK         16911.01        1.278879ms      100.0%         
khatru-badger        OK         18095.48        1.143282ms      100.0%         
relayer-basic        OK         17973.91        1.159149ms      100.0%         
strfry               OK         17906.42        1.165583ms      100.0%         
nostr-rs-relay       OK         18036.49        1.14847ms       100.0%         

================================================================
End of Report
================================================================
