================================================================
NOSTR RELAY BENCHMARK AGGREGATE REPORT
================================================================
Generated: 2025-11-20T15:53:41+00:00
Benchmark Configuration:
  Events per test: 50000
  Concurrent workers: 24
  Test duration: 60s
  
Relays tested: 8

================================================================
SUMMARY BY RELAY
================================================================

Relay: next-orly-badger
----------------------------------------
Status: COMPLETED
Events/sec: 17836.33
Events/sec: 6340.29
Events/sec: 17836.33
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.176626ms
Bottom 10% Avg Latency: 659.571µs
Avg Latency: 1.150109ms
P95 Latency: 1.79182ms
P95 Latency: 1.87572ms
P95 Latency: 870.11µs

Relay: next-orly-dgraph
----------------------------------------
Status: COMPLETED
Events/sec: 16687.23
Events/sec: 6230.59
Events/sec: 16687.23
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.299973ms
Bottom 10% Avg Latency: 703.285µs
Avg Latency: 1.216351ms
P95 Latency: 2.203343ms
P95 Latency: 2.205777ms
P95 Latency: 869.669µs

Relay: next-orly-neo4j
----------------------------------------
Status: COMPLETED
Events/sec: 17497.93
Events/sec: 6254.20
Events/sec: 17497.93
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.220061ms
Bottom 10% Avg Latency: 689.107µs
Avg Latency: 1.207729ms
P95 Latency: 1.873592ms
P95 Latency: 2.026464ms
P95 Latency: 860.711µs

Relay: khatru-sqlite
----------------------------------------
Status: COMPLETED
Events/sec: 15692.37
Events/sec: 6031.64
Events/sec: 15692.37
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.434878ms
Bottom 10% Avg Latency: 773.12µs
Avg Latency: 1.438112ms
P95 Latency: 2.364988ms
P95 Latency: 2.530373ms
P95 Latency: 869.767µs

Relay: khatru-badger
----------------------------------------
Status: COMPLETED
Events/sec: 15459.86
Events/sec: 6208.94
Events/sec: 15459.86
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.468719ms
Bottom 10% Avg Latency: 802.399µs
Avg Latency: 1.250479ms
P95 Latency: 2.396216ms
P95 Latency: 2.142422ms
P95 Latency: 869.166µs

Relay: relayer-basic
----------------------------------------
Status: COMPLETED
Events/sec: 15191.51
Events/sec: 6144.49
Events/sec: 15191.51
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.494499ms
Bottom 10% Avg Latency: 790.923µs
Avg Latency: 1.322915ms
P95 Latency: 2.461731ms
P95 Latency: 2.255818ms
P95 Latency: 888.112µs

Relay: strfry
----------------------------------------
Status: COMPLETED
Events/sec: 16583.98
Events/sec: 5979.92
Events/sec: 16583.98
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.325163ms
Bottom 10% Avg Latency: 732.389µs
Avg Latency: 1.467778ms
P95 Latency: 2.114188ms
P95 Latency: 2.793392ms
P95 Latency: 878.634µs

Relay: nostr-rs-relay
----------------------------------------
Status: COMPLETED
Events/sec: 15250.43
Events/sec: 6286.54
Events/sec: 15250.43
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.477342ms
Bottom 10% Avg Latency: 760.393µs
Avg Latency: 1.167307ms
P95 Latency: 2.527756ms
P95 Latency: 2.003086ms
P95 Latency: 868.365µs


================================================================
DETAILED RESULTS
================================================================

Individual relay reports are available in:
  - /reports/run_20251120_152640/khatru-badger_results.txt
  - /reports/run_20251120_152640/khatru-sqlite_results.txt
  - /reports/run_20251120_152640/next-orly-badger_results.txt
  - /reports/run_20251120_152640/next-orly-dgraph_results.txt
  - /reports/run_20251120_152640/next-orly-neo4j_results.txt
  - /reports/run_20251120_152640/nostr-rs-relay_results.txt
  - /reports/run_20251120_152640/relayer-basic_results.txt
  - /reports/run_20251120_152640/strfry_results.txt

================================================================
BENCHMARK COMPARISON TABLE
================================================================

Relay                Status     Peak Tput/s     Avg Latency     Success Rate   
----                 ------     -----------     -----------     ------------   
next-orly-badger     OK         17836.33        1.176626ms      100.0%         
next-orly-dgraph     OK         16687.23        1.299973ms      100.0%         
next-orly-neo4j      OK         17497.93        1.220061ms      100.0%         
khatru-sqlite        OK         15692.37        1.434878ms      100.0%         
khatru-badger        OK         15459.86        1.468719ms      100.0%         
relayer-basic        OK         15191.51        1.494499ms      100.0%         
strfry               OK         16583.98        1.325163ms      100.0%         
nostr-rs-relay       OK         15250.43        1.477342ms      100.0%         

================================================================
End of Report
================================================================
