================================================================
NOSTR RELAY BENCHMARK AGGREGATE REPORT
================================================================
Generated: 2025-11-20T20:32:25+00:00
Benchmark Configuration:
  Events per test: 50000
  Concurrent workers: 24
  Test duration: 60s
  
Relays tested: 9

================================================================
SUMMARY BY RELAY
================================================================

Relay: rely-sqlite
----------------------------------------
Status: COMPLETED
Events/sec: 17507.10
Events/sec: 6243.12
Events/sec: 17507.10
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.223582ms
Bottom 10% Avg Latency: 698.877µs
Avg Latency: 1.178662ms
P95 Latency: 1.87223ms
P95 Latency: 2.046981ms
P95 Latency: 883.507µs

Relay: next-orly-badger
----------------------------------------
Status: COMPLETED
Events/sec: 16840.34
Events/sec: 6128.23
Events/sec: 16840.34
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.297596ms
Bottom 10% Avg Latency: 722.094µs
Avg Latency: 1.265918ms
P95 Latency: 2.027536ms
P95 Latency: 2.302166ms
P95 Latency: 894.834µs

Relay: next-orly-dgraph
----------------------------------------
Status: COMPLETED
Events/sec: 16563.45
Events/sec: 6132.86
Events/sec: 16563.45
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.32589ms
Bottom 10% Avg Latency: 726.176µs
Avg Latency: 1.340819ms
P95 Latency: 2.152481ms
P95 Latency: 2.37338ms
P95 Latency: 904.165µs

Relay: next-orly-neo4j
----------------------------------------
Status: COMPLETED
Events/sec: 14622.22
Events/sec: 6182.48
Events/sec: 14622.22
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.559545ms
Bottom 10% Avg Latency: 795.698µs
Avg Latency: 1.269605ms
P95 Latency: 2.658118ms
P95 Latency: 2.293256ms
P95 Latency: 867.888µs

Relay: khatru-sqlite
----------------------------------------
Status: COMPLETED
Events/sec: 16872.81
Events/sec: 6219.91
Events/sec: 16872.81
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.294206ms
Bottom 10% Avg Latency: 724.237µs
Avg Latency: 1.28288ms
P95 Latency: 2.011193ms
P95 Latency: 2.16732ms
P95 Latency: 868.521µs

Relay: khatru-badger
----------------------------------------
Status: COMPLETED
Events/sec: 15204.92
Events/sec: 6277.98
Events/sec: 15204.92
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.485679ms
Bottom 10% Avg Latency: 768.979µs
Avg Latency: 1.216531ms
P95 Latency: 2.501619ms
P95 Latency: 2.028348ms
P95 Latency: 862.271µs

Relay: relayer-basic
----------------------------------------
Status: COMPLETED
Events/sec: 17272.97
Events/sec: 6207.90
Events/sec: 17272.97
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.255956ms
Bottom 10% Avg Latency: 712.498µs
Avg Latency: 1.21703ms
P95 Latency: 1.909735ms
P95 Latency: 2.233521ms
P95 Latency: 871.278µs

Relay: strfry
----------------------------------------
Status: COMPLETED
Events/sec: 15745.79
Events/sec: 6264.53
Events/sec: 15745.79
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.415908ms
Bottom 10% Avg Latency: 739.523µs
Avg Latency: 1.153768ms
P95 Latency: 2.340716ms
P95 Latency: 2.007502ms
P95 Latency: 855.87µs

Relay: nostr-rs-relay
----------------------------------------
Status: COMPLETED
Events/sec: 17638.66
Events/sec: 6241.74
Events/sec: 17638.66
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.18563ms
Bottom 10% Avg Latency: 646.954µs
Avg Latency: 1.182584ms
P95 Latency: 1.847889ms
P95 Latency: 2.120267ms
P95 Latency: 866.51µs


================================================================
DETAILED RESULTS
================================================================

Individual relay reports are available in:
  - /reports/run_20251120_200202/khatru-badger_results.txt
  - /reports/run_20251120_200202/khatru-sqlite_results.txt
  - /reports/run_20251120_200202/next-orly-badger_results.txt
  - /reports/run_20251120_200202/next-orly-dgraph_results.txt
  - /reports/run_20251120_200202/next-orly-neo4j_results.txt
  - /reports/run_20251120_200202/nostr-rs-relay_results.txt
  - /reports/run_20251120_200202/relayer-basic_results.txt
  - /reports/run_20251120_200202/rely-sqlite_results.txt
  - /reports/run_20251120_200202/strfry_results.txt

================================================================
BENCHMARK COMPARISON TABLE
================================================================

Relay                Status     Peak Tput/s     Avg Latency     Success Rate   
----                 ------     -----------     -----------     ------------   
rely-sqlite          OK         17507.10        1.223582ms      100.0%         
next-orly-badger     OK         16840.34        1.297596ms      100.0%         
next-orly-dgraph     OK         16563.45        1.32589ms       100.0%         
next-orly-neo4j      OK         14622.22        1.559545ms      100.0%         
khatru-sqlite        OK         16872.81        1.294206ms      100.0%         
khatru-badger        OK         15204.92        1.485679ms      100.0%         
relayer-basic        OK         17272.97        1.255956ms      100.0%         
strfry               OK         15745.79        1.415908ms      100.0%         
nostr-rs-relay       OK         17638.66        1.18563ms       100.0%         

================================================================
End of Report
================================================================
