================================================================
NOSTR RELAY BENCHMARK AGGREGATE REPORT
================================================================
Generated: 2025-11-26T08:04:35+00:00
Benchmark Configuration:
  Events per test: 50000
  Concurrent workers: 24
  Test duration: 60s
  
Relays tested: 9

================================================================
SUMMARY BY RELAY
================================================================

Relay: rely-sqlite
----------------------------------------
Status: COMPLETED
Events/sec: 16298.40
Events/sec: 6150.97
Events/sec: 16298.40
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.360569ms
Bottom 10% Avg Latency: 746.704µs
Avg Latency: 1.411735ms
P95 Latency: 2.160818ms
P95 Latency: 2.29313ms
P95 Latency: 916.446µs

Relay: next-orly-badger
----------------------------------------
Status: COMPLETED
Events/sec: 16698.91
Events/sec: 6011.59
Events/sec: 16698.91
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.331911ms
Bottom 10% Avg Latency: 766.682µs
Avg Latency: 1.496861ms
P95 Latency: 2.019719ms
P95 Latency: 2.715024ms
P95 Latency: 914.112µs

Relay: next-orly-dgraph
----------------------------------------
Status: COMPLETED
Events/sec: 14573.58
Events/sec: 6072.22
Events/sec: 14573.58
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.571025ms
Bottom 10% Avg Latency: 802.953µs
Avg Latency: 1.454825ms
P95 Latency: 2.610305ms
P95 Latency: 2.541414ms
P95 Latency: 902.751µs

Relay: next-orly-neo4j
----------------------------------------
Status: COMPLETED
Events/sec: 16594.60
Events/sec: 6139.73
Events/sec: 16594.60
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.341265ms
Bottom 10% Avg Latency: 760.268µs
Avg Latency: 1.417529ms
P95 Latency: 2.068012ms
P95 Latency: 2.279114ms
P95 Latency: 893.313µs

Relay: khatru-sqlite
----------------------------------------
Status: COMPLETED
Events/sec: 16775.48
Events/sec: 6077.32
Events/sec: 16775.48
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.316097ms
Bottom 10% Avg Latency: 743.925µs
Avg Latency: 1.448816ms
P95 Latency: 2.019999ms
P95 Latency: 2.415349ms
P95 Latency: 915.807µs

Relay: khatru-badger
----------------------------------------
Status: COMPLETED
Events/sec: 14573.64
Events/sec: 6123.62
Events/sec: 14573.64
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.582659ms
Bottom 10% Avg Latency: 849.196µs
Avg Latency: 1.42045ms
P95 Latency: 2.584156ms
P95 Latency: 2.297743ms
P95 Latency: 911.2µs

Relay: relayer-basic
----------------------------------------
Status: COMPLETED
Events/sec: 16103.85
Events/sec: 6038.31
Events/sec: 16103.85
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.401051ms
Bottom 10% Avg Latency: 788.805µs
Avg Latency: 1.501362ms
P95 Latency: 2.187347ms
P95 Latency: 2.477719ms
P95 Latency: 920.8µs

Relay: strfry
----------------------------------------
Status: COMPLETED
Events/sec: 16207.30
Events/sec: 6075.12
Events/sec: 16207.30
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.381579ms
Bottom 10% Avg Latency: 760.474µs
Avg Latency: 1.45496ms
P95 Latency: 2.15555ms
P95 Latency: 2.414222ms
P95 Latency: 907.647µs

Relay: nostr-rs-relay
----------------------------------------
Status: COMPLETED
Events/sec: 15751.45
Events/sec: 6163.36
Events/sec: 15751.45
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.442411ms
Bottom 10% Avg Latency: 812.222µs
Avg Latency: 1.414472ms
P95 Latency: 2.22848ms
P95 Latency: 2.267184ms
P95 Latency: 921.434µs


================================================================
DETAILED RESULTS
================================================================

Individual relay reports are available in:
  - /reports/run_20251126_073410/khatru-badger_results.txt
  - /reports/run_20251126_073410/khatru-sqlite_results.txt
  - /reports/run_20251126_073410/next-orly-badger_results.txt
  - /reports/run_20251126_073410/next-orly-dgraph_results.txt
  - /reports/run_20251126_073410/next-orly-neo4j_results.txt
  - /reports/run_20251126_073410/nostr-rs-relay_results.txt
  - /reports/run_20251126_073410/relayer-basic_results.txt
  - /reports/run_20251126_073410/rely-sqlite_results.txt
  - /reports/run_20251126_073410/strfry_results.txt

================================================================
BENCHMARK COMPARISON TABLE
================================================================

Relay                Status     Peak Tput/s     Avg Latency     Success Rate   
----                 ------     -----------     -----------     ------------   
rely-sqlite          OK         16298.40        1.360569ms      100.0%         
next-orly-badger     OK         16698.91        1.331911ms      100.0%         
next-orly-dgraph     OK         14573.58        1.571025ms      100.0%         
next-orly-neo4j      OK         16594.60        1.341265ms      100.0%         
khatru-sqlite        OK         16775.48        1.316097ms      100.0%         
khatru-badger        OK         14573.64        1.582659ms      100.0%         
relayer-basic        OK         16103.85        1.401051ms      100.0%         
strfry               OK         16207.30        1.381579ms      100.0%         
nostr-rs-relay       OK         15751.45        1.442411ms      100.0%         

================================================================
End of Report
================================================================
