================================================================
NOSTR RELAY BENCHMARK AGGREGATE REPORT
================================================================
Generated: 2025-11-19T12:08:43+00:00
Benchmark Configuration:
  Events per test: 50000
  Concurrent workers: 24
  Test duration: 60s
  
Relays tested: 8

================================================================
SUMMARY BY RELAY
================================================================

Relay: next-orly-badger
----------------------------------------
Status: COMPLETED
Events/sec: 17949.86
Events/sec: 6293.77
Events/sec: 17949.86
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.089014ms
Bottom 10% Avg Latency: 552.633µs
Avg Latency: 749.292µs
P95 Latency: 1.801326ms
P95 Latency: 1.544064ms
P95 Latency: 797.32µs

Relay: next-orly-dgraph
----------------------------------------
Status: COMPLETED
Events/sec: 17627.19
Events/sec: 6241.01
Events/sec: 17627.19
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.103766ms
Bottom 10% Avg Latency: 537.227µs
Avg Latency: 973.956µs
P95 Latency: 1.895983ms
P95 Latency: 1.938364ms
P95 Latency: 839.77µs

Relay: next-orly-neo4j
----------------------------------------
Status: COMPLETED
Events/sec: 15536.46
Events/sec: 6269.18
Events/sec: 15536.46
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.414281ms
Bottom 10% Avg Latency: 704.384µs
Avg Latency: 919.794µs
P95 Latency: 2.486204ms
P95 Latency: 1.842478ms
P95 Latency: 828.598µs

Relay: khatru-sqlite
----------------------------------------
Status: COMPLETED
Events/sec: 17237.90
Events/sec: 6137.41
Events/sec: 17237.90
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.195398ms
Bottom 10% Avg Latency: 614.1µs
Avg Latency: 967.476µs
P95 Latency: 2.00684ms
P95 Latency: 2.046996ms
P95 Latency: 843.455µs

Relay: khatru-badger
----------------------------------------
Status: COMPLETED
Events/sec: 16911.23
Events/sec: 6231.83
Events/sec: 16911.23
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.187112ms
Bottom 10% Avg Latency: 540.572µs
Avg Latency: 957.9µs
P95 Latency: 2.183304ms
P95 Latency: 1.888493ms
P95 Latency: 824.399µs

Relay: relayer-basic
----------------------------------------
Status: COMPLETED
Events/sec: 17836.39
Events/sec: 6270.82
Events/sec: 17836.39
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.081434ms
Bottom 10% Avg Latency: 525.619µs
Avg Latency: 951.65µs
P95 Latency: 1.853627ms
P95 Latency: 1.779976ms
P95 Latency: 831.883µs

Relay: strfry
----------------------------------------
Status: COMPLETED
Events/sec: 16470.06
Events/sec: 6004.96
Events/sec: 16470.06
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.261656ms
Bottom 10% Avg Latency: 566.551µs
Avg Latency: 1.02418ms
P95 Latency: 2.241835ms
P95 Latency: 2.314062ms
P95 Latency: 821.493µs

Relay: nostr-rs-relay
----------------------------------------
Status: COMPLETED
Events/sec: 16764.35
Events/sec: 6300.71
Events/sec: 16764.35
Success Rate: 100.0%
Success Rate: 100.0%
Success Rate: 100.0%
Avg Latency: 1.245012ms
Bottom 10% Avg Latency: 614.335µs
Avg Latency: 869.47µs
P95 Latency: 2.151312ms
P95 Latency: 1.707251ms
P95 Latency: 816.334µs


================================================================
DETAILED RESULTS
================================================================

Individual relay reports are available in:
  - /reports/run_20251119_114143/khatru-badger_results.txt
  - /reports/run_20251119_114143/khatru-sqlite_results.txt
  - /reports/run_20251119_114143/next-orly-badger_results.txt
  - /reports/run_20251119_114143/next-orly-dgraph_results.txt
  - /reports/run_20251119_114143/next-orly-neo4j_results.txt
  - /reports/run_20251119_114143/nostr-rs-relay_results.txt
  - /reports/run_20251119_114143/relayer-basic_results.txt
  - /reports/run_20251119_114143/strfry_results.txt

================================================================
BENCHMARK COMPARISON TABLE
================================================================

Relay                Status     Peak Tput/s     Avg Latency     Success Rate   
----                 ------     -----------     -----------     ------------   
next-orly-badger     OK         17949.86        1.089014ms      100.0%         
next-orly-dgraph     OK         17627.19        1.103766ms      100.0%         
next-orly-neo4j      OK         15536.46        1.414281ms      100.0%         
khatru-sqlite        OK         17237.90        1.195398ms      100.0%         
khatru-badger        OK         16911.23        1.187112ms      100.0%         
relayer-basic        OK         17836.39        1.081434ms      100.0%         
strfry               OK         16470.06        1.261656ms      100.0%         
nostr-rs-relay       OK         16764.35        1.245012ms      100.0%         

================================================================
End of Report
================================================================
