Throughput is measured from blocks the chain produced (own senders vs every sender), resource use from Cloud Monitoring, Prometheus and the on-node sampler. Summaries cover the mixed phase. Hover any number for the JSON field it came from.
Landed counts only our own senders; latency is submit → block timestamp.
| Type | Submitted | Accepted | Landed | Reverted | Unlanded | Skips | Gas limit | Gas used avg | p50 | p95 |
|---|---|---|---|---|---|---|---|---|---|---|
| native_transfer | 4.01M | 4.01M | 4M | 0 | 7.79K | 0 | 24.1K | 21K | 2,423 ms | 12,440 ms |
| batched_self_send | 2.19M | 2.19M | 2.18M | 0 | 6.79K | 0 | 24.1K | 21K | 2,528 ms | 12,983 ms |
| uniswap_v2_swap | 1.98M | 1.98M | 1.97M | 0 | 5.58K | 0 | 180K | 106K | 2,429 ms | 12,429 ms |
| stablecoin_transfer | 1.65M | 1.65M | 1.65M | 0 | 4.62K | 0 | 75K | 43.9K | 2,426 ms | 12,449 ms |
| wtel_wrap | 1.32M | 1.32M | 1.32M | 0 | 3.74K | 0 | 50K | 27.9K | 2,424 ms | 12,421 ms |
| wtel_unwrap | 881K | 881K | 879K | 0 | 2.53K | 0 | 45K | 35.2K | 2,427 ms | 12,514 ms |
| stablecoin_approve | 662K | 662K | 661K | 0 | 1.89K | 0 | 60K | 31.8K | 2,422 ms | 12,415 ms |
| uniswap_v2_add_liquidity | 440K | 440K | 439K | 0 | 1.21K | 0 | 250K | 128K | 2,428 ms | 12,486 ms |
| contract_deploy | 330K | 330K | 329K | 0 | 901 | 0 | 140K | 74.2K | 2,431 ms | 12,472 ms |
| uniswap_v4_swap | 329K | 329K | 328K | 0 | 984 | 0 | 250K | 124K | 2,434 ms | 12,462 ms |
| uniswap_v2_remove_liquidity | 220K | 220K | 219K | 0 | 623 | 0 | 220K | 129K | 2,428 ms | 12,531 ms |
| uniswap_v3_swap | 219K | 219K | 218K | 0 | 611 | 0 | 220K | 120K | 2,430 ms | 12,480 ms |
| faucet_drip | 126K | 126K | 126K | 0 | 20 | 424K | 150K | 107K | 2,232 ms | 15,563 ms |
| Node | Submitted | Accepted | Accepted % | Top errors | Send p50 | Send p95 |
|---|---|---|---|---|---|---|
| bench-validator-01 bench-validator-01:8545 | 2.24M | 2.22M | 98.9 % | known 14.6K | 9 ms | 29 ms |
| bench-validator-02 bench-validator-02:8545 | 1.08M | 1.03M | 95.7 % | known 24.8K | 7 ms | 27 ms |
| bench-validator-03 bench-validator-03:8545 | 1.63M | 1.59M | 97.6 % | known 20.2K | 8 ms | 31 ms |
| bench-validator-04 bench-validator-04:8545 | 1.56M | 1.53M | 98.1 % | known 15.3K | 11 ms | 40 ms |
| bench-validator-05 bench-validator-05:8545 | 1.02M | 992K | 97.6 % | known 11.8K, pool_full 779 | 8 ms | 33 ms |
| bench-validator-06 bench-validator-06:8545 | 1.04M | 994K | 95.6 % | known 25K | 8 ms | 30 ms |
| bench-validator-07 bench-validator-07:8545 | 1.86M | 1.83M | 98.2 % | known 18.6K | 7 ms | 26 ms |
| bench-validator-08 bench-validator-08:8545 | 1.61M | 1.57M | 97.6 % | known 19.9K | 8 ms | 30 ms |
| bench-validator-09 bench-validator-09:8545 | 1.73M | 1.7M | 98.2 % | known 12.9K | 9 ms | 28 ms |
| bench-validator-10 bench-validator-10:8545 | 1.02M | 979K | 95.6 % | known 24.6K | 7 ms | 26 ms |
Shaded: phases outside the mixed window. Hairlines: epoch closes. Dashed orange: chaos events.
own senders vs chain total, per block-timestamp second
own vs chain gas used, per block-timestamp second
compute.googleapis.com/instance/cpu/utilization, 60-s mean, % of all vCPUs; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 15.4 % | 17.3 % | 17.8 % | 17.8 % |
| bench-validator-01 | validator | 35.8 % | 45.9 % | 48.7 % | 48.7 % |
| bench-validator-02 | validator | 34.7 % | 43.8 % | 45.4 % | 45.4 % |
| bench-validator-03 | validator | 35.2 % | 41.4 % | 43.4 % | 43.4 % |
| bench-validator-04 | validator | 34.9 % | 39.7 % | 43.7 % | 43.7 % |
| bench-validator-05 | validator | 27.3 % | 37.2 % | 46.1 % | 46.1 % |
| bench-validator-06 | validator | 35.4 % | 43.9 % | 51.0 % | 51.0 % |
| bench-validator-07 | validator | 35.2 % | 44.7 % | 47.8 % | 47.8 % |
| bench-validator-08 | validator | 35.0 % | 41.9 % | 43.4 % | 43.4 % |
| bench-validator-09 | validator | 35.3 % | 43.4 % | 46.6 % | 46.6 % |
| bench-validator-10 | validator | 35.2 % | 43.8 % | 47.0 % | 47.0 % |
One row per node, over the mixed phase.
agent processes/rss_usage summed over telcoin pids; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 3.11 GiB | 4.25 GiB | 4.32 GiB | 4.32 GiB |
| bench-validator-01 | validator | 5.58 GiB | 7.30 GiB | 7.39 GiB | 7.39 GiB |
| bench-validator-02 | validator | 7.10 GiB | 9.16 GiB | 9.31 GiB | 9.31 GiB |
| bench-validator-03 | validator | 5.79 GiB | 7.52 GiB | 7.70 GiB | 7.70 GiB |
| bench-validator-04 | validator | 5.53 GiB | 7.87 GiB | 8.53 GiB | 8.53 GiB |
| bench-validator-05 | validator | 4.78 GiB | 6.45 GiB | 6.67 GiB | 6.67 GiB |
| bench-validator-06 | validator | 6.17 GiB | 8.90 GiB | 9.19 GiB | 9.19 GiB |
| bench-validator-07 | validator | 6.26 GiB | 8.65 GiB | 9.01 GiB | 9.01 GiB |
| bench-validator-08 | validator | 5.66 GiB | 7.54 GiB | 7.65 GiB | 7.65 GiB |
| bench-validator-09 | validator | 5.62 GiB | 7.39 GiB | 7.49 GiB | 7.49 GiB |
| bench-validator-10 | validator | 5.53 GiB | 7.29 GiB | 7.47 GiB | 7.47 GiB |
One row per node, over the mixed phase.
agent memory/percent_used, state=used; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 10.2 % | 11.7 % | 12.0 % | 12.0 % |
| bench-validator-01 | validator | 28.0 % | 32.6 % | 33.2 % | 33.2 % |
| bench-validator-02 | validator | 37.9 % | 46.5 % | 47.7 % | 47.7 % |
| bench-validator-03 | validator | 29.4 % | 34.7 % | 34.9 % | 34.9 % |
| bench-validator-04 | validator | 27.3 % | 36.3 % | 38.6 % | 38.6 % |
| bench-validator-05 | validator | 21.7 % | 28.9 % | 31.3 % | 31.3 % |
| bench-validator-06 | validator | 32.2 % | 45.7 % | 46.6 % | 46.6 % |
| bench-validator-07 | validator | 32.2 % | 42.2 % | 42.6 % | 42.6 % |
| bench-validator-08 | validator | 28.6 % | 34.1 % | 34.3 % | 34.3 % |
| bench-validator-09 | validator | 29.7 % | 36.0 % | 36.3 % | 36.3 % |
| bench-validator-10 | validator | 28.0 % | 33.1 % | 33.9 % | 33.9 % |
One row per node, over the mixed phase.
instance/disk/{read,write}_bytes_count rate, all devices; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max | Limit |
|---|---|---|---|---|---|---|
| bench-observer-11 | observer | 260.4 MiB/s | 411.6 MiB/s | 458.3 MiB/s | 458.3 MiB/s | 800.0 MiB/s |
| bench-validator-01 | validator | 188.1 MiB/s | 344.7 MiB/s | 369.4 MiB/s | 369.4 MiB/s | 800.0 MiB/s |
| bench-validator-02 | validator | 182.3 MiB/s | 310.8 MiB/s | 333.5 MiB/s | 333.5 MiB/s | 800.0 MiB/s |
| bench-validator-03 | validator | 187.4 MiB/s | 362.5 MiB/s | 404.5 MiB/s | 404.5 MiB/s | 800.0 MiB/s |
| bench-validator-04 | validator | 209.7 MiB/s | 388.0 MiB/s | 427.2 MiB/s | 427.2 MiB/s | 800.0 MiB/s |
| bench-validator-05 | validator | 158.8 MiB/s | 347.8 MiB/s | 379.9 MiB/s | 379.9 MiB/s | 800.0 MiB/s |
| bench-validator-06 | validator | 183.8 MiB/s | 351.4 MiB/s | 385.4 MiB/s | 385.4 MiB/s | 800.0 MiB/s |
| bench-validator-07 | validator | 196.3 MiB/s | 327.2 MiB/s | 360.1 MiB/s | 360.1 MiB/s | 800.0 MiB/s |
| bench-validator-08 | validator | 188.6 MiB/s | 304.3 MiB/s | 336.4 MiB/s | 336.4 MiB/s | 800.0 MiB/s |
| bench-validator-09 | validator | 172.6 MiB/s | 386.7 MiB/s | 428.0 MiB/s | 428.0 MiB/s | 800.0 MiB/s |
| bench-validator-10 | validator | 208.3 MiB/s | 414.9 MiB/s | 447.7 MiB/s | 447.7 MiB/s | 800.0 MiB/s |
instance/disk/{read,write}_ops_count rate, all devices; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max | Limit |
|---|---|---|---|---|---|---|
| bench-observer-11 | observer | 12.7K IOPS | 16.3K IOPS | 17.4K IOPS | 17.4K IOPS | 20K IOPS |
| bench-validator-01 | validator | 14.3K IOPS | 16.9K IOPS | 18.3K IOPS | 18.3K IOPS | 20K IOPS |
| bench-validator-02 | validator | 14.6K IOPS | 18K IOPS | 18.8K IOPS | 18.8K IOPS | 20K IOPS |
| bench-validator-03 | validator | 14.4K IOPS | 17.9K IOPS | 18.4K IOPS | 18.4K IOPS | 20K IOPS |
| bench-validator-04 | validator | 14.1K IOPS | 18.1K IOPS | 19K IOPS | 19K IOPS | 20K IOPS |
| bench-validator-05 | validator | 11.4K IOPS | 17K IOPS | 19.1K IOPS | 19.1K IOPS | 20K IOPS |
| bench-validator-06 | validator | 14.6K IOPS | 18.1K IOPS | 18.7K IOPS | 18.7K IOPS | 20K IOPS |
| bench-validator-07 | validator | 14.4K IOPS | 17.7K IOPS | 18.2K IOPS | 18.2K IOPS | 20K IOPS |
| bench-validator-08 | validator | 14.5K IOPS | 18K IOPS | 18.4K IOPS | 18.4K IOPS | 20K IOPS |
| bench-validator-09 | validator | 14.3K IOPS | 17.4K IOPS | 18K IOPS | 18K IOPS | 20K IOPS |
| bench-validator-10 | validator | 14.1K IOPS | 17.6K IOPS | 18.3K IOPS | 18.3K IOPS | 20K IOPS |
| Node | Machine | vCPU | Disk | IOPS limit | MiB/s limit | Basis |
|---|---|---|---|---|---|---|
| bench-observer-11 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-01 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-02 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-03 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-04 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-05 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-06 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-07 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-08 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-09 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-10 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
instance/network/sent_bytes_count rate; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 1.1 Mbps | 1.3 Mbps | 1.4 Mbps | 1.4 Mbps |
| bench-validator-01 | validator | 98.1 Mbps | 113.0 Mbps | 134.8 Mbps | 134.8 Mbps |
| bench-validator-02 | validator | 95.3 Mbps | 111.5 Mbps | 149.2 Mbps | 149.2 Mbps |
| bench-validator-03 | validator | 95.8 Mbps | 113.3 Mbps | 119.0 Mbps | 119.0 Mbps |
| bench-validator-04 | validator | 94.4 Mbps | 115.7 Mbps | 115.8 Mbps | 115.8 Mbps |
| bench-validator-05 | validator | 76.2 Mbps | 114.6 Mbps | 120.0 Mbps | 120.0 Mbps |
| bench-validator-06 | validator | 92.6 Mbps | 110.5 Mbps | 112.1 Mbps | 112.1 Mbps |
| bench-validator-07 | validator | 97.1 Mbps | 119.7 Mbps | 124.3 Mbps | 124.3 Mbps |
| bench-validator-08 | validator | 96.0 Mbps | 120.2 Mbps | 124.2 Mbps | 124.2 Mbps |
| bench-validator-09 | validator | 95.8 Mbps | 116.6 Mbps | 119.4 Mbps | 119.4 Mbps |
| bench-validator-10 | validator | 92.7 Mbps | 110.4 Mbps | 120.8 Mbps | 120.8 Mbps |
instance/network/received_bytes_count rate; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 6.2 Mbps | 5.9 Mbps | 53.9 Mbps | 53.9 Mbps |
| bench-validator-01 | validator | 10.1 Mbps | 12.8 Mbps | 13.1 Mbps | 13.1 Mbps |
| bench-validator-02 | validator | 8.2 Mbps | 10.3 Mbps | 10.9 Mbps | 10.9 Mbps |
| bench-validator-03 | validator | 9.1 Mbps | 11.1 Mbps | 11.5 Mbps | 11.5 Mbps |
| bench-validator-04 | validator | 9.0 Mbps | 11.4 Mbps | 11.8 Mbps | 11.8 Mbps |
| bench-validator-05 | validator | 11.3 Mbps | 20.7 Mbps | 53.9 Mbps | 53.9 Mbps |
| bench-validator-06 | validator | 8.9 Mbps | 10.3 Mbps | 35.4 Mbps | 35.4 Mbps |
| bench-validator-07 | validator | 9.5 Mbps | 11.9 Mbps | 12.1 Mbps | 12.1 Mbps |
| bench-validator-08 | validator | 9.2 Mbps | 12.1 Mbps | 14.4 Mbps | 14.4 Mbps |
| bench-validator-09 | validator | 9.5 Mbps | 11.8 Mbps | 14.2 Mbps | 14.2 Mbps |
| bench-validator-10 | validator | 8.9 Mbps | 12.0 Mbps | 35.8 Mbps | 35.8 Mbps |
| Metric | Query | Class | Nodes | Median of node means | Worst peak 60-s mean | Max |
|---|---|---|---|---|---|---|
| tn_primary_commit_latency_seconds | p95 | validator | 10 | 3,864 ms | 29.0 s | 29.0 s |
| tn_engine_execution_duration_seconds | p95 | validator | 10 | 3,870 ms | 15.8 s | 20.0 s |
| tn_engine_execution_duration_seconds | p95 | observer | 1 | 3,243 ms | 5,558 ms | 6,750 ms |
| tn_worker_batch_size_bytes | p95 | validator | 10 | 240.4 KiB | 246.4 KiB | 246.4 KiB |
| tn_worker_batch_transactions | p95 | validator | 10 | 486 | 1K | 1K |
| tn_executor_output_transactions | p95 | validator | 10 | 1K | 1K | 1K |
| tn_primary_consensus_output_bytes | max | validator | 10 | 799.7 KiB | 2.1 MiB | 3.5 MiB |
| tn_primary_consensus_output_bytes | max | observer | 1 | 721.1 KiB | 1.6 MiB | 2.3 MiB |
| tn_engine_queued_outputs | max | validator | 10 | 2.37 | 7.75 | 8 |
| tn_engine_queued_outputs | max | observer | 1 | 1.88 | 4.25 | 8 |
| tn_primary_round | max | validator | 10 | 837 | 1.76K | 1.78K |
| tn_primary_round | max | observer | 1 | 832 | 1.75K | 1.77K |
| tn_primary_committed_round | max | validator | 10 | 835 | 1.76K | 1.78K |
| tn_primary_committed_round | max | observer | 1 | 832 | 1.75K | 1.77K |
| tn_epoch_current | max | validator | 10 | 6.51 | 7.25 | 8 |
| tn_epoch_current | max | observer | 1 | 6.51 | 7.25 | 8 |
| tn_batch_builder_pending_pool_transactions | max | validator | 10 | 402 | 8.9K | 8.9K |
| tn_batch_builder_pending_pool_transactions | max | observer | 1 | 0 | 0 | 0 |
| reth_process_resident_memory_bytes | max | validator | 10 | 5.76 GiB | 9.30 GiB | 9.32 GiB |
| reth_process_resident_memory_bytes | max | observer | 1 | 3.16 GiB | 4.39 GiB | 4.40 GiB |
| tn_primary_subdags_committed_total | rate | validator | 10 | 0.637 | 0.972 | 1.09 |
| tn_primary_subdags_committed_total | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_round_lag | lag | validator | 10 | 2.91 | 24.2 | 26 |
| tn_primary_round_lag | lag | observer | 1 | 0 | 0 | 0 |
| tn_batch_builder_seal_failures_total | rate | validator | 5 | 0 | 0.0167 | 0.0222 |
| tn_node_mode | max | validator | 10 | 0 | 1 | 1 |
| tn_node_mode | max | observer | 1 | 0 | 0 | 0 |
tn_primary_commit_latency_seconds
tn_primary_round − tn_primary_committed_round
tn_engine_queued_outputs, max by node
The share of each validator's own headers that formed a certificate, per window (tools/cert-rate.py on the node logs). bench-validator-02, bench-validator-06 and bench-validator-08 certified fewer than 90 % of their own headers in a window where they proposed at least 50. Own leader % is the validator's share of the committed leaders and not committed % the share of its certificates no committed leader reached, both over the run window; the fair share is 100 / 10 validators = 10.0 %. Greyed: fewer than 50 headers proposed, not judged.
| Validator | Region | arm a3check | arm stage2 | phase preamble | phase warmup | phase mixed | phase cooldown | run | Own leader % | Not committed % |
|---|---|---|---|---|---|---|---|---|---|---|
| bench-validator-01 | us-west2 (Los Angeles) | 99.8 | 99.1 | 99.3 | 99.4 | 97.6 | 99.8 | 99.5 | 13.2 | 0.6 |
| bench-validator-02 below 90 % | europe-west2 (London) | 97.9 | 97.7 | 89.1 | 93.7 | 94.4 | 100.0 | 98.3 | 2.0 | 19.0 |
| bench-validator-03 | australia-southeast1 (Sydney) | 99.9 | 98.8 | 97.1 | 98.9 | 96.7 | 100.0 | 99.4 | 13.1 | 0.8 |
| bench-validator-04 | asia-northeast1 (Tokyo) | 100.0 | 98.9 | 95.7 | 97.7 | 97.2 | 99.8 | 99.5 | 13.1 | 0.6 |
| bench-validator-05 | northamerica-northeast1 (Montréal) | 99.5 | 98.7 | 98.6 | 98.9 | 95.3 | – | 99.3 | 10.6 | 1.7 |
| bench-validator-06 below 90 % | europe-west4 (Netherlands) | 82.2 | 96.5 | 100.0 | 98.9 | 91.8 | 100.0 | 88.3 | 1.0 | 20.7 |
| bench-validator-07 | asia-southeast1 (Singapore) | 99.5 | 99.1 | 98.6 | 97.7 | 97.5 | 100.0 | 99.4 | 12.8 | 0.6 |
| bench-validator-08 below 90 % | asia-east2 (Hong Kong) | 97.1 | 97.0 | 89.1 | 86.9 | 92.5 | 99.8 | 97.8 | 12.5 | 0.7 |
| bench-validator-09 | asia-northeast3 (Seoul) | 99.4 | 97.5 | 98.6 | 98.3 | 93.1 | 99.8 | 98.7 | 13.0 | 0.5 |
| bench-validator-10 | asia-south1 (Mumbai) | 99.4 | 97.2 | 91.3 | 92.7 | 92.6 | 100.0 | 98.5 | 10.1 | 1.6 |
| Node | Class | Peak RssAnon | Peak RssFile | Peak cache | PSI mem | PSI io | PSI cpu | db growth | static_files growth | Root used | OOM Δ |
|---|---|---|---|---|---|---|---|---|---|---|---|
| bench-observer-11 | observer | 925 MiB | 3.84 GiB | 64 MiB 6.3 % | 0.0 % | 17.0 % | 0.7 % | 0 B | 4.13 GiB | 17.0 % | 0 |
| bench-validator-01 | validator | 4.42 GiB | 3.05 GiB | 64 MiB 6.3 % | 0.1 % | 17.4 % | 10.8 % | 0 B | 4.13 GiB | 45.0 % | 0 |
| bench-validator-02 | validator | 6.76 GiB | 2.75 GiB | 64 MiB 6.3 % | 0.0 % | 15.9 % | 10.2 % | 0 B | 4.13 GiB | 47.0 % | 0 |
| bench-validator-03 | validator | 4.71 GiB | 3.06 GiB | 64 MiB 6.3 % | 0.1 % | 19.7 % | 9.8 % | 0 B | 4.13 GiB | 46.0 % | 0 |
| bench-validator-04 | validator | 5.29 GiB | 3.03 GiB | 64 MiB 6.3 % | 0.0 % | 22.3 % | 10.4 % | 0 B | 4.13 GiB | 45.0 % | 0 |
| bench-validator-05 | validator | 4.22 GiB | 3.07 GiB | 1.00 GiB 100.0 % | 0.0 % | 17.3 % | 16.1 % | 0 B | 3.95 GiB | 40.0 % | 0 |
| bench-validator-06 | validator | 6.61 GiB | 2.79 GiB | 64 MiB 6.3 % | 0.1 % | 19.4 % | 10.4 % | 0 B | 4.13 GiB | 47.0 % | 0 |
| bench-validator-07 | validator | 5.96 GiB | 3.07 GiB | 64 MiB 6.3 % | 0.1 % | 18.3 % | 11.1 % | 0 B | 4.13 GiB | 45.0 % | 0 |
| bench-validator-08 | validator | 4.63 GiB | 3.19 GiB | 64 MiB 6.3 % | 0.1 % | 15.1 % | 10.4 % | 0 B | 4.13 GiB | 46.0 % | 0 |
| bench-validator-09 | validator | 4.94 GiB | 2.70 GiB | 64 MiB 6.3 % | 0.3 % | 21.1 % | 10.5 % | 0 B | 4.13 GiB | 45.0 % | 0 |
| bench-validator-10 | validator | 4.45 GiB | 3.07 GiB | 64 MiB 6.3 % | 0.0 % | 22.7 % | 10.7 % | 0 B | 4.13 GiB | 47.0 % | 0 |
/proc/<pid>/status of the telcoin process on the node with the largest RSS
du -sb of consensus-db/cache vs the 1 GiB ceiling
/proc/pressure on the node with the highest memory PSI
Per role and per node, from sizing.json (p95 over the landed window; PSI and RssAnon max over the whole sampler run). The lines follow the hardware doc's tier rules: CPU p95 over 70 % of vCPUs; memory used p95 over 75 % of RAM, or telcoin RSS p95 over 85 % of RAM; disk write p95 over 60 % of the PD MiB/s limit, or write IOPS p95 over 60 % of the IOPS limit; IO pressure over 20 % or memory pressure over 5 % (PSI some avg10, max); network p95 over 50 % of 1 Gbps; root disk over 80 %. A line crossed on any node puts the role at the limit; a nonzero reading within 15 points of its line is tight; otherwise the role has headroom. OOM kills, disk throttling and degraded disk performance are flagged too.
| Signal | Class | Worst node | Value | Share of capacity | Line | Nodes over / tight | Status |
|---|---|---|---|---|---|---|---|
| CPU p95 | validator | bench-validator-01 | 45.9 % | 45.9 % | > 70 % | 0 / 0 | headroom |
| Memory used p95 | validator | bench-validator-02 | 46.5 % | 46.5 % | > 75 % | 0 / 0 | headroom |
| telcoin RSS p95 | validator | bench-validator-02 | 9.83 GB | 57.2 % | > 85 % | 0 / 0 | headroom |
| PSI memory max | validator | bench-validator-09 | 0.3 % | 0.3 % | > 5 % | 0 / 8 | tight |
| RssAnon peak | validator | bench-validator-02 | 7.26 GB | 42.2 % | info | – | info |
| Disk write p95 | validator | bench-validator-10 | 446 MB/s | 53.1 % | > 60 % | 0 / 6 | tight |
| Write IOPS p95 | validator | bench-validator-06 | 17,933 | 89.7 % | > 60 % | 10 / 0 | at the limit |
| PSI io max | validator | bench-validator-10 | 22.7 % | 22.7 % | > 20 % | 6 / 4 | at the limit |
| Root disk max | validator | bench-validator-06 | 46.6 % | 46.6 % | > 80 % | 0 / 0 | headroom |
| Network p95 | validator | bench-validator-08 | 120 Mbps | 12.0 % | > 50 % | 0 / 0 | headroom |
| Consensus cache peak | validator | bench-validator-05 | 1.00 GiB | 100.0 % | info | – | info |
| OOM kills | validator | – | – | any | any | – | none |
| Disk throttling | validator | – | – | metric type unavailable in project | any | – | not collected |
| Disk performance degraded | validator | – | – | any sample | any | – | none |
| CPU p95 | observer | bench-observer-11 | 17.3 % | 17.3 % | > 70 % | 0 / 0 | headroom |
| Memory used p95 | observer | bench-observer-11 | 11.7 % | 11.7 % | > 75 % | 0 / 0 | headroom |
| telcoin RSS p95 | observer | bench-observer-11 | 4.56 GB | 26.5 % | > 85 % | 0 / 0 | headroom |
| PSI memory max | observer | bench-observer-11 | 0.0 % | 0.0 % | > 5 % | 0 / 0 | headroom |
| RssAnon peak | observer | bench-observer-11 | 0.97 GB | 5.6 % | info | – | info |
| Disk write p95 | observer | bench-observer-11 | 444 MB/s | 52.9 % | > 60 % | 0 / 1 | tight |
| Write IOPS p95 | observer | bench-observer-11 | 16,262 | 81.3 % | > 60 % | 1 / 0 | at the limit |
| PSI io max | observer | bench-observer-11 | 17.0 % | 17.0 % | > 20 % | 0 / 1 | tight |
| Root disk max | observer | bench-observer-11 | 15.9 % | 15.9 % | > 80 % | 0 / 0 | headroom |
| Network p95 | observer | bench-observer-11 | 6 Mbps | 0.6 % | > 50 % | 0 / 0 | headroom |
| Consensus cache peak | observer | bench-observer-11 | 0.06 GiB | 6.3 % | info | – | info |
| OOM kills | observer | – | – | any | any | – | none |
| Disk throttling | observer | – | – | metric type unavailable in project | any | – | not collected |
| Disk performance degraded | observer | – | – | any sample | any | – | none |
| Node | Class | CPU p95 | Memory used p95 | telcoin RSS p95 | PSI memory max | RssAnon peak | Disk write p95 | Write IOPS p95 | PSI io max | Root disk max | Network p95 | Consensus cache peak |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Line | > 70 % | > 75 % | > 85 % | > 5 % | info | > 60 % | > 60 % | > 20 % | > 80 % | > 50 % | info | |
| bench-validator-01 | validator | 45.9 % | 32.6 % | 7.84 GB 46 % | 0.1 % | 4.75 GB 28 % | 377 MB/s 45 % | 16,653 83 % | 20.0 % | 44.0 % | 113 Mbps 11 % | 0.06 GiB 6 % |
| bench-validator-02 | validator | 43.8 % | 46.5 % | 9.83 GB 57 % | 0.0 % | 7.26 GB 42 % | 345 MB/s 41 % | 17,657 88 % | 20.4 % | 46.1 % | 112 Mbps 11 % | 0.06 GiB 6 % |
| bench-validator-03 | validator | 41.4 % | 34.7 % | 8.08 GB 47 % | 0.1 % | 5.06 GB 29 % | 404 MB/s 48 % | 17,735 89 % | 19.7 % | 45.1 % | 113 Mbps 11 % | 0.06 GiB 6 % |
| bench-validator-04 | validator | 39.7 % | 36.3 % | 8.45 GB 49 % | 0.0 % | 5.74 GB 33 % | 431 MB/s 51 % | 17,619 88 % | 22.3 % | 45.2 % | 116 Mbps 12 % | 0.06 GiB 6 % |
| bench-validator-05 | validator | 37.2 % | 28.9 % | 6.76 GB 39 % | 0.0 % | 4.67 GB 27 % | 386 MB/s 46 % | 16,753 84 % | 20.9 % | 38.8 % | 115 Mbps 11 % | 1.00 GiB 100 % |
| bench-validator-06 | validator | 43.9 % | 45.7 % | 9.56 GB 56 % | 0.1 % | 7.09 GB 41 % | 398 MB/s 47 % | 17,933 90 % | 21.1 % | 46.6 % | 110 Mbps 11 % | 0.06 GiB 6 % |
| bench-validator-07 | validator | 44.7 % | 42.2 % | 9.28 GB 54 % | 0.1 % | 6.40 GB 37 % | 377 MB/s 45 % | 17,556 88 % | 19.8 % | 44.6 % | 120 Mbps 12 % | 0.06 GiB 6 % |
| bench-validator-08 | validator | 41.9 % | 34.1 % | 8.09 GB 47 % | 0.1 % | 4.98 GB 29 % | 340 MB/s 41 % | 17,799 89 % | 19.0 % | 44.6 % | 120 Mbps 12 % | 0.06 GiB 6 % |
| bench-validator-09 | validator | 43.4 % | 36.0 % | 7.94 GB 46 % | 0.3 % | 5.30 GB 31 % | 429 MB/s 51 % | 17,002 85 % | 21.1 % | 44.3 % | 117 Mbps 12 % | 0.06 GiB 6 % |
| bench-validator-10 | validator | 43.8 % | 33.1 % | 7.83 GB 46 % | 0.0 % | 4.78 GB 28 % | 446 MB/s 53 % | 17,498 87 % | 22.7 % | 46.0 % | 110 Mbps 11 % | 0.06 GiB 6 % |
| bench-observer-11 | observer | 17.3 % | 11.7 % | 4.56 GB 27 % | 0.0 % | 0.97 GB 6 % | 444 MB/s 53 % | 16,262 81 % | 17.0 % | 15.9 % | 6 Mbps 1 % | 0.06 GiB 6 % |
Small figures are the share of capacity: RAM for RSS, the PD limit for disk write (VM cap applied), 1 Gbps for network. Hover a cell for its JSON path.
A = Fleet c3-hdb · c3-highcpu-8 · r20261007-0316
B = Fleet c3-hdb · c3-highcpu-8 · r20261006-0458
at the limit c3-highcpu-8 validators at 6,910 sustained TPS: at the limit on disk. Disk at the limit: write IOPS p95 16,653–17,933, up to 89.7 % of the 20,000 IOPS limit, over the 60 % line on all 10 validators (bench-validator-01, 02, 03, 04, 05, 06, 07, 08, 09, 10); IO pressure (PSI some avg10) max 20.4–22.7 %, over the 20 % line on 6 of 10 validators (bench-validator-02, 04, 05, 06, 09, 10); write p95 446 MB/s, 53.1 % of the 800 MiB/s limit (bench-validator-10), tight against the 60 % line. Memory tight: memory pressure (PSI some avg10) max 0.3 % (bench-validator-09), tight against the 5 % line. CPU has headroom: CPU p95 45.9 % of 8 vCPUs (bench-validator-01). Network has headroom: network p95 120 Mbps, 12.0 % of 1 Gbps (bench-validator-08). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).
at the limit c3-highcpu-8 observers at 6,910 sustained TPS: at the limit on disk. Disk at the limit: write IOPS p95 16,262, 81.3 % of the 20,000 IOPS limit on bench-observer-11, over the 60 % line; write p95 444 MB/s, 52.9 % of the 800 MiB/s limit (bench-observer-11), tight against the 60 % line; IO pressure (PSI some avg10) max 17.0 % (bench-observer-11), tight against the 20 % line. CPU has headroom: CPU p95 17.3 % of 8 vCPUs (bench-observer-11). Memory has headroom: memory used p95 11.7 % of RAM (bench-observer-11); telcoin RSS p95 4.56 GB, 26.5 % of 16 GiB RAM (bench-observer-11); memory pressure (PSI some avg10) max 0.0 % (bench-observer-11). Network has headroom: network p95 6 Mbps, 0.6 % of 1 Gbps (bench-observer-11). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).
at the limit c3-highcpu-8 validators at 5,953 sustained TPS: at the limit on disk. Disk at the limit: write p95 505–508 MB/s, up to 60.5 % of the 800 MiB/s limit, over the 60 % line on 2 of 10 validators (bench-validator-09, 10); IO pressure (PSI some avg10) max 26.4–32.2 %, over the 20 % line on all 10 validators (bench-validator-01, 02, 03, 04, 05, 06, 07, 08, 09, 10). Memory tight: memory pressure (PSI some avg10) max 0.0 % (bench-validator-03), tight against the 5 % line. CPU has headroom: CPU p95 31.3 % of 8 vCPUs (bench-validator-02). Network has headroom: network p95 103 Mbps, 10.3 % of 1 Gbps (bench-validator-06). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).
at the limit c3-highcpu-8 observers at 5,953 sustained TPS: at the limit on disk. Disk at the limit: IO pressure (PSI some avg10) max 29.3 % on bench-observer-11, over the 20 % line; write p95 475 MB/s, 56.6 % of the 800 MiB/s limit (bench-observer-11), tight against the 60 % line. CPU has headroom: CPU p95 20.3 % of 8 vCPUs (bench-observer-11). Memory has headroom: memory used p95 11.9 % of RAM (bench-observer-11); telcoin RSS p95 4.38 GB, 25.5 % of 16 GiB RAM (bench-observer-11); memory pressure (PSI some avg10) max 0.0 % (bench-observer-11). Network has headroom: network p95 9 Mbps, 0.9 % of 1 Gbps (bench-observer-11). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).
Validators: Fleet A (c3-highcpu-8) is at the limit on disk, tight on memory, with headroom on CPU and network; Fleet B (c3-highcpu-8) is at the limit on disk, tight on memory, with headroom on CPU and network. The same disk limit binds both fleets: every validator runs a 100 GB hyperdisk-balanced, which allows 20,000 IOPS on both; its throughput limit is 800 MiB/s on both. Disk is at the limit on both (Fleet A (c3-highcpu-8): write IOPS p95 17,933, 89.7 % of the 20,000 IOPS limit, IO pressure (PSI some avg10) max 22.7 %; Fleet B (c3-highcpu-8): write p95 508 MB/s, 60.5 % of the 800 MiB/s limit, IO pressure (PSI some avg10) max 32.2 %). Changing the machine shape did not clear it; the volume is the binding resource.
Observers: Fleet A (c3-highcpu-8) is at the limit on disk, with headroom on CPU, memory and network; Fleet B (c3-highcpu-8) is at the limit on disk, with headroom on CPU, memory and network. The same disk limit binds both fleets: every observer runs a 100 GB hyperdisk-balanced, which allows 20,000 IOPS on both; its throughput limit is 800 MiB/s on both. Disk is at the limit on both (Fleet A (c3-highcpu-8): write IOPS p95 16,262, 81.3 % of the 20,000 IOPS limit; Fleet B (c3-highcpu-8): IO pressure (PSI some avg10) max 29.3 %). Changing the machine shape did not clear it; the volume is the binding resource.
| KPI | Fleet A | Fleet B | B ÷ A |
|---|---|---|---|
| Sustained mixed TPS (own) | 6,909.7 tx/s | 5,952.9 tx/s | 0.86× |
| Sustained mixed TPS (chain) | 6,909.7 tx/s | 5,952.9 tx/s | 0.86× |
| Landed / accepted | 99.7 % | 99.6 % | 1.00× |
| Reverted (own) | 0 | 0 | – |
| Latency p50 | 2,441 ms | 3,383 ms | 1.39× |
| Latency p95 | 12,564 ms | 17,983 ms | 1.43× |
| Gas / s (own) | 268M gas/s | 167M gas/s | 0.62× |
| Capacity at mix | 11,256.8 tx/s | 6,852.7 tx/s | 0.61× |
| Signal | Class | Fleet A | Fleet B | Line |
|---|---|---|---|---|
| CPU p95 | validator | 45.9 % headroom | 31.3 % headroom | > 70 % |
| Memory used p95 | validator | 46.5 % headroom | 50.6 % headroom | > 75 % |
| telcoin RSS p95 | validator | 9.83 GB 57.2 % headroom | 10.31 GB 60.0 % headroom | > 85 % |
| PSI memory max | validator | 0.3 % tight | 0.0 % tight | > 5 % |
| Disk write p95 | validator | 446 MB/s 53.1 % tight | 508 MB/s 60.5 % at the limit | > 60 % |
| Write IOPS p95 | validator | 17,933 89.7 % at the limit | 5,324 26.6 % headroom | > 60 % |
| PSI io max | validator | 22.7 % at the limit | 32.2 % at the limit | > 20 % |
| Root disk max | validator | 46.6 % headroom | 13.6 % headroom | > 80 % |
| Network p95 | validator | 120 Mbps 12.0 % headroom | 103 Mbps 10.3 % headroom | > 50 % |
| CPU p95 | observer | 17.3 % headroom | 20.3 % headroom | > 70 % |
| Memory used p95 | observer | 11.7 % headroom | 11.9 % headroom | > 75 % |
| telcoin RSS p95 | observer | 4.56 GB 26.5 % headroom | 4.38 GB 25.5 % headroom | > 85 % |
| PSI memory max | observer | 0.0 % headroom | 0.0 % headroom | > 5 % |
| Disk write p95 | observer | 444 MB/s 52.9 % tight | 475 MB/s 56.6 % tight | > 60 % |
| Write IOPS p95 | observer | 16,262 81.3 % at the limit | 2,101 10.5 % headroom | > 60 % |
| PSI io max | observer | 17.0 % tight | 29.3 % at the limit | > 20 % |
| Root disk max | observer | 15.9 % headroom | 14.3 % headroom | > 80 % |
| Network p95 | observer | 6 Mbps 0.6 % headroom | 9 Mbps 0.9 % headroom | > 50 % |
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
Not collected: reference chains.