Throughput is measured from blocks the chain produced (own senders vs every sender), resource use from Cloud Monitoring, Prometheus and the on-node sampler. Summaries cover the mixed phase. Hover any number for the JSON field it came from.
Landed counts only our own senders; latency is submit → block timestamp.
| Type | Submitted | Accepted | Landed | Reverted | Unlanded | Skips | Gas limit | Gas used avg | p50 | p95 |
|---|---|---|---|---|---|---|---|---|---|---|
| native_transfer | 3.3M | 3.3M | 3.28M | 0 | 20.1K | 0 | 24.1K | 21K | 3,178 ms | 43,647 ms |
| batched_self_send | 1.64M | 1.64M | 1.63M | 0 | 13K | 0 | 24.1K | 21K | 3,247 ms | 63,321 ms |
| uniswap_v2_swap | 1.35M | 1.35M | 1.35M | 0 | 6.76K | 1.06K | 180K | 106K | 3,116 ms | 14,659 ms |
| stablecoin_transfer | 1.19M | 1.19M | 1.19M | 0 | 6.4K | 669 | 75K | 43.9K | 3,137 ms | 15,461 ms |
| wtel_wrap | 978K | 978K | 971K | 0 | 6.9K | 0 | 50K | 27.9K | 3,181 ms | 40,291 ms |
| wtel_unwrap | 630K | 630K | 626K | 0 | 3.29K | 749 | 45K | 35.2K | 3,136 ms | 15,322 ms |
| stablecoin_approve | 490K | 490K | 487K | 0 | 3.46K | 0 | 60K | 31.8K | 3,179 ms | 39,365 ms |
| uniswap_v2_add_liquidity | 301K | 301K | 299K | 0 | 1.53K | 1.06K | 250K | 128K | 3,112 ms | 14,667 ms |
| contract_deploy | 245K | 245K | 243K | 0 | 1.76K | 0 | 140K | 74.2K | 3,182 ms | 44,275 ms |
| uniswap_v4_swap | 221K | 221K | 220K | 0 | 1.03K | 1.15K | 250K | 124K | 3,110 ms | 14,643 ms |
| uniswap_v3_swap | 150K | 150K | 149K | 0 | 723 | 1.09K | 220K | 120K | 3,117 ms | 14,480 ms |
| uniswap_v2_remove_liquidity | 147K | 147K | 147K | 0 | 737 | 1.23K | 220K | 129K | 3,103 ms | 14,485 ms |
| faucet_drip | 113K | 113K | 112K | 0 | 1.08K | 294K | 150K | 107K | 3,344 ms | 350,229 ms |
| Node | Submitted | Accepted | Accepted % | Top errors | Send p50 | Send p95 |
|---|---|---|---|---|---|---|
| bench-validator-01 bench-validator-01:8545 | 1.08M | 1.03M | 95.9 % | known 22.2K | 8 ms | 30 ms |
| bench-validator-02 bench-validator-02:8545 | 1.04M | 989K | 95.4 % | known 22.6K | 7 ms | 27 ms |
| bench-validator-03 bench-validator-03:8545 | 174K | 134K | 77.4 % | known 15.2K | 12 ms | 52 ms |
| bench-validator-04 bench-validator-04:8545 | 165K | 126K | 76.1 % | known 15.4K | 13 ms | 47 ms |
| bench-validator-05 bench-validator-05:8545 | 2.03M | 2M | 98.6 % | known 12.5K, conn 2.16K | 8 ms | 27 ms |
| bench-validator-06 bench-validator-06:8545 | 2.56M | 2.54M | 99.1 % | known 9.23K | 8 ms | 26 ms |
| bench-validator-07 bench-validator-07:8545 | 902K | 853K | 94.6 % | known 22.6K | 7 ms | 25 ms |
| bench-validator-08 bench-validator-08:8545 | 981K | 934K | 95.2 % | known 23.9K | 7 ms | 24 ms |
| bench-validator-09 bench-validator-09:8545 | 1.05M | 1M | 95.7 % | known 18.9K | 8 ms | 27 ms |
| bench-validator-10 bench-validator-10:8545 | 1.26M | 1.22M | 96.9 % | known 17.5K | 9 ms | 35 ms |
Shaded: phases outside the mixed window. Hairlines: epoch closes. Dashed orange: chaos events.
own senders vs chain total, per block-timestamp second
own vs chain gas used, per block-timestamp second
compute.googleapis.com/instance/cpu/utilization, 60-s mean, % of all vCPUs; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 11.5 % | 14.9 % | 15.8 % | 15.8 % |
| bench-validator-01 | validator | 19.5 % | 26.4 % | 31.2 % | 31.2 % |
| bench-validator-02 | validator | 19.4 % | 26.2 % | 28.5 % | 28.5 % |
| bench-validator-03 | validator | 21.4 % | 27.8 % | 31.2 % | 31.2 % |
| bench-validator-04 | validator | 21.1 % | 27.1 % | 30.8 % | 30.8 % |
| bench-validator-05 | validator | 19.6 % | 26.8 % | 31.8 % | 31.8 % |
| bench-validator-06 | validator | 20.5 % | 27.0 % | 28.9 % | 28.9 % |
| bench-validator-07 | validator | 19.4 % | 25.5 % | 27.1 % | 27.1 % |
| bench-validator-08 | validator | 19.1 % | 24.8 % | 26.3 % | 26.3 % |
| bench-validator-09 | validator | 19.1 % | 25.2 % | 26.6 % | 26.6 % |
| bench-validator-10 | validator | 19.5 % | 27.3 % | 30.6 % | 30.6 % |
One row per node, over the mixed phase.
agent processes/rss_usage summed over telcoin pids; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 1.71 GiB | 2.56 GiB | 2.59 GiB | 2.59 GiB |
| bench-validator-01 | validator | 5.15 GiB | 7.05 GiB | 7.08 GiB | 7.08 GiB |
| bench-validator-02 | validator | 4.96 GiB | 7.18 GiB | 7.22 GiB | 7.22 GiB |
| bench-validator-03 | validator | 5.81 GiB | 8.99 GiB | 9.17 GiB | 9.17 GiB |
| bench-validator-04 | validator | 5.18 GiB | 7.17 GiB | 7.27 GiB | 7.27 GiB |
| bench-validator-05 | validator | 3.93 GiB | 5.19 GiB | 5.24 GiB | 5.24 GiB |
| bench-validator-06 | validator | 5.13 GiB | 7.20 GiB | 7.24 GiB | 7.24 GiB |
| bench-validator-07 | validator | 4.93 GiB | 6.85 GiB | 6.90 GiB | 6.90 GiB |
| bench-validator-08 | validator | 4.91 GiB | 6.55 GiB | 6.59 GiB | 6.59 GiB |
| bench-validator-09 | validator | 4.88 GiB | 6.47 GiB | 6.52 GiB | 6.52 GiB |
| bench-validator-10 | validator | 4.40 GiB | 5.86 GiB | 5.93 GiB | 5.93 GiB |
One row per node, over the mixed phase.
agent memory/percent_used, state=used; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 9.7 % | 12.3 % | 12.9 % | 12.9 % |
| bench-validator-01 | validator | 30.6 % | 37.4 % | 37.5 % | 37.5 % |
| bench-validator-02 | validator | 29.3 % | 38.1 % | 38.4 % | 38.4 % |
| bench-validator-03 | validator | 34.5 % | 49.9 % | 50.4 % | 50.4 % |
| bench-validator-04 | validator | 30.6 % | 38.3 % | 38.6 % | 38.6 % |
| bench-validator-05 | validator | 20.7 % | 27.7 % | 28.1 % | 28.1 % |
| bench-validator-06 | validator | 30.4 % | 38.3 % | 38.5 % | 38.5 % |
| bench-validator-07 | validator | 29.3 % | 36.1 % | 36.6 % | 36.6 % |
| bench-validator-08 | validator | 29.0 % | 34.3 % | 34.4 % | 34.4 % |
| bench-validator-09 | validator | 28.7 % | 33.9 % | 33.9 % | 33.9 % |
| bench-validator-10 | validator | 25.9 % | 30.3 % | 30.4 % | 30.4 % |
One row per node, over the mixed phase.
instance/disk/{read,write}_bytes_count rate, all devices; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max | Limit |
|---|---|---|---|---|---|---|
| bench-observer-11 | observer | 282.9 MiB/s | 419.0 MiB/s | 426.6 MiB/s | 426.6 MiB/s | 800.0 MiB/s |
| bench-validator-01 | validator | 316.3 MiB/s | 455.3 MiB/s | 461.9 MiB/s | 461.9 MiB/s | 800.0 MiB/s |
| bench-validator-02 | validator | 316.2 MiB/s | 453.2 MiB/s | 466.1 MiB/s | 466.1 MiB/s | 800.0 MiB/s |
| bench-validator-03 | validator | 307.4 MiB/s | 453.4 MiB/s | 465.5 MiB/s | 465.5 MiB/s | 800.0 MiB/s |
| bench-validator-04 | validator | 316.2 MiB/s | 461.7 MiB/s | 463.6 MiB/s | 463.6 MiB/s | 800.0 MiB/s |
| bench-validator-05 | validator | 275.7 MiB/s | 399.2 MiB/s | 437.0 MiB/s | 437.0 MiB/s | 800.0 MiB/s |
| bench-validator-06 | validator | 318.5 MiB/s | 464.3 MiB/s | 470.3 MiB/s | 470.3 MiB/s | 800.0 MiB/s |
| bench-validator-07 | validator | 318.1 MiB/s | 460.9 MiB/s | 473.2 MiB/s | 473.2 MiB/s | 800.0 MiB/s |
| bench-validator-08 | validator | 317.2 MiB/s | 455.7 MiB/s | 475.0 MiB/s | 475.0 MiB/s | 800.0 MiB/s |
| bench-validator-09 | validator | 317.0 MiB/s | 455.6 MiB/s | 469.4 MiB/s | 469.4 MiB/s | 800.0 MiB/s |
| bench-validator-10 | validator | 316.5 MiB/s | 457.0 MiB/s | 468.1 MiB/s | 468.1 MiB/s | 800.0 MiB/s |
instance/disk/{read,write}_ops_count rate, all devices; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max | Limit |
|---|---|---|---|---|---|---|
| bench-observer-11 | observer | 1.74K IOPS | 4.32K IOPS | 4.62K IOPS | 4.62K IOPS | 20K IOPS |
| bench-validator-01 | validator | 1.57K IOPS | 2.24K IOPS | 2.26K IOPS | 2.26K IOPS | 20K IOPS |
| bench-validator-02 | validator | 1.57K IOPS | 2.21K IOPS | 2.28K IOPS | 2.28K IOPS | 20K IOPS |
| bench-validator-03 | validator | 1.81K IOPS | 3.68K IOPS | 4.28K IOPS | 4.28K IOPS | 20K IOPS |
| bench-validator-04 | validator | 1.56K IOPS | 2.26K IOPS | 2.27K IOPS | 2.27K IOPS | 20K IOPS |
| bench-validator-05 | validator | 2.55K IOPS | 5.88K IOPS | 6.58K IOPS | 6.58K IOPS | 20K IOPS |
| bench-validator-06 | validator | 1.56K IOPS | 2.27K IOPS | 2.3K IOPS | 2.3K IOPS | 20K IOPS |
| bench-validator-07 | validator | 1.56K IOPS | 2.25K IOPS | 2.31K IOPS | 2.31K IOPS | 20K IOPS |
| bench-validator-08 | validator | 1.56K IOPS | 2.21K IOPS | 2.32K IOPS | 2.32K IOPS | 20K IOPS |
| bench-validator-09 | validator | 1.56K IOPS | 2.25K IOPS | 2.29K IOPS | 2.29K IOPS | 20K IOPS |
| bench-validator-10 | validator | 1.56K IOPS | 2.24K IOPS | 2.29K IOPS | 2.29K IOPS | 20K IOPS |
| Node | Machine | vCPU | Disk | IOPS limit | MiB/s limit | Basis |
|---|---|---|---|---|---|---|
| bench-observer-11 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-01 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-02 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-03 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-04 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-05 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-06 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-07 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-08 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-09 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-10 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
instance/network/sent_bytes_count rate; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 1.1 Mbps | 1.4 Mbps | 1.4 Mbps | 1.4 Mbps |
| bench-validator-01 | validator | 57.5 Mbps | 79.6 Mbps | 84.3 Mbps | 84.3 Mbps |
| bench-validator-02 | validator | 59.6 Mbps | 81.4 Mbps | 87.2 Mbps | 87.2 Mbps |
| bench-validator-03 | validator | 55.7 Mbps | 75.2 Mbps | 78.0 Mbps | 78.0 Mbps |
| bench-validator-04 | validator | 55.2 Mbps | 76.0 Mbps | 78.0 Mbps | 78.0 Mbps |
| bench-validator-05 | validator | 61.4 Mbps | 84.6 Mbps | 93.4 Mbps | 93.4 Mbps |
| bench-validator-06 | validator | 63.7 Mbps | 84.7 Mbps | 90.6 Mbps | 90.6 Mbps |
| bench-validator-07 | validator | 57.0 Mbps | 78.1 Mbps | 80.7 Mbps | 80.7 Mbps |
| bench-validator-08 | validator | 58.8 Mbps | 81.5 Mbps | 83.9 Mbps | 83.9 Mbps |
| bench-validator-09 | validator | 57.3 Mbps | 77.8 Mbps | 83.5 Mbps | 83.5 Mbps |
| bench-validator-10 | validator | 59.0 Mbps | 87.2 Mbps | 92.2 Mbps | 92.2 Mbps |
instance/network/received_bytes_count rate; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 3.6 Mbps | 4.9 Mbps | 5.8 Mbps | 5.8 Mbps |
| bench-validator-01 | validator | 5.9 Mbps | 8.6 Mbps | 10.5 Mbps | 10.5 Mbps |
| bench-validator-02 | validator | 5.8 Mbps | 8.5 Mbps | 10.0 Mbps | 10.0 Mbps |
| bench-validator-03 | validator | 6.9 Mbps | 9.4 Mbps | 12.7 Mbps | 12.7 Mbps |
| bench-validator-04 | validator | 6.6 Mbps | 9.3 Mbps | 12.1 Mbps | 12.1 Mbps |
| bench-validator-05 | validator | 7.7 Mbps | 13.9 Mbps | 14.7 Mbps | 14.7 Mbps |
| bench-validator-06 | validator | 8.6 Mbps | 12.2 Mbps | 14.1 Mbps | 14.1 Mbps |
| bench-validator-07 | validator | 5.7 Mbps | 7.9 Mbps | 10.3 Mbps | 10.3 Mbps |
| bench-validator-08 | validator | 5.6 Mbps | 7.8 Mbps | 9.4 Mbps | 9.4 Mbps |
| bench-validator-09 | validator | 5.7 Mbps | 9.0 Mbps | 9.4 Mbps | 9.4 Mbps |
| bench-validator-10 | validator | 6.1 Mbps | 11.1 Mbps | 12.1 Mbps | 12.1 Mbps |
| Metric | Query | Class | Nodes | Median of node means | Worst peak 60-s mean | Max |
|---|---|---|---|---|---|---|
| tn_primary_commit_latency_seconds | p95 | validator | 10 | 3,074 ms | 30.0 s | 30.0 s |
| tn_engine_execution_duration_seconds | p95 | validator | 10 | 3,727 ms | 7,062 ms | 9,250 ms |
| tn_engine_execution_duration_seconds | p95 | observer | 1 | 3,516 ms | 6,088 ms | 8,000 ms |
| tn_worker_batch_size_bytes | p95 | validator | 10 | 233.7 KiB | 246.4 KiB | 246.4 KiB |
| tn_worker_batch_transactions | p95 | validator | 10 | 514 | 1K | 1K |
| tn_executor_output_transactions | p95 | validator | 10 | 1K | 1K | 1K |
| tn_primary_consensus_output_bytes | max | validator | 10 | 673.7 KiB | 1.6 MiB | 2.4 MiB |
| tn_primary_consensus_output_bytes | max | observer | 1 | 692.3 KiB | 1.6 MiB | 2.1 MiB |
| tn_engine_queued_outputs | max | validator | 10 | 1.49 | 6.5 | 8 |
| tn_engine_queued_outputs | max | observer | 1 | 1.01 | 5 | 6 |
| tn_primary_round | max | validator | 10 | 900 | 1.79K | 1.79K |
| tn_primary_round | max | observer | 1 | 893 | 1.78K | 1.78K |
| tn_primary_committed_round | max | validator | 10 | 897 | 1.78K | 1.79K |
| tn_primary_committed_round | max | observer | 1 | 893 | 1.78K | 1.78K |
| tn_epoch_current | max | validator | 10 | 2.4 | 3 | 3 |
| tn_epoch_current | max | observer | 1 | 2.41 | 3 | 3 |
| tn_batch_builder_pending_pool_transactions | max | validator | 10 | 319 | 4.13K | 8.82K |
| tn_batch_builder_pending_pool_transactions | max | observer | 1 | 0 | 0 | 0 |
| reth_process_resident_memory_bytes | max | validator | 10 | 5.09 GiB | 9.29 GiB | 9.31 GiB |
| reth_process_resident_memory_bytes | max | observer | 1 | 1.79 GiB | 2.70 GiB | 2.73 GiB |
| tn_primary_subdags_committed_total | rate | validator | 10 | 0.469 | 0.856 | 0.867 |
| tn_primary_subdags_committed_total | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_round_lag | lag | validator | 10 | 2.4 | 5 | 6 |
| tn_primary_round_lag | lag | observer | 1 | 0 | 0 | 0 |
| tn_batch_builder_seal_failures_total | rate | validator | 7 | 0 | 0 | 0 |
| tn_node_mode | max | validator | 10 | 0 | 0 | 0 |
| tn_node_mode | max | observer | 1 | 0 | 0 | 0 |
tn_primary_commit_latency_seconds
tn_primary_round − tn_primary_committed_round
tn_engine_queued_outputs, max by node
| Node | Class | Peak RssAnon | Peak RssFile | Peak cache | PSI mem | PSI io | PSI cpu | db growth | static_files growth | Root used | OOM Δ |
|---|---|---|---|---|---|---|---|---|---|---|---|
| bench-observer-11 | observer | 1.08 GiB | 2.12 GiB | 64 MiB 6.3 % | 0.0 % | 22.8 % | 0.8 % | 0 B | 2.42 GiB | 12.0 % | 0 |
| bench-validator-01 | validator | 5.08 GiB | 2.12 GiB | 64 MiB 6.3 % | 0.0 % | 30.8 % | 3.5 % | 0 B | 2.42 GiB | 12.0 % | 0 |
| bench-validator-02 | validator | 5.25 GiB | 2.12 GiB | 64 MiB 6.3 % | 0.0 % | 28.9 % | 3.5 % | 0 B | 2.42 GiB | 12.0 % | 0 |
| bench-validator-03 | validator | 7.21 GiB | 2.11 GiB | 64 MiB 6.3 % | 0.0 % | 26.8 % | 3.4 % | 0 B | 2.42 GiB | 12.0 % | 0 |
| bench-validator-04 | validator | 5.28 GiB | 2.12 GiB | 64 MiB 6.3 % | 0.0 % | 30.9 % | 3.8 % | 0 B | 2.42 GiB | 12.0 % | 0 |
| bench-validator-05 | validator | 3.57 GiB | 2.09 GiB | 64 MiB 6.3 % | 0.0 % | 26.7 % | 3.8 % | 0 B | 2.42 GiB | 12.0 % | 0 |
| bench-validator-06 | validator | 5.24 GiB | 2.12 GiB | 64 MiB 6.3 % | 0.0 % | 33.6 % | 3.8 % | 0 B | 2.42 GiB | 12.0 % | 0 |
| bench-validator-07 | validator | 4.90 GiB | 2.12 GiB | 64 MiB 6.3 % | 0.0 % | 30.5 % | 3.5 % | 0 B | 2.42 GiB | 12.0 % | 0 |
| bench-validator-08 | validator | 4.62 GiB | 2.12 GiB | 64 MiB 6.3 % | 0.0 % | 31.7 % | 3.2 % | 0 B | 2.42 GiB | 12.0 % | 0 |
| bench-validator-09 | validator | 4.51 GiB | 2.12 GiB | 64 MiB 6.3 % | 0.0 % | 28.8 % | 2.6 % | 0 B | 2.42 GiB | 12.0 % | 0 |
| bench-validator-10 | validator | 3.93 GiB | 2.12 GiB | 64 MiB 6.3 % | 0.0 % | 31.2 % | 3.7 % | 0 B | 2.42 GiB | 12.0 % | 0 |
/proc/<pid>/status of the telcoin process on the node with the largest RSS
du -sb of consensus-db/cache vs the 1 GiB ceiling
/proc/pressure on the node with the highest memory PSI
Per role and per node, from sizing.json (p95 over the landed window; PSI and RssAnon max over the whole sampler run). The lines follow the hardware doc's tier rules: CPU p95 over 70 % of vCPUs; memory used p95 over 75 % of RAM, or telcoin RSS p95 over 85 % of RAM; disk write p95 over 60 % of the PD MiB/s limit, or write IOPS p95 over 60 % of the IOPS limit; IO pressure over 20 % or memory pressure over 5 % (PSI some avg10, max); network p95 over 50 % of 1 Gbps; root disk over 80 %. A line crossed on any node puts the role at the limit; a nonzero reading within 15 points of its line is tight; otherwise the role has headroom. OOM kills, disk throttling and degraded disk performance are flagged too.
| Signal | Class | Worst node | Value | Share of capacity | Line | Nodes over / tight | Status |
|---|---|---|---|---|---|---|---|
| CPU p95 | validator | bench-validator-03 | 28.2 % | 28.2 % | > 70 % | 0 / 0 | headroom |
| Memory used p95 | validator | bench-validator-03 | 50.5 % | 50.5 % | > 75 % | 0 / 0 | headroom |
| telcoin RSS p95 | validator | bench-validator-03 | 10.12 GB | 58.9 % | > 85 % | 0 / 0 | headroom |
| PSI memory max | validator | bench-validator-01 | 0.0 % | 0.0 % | > 5 % | 0 / 0 | headroom |
| RssAnon peak | validator | bench-validator-03 | 7.76 GB | 45.1 % | info | – | info |
| Disk write p95 | validator | bench-validator-10 | 555 MB/s | 66.2 % | > 60 % | 8 / 2 | at the limit |
| Write IOPS p95 | validator | bench-validator-05 | 6,744 | 33.7 % | > 60 % | 0 / 0 | headroom |
| PSI io max | validator | bench-validator-06 | 33.6 % | 33.6 % | > 20 % | 10 / 0 | at the limit |
| Root disk max | validator | bench-validator-10 | 12.4 % | 12.4 % | > 80 % | 0 / 0 | headroom |
| Network p95 | validator | bench-validator-06 | 87 Mbps | 8.7 % | > 50 % | 0 / 0 | headroom |
| Consensus cache peak | validator | bench-validator-01 | 0.06 GiB | 6.3 % | info | – | info |
| OOM kills | validator | – | – | any | any | – | none |
| Disk throttling | validator | – | – | metric type unavailable in project | any | – | not collected |
| Disk performance degraded | validator | – | – | any sample | any | – | none |
| CPU p95 | observer | bench-observer-11 | 14.9 % | 14.9 % | > 70 % | 0 / 0 | headroom |
| Memory used p95 | observer | bench-observer-11 | 12.3 % | 12.3 % | > 75 % | 0 / 0 | headroom |
| telcoin RSS p95 | observer | bench-observer-11 | 2.99 GB | 17.4 % | > 85 % | 0 / 0 | headroom |
| PSI memory max | observer | bench-observer-11 | 0.0 % | 0.0 % | > 5 % | 0 / 0 | headroom |
| RssAnon peak | observer | bench-observer-11 | 1.16 GB | 6.8 % | info | – | info |
| Disk write p95 | observer | bench-observer-11 | 439 MB/s | 52.4 % | > 60 % | 0 / 1 | tight |
| Write IOPS p95 | observer | bench-observer-11 | 5,617 | 28.1 % | > 60 % | 0 / 0 | headroom |
| PSI io max | observer | bench-observer-11 | 22.8 % | 22.8 % | > 20 % | 1 / 0 | at the limit |
| Root disk max | observer | bench-observer-11 | 12.1 % | 12.1 % | > 80 % | 0 / 0 | headroom |
| Network p95 | observer | bench-observer-11 | 6 Mbps | 0.6 % | > 50 % | 0 / 0 | headroom |
| Consensus cache peak | observer | bench-observer-11 | 0.06 GiB | 6.3 % | info | – | info |
| OOM kills | observer | – | – | any | any | – | none |
| Disk throttling | observer | – | – | metric type unavailable in project | any | – | not collected |
| Disk performance degraded | observer | – | – | any sample | any | – | none |
| Node | Class | CPU p95 | Memory used p95 | telcoin RSS p95 | PSI memory max | RssAnon peak | Disk write p95 | Write IOPS p95 | PSI io max | Root disk max | Network p95 | Consensus cache peak |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Line | > 70 % | > 75 % | > 85 % | > 5 % | info | > 60 % | > 60 % | > 20 % | > 80 % | > 50 % | info | |
| bench-validator-01 | validator | 26.4 % | 37.5 % | 7.85 GB 46 % | 0.0 % | 5.47 GB 32 % | 547 MB/s 65 % | 3,048 15 % | 31.8 % | 12.3 % | 80 Mbps 8 % | 0.06 GiB 6 % |
| bench-validator-02 | validator | 26.2 % | 38.8 % | 8.05 GB 47 % | 0.0 % | 5.71 GB 33 % | 542 MB/s 65 % | 3,369 17 % | 32.1 % | 12.3 % | 81 Mbps 8 % | 0.06 GiB 6 % |
| bench-validator-03 | validator | 28.2 % | 50.5 % | 10.12 GB 59 % | 0.0 % | 7.76 GB 45 % | 475 MB/s 57 % | 5,253 26 % | 26.8 % | 12.3 % | 75 Mbps 8 % | 0.06 GiB 6 % |
| bench-validator-04 | validator | 27.7 % | 38.8 % | 8.08 GB 47 % | 0.0 % | 5.70 GB 33 % | 532 MB/s 63 % | 3,518 18 % | 31.4 % | 12.3 % | 76 Mbps 8 % | 0.06 GiB 6 % |
| bench-validator-05 | validator | 27.8 % | 27.7 % | 6.04 GB 35 % | 0.0 % | 3.83 GB 22 % | 419 MB/s 50 % | 6,744 34 % | 26.7 % | 12.2 % | 86 Mbps 9 % | 0.06 GiB 6 % |
| bench-validator-06 | validator | 27.4 % | 38.4 % | 7.99 GB 46 % | 0.0 % | 5.62 GB 33 % | 543 MB/s 65 % | 2,615 13 % | 33.6 % | 12.3 % | 87 Mbps 9 % | 0.06 GiB 6 % |
| bench-validator-07 | validator | 25.5 % | 36.7 % | 7.69 GB 45 % | 0.0 % | 5.29 GB 31 % | 548 MB/s 65 % | 2,625 13 % | 33.0 % | 12.3 % | 78 Mbps 8 % | 0.06 GiB 6 % |
| bench-validator-08 | validator | 24.8 % | 34.7 % | 7.35 GB 43 % | 0.0 % | 4.96 GB 29 % | 553 MB/s 66 % | 2,642 13 % | 32.2 % | 12.3 % | 81 Mbps 8 % | 0.06 GiB 6 % |
| bench-validator-09 | validator | 25.2 % | 34.0 % | 7.26 GB 42 % | 0.0 % | 4.87 GB 28 % | 554 MB/s 66 % | 2,640 13 % | 32.6 % | 12.3 % | 78 Mbps 8 % | 0.06 GiB 6 % |
| bench-validator-10 | validator | 27.3 % | 30.5 % | 6.63 GB 39 % | 0.0 % | 4.23 GB 25 % | 555 MB/s 66 % | 2,634 13 % | 32.8 % | 12.4 % | 87 Mbps 9 % | 0.06 GiB 6 % |
| bench-observer-11 | observer | 14.9 % | 12.3 % | 2.99 GB 17 % | 0.0 % | 1.16 GB 7 % | 439 MB/s 52 % | 5,617 28 % | 22.8 % | 12.1 % | 6 Mbps 1 % | 0.06 GiB 6 % |
Small figures are the share of capacity: RAM for RSS, the PD limit for disk write (VM cap applied), 1 Gbps for network. Hover a cell for its JSON path.
A = Fleet c3-hdb · c3-highcpu-8 · r20261006-0053
B = Fleet c3-hdb · c3-highcpu-8 · r20260929-1647
at the limit c3-highcpu-8 validators at 7,239 sustained TPS: at the limit on disk. Disk at the limit: write p95 532–555 MB/s, up to 66.2 % of the 800 MiB/s limit, over the 60 % line on 8 of 10 validators (bench-validator-01, 02, 04, 06, 07, 08, 09, 10); IO pressure (PSI some avg10) max 26.7–33.6 %, over the 20 % line on all 10 validators (bench-validator-01, 02, 03, 04, 05, 06, 07, 08, 09, 10). CPU has headroom: CPU p95 28.2 % of 8 vCPUs (bench-validator-03). Memory has headroom: memory used p95 50.5 % of RAM (bench-validator-03); telcoin RSS p95 10.12 GB, 58.9 % of 16 GiB RAM (bench-validator-03); memory pressure (PSI some avg10) max 0.0 % (bench-validator-01). Network has headroom: network p95 87 Mbps, 8.7 % of 1 Gbps (bench-validator-06). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).
at the limit c3-highcpu-8 observers at 7,239 sustained TPS: at the limit on disk. Disk at the limit: IO pressure (PSI some avg10) max 22.8 % on bench-observer-11, over the 20 % line; write p95 439 MB/s, 52.4 % of the 800 MiB/s limit (bench-observer-11), tight against the 60 % line. CPU has headroom: CPU p95 14.9 % of 8 vCPUs (bench-observer-11). Memory has headroom: memory used p95 12.3 % of RAM (bench-observer-11); telcoin RSS p95 2.99 GB, 17.4 % of 16 GiB RAM (bench-observer-11); memory pressure (PSI some avg10) max 0.0 % (bench-observer-11). Network has headroom: network p95 6 Mbps, 0.6 % of 1 Gbps (bench-observer-11). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).
at the limit c3-highcpu-8 validators at 6,561 sustained TPS: at the limit on disk. Disk at the limit: IO pressure (PSI some avg10) max 24.0–30.3 %, over the 20 % line on all 10 validators (bench-validator-01, 02, 03, 04, 05, 06, 07, 08, 09, 10); write p95 494 MB/s, 58.9 % of the 800 MiB/s limit (bench-validator-09), tight against the 60 % line; write IOPS p95 11,076, 55.4 % of the 20,000 IOPS limit (bench-validator-05), tight against the 60 % line. Memory tight: memory pressure (PSI some avg10) max 0.0 % (bench-validator-05), tight against the 5 % line. CPU has headroom: CPU p95 32.8 % of 8 vCPUs (bench-validator-03). Network has headroom: network p95 112 Mbps, 11.2 % of 1 Gbps (bench-validator-06). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).
at the limit c3-highcpu-8 observers at 6,561 sustained TPS: at the limit on disk. Disk at the limit: IO pressure (PSI some avg10) max 26.9 % on bench-observer-11, over the 20 % line; write p95 434 MB/s, 51.8 % of the 800 MiB/s limit (bench-observer-11), tight against the 60 % line. CPU has headroom: CPU p95 15.7 % of 8 vCPUs (bench-observer-11). Memory has headroom: memory used p95 10.4 % of RAM (bench-observer-11); telcoin RSS p95 3.57 GB, 20.8 % of 16 GiB RAM (bench-observer-11); memory pressure (PSI some avg10) max 0.0 % (bench-observer-11). Network has headroom: network p95 5 Mbps, 0.5 % of 1 Gbps (bench-observer-11). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).
Validators: Fleet A (c3-highcpu-8) is at the limit on disk, with headroom on CPU, memory and network; Fleet B (c3-highcpu-8) is at the limit on disk, tight on memory, with headroom on CPU and network. The same disk limit binds both fleets: every validator runs a 100 GB hyperdisk-balanced, which allows 20,000 IOPS on both; its throughput limit is 800 MiB/s on both. Disk is at the limit on both (Fleet A (c3-highcpu-8): write p95 555 MB/s, 66.2 % of the 800 MiB/s limit, IO pressure (PSI some avg10) max 33.6 %; Fleet B (c3-highcpu-8): IO pressure (PSI some avg10) max 30.3 %). Changing the machine shape did not clear it; the volume is the binding resource.
Observers: Fleet A (c3-highcpu-8) is at the limit on disk, with headroom on CPU, memory and network; Fleet B (c3-highcpu-8) is at the limit on disk, with headroom on CPU, memory and network. The same disk limit binds both fleets: every observer runs a 100 GB hyperdisk-balanced, which allows 20,000 IOPS on both; its throughput limit is 800 MiB/s on both. Disk is at the limit on both (Fleet A (c3-highcpu-8): IO pressure (PSI some avg10) max 22.8 %; Fleet B (c3-highcpu-8): IO pressure (PSI some avg10) max 26.9 %). Changing the machine shape did not clear it; the volume is the binding resource.
| KPI | Fleet A | Fleet B | B ÷ A |
|---|---|---|---|
| Sustained mixed TPS (own) | 7,239.4 tx/s | 6,561.4 tx/s | 0.91× |
| Sustained mixed TPS (chain) | 7,239.4 tx/s | 6,561.4 tx/s | 0.91× |
| Landed / accepted | 99.4 % | 99.7 % | 1.00× |
| Reverted (own) | 0 | 0 | – |
| Latency p50 | 3,169 ms | 4,036 ms | 1.27× |
| Latency p95 | 26,067 ms | 14,363 ms | 0.55× |
| Gas / s (own) | 160M gas/s | 208M gas/s | 1.30× |
| Capacity at mix | 6,709.8 tx/s | 7,745.9 tx/s | 1.15× |
| Signal | Class | Fleet A | Fleet B | Line |
|---|---|---|---|---|
| CPU p95 | validator | 28.2 % headroom | 32.8 % headroom | > 70 % |
| Memory used p95 | validator | 50.5 % headroom | 44.5 % headroom | > 75 % |
| telcoin RSS p95 | validator | 10.12 GB 58.9 % headroom | 10.58 GB 61.6 % headroom | > 85 % |
| PSI memory max | validator | 0.0 % headroom | 0.0 % tight | > 5 % |
| Disk write p95 | validator | 555 MB/s 66.2 % at the limit | 494 MB/s 58.9 % tight | > 60 % |
| Write IOPS p95 | validator | 6,744 33.7 % headroom | 11,076 55.4 % tight | > 60 % |
| PSI io max | validator | 33.6 % at the limit | 30.3 % at the limit | > 20 % |
| Root disk max | validator | 12.4 % headroom | 15.0 % headroom | > 80 % |
| Network p95 | validator | 87 Mbps 8.7 % headroom | 112 Mbps 11.2 % headroom | > 50 % |
| CPU p95 | observer | 14.9 % headroom | 15.7 % headroom | > 70 % |
| Memory used p95 | observer | 12.3 % headroom | 10.4 % headroom | > 75 % |
| telcoin RSS p95 | observer | 2.99 GB 17.4 % headroom | 3.57 GB 20.8 % headroom | > 85 % |
| PSI memory max | observer | 0.0 % headroom | 0.0 % headroom | > 5 % |
| Disk write p95 | observer | 439 MB/s 52.4 % tight | 434 MB/s 51.8 % tight | > 60 % |
| Write IOPS p95 | observer | 5,617 28.1 % headroom | 7,149 35.7 % headroom | > 60 % |
| PSI io max | observer | 22.8 % at the limit | 26.9 % at the limit | > 20 % |
| Root disk max | observer | 12.1 % headroom | 13.7 % headroom | > 80 % |
| Network p95 | observer | 6 Mbps 0.6 % headroom | 5 Mbps 0.5 % headroom | > 50 % |
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
Not collected: reference chains.