Throughput is measured from blocks the chain produced (own senders vs every sender), resource use from Cloud Monitoring, Prometheus and the on-node sampler. Summaries cover the mixed phase. Hover any number for the JSON field it came from.
Landed counts only our own senders; latency is submit → block timestamp.
| Type | Submitted | Accepted | Landed | Reverted | Unlanded | Skips | Gas limit | Gas used avg | p50 | p95 |
|---|---|---|---|---|---|---|---|---|---|---|
| native_transfer | 1.35M | 1.35M | 1.34M | 0 | 13.2K | 0 | 24.1K | 21K | 3,158 ms | 7,942 ms |
| batched_self_send | 460K | 460K | 451K | 0 | 8.88K | 0 | 24.1K | 21K | 3,218 ms | 7,983 ms |
| uniswap_v2_swap | 412K | 412K | 405K | 0 | 7.69K | 0 | 180K | 106K | 3,160 ms | 7,931 ms |
| stablecoin_transfer | 343K | 343K | 337K | 0 | 6.13K | 0 | 75K | 43.9K | 3,156 ms | 7,926 ms |
| wtel_wrap | 276K | 276K | 271K | 0 | 5.03K | 0 | 50K | 27.9K | 3,155 ms | 7,929 ms |
| wtel_unwrap | 184K | 184K | 180K | 0 | 3.37K | 0 | 45K | 35.2K | 3,160 ms | 7,914 ms |
| stablecoin_approve | 139K | 139K | 136K | 0 | 2.56K | 0 | 60K | 31.8K | 3,164 ms | 7,913 ms |
| uniswap_v2_add_liquidity | 91.7K | 91.7K | 89.9K | 0 | 1.77K | 0 | 250K | 128K | 3,162 ms | 7,939 ms |
| faucet_drip | 72K | 72K | 70.4K | 0 | 1.66K | 42.2K | 150K | 107K | 3,351 ms | 11,160 ms |
| contract_deploy | 70.6K | 70.6K | 69.3K | 0 | 1.29K | 0 | 140K | 74.2K | 3,160 ms | 7,921 ms |
| uniswap_v4_swap | 68.5K | 68.5K | 67.3K | 0 | 1.25K | 0 | 250K | 124K | 3,168 ms | 7,929 ms |
| uniswap_v2_remove_liquidity | 45.8K | 45.8K | 45K | 0 | 835 | 0 | 220K | 129K | 3,160 ms | 7,908 ms |
| uniswap_v3_swap | 45.6K | 45.6K | 44.8K | 0 | 817 | 0 | 220K | 120K | 3,156 ms | 7,931 ms |
| Node | Submitted | Accepted | Accepted % | Top errors | Send p50 | Send p95 |
|---|---|---|---|---|---|---|
| bench-validator-01 bench-validator-01:8545 | 626K | 626K | 100.0 % | none | 8 ms | 29 ms |
| bench-validator-02 bench-validator-02:8545 | 61.1K | 44.6K | 72.9 % | known 2.34K | 12 ms | 45 ms |
| bench-validator-03 bench-validator-03:8545 | 415K | 411K | 99.0 % | known 2.38K | 3 ms | 18 ms |
| bench-validator-04 bench-validator-04:8545 | 508K | 502K | 98.8 % | known 3.36K | 9 ms | 41 ms |
| bench-validator-05 bench-validator-05:8545 | 343K | 335K | 97.7 % | known 4.13K | 5 ms | 25 ms |
| bench-validator-06 bench-validator-06:8545 | 141K | 118K | 83.8 % | known 5.16K | 10 ms | 48 ms |
| bench-validator-07 bench-validator-07:8545 | 534K | 529K | 99.1 % | known 2.7K | 5 ms | 25 ms |
| bench-validator-08 bench-validator-08:8545 | 602K | 599K | 99.6 % | known 1.05K | 7 ms | 29 ms |
| bench-validator-09 bench-validator-09:8545 | 349K | 340K | 97.5 % | known 4.65K | 6 ms | 25 ms |
| bench-validator-10 bench-validator-10:8545 | 126K | 117K | 92.2 % | known 3.98K | 10 ms | 41 ms |
Shaded: phases outside the mixed window. Hairlines: epoch closes. Dashed orange: chaos events.
own senders vs chain total, per block-timestamp second
own vs chain gas used, per block-timestamp second
compute.googleapis.com/instance/cpu/utilization, 60-s mean, % of all vCPUs; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 14.8 % | 16.9 % | 16.9 % | 16.9 % |
| bench-validator-01 | validator | 28.4 % | 31.6 % | 31.6 % | 31.6 % |
| bench-validator-02 | validator | 26.0 % | 29.7 % | 29.7 % | 29.7 % |
| bench-validator-03 | validator | 27.3 % | 30.7 % | 30.7 % | 30.7 % |
| bench-validator-04 | validator | 27.3 % | 30.9 % | 30.9 % | 30.9 % |
| bench-validator-05 | validator | 26.5 % | 30.7 % | 30.7 % | 30.7 % |
| bench-validator-06 | validator | 27.3 % | 30.3 % | 30.3 % | 30.3 % |
| bench-validator-07 | validator | 27.3 % | 30.9 % | 30.9 % | 30.9 % |
| bench-validator-08 | validator | 28.1 % | 31.5 % | 31.5 % | 31.5 % |
| bench-validator-09 | validator | 25.9 % | 29.4 % | 29.4 % | 29.4 % |
| bench-validator-10 | validator | 25.8 % | 29.8 % | 29.8 % | 29.8 % |
One row per node, over the mixed phase.
agent processes/rss_usage summed over telcoin pids; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 3.07 GiB | 3.37 GiB | 3.37 GiB | 3.37 GiB |
| bench-validator-01 | validator | 4.86 GiB | 5.49 GiB | 5.49 GiB | 5.49 GiB |
| bench-validator-02 | validator | 5.47 GiB | 6.30 GiB | 6.30 GiB | 6.30 GiB |
| bench-validator-03 | validator | 5.06 GiB | 5.69 GiB | 5.69 GiB | 5.69 GiB |
| bench-validator-04 | validator | 5.23 GiB | 5.84 GiB | 5.84 GiB | 5.84 GiB |
| bench-validator-05 | validator | 5.00 GiB | 5.65 GiB | 5.65 GiB | 5.65 GiB |
| bench-validator-06 | validator | 5.58 GiB | 6.27 GiB | 6.27 GiB | 6.27 GiB |
| bench-validator-07 | validator | 5.09 GiB | 5.74 GiB | 5.74 GiB | 5.74 GiB |
| bench-validator-08 | validator | 5.15 GiB | 5.76 GiB | 5.76 GiB | 5.76 GiB |
| bench-validator-09 | validator | 5.06 GiB | 5.54 GiB | 5.54 GiB | 5.54 GiB |
| bench-validator-10 | validator | 5.56 GiB | 6.35 GiB | 6.35 GiB | 6.35 GiB |
One row per node, over the mixed phase.
agent memory/percent_used, state=used; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 8.7 % | 9.0 % | 9.0 % | 9.0 % |
| bench-validator-01 | validator | 19.5 % | 21.5 % | 21.5 % | 21.5 % |
| bench-validator-02 | validator | 23.0 % | 26.4 % | 26.4 % | 26.4 % |
| bench-validator-03 | validator | 20.5 % | 22.6 % | 22.6 % | 22.6 % |
| bench-validator-04 | validator | 21.4 % | 23.4 % | 23.4 % | 23.4 % |
| bench-validator-05 | validator | 20.3 % | 22.5 % | 22.5 % | 22.5 % |
| bench-validator-06 | validator | 23.8 % | 26.3 % | 26.3 % | 26.3 % |
| bench-validator-07 | validator | 20.6 % | 22.8 % | 22.8 % | 22.8 % |
| bench-validator-08 | validator | 20.9 % | 22.9 % | 22.9 % | 22.9 % |
| bench-validator-09 | validator | 20.7 % | 22.6 % | 22.6 % | 22.6 % |
| bench-validator-10 | validator | 23.6 % | 26.8 % | 26.8 % | 26.8 % |
One row per node, over the mixed phase.
instance/disk/{read,write}_bytes_count rate, all devices; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max | Limit |
|---|---|---|---|---|---|---|
| bench-observer-11 | observer | 82.9 MiB/s | 93.9 MiB/s | 93.9 MiB/s | 93.9 MiB/s | 800.0 MiB/s |
| bench-validator-01 | validator | 275.2 MiB/s | 299.2 MiB/s | 299.2 MiB/s | 299.2 MiB/s | 800.0 MiB/s |
| bench-validator-02 | validator | 272.8 MiB/s | 295.7 MiB/s | 295.7 MiB/s | 295.7 MiB/s | 800.0 MiB/s |
| bench-validator-03 | validator | 273.4 MiB/s | 298.5 MiB/s | 298.5 MiB/s | 298.5 MiB/s | 800.0 MiB/s |
| bench-validator-04 | validator | 274.8 MiB/s | 300.3 MiB/s | 300.3 MiB/s | 300.3 MiB/s | 800.0 MiB/s |
| bench-validator-05 | validator | 274.3 MiB/s | 297.4 MiB/s | 297.4 MiB/s | 297.4 MiB/s | 800.0 MiB/s |
| bench-validator-06 | validator | 272.7 MiB/s | 301.2 MiB/s | 301.2 MiB/s | 301.2 MiB/s | 800.0 MiB/s |
| bench-validator-07 | validator | 273.3 MiB/s | 298.3 MiB/s | 298.3 MiB/s | 298.3 MiB/s | 800.0 MiB/s |
| bench-validator-08 | validator | 274.1 MiB/s | 299.6 MiB/s | 299.6 MiB/s | 299.6 MiB/s | 800.0 MiB/s |
| bench-validator-09 | validator | 272.3 MiB/s | 295.6 MiB/s | 295.6 MiB/s | 295.6 MiB/s | 800.0 MiB/s |
| bench-validator-10 | validator | 271.8 MiB/s | 291.7 MiB/s | 291.7 MiB/s | 291.7 MiB/s | 800.0 MiB/s |
instance/disk/{read,write}_ops_count rate, all devices; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max | Limit |
|---|---|---|---|---|---|---|
| bench-observer-11 | observer | 17.8K IOPS | 20.1K IOPS | 20.1K IOPS | 20.1K IOPS | 20K IOPS |
| bench-validator-01 | validator | 17.5K IOPS | 20K IOPS | 20K IOPS | 20K IOPS | 20K IOPS |
| bench-validator-02 | validator | 17.5K IOPS | 20K IOPS | 20K IOPS | 20K IOPS | 20K IOPS |
| bench-validator-03 | validator | 17.4K IOPS | 19.9K IOPS | 19.9K IOPS | 19.9K IOPS | 20K IOPS |
| bench-validator-04 | validator | 17.4K IOPS | 20.1K IOPS | 20.1K IOPS | 20.1K IOPS | 20K IOPS |
| bench-validator-05 | validator | 17.4K IOPS | 19.9K IOPS | 19.9K IOPS | 19.9K IOPS | 20K IOPS |
| bench-validator-06 | validator | 17.5K IOPS | 20K IOPS | 20K IOPS | 20K IOPS | 20K IOPS |
| bench-validator-07 | validator | 17.4K IOPS | 20K IOPS | 20K IOPS | 20K IOPS | 20K IOPS |
| bench-validator-08 | validator | 17.4K IOPS | 20K IOPS | 20K IOPS | 20K IOPS | 20K IOPS |
| bench-validator-09 | validator | 17.3K IOPS | 19.9K IOPS | 19.9K IOPS | 19.9K IOPS | 20K IOPS |
| bench-validator-10 | validator | 17.4K IOPS | 20.1K IOPS | 20.1K IOPS | 20.1K IOPS | 20K IOPS |
| Node | Machine | vCPU | Disk | IOPS limit | MiB/s limit | Basis |
|---|---|---|---|---|---|---|
| bench-observer-11 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-01 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-02 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-03 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-04 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-05 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-06 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-07 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-08 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-09 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-10 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
instance/network/sent_bytes_count rate; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 1.2 Mbps | 1.3 Mbps | 1.3 Mbps | 1.3 Mbps |
| bench-validator-01 | validator | 104.4 Mbps | 116.9 Mbps | 116.9 Mbps | 116.9 Mbps |
| bench-validator-02 | validator | 90.5 Mbps | 103.3 Mbps | 103.3 Mbps | 103.3 Mbps |
| bench-validator-03 | validator | 94.9 Mbps | 105.0 Mbps | 105.0 Mbps | 105.0 Mbps |
| bench-validator-04 | validator | 96.1 Mbps | 110.4 Mbps | 110.4 Mbps | 110.4 Mbps |
| bench-validator-05 | validator | 93.7 Mbps | 108.6 Mbps | 108.6 Mbps | 108.6 Mbps |
| bench-validator-06 | validator | 91.3 Mbps | 100.2 Mbps | 100.2 Mbps | 100.2 Mbps |
| bench-validator-07 | validator | 97.1 Mbps | 109.9 Mbps | 109.9 Mbps | 109.9 Mbps |
| bench-validator-08 | validator | 99.0 Mbps | 111.0 Mbps | 111.0 Mbps | 111.0 Mbps |
| bench-validator-09 | validator | 92.5 Mbps | 104.2 Mbps | 104.2 Mbps | 104.2 Mbps |
| bench-validator-10 | validator | 90.3 Mbps | 103.7 Mbps | 103.7 Mbps | 103.7 Mbps |
instance/network/received_bytes_count rate; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 6.6 Mbps | 7.5 Mbps | 7.5 Mbps | 7.5 Mbps |
| bench-validator-01 | validator | 10.8 Mbps | 12.0 Mbps | 12.0 Mbps | 12.0 Mbps |
| bench-validator-02 | validator | 6.9 Mbps | 9.2 Mbps | 9.2 Mbps | 9.2 Mbps |
| bench-validator-03 | validator | 9.0 Mbps | 10.3 Mbps | 10.3 Mbps | 10.3 Mbps |
| bench-validator-04 | validator | 9.8 Mbps | 11.7 Mbps | 11.7 Mbps | 11.7 Mbps |
| bench-validator-05 | validator | 8.5 Mbps | 10.8 Mbps | 10.8 Mbps | 10.8 Mbps |
| bench-validator-06 | validator | 8.2 Mbps | 10.2 Mbps | 10.2 Mbps | 10.2 Mbps |
| bench-validator-07 | validator | 10.1 Mbps | 11.5 Mbps | 11.5 Mbps | 11.5 Mbps |
| bench-validator-08 | validator | 10.7 Mbps | 12.3 Mbps | 12.3 Mbps | 12.3 Mbps |
| bench-validator-09 | validator | 8.1 Mbps | 10.2 Mbps | 10.2 Mbps | 10.2 Mbps |
| bench-validator-10 | validator | 6.9 Mbps | 8.8 Mbps | 8.8 Mbps | 8.8 Mbps |
| Metric | Query | Class | Nodes | Median of node means | Worst peak 60-s mean | Max |
|---|---|---|---|---|---|---|
| tn_primary_commit_latency_seconds | p95 | validator | 10 | 2,411 ms | 5,258 ms | 6,250 ms |
| tn_engine_execution_duration_seconds | p95 | validator | 10 | 2,591 ms | 4,154 ms | 4,450 ms |
| tn_engine_execution_duration_seconds | p95 | observer | 1 | 2,268 ms | 2,487 ms | 2,500 ms |
| tn_worker_batch_size_bytes | p95 | validator | 10 | 241.1 KiB | 246.4 KiB | 246.4 KiB |
| tn_worker_batch_transactions | p95 | validator | 10 | 486 | 1K | 1K |
| tn_executor_output_transactions | p95 | validator | 10 | 1K | 1K | 1K |
| tn_primary_consensus_output_bytes | max | validator | 10 | 662.8 KiB | 2.2 MiB | 2.2 MiB |
| tn_primary_consensus_output_bytes | max | observer | 1 | 659.1 KiB | 1.6 MiB | 1.6 MiB |
| tn_engine_queued_outputs | max | validator | 10 | 1.38 | 3.5 | 4 |
| tn_engine_queued_outputs | max | observer | 1 | 0.938 | 2.5 | 3 |
| tn_primary_round | max | validator | 10 | 1.57K | 1.96K | 2K |
| tn_primary_round | max | observer | 1 | 1.52K | 1.94K | 1.97K |
| tn_primary_committed_round | max | validator | 10 | 1.57K | 1.96K | 2K |
| tn_primary_committed_round | max | observer | 1 | 1.52K | 1.94K | 1.97K |
| tn_epoch_current | max | validator | 10 | 8.09 | 8.75 | 9 |
| tn_epoch_current | max | observer | 1 | 8.09 | 8.75 | 9 |
| tn_batch_builder_pending_pool_transactions | max | validator | 10 | 1.03K | 6K | 6.41K |
| tn_batch_builder_pending_pool_transactions | max | observer | 1 | 0 | 0 | 0 |
| reth_process_resident_memory_bytes | max | validator | 10 | 5.22 GiB | 6.33 GiB | 6.35 GiB |
| reth_process_resident_memory_bytes | max | observer | 1 | 3.09 GiB | 3.35 GiB | 3.37 GiB |
| tn_primary_subdags_committed_total | rate | validator | 10 | 0.71 | 0.867 | 0.911 |
| tn_primary_subdags_committed_total | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_round_lag | lag | validator | 10 | 2.31 | 4 | 7 |
| tn_primary_round_lag | lag | observer | 1 | 0 | 0 | 0 |
| tn_batch_builder_seal_failures_total | rate | validator | 1 | 0 | 0 | 0 |
| tn_node_mode | max | validator | 10 | 0 | 0 | 0 |
| tn_node_mode | max | observer | 1 | 0 | 0 | 0 |
tn_primary_commit_latency_seconds
tn_primary_round − tn_primary_committed_round
tn_engine_queued_outputs, max by node
| Node | Class | Peak RssAnon | Peak RssFile | Peak cache | PSI mem | PSI io | PSI cpu | db growth | static_files growth | Root used | OOM Δ |
|---|---|---|---|---|---|---|---|---|---|---|---|
| bench-observer-11 | observer | 460 MiB | 2.93 GiB | 64 MiB 6.3 % | 0.0 % | 9.6 % | 0.1 % | 0 B | 3.67 GiB | 14.0 % | 0 |
| bench-validator-01 | validator | 2.49 GiB | 3.01 GiB | 64 MiB 6.3 % | 0.0 % | 11.8 % | 2.8 % | 0 B | 3.67 GiB | 15.0 % | 0 |
| bench-validator-02 | validator | 3.31 GiB | 3.00 GiB | 64 MiB 6.3 % | 0.0 % | 13.3 % | 2.7 % | 0 B | 3.67 GiB | 14.0 % | 0 |
| bench-validator-03 | validator | 2.68 GiB | 3.01 GiB | 64 MiB 6.3 % | 0.0 % | 13.8 % | 2.4 % | 0 B | 3.67 GiB | 15.0 % | 0 |
| bench-validator-04 | validator | 2.84 GiB | 3.01 GiB | 64 MiB 6.3 % | 0.0 % | 13.8 % | 2.6 % | 0 B | 3.67 GiB | 15.0 % | 0 |
| bench-validator-05 | validator | 2.65 GiB | 3.01 GiB | 64 MiB 6.3 % | 0.0 % | 12.3 % | 2.5 % | 0 B | 3.67 GiB | 15.0 % | 0 |
| bench-validator-06 | validator | 3.30 GiB | 2.97 GiB | 64 MiB 6.3 % | 0.0 % | 12.6 % | 2.6 % | 0 B | 3.67 GiB | 15.0 % | 0 |
| bench-validator-07 | validator | 2.75 GiB | 3.01 GiB | 64 MiB 6.3 % | 0.0 % | 13.8 % | 2.6 % | 0 B | 3.67 GiB | 15.0 % | 0 |
| bench-validator-08 | validator | 2.76 GiB | 3.01 GiB | 64 MiB 6.3 % | 0.0 % | 12.3 % | 2.7 % | 0 B | 3.67 GiB | 15.0 % | 0 |
| bench-validator-09 | validator | 2.68 GiB | 2.87 GiB | 64 MiB 6.3 % | 0.0 % | 11.9 % | 2.2 % | 0 B | 3.67 GiB | 15.0 % | 0 |
| bench-validator-10 | validator | 3.38 GiB | 2.98 GiB | 64 MiB 6.3 % | 0.0 % | 12.8 % | 2.4 % | 0 B | 3.67 GiB | 15.0 % | 0 |
/proc/<pid>/status of the telcoin process on the node with the largest RSS
du -sb of consensus-db/cache vs the 1 GiB ceiling
/proc/pressure on the node with the highest memory PSI
Per role and per node, from sizing.json (p95 over the landed window; PSI and RssAnon max over the whole sampler run). The lines follow the hardware doc's tier rules: CPU p95 over 70 % of vCPUs; memory used p95 over 75 % of RAM, or telcoin RSS p95 over 85 % of RAM; disk write p95 over 60 % of the PD MiB/s limit, or write IOPS p95 over 60 % of the IOPS limit; IO pressure over 20 % or memory pressure over 5 % (PSI some avg10, max); network p95 over 50 % of 1 Gbps; root disk over 80 %. A line crossed on any node puts the role at the limit; a nonzero reading within 15 points of its line is tight; otherwise the role has headroom. OOM kills, disk throttling and degraded disk performance are flagged too.
| Signal | Class | Worst node | Value | Share of capacity | Line | Nodes over / tight | Status |
|---|---|---|---|---|---|---|---|
| CPU p95 | validator | bench-validator-06 | 35.0 % | 35.0 % | > 70 % | 0 / 0 | headroom |
| Memory used p95 | validator | bench-validator-10 | 26.8 % | 26.8 % | > 75 % | 0 / 0 | headroom |
| telcoin RSS p95 | validator | bench-validator-10 | 6.82 GB | 39.7 % | > 85 % | 0 / 0 | headroom |
| PSI memory max | validator | bench-validator-01 | 0.0 % | 0.0 % | > 5 % | 0 / 0 | headroom |
| RssAnon peak | validator | bench-validator-07 | 4.45 GB | 25.9 % | info | – | info |
| Disk write p95 | validator | bench-validator-07 | 332 MB/s | 39.6 % | > 60 % | 0 / 0 | headroom |
| Write IOPS p95 | validator | bench-validator-04 | 20,105 | 100.5 % | > 60 % | 10 / 0 | at the limit |
| PSI io max | validator | bench-validator-02 | 22.5 % | 22.5 % | > 20 % | 8 / 2 | at the limit |
| Root disk max | validator | bench-validator-09 | 14.6 % | 14.6 % | > 80 % | 0 / 0 | headroom |
| Network p95 | validator | bench-validator-01 | 117 Mbps | 11.7 % | > 50 % | 0 / 0 | headroom |
| Consensus cache peak | validator | bench-validator-01 | 0.06 GiB | 6.3 % | info | – | info |
| OOM kills | validator | – | – | any | any | – | none |
| Disk throttling | validator | – | – | metric type unavailable in project | any | – | not collected |
| Disk performance degraded | validator | – | – | any sample | any | – | none |
| CPU p95 | observer | bench-observer-11 | 17.2 % | 17.2 % | > 70 % | 0 / 0 | headroom |
| Memory used p95 | observer | bench-observer-11 | 9.0 % | 9.0 % | > 75 % | 0 / 0 | headroom |
| telcoin RSS p95 | observer | bench-observer-11 | 3.62 GB | 21.1 % | > 85 % | 0 / 0 | headroom |
| PSI memory max | observer | bench-observer-11 | 0.0 % | 0.0 % | > 5 % | 0 / 0 | headroom |
| RssAnon peak | observer | bench-observer-11 | 0.58 GB | 3.4 % | info | – | info |
| Disk write p95 | observer | bench-observer-11 | 98 MB/s | 11.7 % | > 60 % | 0 / 0 | headroom |
| Write IOPS p95 | observer | bench-observer-11 | 20,078 | 100.4 % | > 60 % | 1 / 0 | at the limit |
| PSI io max | observer | bench-observer-11 | 12.9 % | 12.9 % | > 20 % | 0 / 1 | tight |
| Root disk max | observer | bench-observer-11 | 13.2 % | 13.2 % | > 80 % | 0 / 0 | headroom |
| Network p95 | observer | bench-observer-11 | 10 Mbps | 1.0 % | > 50 % | 0 / 0 | headroom |
| Consensus cache peak | observer | bench-observer-11 | 0.06 GiB | 6.3 % | info | – | info |
| OOM kills | observer | – | – | any | any | – | none |
| Disk throttling | observer | – | – | metric type unavailable in project | any | – | not collected |
| Disk performance degraded | observer | – | – | any sample | any | – | none |
| Node | Class | CPU p95 | Memory used p95 | telcoin RSS p95 | PSI memory max | RssAnon peak | Disk write p95 | Write IOPS p95 | PSI io max | Root disk max | Network p95 | Consensus cache peak |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Line | > 70 % | > 75 % | > 85 % | > 5 % | info | > 60 % | > 60 % | > 20 % | > 80 % | > 50 % | info | |
| bench-validator-01 | validator | 32.7 % | 21.5 % | 5.90 GB 34 % | 0.0 % | 3.68 GB 21 % | 319 MB/s 38 % | 20,025 100 % | 20.8 % | 14.0 % | 117 Mbps 12 % | 0.06 GiB 6 % |
| bench-validator-02 | validator | 32.3 % | 26.4 % | 6.76 GB 39 % | 0.0 % | 3.72 GB 22 % | 324 MB/s 39 % | 20,009 100 % | 22.5 % | 14.0 % | 103 Mbps 10 % | 0.06 GiB 6 % |
| bench-validator-03 | validator | 31.6 % | 22.6 % | 6.10 GB 36 % | 0.0 % | 3.57 GB 21 % | 325 MB/s 39 % | 19,943 100 % | 21.2 % | 14.1 % | 105 Mbps 11 % | 0.06 GiB 6 % |
| bench-validator-04 | validator | 33.1 % | 23.4 % | 6.27 GB 36 % | 0.0 % | 3.22 GB 19 % | 328 MB/s 39 % | 20,105 101 % | 20.9 % | 14.1 % | 110 Mbps 11 % | 0.06 GiB 6 % |
| bench-validator-05 | validator | 31.8 % | 22.5 % | 6.06 GB 35 % | 0.0 % | 3.38 GB 20 % | 327 MB/s 39 % | 19,908 100 % | 20.9 % | 14.1 % | 109 Mbps 11 % | 0.06 GiB 6 % |
| bench-validator-06 | validator | 35.0 % | 26.3 % | 6.74 GB 39 % | 0.0 % | 4.29 GB 25 % | 321 MB/s 38 % | 19,972 100 % | 20.7 % | 14.1 % | 100 Mbps 10 % | 0.06 GiB 6 % |
| bench-validator-07 | validator | 32.1 % | 22.8 % | 6.17 GB 36 % | 0.0 % | 4.45 GB 26 % | 332 MB/s 40 % | 19,976 100 % | 20.2 % | 14.2 % | 110 Mbps 11 % | 0.06 GiB 6 % |
| bench-validator-08 | validator | 31.7 % | 22.9 % | 6.18 GB 36 % | 0.0 % | 3.46 GB 20 % | 328 MB/s 39 % | 19,971 100 % | 19.9 % | 14.2 % | 111 Mbps 11 % | 0.06 GiB 6 % |
| bench-validator-09 | validator | 32.5 % | 22.6 % | 5.95 GB 35 % | 0.0 % | 3.47 GB 20 % | 332 MB/s 40 % | 19,937 100 % | 19.4 % | 14.6 % | 107 Mbps 11 % | 0.06 GiB 6 % |
| bench-validator-10 | validator | 31.6 % | 26.8 % | 6.82 GB 40 % | 0.0 % | 4.02 GB 23 % | 332 MB/s 40 % | 20,059 100 % | 21.2 % | 14.2 % | 104 Mbps 10 % | 0.06 GiB 6 % |
| bench-observer-11 | observer | 17.2 % | 9.0 % | 3.62 GB 21 % | 0.0 % | 0.58 GB 3 % | 98 MB/s 12 % | 20,078 100 % | 12.9 % | 13.2 % | 10 Mbps 1 % | 0.06 GiB 6 % |
Small figures are the share of capacity: RAM for RSS, the PD limit for disk write (VM cap applied), 1 Gbps for network. Hover a cell for its JSON path.
A = Fleet c3-hdb · c3-highcpu-8 · r20261006-2058
B = Fleet c3-hdb · c3-highcpu-8 · r20261006-0458
at the limit c3-highcpu-8 validators at 6,623 sustained TPS: at the limit on disk. Disk at the limit: write IOPS p95 19,908–20,105, up to 100.5 % of the 20,000 IOPS limit, over the 60 % line on all 10 validators (bench-validator-01, 02, 03, 04, 05, 06, 07, 08, 09, 10); IO pressure (PSI some avg10) max 20.2–22.5 %, over the 20 % line on 8 of 10 validators (bench-validator-01, 02, 03, 04, 05, 06, 07, 10). CPU has headroom: CPU p95 35.0 % of 8 vCPUs (bench-validator-06). Memory has headroom: memory used p95 26.8 % of RAM (bench-validator-10); telcoin RSS p95 6.82 GB, 39.7 % of 16 GiB RAM (bench-validator-10); memory pressure (PSI some avg10) max 0.0 % (bench-validator-01). Network has headroom: network p95 117 Mbps, 11.7 % of 1 Gbps (bench-validator-01). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).
at the limit c3-highcpu-8 observers at 6,623 sustained TPS: at the limit on disk. Disk at the limit: write IOPS p95 20,078, 100.4 % of the 20,000 IOPS limit on bench-observer-11, over the 60 % line; IO pressure (PSI some avg10) max 12.9 % (bench-observer-11), tight against the 20 % line. CPU has headroom: CPU p95 17.2 % of 8 vCPUs (bench-observer-11). Memory has headroom: memory used p95 9.0 % of RAM (bench-observer-11); telcoin RSS p95 3.62 GB, 21.1 % of 16 GiB RAM (bench-observer-11); memory pressure (PSI some avg10) max 0.0 % (bench-observer-11). Network has headroom: network p95 10 Mbps, 1.0 % of 1 Gbps (bench-observer-11). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).
at the limit c3-highcpu-8 validators at 5,953 sustained TPS: at the limit on disk. Disk at the limit: write p95 505–508 MB/s, up to 60.5 % of the 800 MiB/s limit, over the 60 % line on 2 of 10 validators (bench-validator-09, 10); IO pressure (PSI some avg10) max 26.4–32.2 %, over the 20 % line on all 10 validators (bench-validator-01, 02, 03, 04, 05, 06, 07, 08, 09, 10). Memory tight: memory pressure (PSI some avg10) max 0.0 % (bench-validator-03), tight against the 5 % line. CPU has headroom: CPU p95 31.3 % of 8 vCPUs (bench-validator-02). Network has headroom: network p95 103 Mbps, 10.3 % of 1 Gbps (bench-validator-06). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).
at the limit c3-highcpu-8 observers at 5,953 sustained TPS: at the limit on disk. Disk at the limit: IO pressure (PSI some avg10) max 29.3 % on bench-observer-11, over the 20 % line; write p95 475 MB/s, 56.6 % of the 800 MiB/s limit (bench-observer-11), tight against the 60 % line. CPU has headroom: CPU p95 20.3 % of 8 vCPUs (bench-observer-11). Memory has headroom: memory used p95 11.9 % of RAM (bench-observer-11); telcoin RSS p95 4.38 GB, 25.5 % of 16 GiB RAM (bench-observer-11); memory pressure (PSI some avg10) max 0.0 % (bench-observer-11). Network has headroom: network p95 9 Mbps, 0.9 % of 1 Gbps (bench-observer-11). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).
Validators: Fleet A (c3-highcpu-8) is at the limit on disk, with headroom on CPU, memory and network; Fleet B (c3-highcpu-8) is at the limit on disk, tight on memory, with headroom on CPU and network. The same disk limit binds both fleets: every validator runs a 100 GB hyperdisk-balanced, which allows 20,000 IOPS on both; its throughput limit is 800 MiB/s on both. Disk is at the limit on both (Fleet A (c3-highcpu-8): write IOPS p95 20,105, 100.5 % of the 20,000 IOPS limit, IO pressure (PSI some avg10) max 22.5 %; Fleet B (c3-highcpu-8): write p95 508 MB/s, 60.5 % of the 800 MiB/s limit, IO pressure (PSI some avg10) max 32.2 %). Changing the machine shape did not clear it; the volume is the binding resource.
Observers: Fleet A (c3-highcpu-8) is at the limit on disk, with headroom on CPU, memory and network; Fleet B (c3-highcpu-8) is at the limit on disk, with headroom on CPU, memory and network. The same disk limit binds both fleets: every observer runs a 100 GB hyperdisk-balanced, which allows 20,000 IOPS on both; its throughput limit is 800 MiB/s on both. Disk is at the limit on both (Fleet A (c3-highcpu-8): write IOPS p95 20,078, 100.4 % of the 20,000 IOPS limit; Fleet B (c3-highcpu-8): IO pressure (PSI some avg10) max 29.3 %). Changing the machine shape did not clear it; the volume is the binding resource.
| KPI | Fleet A | Fleet B | B ÷ A |
|---|---|---|---|
| Sustained mixed TPS (own) | 6,623.1 tx/s | 5,952.9 tx/s | 0.90× |
| Sustained mixed TPS (chain) | 6,623.1 tx/s | 5,952.9 tx/s | 0.90× |
| Landed / accepted | 98.5 % | 99.6 % | 1.01× |
| Reverted (own) | 0 | 0 | – |
| Latency p50 | 3,173 ms | 3,383 ms | 1.07× |
| Latency p95 | 7,946 ms | 17,983 ms | 2.26× |
| Gas / s (own) | 249M gas/s | 167M gas/s | 0.67× |
| Capacity at mix | 9,328.4 tx/s | 6,852.7 tx/s | 0.73× |
| Signal | Class | Fleet A | Fleet B | Line |
|---|---|---|---|---|
| CPU p95 | validator | 35.0 % headroom | 31.3 % headroom | > 70 % |
| Memory used p95 | validator | 26.8 % headroom | 50.6 % headroom | > 75 % |
| telcoin RSS p95 | validator | 6.82 GB 39.7 % headroom | 10.31 GB 60.0 % headroom | > 85 % |
| PSI memory max | validator | 0.0 % headroom | 0.0 % tight | > 5 % |
| Disk write p95 | validator | 332 MB/s 39.6 % headroom | 508 MB/s 60.5 % at the limit | > 60 % |
| Write IOPS p95 | validator | 20,105 100.5 % at the limit | 5,324 26.6 % headroom | > 60 % |
| PSI io max | validator | 22.5 % at the limit | 32.2 % at the limit | > 20 % |
| Root disk max | validator | 14.6 % headroom | 13.6 % headroom | > 80 % |
| Network p95 | validator | 117 Mbps 11.7 % headroom | 103 Mbps 10.3 % headroom | > 50 % |
| CPU p95 | observer | 17.2 % headroom | 20.3 % headroom | > 70 % |
| Memory used p95 | observer | 9.0 % headroom | 11.9 % headroom | > 75 % |
| telcoin RSS p95 | observer | 3.62 GB 21.1 % headroom | 4.38 GB 25.5 % headroom | > 85 % |
| PSI memory max | observer | 0.0 % headroom | 0.0 % headroom | > 5 % |
| Disk write p95 | observer | 98 MB/s 11.7 % headroom | 475 MB/s 56.6 % tight | > 60 % |
| Write IOPS p95 | observer | 20,078 100.4 % at the limit | 2,101 10.5 % headroom | > 60 % |
| PSI io max | observer | 12.9 % tight | 29.3 % at the limit | > 20 % |
| Root disk max | observer | 13.2 % headroom | 14.3 % headroom | > 80 % |
| Network p95 | observer | 10 Mbps 1.0 % headroom | 9 Mbps 0.9 % headroom | > 50 % |
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
Not collected: reference chains.