Throughput is measured from blocks the chain produced (own senders vs every sender), resource use from Cloud Monitoring, Prometheus and the on-node sampler. Summaries cover the mixed phase. Hover any number for the JSON field it came from.
Landed counts only our own senders; latency is submit → block timestamp.
| Type | Submitted | Accepted | Landed | Reverted | Unlanded | Skips | Gas limit | Gas used avg | p50 | p95 |
|---|---|---|---|---|---|---|---|---|---|---|
| native_transfer | 7.44M | 7.34M | 7.34M | 0 | 480 | 0 | 24.1K | 21K | 1,654 ms | 8,698 ms |
| batched_self_send | 3.87M | 3.79M | 3.79M | 0 | 311 | 0 | 24.1K | 21K | 1,706 ms | 9,148 ms |
| uniswap_v2_swap | 3.48M | 3.41M | 3.41M | 0 | 343 | 0 | 180K | 106K | 1,656 ms | 8,713 ms |
| stablecoin_transfer | 2.9M | 2.84M | 2.84M | 0 | 264 | 0 | 75K | 43.9K | 1,654 ms | 8,648 ms |
| wtel_wrap | 2.31M | 2.27M | 2.27M | 0 | 220 | 0 | 50K | 27.9K | 1,655 ms | 8,635 ms |
| wtel_unwrap | 1.54M | 1.51M | 1.51M | 0 | 140 | 0 | 45K | 35.2K | 1,655 ms | 8,704 ms |
| stablecoin_approve | 1.16M | 1.14M | 1.14M | 0 | 113 | 0 | 60K | 31.8K | 1,654 ms | 8,650 ms |
| uniswap_v2_add_liquidity | 773K | 758K | 758K | 0 | 82 | 0 | 250K | 128K | 1,658 ms | 8,693 ms |
| uniswap_v4_swap | 580K | 568K | 568K | 0 | 66 | 0 | 250K | 124K | 1,655 ms | 8,806 ms |
| contract_deploy | 574K | 562K | 562K | 0 | 43 | 0 | 140K | 74.2K | 1,654 ms | 8,583 ms |
| uniswap_v2_remove_liquidity | 389K | 381K | 381K | 0 | 37 | 0 | 220K | 129K | 1,654 ms | 8,618 ms |
| uniswap_v3_swap | 386K | 379K | 379K | 0 | 38 | 0 | 220K | 120K | 1,657 ms | 8,683 ms |
| faucet_drip | 126K | 126K | 126K | 0 | 0 | 839K | 150K | 107K | 1,299 ms | 9,779 ms |
| Node | Submitted | Accepted | Accepted % | Top errors | Send p50 | Send p95 |
|---|---|---|---|---|---|---|
| bench-validator-01 bench-validator-01:8545 | 2.75M | 2.75M | 100.0 % | none | 7 ms | 28 ms |
| bench-validator-02 bench-validator-02:8545 | 2.02M | 2.02M | 100.0 % | none | 11 ms | 43 ms |
| bench-validator-03 bench-validator-03:8545 | 2.9M | 2.9M | 100.0 % | none | 8 ms | 27 ms |
| bench-validator-04 bench-validator-04:8545 | 1.88M | 1.88M | 100.0 % | none | 8 ms | 35 ms |
| bench-validator-05 bench-validator-05:8545 | 3.1M | 1.74M | 56.0 % | other 1.37M | 3 ms | 30 ms |
| bench-validator-06 bench-validator-06:8545 | 1.89M | 1.89M | 100.0 % | none | 16 ms | 49 ms |
| bench-validator-07 bench-validator-07:8545 | 2.95M | 2.95M | 100.0 % | none | 9 ms | 33 ms |
| bench-validator-08 bench-validator-08:8545 | 3.13M | 3.13M | 100.0 % | none | 8 ms | 29 ms |
| bench-validator-09 bench-validator-09:8545 | 2.87M | 2.87M | 100.0 % | none | 6 ms | 23 ms |
| bench-validator-10 bench-validator-10:8545 | 3.01M | 3.01M | 100.0 % | none | 9 ms | 38 ms |
Shaded: phases outside the mixed window. Hairlines: epoch closes. Dashed orange: chaos events.
own senders vs chain total, per block-timestamp second
own vs chain gas used, per block-timestamp second
compute.googleapis.com/instance/cpu/utilization, 60-s mean, % of all vCPUs; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 27.8 % | 32.1 % | 35.2 % | 35.2 % |
| bench-validator-01 | validator | 47.9 % | 56.2 % | 70.2 % | 70.2 % |
| bench-validator-02 | validator | 48.1 % | 53.6 % | 69.1 % | 69.1 % |
| bench-validator-03 | validator | 48.8 % | 56.5 % | 69.8 % | 69.8 % |
| bench-validator-04 | validator | 46.7 % | 53.8 % | 70.2 % | 70.2 % |
| bench-validator-05 | validator | 39.6 % | 56.3 % | 70.1 % | 70.1 % |
| bench-validator-06 | validator | 47.7 % | 55.7 % | 66.7 % | 66.7 % |
| bench-validator-07 | validator | 49.5 % | 55.1 % | 72.7 % | 72.7 % |
| bench-validator-08 | validator | 49.4 % | 54.7 % | 71.0 % | 71.0 % |
| bench-validator-09 | validator | 48.6 % | 53.3 % | 71.6 % | 71.6 % |
| bench-validator-10 | validator | 49.4 % | 55.4 % | 70.2 % | 70.2 % |
One row per node, over the mixed phase.
agent processes/rss_usage summed over telcoin pids; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 4.49 GiB | 5.94 GiB | 6.01 GiB | 6.01 GiB |
| bench-validator-01 | validator | 5.61 GiB | 6.83 GiB | 6.93 GiB | 6.93 GiB |
| bench-validator-02 | validator | 5.54 GiB | 6.78 GiB | 6.92 GiB | 6.92 GiB |
| bench-validator-03 | validator | 5.56 GiB | 6.76 GiB | 6.83 GiB | 6.83 GiB |
| bench-validator-04 | validator | 5.71 GiB | 7.09 GiB | 7.25 GiB | 7.25 GiB |
| bench-validator-05 | validator | 4.90 GiB | 7.29 GiB | 7.33 GiB | 7.33 GiB |
| bench-validator-06 | validator | 5.53 GiB | 6.71 GiB | 6.83 GiB | 6.83 GiB |
| bench-validator-07 | validator | 5.46 GiB | 6.65 GiB | 6.71 GiB | 6.71 GiB |
| bench-validator-08 | validator | 5.47 GiB | 6.68 GiB | 6.80 GiB | 6.80 GiB |
| bench-validator-09 | validator | 5.49 GiB | 6.72 GiB | 6.74 GiB | 6.74 GiB |
| bench-validator-10 | validator | 5.54 GiB | 6.64 GiB | 6.72 GiB | 6.72 GiB |
One row per node, over the mixed phase.
agent memory/percent_used, state=used; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 10.5 % | 11.4 % | 11.6 % | 11.6 % |
| bench-validator-01 | validator | 17.1 % | 18.1 % | 18.2 % | 18.2 % |
| bench-validator-02 | validator | 16.7 % | 17.8 % | 17.9 % | 17.9 % |
| bench-validator-03 | validator | 16.8 % | 17.5 % | 17.6 % | 17.6 % |
| bench-validator-04 | validator | 17.8 % | 19.9 % | 20.3 % | 20.3 % |
| bench-validator-05 | validator | 15.4 % | 21.0 % | 21.4 % | 21.4 % |
| bench-validator-06 | validator | 16.6 % | 17.4 % | 17.5 % | 17.5 % |
| bench-validator-07 | validator | 16.2 % | 16.9 % | 17.0 % | 17.0 % |
| bench-validator-08 | validator | 16.1 % | 17.0 % | 17.2 % | 17.2 % |
| bench-validator-09 | validator | 16.3 % | 17.2 % | 17.3 % | 17.3 % |
| bench-validator-10 | validator | 16.6 % | 17.0 % | 17.2 % | 17.2 % |
One row per node, over the mixed phase.
instance/disk/{read,write}_bytes_count rate, all devices; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max | Limit |
|---|---|---|---|---|---|---|
| bench-observer-11 | observer | 241.2 MiB/s | 289.4 MiB/s | 304.5 MiB/s | 304.5 MiB/s | 800.0 MiB/s |
| bench-validator-01 | validator | 237.9 MiB/s | 282.7 MiB/s | 291.4 MiB/s | 291.4 MiB/s | 800.0 MiB/s |
| bench-validator-02 | validator | 216.4 MiB/s | 283.5 MiB/s | 284.1 MiB/s | 284.1 MiB/s | 800.0 MiB/s |
| bench-validator-03 | validator | 214.9 MiB/s | 277.1 MiB/s | 279.9 MiB/s | 279.9 MiB/s | 800.0 MiB/s |
| bench-validator-04 | validator | 244.8 MiB/s | 282.7 MiB/s | 283.4 MiB/s | 283.4 MiB/s | 800.0 MiB/s |
| bench-validator-05 | validator | 166.8 MiB/s | 278.1 MiB/s | 283.1 MiB/s | 283.1 MiB/s | 800.0 MiB/s |
| bench-validator-06 | validator | 231.9 MiB/s | 286.0 MiB/s | 294.1 MiB/s | 294.1 MiB/s | 800.0 MiB/s |
| bench-validator-07 | validator | 211.0 MiB/s | 279.3 MiB/s | 285.2 MiB/s | 285.2 MiB/s | 800.0 MiB/s |
| bench-validator-08 | validator | 225.2 MiB/s | 284.2 MiB/s | 290.2 MiB/s | 290.2 MiB/s | 800.0 MiB/s |
| bench-validator-09 | validator | 223.6 MiB/s | 278.4 MiB/s | 281.1 MiB/s | 281.1 MiB/s | 800.0 MiB/s |
| bench-validator-10 | validator | 209.7 MiB/s | 275.5 MiB/s | 280.3 MiB/s | 280.3 MiB/s | 800.0 MiB/s |
instance/disk/{read,write}_ops_count rate, all devices; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max | Limit |
|---|---|---|---|---|---|---|
| bench-observer-11 | observer | 15.9K IOPS | 17.7K IOPS | 18K IOPS | 18K IOPS | 20K IOPS |
| bench-validator-01 | validator | 16.5K IOPS | 19.4K IOPS | 19.8K IOPS | 19.8K IOPS | 20K IOPS |
| bench-validator-02 | validator | 17.5K IOPS | 19.8K IOPS | 20.3K IOPS | 20.3K IOPS | 20K IOPS |
| bench-validator-03 | validator | 17.4K IOPS | 20K IOPS | 20.2K IOPS | 20.2K IOPS | 20K IOPS |
| bench-validator-04 | validator | 16K IOPS | 18.6K IOPS | 20.1K IOPS | 20.1K IOPS | 20K IOPS |
| bench-validator-05 | validator | 14.6K IOPS | 20K IOPS | 20.1K IOPS | 20.1K IOPS | 20K IOPS |
| bench-validator-06 | validator | 16.8K IOPS | 19.7K IOPS | 19.9K IOPS | 19.9K IOPS | 20K IOPS |
| bench-validator-07 | validator | 17.7K IOPS | 20K IOPS | 20.1K IOPS | 20.1K IOPS | 20K IOPS |
| bench-validator-08 | validator | 17.1K IOPS | 19.6K IOPS | 20K IOPS | 20K IOPS | 20K IOPS |
| bench-validator-09 | validator | 17.2K IOPS | 19.1K IOPS | 19.4K IOPS | 19.4K IOPS | 20K IOPS |
| bench-validator-10 | validator | 17.7K IOPS | 19.7K IOPS | 19.9K IOPS | 19.9K IOPS | 20K IOPS |
| Node | Machine | vCPU | Disk | IOPS limit | MiB/s limit | Basis |
|---|---|---|---|---|---|---|
| bench-observer-11 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-01 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-02 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-03 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-04 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-05 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-06 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-07 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-08 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-09 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
| bench-validator-10 | c3-highcpu-8 | 8 | hyperdisk-balanced 100 GB | 20K IOPS | 800.0 MiB/s | hyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget |
instance/network/sent_bytes_count rate; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 1.4 Mbps | 1.7 Mbps | 1.8 Mbps | 1.8 Mbps |
| bench-validator-01 | validator | 166.8 Mbps | 195.1 Mbps | 221.2 Mbps | 221.2 Mbps |
| bench-validator-02 | validator | 167.9 Mbps | 196.4 Mbps | 271.2 Mbps | 271.2 Mbps |
| bench-validator-03 | validator | 167.4 Mbps | 196.1 Mbps | 207.3 Mbps | 207.3 Mbps |
| bench-validator-04 | validator | 162.1 Mbps | 189.8 Mbps | 210.1 Mbps | 210.1 Mbps |
| bench-validator-05 | validator | 137.6 Mbps | 195.0 Mbps | 210.6 Mbps | 210.6 Mbps |
| bench-validator-06 | validator | 164.1 Mbps | 189.2 Mbps | 199.3 Mbps | 199.3 Mbps |
| bench-validator-07 | validator | 168.4 Mbps | 187.5 Mbps | 205.9 Mbps | 205.9 Mbps |
| bench-validator-08 | validator | 167.9 Mbps | 185.0 Mbps | 206.6 Mbps | 206.6 Mbps |
| bench-validator-09 | validator | 168.7 Mbps | 193.8 Mbps | 210.2 Mbps | 210.2 Mbps |
| bench-validator-10 | validator | 169.2 Mbps | 190.6 Mbps | 205.3 Mbps | 205.3 Mbps |
instance/network/received_bytes_count rate; summaries over the mixed phase
| Node | Class | Mean | p95 | Peak 60-s mean | Max |
|---|---|---|---|---|---|
| bench-observer-11 | observer | 8.5 Mbps | 9.9 Mbps | 17.2 Mbps | 17.2 Mbps |
| bench-validator-01 | validator | 15.5 Mbps | 20.1 Mbps | 29.1 Mbps | 29.1 Mbps |
| bench-validator-02 | validator | 14.3 Mbps | 15.5 Mbps | 26.2 Mbps | 26.2 Mbps |
| bench-validator-03 | validator | 16.1 Mbps | 19.8 Mbps | 27.2 Mbps | 27.2 Mbps |
| bench-validator-04 | validator | 14.0 Mbps | 18.4 Mbps | 29.1 Mbps | 29.1 Mbps |
| bench-validator-05 | validator | 22.9 Mbps | 48.7 Mbps | 149.6 Mbps | 149.6 Mbps |
| bench-validator-06 | validator | 14.4 Mbps | 16.8 Mbps | 25.6 Mbps | 25.6 Mbps |
| bench-validator-07 | validator | 16.0 Mbps | 17.7 Mbps | 28.8 Mbps | 28.8 Mbps |
| bench-validator-08 | validator | 16.4 Mbps | 18.0 Mbps | 30.3 Mbps | 30.3 Mbps |
| bench-validator-09 | validator | 15.9 Mbps | 18.3 Mbps | 30.9 Mbps | 30.9 Mbps |
| bench-validator-10 | validator | 16.3 Mbps | 18.3 Mbps | 28.5 Mbps | 28.5 Mbps |
| Metric | Query | Class | Nodes | Median of node means | Worst peak 60-s mean | Max |
|---|---|---|---|---|---|---|
| tn_primary_commit_latency_seconds | p95 | validator | 9 | 1,402 ms | 18.0 s | 25.3 s |
| tn_engine_execution_duration_seconds | p95 | validator | 9 | 2,184 ms | 29.0 s | 29.0 s |
| tn_engine_execution_duration_seconds | p95 | observer | 1 | 1,965 ms | 2,425 ms | 2,562 ms |
| tn_worker_batch_size_bytes | p95 | validator | 9 | 240.8 KiB | 246.4 KiB | 246.4 KiB |
| tn_worker_batch_transactions | p95 | validator | 9 | 500 | 1.48K | 1.48K |
| tn_executor_output_transactions | p95 | validator | 9 | 21.8K | 37.5K | 37.5K |
| tn_primary_consensus_output_bytes | max | validator | 10 | 784.8 KiB | 2.3 MiB | 3.0 MiB |
| tn_primary_consensus_output_bytes | max | observer | 1 | 773.2 KiB | 1.6 MiB | 2.5 MiB |
| tn_engine_queued_outputs | max | validator | 10 | 5.95 | 8 | 8 |
| tn_engine_queued_outputs | max | observer | 1 | 1.86 | 4.25 | 7 |
| tn_primary_round | max | validator | 10 | 1.36K | 2.92K | 2.93K |
| tn_primary_round | max | observer | 1 | 1.34K | 2.86K | 2.91K |
| tn_primary_committed_round | max | validator | 10 | 1.36K | 2.92K | 2.93K |
| tn_primary_committed_round | max | observer | 1 | 1.34K | 2.86K | 2.91K |
| tn_epoch_current | max | validator | 10 | 4.51 | 5.5 | 6 |
| tn_epoch_current | max | observer | 1 | 4.52 | 5.5 | 6 |
| tn_batch_builder_pending_pool_transactions | max | validator | 10 | 953 | 6.17K | 9.89K |
| tn_batch_builder_pending_pool_transactions | max | observer | 1 | 0 | 0 | 0 |
| reth_process_resident_memory_bytes | max | validator | 10 | 5.57 GiB | 7.51 GiB | 7.59 GiB |
| reth_process_resident_memory_bytes | max | observer | 1 | 4.51 GiB | 6.02 GiB | 6.07 GiB |
| tn_primary_subdags_committed_total | rate | validator | 10 | 1.09 | 1.4 | 1.4 |
| tn_primary_subdags_committed_total | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_round_lag | lag | validator | 10 | 2.24 | 3.5 | 5 |
| tn_primary_round_lag | lag | observer | 1 | 0 | 0 | 0 |
| tn_batch_builder_seal_failures_total | rate | validator | 10 | 0.000552 | 0.0167 | 0.0222 |
| tn_node_mode | max | validator | 10 | 0 | 1 | 1 |
| tn_node_mode | max | observer | 1 | 0 | 0 | 0 |
| tn_primary_vote_requests_total | rate | validator | 10 | 19.1 | 31.2 | 31.6 |
| tn_primary_vote_requests_total | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_votes_created_total | rate | validator | 10 | 17.8 | 25.1 | 25.2 |
| tn_primary_votes_created_total | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_votes_recast_total | rate | validator | 10 | 0 | 0 | 0 |
| tn_primary_votes_recast_total | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_vote_requests_too_new_total | rate | validator | 10 | 0 | 0 | 0 |
| tn_primary_vote_requests_too_new_total | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_vote_timeouts_total{stage="exec_wait"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_primary_vote_timeouts_total{stage="exec_wait"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_vote_timeouts_total{stage="lead_sleep"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_primary_vote_timeouts_total{stage="lead_sleep"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_vote_timeouts_total{stage="parents"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_primary_vote_timeouts_total{stage="parents"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_vote_timeouts_total{stage="persist"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_primary_vote_timeouts_total{stage="persist"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_vote_timeouts_total{stage="prelock_wait"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_primary_vote_timeouts_total{stage="prelock_wait"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_vote_timeouts_total{stage="sync_batches"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_primary_vote_timeouts_total{stage="sync_batches"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_vote_timeouts_total{stage="validate"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_primary_vote_timeouts_total{stage="validate"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_vote_timeouts_total{stage="vote_store"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_primary_vote_timeouts_total{stage="vote_store"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_vote_stage_seconds{stage="exec_wait"} | p95 | validator | 10 | 0 ms | 0 ms | 0 ms |
| tn_primary_vote_stage_seconds{stage="lead_sleep"} | p95 | validator | 10 | 0 ms | 0 ms | 0 ms |
| tn_primary_vote_stage_seconds{stage="lock"} | p95 | validator | 10 | 0 ms | 0 ms | 0 ms |
| tn_primary_vote_stage_seconds{stage="parents"} | p95 | validator | 10 | 1 ms | 2 ms | 2 ms |
| tn_primary_vote_stage_seconds{stage="persist"} | p95 | validator | 10 | 11 ms | 28 ms | 33 ms |
| tn_primary_vote_stage_seconds{stage="prelock_wait"} | p95 | validator | 10 | 484 ms | 2,425 ms | 2,425 ms |
| tn_primary_vote_stage_seconds{stage="sync_batches"} | p95 | validator | 10 | 0 ms | 0 ms | 0 ms |
| tn_primary_vote_stage_seconds{stage="validate"} | p95 | validator | 10 | 4 ms | 6 ms | 6 ms |
| tn_primary_vote_stage_seconds{stage="vote_store"} | p95 | validator | 10 | 1 ms | 2 ms | 2 ms |
| tn_primary_leader_rounds_total{leader="2DCK5j4xmRh2S7BwQ5R6BST3UpcUJo2ubKzbTrwKX8Jh",swapped="false",found="false"} | rate | validator | 10 | 0.000381 | 0.0166 | 0.0221 |
| tn_primary_leader_rounds_total{leader="2DCK5j4xmRh2S7BwQ5R6BST3UpcUJo2ubKzbTrwKX8Jh",swapped="false",found="true"} | rate | validator | 10 | 0.0962 | 0.15 | 0.156 |
| tn_primary_leader_rounds_total{leader="2DCK5j4xmRh2S7BwQ5R6BST3UpcUJo2ubKzbTrwKX8Jh",swapped="true",found="false"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_primary_leader_rounds_total{leader="2DCK5j4xmRh2S7BwQ5R6BST3UpcUJo2ubKzbTrwKX8Jh",swapped="true",found="true"} | rate | validator | 10 | 0.0202 | 0.0722 | 0.0889 |
| tn_primary_leader_rounds_total{leader="2i2dxF6uefXyS87MLN8Hic8wMJ64po5hGwGiQjsEJWnW",swapped="false",found="false"} | rate | validator | 10 | 0.00544 | 0.106 | 0.111 |
| tn_primary_leader_rounds_total{leader="2i2dxF6uefXyS87MLN8Hic8wMJ64po5hGwGiQjsEJWnW",swapped="false",found="true"} | rate | validator | 10 | 0.0468 | 0.15 | 0.156 |
| tn_primary_leader_rounds_total{leader="2i2dxF6uefXyS87MLN8Hic8wMJ64po5hGwGiQjsEJWnW",swapped="true",found="false"} | rate | validator | 10 | 0.00118 | 0.0443 | 0.0664 |
| tn_primary_leader_rounds_total{leader="2i2dxF6uefXyS87MLN8Hic8wMJ64po5hGwGiQjsEJWnW",swapped="true",found="true"} | rate | validator | 10 | 0.00455 | 0.0611 | 0.0667 |
| tn_primary_leader_rounds_total{leader="6azyk4NmEfHamXEY9kQK3cnNH3W3rL8R14sN1ixzSgsg",swapped="false",found="false"} | rate | validator | 10 | 0.000795 | 0.0167 | 0.0222 |
| tn_primary_leader_rounds_total{leader="6azyk4NmEfHamXEY9kQK3cnNH3W3rL8R14sN1ixzSgsg",swapped="false",found="true"} | rate | validator | 10 | 0.111 | 0.15 | 0.156 |
| tn_primary_leader_rounds_total{leader="6azyk4NmEfHamXEY9kQK3cnNH3W3rL8R14sN1ixzSgsg",swapped="true",found="false"} | rate | validator | 10 | 0.000383 | 0.0166 | 0.0221 |
| tn_primary_leader_rounds_total{leader="6azyk4NmEfHamXEY9kQK3cnNH3W3rL8R14sN1ixzSgsg",swapped="true",found="true"} | rate | validator | 10 | 0.0398 | 0.133 | 0.178 |
| tn_primary_leader_rounds_total{leader="8h6kX97Cs66wqtsswGym86GkuRbR8fWnKkwtZn5VeJzs",swapped="false",found="false"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_primary_leader_rounds_total{leader="8h6kX97Cs66wqtsswGym86GkuRbR8fWnKkwtZn5VeJzs",swapped="false",found="true"} | rate | validator | 10 | 0.00455 | 0.1 | 0.133 |
| tn_primary_leader_rounds_total{leader="8h6kX97Cs66wqtsswGym86GkuRbR8fWnKkwtZn5VeJzs",swapped="true",found="false"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_primary_leader_rounds_total{leader="8h6kX97Cs66wqtsswGym86GkuRbR8fWnKkwtZn5VeJzs",swapped="true",found="true"} | rate | validator | 10 | 0.000773 | 0.0332 | 0.0443 |
| tn_primary_leader_rounds_total{leader="9REQ4Cn46SwZffUpbaUZo7xcEszesF325wDVY5QhYQQP",swapped="false",found="false"} | rate | validator | 10 | 0.0019 | 0.0167 | 0.0222 |
| tn_primary_leader_rounds_total{leader="9REQ4Cn46SwZffUpbaUZo7xcEszesF325wDVY5QhYQQP",swapped="false",found="true"} | rate | validator | 10 | 0.109 | 0.15 | 0.156 |
| tn_primary_leader_rounds_total{leader="9REQ4Cn46SwZffUpbaUZo7xcEszesF325wDVY5QhYQQP",swapped="true",found="false"} | rate | validator | 10 | 0.000383 | 0.0166 | 0.0221 |
| tn_primary_leader_rounds_total{leader="9REQ4Cn46SwZffUpbaUZo7xcEszesF325wDVY5QhYQQP",swapped="true",found="true"} | rate | validator | 10 | 0.0393 | 0.104 | 0.111 |
| tn_primary_leader_rounds_total{leader="BCUVdtwG3Xjwi99f6gXHSbC95G461jJsiSLVb1C7M3hy",swapped="false",found="false"} | rate | validator | 10 | 0.00121 | 0.0222 | 0.0222 |
| tn_primary_leader_rounds_total{leader="BCUVdtwG3Xjwi99f6gXHSbC95G461jJsiSLVb1C7M3hy",swapped="false",found="true"} | rate | validator | 10 | 0.11 | 0.15 | 0.156 |
| tn_primary_leader_rounds_total{leader="BCUVdtwG3Xjwi99f6gXHSbC95G461jJsiSLVb1C7M3hy",swapped="true",found="false"} | rate | validator | 10 | 0.000381 | 0.0166 | 0.0221 |
| tn_primary_leader_rounds_total{leader="BCUVdtwG3Xjwi99f6gXHSbC95G461jJsiSLVb1C7M3hy",swapped="true",found="true"} | rate | validator | 10 | 0.0447 | 0.117 | 0.156 |
| tn_primary_leader_rounds_total{leader="C2S8yukvLNoFHrZV89mQZJzsPZ2zQuiZg4dkwxwh88un",swapped="false",found="false"} | rate | validator | 10 | 0.000412 | 0.0166 | 0.0222 |
| tn_primary_leader_rounds_total{leader="C2S8yukvLNoFHrZV89mQZJzsPZ2zQuiZg4dkwxwh88un",swapped="false",found="true"} | rate | validator | 10 | 0.108 | 0.15 | 0.156 |
| tn_primary_leader_rounds_total{leader="C2S8yukvLNoFHrZV89mQZJzsPZ2zQuiZg4dkwxwh88un",swapped="true",found="false"} | rate | validator | 10 | 0.000383 | 0.0166 | 0.0221 |
| tn_primary_leader_rounds_total{leader="C2S8yukvLNoFHrZV89mQZJzsPZ2zQuiZg4dkwxwh88un",swapped="true",found="true"} | rate | validator | 10 | 0.0374 | 0.128 | 0.156 |
| tn_primary_leader_rounds_total{leader="EdzGQYtW4x9VTADCFHz6JURdVfwtwzAb4eF9HAs28Jsj",swapped="false",found="false"} | rate | validator | 10 | 0.000381 | 0.0166 | 0.0221 |
| tn_primary_leader_rounds_total{leader="EdzGQYtW4x9VTADCFHz6JURdVfwtwzAb4eF9HAs28Jsj",swapped="false",found="true"} | rate | validator | 10 | 0.0305 | 0.117 | 0.133 |
| tn_primary_leader_rounds_total{leader="EdzGQYtW4x9VTADCFHz6JURdVfwtwzAb4eF9HAs28Jsj",swapped="true",found="false"} | rate | validator | 10 | 0.000381 | 0.0166 | 0.0221 |
| tn_primary_leader_rounds_total{leader="EdzGQYtW4x9VTADCFHz6JURdVfwtwzAb4eF9HAs28Jsj",swapped="true",found="true"} | rate | validator | 10 | 0.0016 | 0.0545 | 0.0664 |
| tn_primary_leader_rounds_total{leader="FK99Q69fo6Ge5PqybG2dqAVn7x4A2SZUiNaya8rgVSay",swapped="false",found="false"} | rate | validator | 10 | 0.00121 | 0.0167 | 0.0222 |
| tn_primary_leader_rounds_total{leader="FK99Q69fo6Ge5PqybG2dqAVn7x4A2SZUiNaya8rgVSay",swapped="false",found="true"} | rate | validator | 10 | 0.11 | 0.15 | 0.156 |
| tn_primary_leader_rounds_total{leader="FK99Q69fo6Ge5PqybG2dqAVn7x4A2SZUiNaya8rgVSay",swapped="true",found="false"} | rate | validator | 10 | 0.000383 | 0.0166 | 0.0221 |
| tn_primary_leader_rounds_total{leader="FK99Q69fo6Ge5PqybG2dqAVn7x4A2SZUiNaya8rgVSay",swapped="true",found="true"} | rate | validator | 10 | 0.0418 | 0.1 | 0.111 |
| tn_primary_leader_rounds_total{leader="L5cHimQmhttFbobChPjTVUVUyBXQZP3XcohGburWJRu",swapped="false",found="false"} | rate | validator | 10 | 0.0041 | 0.0444 | 0.0667 |
| tn_primary_leader_rounds_total{leader="L5cHimQmhttFbobChPjTVUVUyBXQZP3XcohGburWJRu",swapped="false",found="true"} | rate | validator | 10 | 0.108 | 0.15 | 0.156 |
| tn_primary_leader_rounds_total{leader="L5cHimQmhttFbobChPjTVUVUyBXQZP3XcohGburWJRu",swapped="true",found="false"} | rate | validator | 10 | 0.000383 | 0.0166 | 0.025 |
| tn_primary_leader_rounds_total{leader="L5cHimQmhttFbobChPjTVUVUyBXQZP3XcohGburWJRu",swapped="true",found="true"} | rate | validator | 10 | 0.029 | 0.0889 | 0.111 |
| tn_primary_leader_commits_total{leader="2DCK5j4xmRh2S7BwQ5R6BST3UpcUJo2ubKzbTrwKX8Jh"} | rate | validator | 10 | 0.116 | 0.206 | 0.222 |
| tn_primary_leader_commits_total{leader="2i2dxF6uefXyS87MLN8Hic8wMJ64po5hGwGiQjsEJWnW"} | rate | validator | 10 | 0.0513 | 0.189 | 0.222 |
| tn_primary_leader_commits_total{leader="6azyk4NmEfHamXEY9kQK3cnNH3W3rL8R14sN1ixzSgsg"} | rate | validator | 10 | 0.15 | 0.261 | 0.311 |
| tn_primary_leader_commits_total{leader="8h6kX97Cs66wqtsswGym86GkuRbR8fWnKkwtZn5VeJzs"} | rate | validator | 10 | 0.00538 | 0.133 | 0.178 |
| tn_primary_leader_commits_total{leader="9REQ4Cn46SwZffUpbaUZo7xcEszesF325wDVY5QhYQQP"} | rate | validator | 10 | 0.149 | 0.237 | 0.244 |
| tn_primary_leader_commits_total{leader="BCUVdtwG3Xjwi99f6gXHSbC95G461jJsiSLVb1C7M3hy"} | rate | validator | 10 | 0.154 | 0.244 | 0.267 |
| tn_primary_leader_commits_total{leader="C2S8yukvLNoFHrZV89mQZJzsPZ2zQuiZg4dkwxwh88un"} | rate | validator | 10 | 0.146 | 0.233 | 0.267 |
| tn_primary_leader_commits_total{leader="EdzGQYtW4x9VTADCFHz6JURdVfwtwzAb4eF9HAs28Jsj"} | rate | validator | 10 | 0.0319 | 0.15 | 0.178 |
| tn_primary_leader_commits_total{leader="FK99Q69fo6Ge5PqybG2dqAVn7x4A2SZUiNaya8rgVSay"} | rate | validator | 10 | 0.151 | 0.228 | 0.244 |
| tn_primary_leader_commits_total{leader="L5cHimQmhttFbobChPjTVUVUyBXQZP3XcohGburWJRu"} | rate | validator | 10 | 0.137 | 0.217 | 0.244 |
| tn_engine_queue_wait_seconds | p95 | validator | 10 | 8,159 ms | 30.0 s | 30.0 s |
| tn_engine_queue_wait_seconds | p95 | observer | 1 | 2,816 ms | 6,074 ms | 6,875 ms |
| tn_engine_persist_duration_seconds | p95 | validator | 9 | 878 ms | 29.0 s | 29.0 s |
| tn_engine_persist_duration_seconds | p95 | observer | 1 | 832 ms | 1,457 ms | 1,731 ms |
| tn_engine_busy_milliseconds_total | rate | validator | 10 | 982 | 1.09K | 1.25K |
| tn_engine_busy_milliseconds_total | rate | observer | 1 | 880 | 1K | 1.01K |
| tn_reth_persist_save_blocks_seconds | p95 | validator | 10 | 299 ms | 29.0 s | 29.0 s |
| tn_reth_persist_save_blocks_seconds | p95 | observer | 1 | 259 ms | 402 ms | 425 ms |
| tn_reth_persist_commit_seconds | p95 | validator | 10 | 574 ms | 1,442 ms | 1,825 ms |
| tn_reth_persist_commit_seconds | p95 | observer | 1 | 592 ms | 905 ms | 927 ms |
| tn_reth_persisted_accounts_total | rate | validator | 10 | 4.23K | 10.2K | 10.2K |
| tn_reth_persisted_accounts_total | rate | observer | 1 | 4.2K | 9.53K | 9.53K |
| tn_reth_persisted_storage_slots_total | rate | validator | 10 | 5.51K | 7.13K | 7.31K |
| tn_reth_persisted_storage_slots_total | rate | observer | 1 | 5.48K | 7.24K | 7.45K |
| tn_executor_rejoin_blocked_total{reason="attempts_exhausted"} | rate | validator | 1 | 0 | 0 | 0 |
| tn_executor_rejoin_blocked_total{reason="epoch_closed"} | rate | validator | 1 | 0.0445 | 0.311 | 0.378 |
| tn_executor_rejoin_blocked_total{reason="epoch_mismatch"} | rate | validator | 1 | 0 | 0 | 0 |
| tn_executor_rejoin_blocked_total{reason="no_known_header"} | rate | validator | 1 | 0 | 0 | 0 |
| tn_executor_rejoin_blocked_total{reason="round_gap"} | rate | validator | 1 | 0.8 | 1.17 | 1.27 |
| tn_executor_rejoin_blocked_total{reason="stale_head"} | rate | validator | 1 | 0.0288 | 0.1 | 0.2 |
| tn_worker_sync_serves_denied_total{worker="0",tier="committee"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_worker_sync_serves_denied_total{worker="0",tier="committee"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_worker_sync_serves_denied_total{worker="0",tier="public"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_worker_sync_serves_denied_total{worker="0",tier="public"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_worker_batch_requests_denied_total{worker="0",peer="22nvxLQcXRosZbgj1jUJRLgnXYQ4QjBYM6n7XHLwMyG7dnEVTaygo62RNhY5qJaEwKhN596vWYq8BB53FUqGWN1TD2x48gWwupC4aLuGN53RuEjt8CJU8coxHAsjRHYKJwmG"} | rate | validator | 2 | 0.0084 | 0.316 | 0.421 |
| tn_worker_batch_requests_denied_total{worker="0",peer="23y7SCzzCBZqCPUUcY833pU1gF74pXrGturtYCDTaasP2KXfW699mJP2h6ULkwSQ2HTW7tKaLid3maDpEmevRAfrWrU1RA7naUwZQ5ky7eTxj33nDMfD2QNfMqh8fJR12uat"} | rate | validator | 2 | 0.00958 | 0.25 | 0.333 |
| tn_worker_batch_requests_denied_total{worker="0",peer="26eqXGzLWGaemHqS4Hy3ageCGgJBqCut756XfFtJ8yyAJhu2J2FaMxPohzKuEmXsM9Rh4XUZvT7hvtjSEKeSuhtLya3itYYQqejCoKSona2V1PNRVm29ERyNazV2FDciPBCf"} | rate | validator | 6 | 0 | 0.171 | 0.228 |
| tn_worker_batch_requests_denied_total{worker="0",peer="nsxwdTeAJZEYe72jViRAc1Gv3S76NRD2g2t4RvntAHYbRxaHVB51zehNzMkhKpnujAYjGjwddz8scF3FaSqqSrYSan9NafuRtY139xVjDLiDAbH1njdUMTBYR4pNY4hbm5A"} | rate | validator | 2 | 0.00113 | 0.0222 | 0.0889 |
| tn_worker_batch_requests_denied_total{worker="0",peer="oYq6NTTeRyZsGtQ9zi58WDY7Fu1t6o5shWTLu5CFmuJHH7vDt9p66pXAWUqxCtq93AH6mpAW7dJKE77JKQCg8DHGnUdQJnwNW3G6wvWD13jMxvZQCxLsqrEk6xbpuszHUuz"} | rate | validator | 2 | 0 | 0 | 0 |
| tn_worker_batch_requests_denied_total{worker="0",peer="otLeJWfYvzUbns4hYikGKYoGz226KKiyAibo7YgrzZ75zRPHyUeR5gNML1JwfMmdKvp7JY7AFs5AVQhjLoUeyPB7b84WdSz49rADMoCxLEQ9JdyxGvWwhZtAidJHa4rKVZa"} | rate | validator | 2 | 0.00141 | 0.0278 | 0.111 |
| tn_worker_batch_requests_denied_total{worker="0",peer="sVf6rdVnb2JprGawcrHv651LauKHsNrU9YFyj8CfQQWuSBaCcxCZZZyNxH4Cd7jwYwiH4XgBZvGmzKdzrg3qchfPrUSEKFUronouRWo3w4NmZaV7PhsidfjX4vpbUJhT6hD"} | rate | validator | 2 | 0.00592 | 0.211 | 0.281 |
| tn_worker_batch_requests_denied_total{worker="0",peer="tAd3NTiH6dVTnnPBVQGACmdWMVFCWvU5RdpMWH9BuAinEi3pkhzLXdnqp2rcJiGjypmEdK3juQLF6FmdZmPYg31jEBvceUKKUNBTp5ozy8swv9VmZiZh8trCm7V29mSx1XY"} | rate | validator | 7 | 0.00124 | 0.0556 | 0.133 |
| tn_worker_batch_requests_denied_total{worker="0",peer="uWh9aawJ2gNHzV7pSryUJX72r3fHe6F8iDB1kC5q7YXxQkjjkWb7KUWLWqBc8JgdXYAfEkrZ8sjDVMWkXDyWmKuCT61bkm8Lmrqvp2NrQ769ebTiaRGW7xHjARnvFWH8crA"} | rate | validator | 3 | 0 | 0.0333 | 0.133 |
| tn_worker_batch_requests_denied_total{worker="0",peer="yPh8F4LCWcQjfyKZatWqrq5H7qwS5zyTDw7TAi2BdyZvMQegULXoQbwpkpRDSG37SxWBu2SFAbfLbvvdyouXsdoAHW5L9KMir3bNzPWi6tAWwudwbEsZmPCPgAadfPdHK84"} | rate | validator | 3 | 0 | 0.197 | 0.263 |
| tn_worker_batch_requests_failed_total{worker="0",peer="22nvxLQcXRosZbgj1jUJRLgnXYQ4QjBYM6n7XHLwMyG7dnEVTaygo62RNhY5qJaEwKhN596vWYq8BB53FUqGWN1TD2x48gWwupC4aLuGN53RuEjt8CJU8coxHAsjRHYKJwmG"} | rate | validator | 2 | 0 | 0 | 0 |
| tn_worker_batch_requests_failed_total{worker="0",peer="23y7SCzzCBZqCPUUcY833pU1gF74pXrGturtYCDTaasP2KXfW699mJP2h6ULkwSQ2HTW7tKaLid3maDpEmevRAfrWrU1RA7naUwZQ5ky7eTxj33nDMfD2QNfMqh8fJR12uat"} | rate | validator | 2 | 0.0021 | 0.0167 | 0.0222 |
| tn_worker_batch_requests_failed_total{worker="0",peer="26eqXGzLWGaemHqS4Hy3ageCGgJBqCut756XfFtJ8yyAJhu2J2FaMxPohzKuEmXsM9Rh4XUZvT7hvtjSEKeSuhtLya3itYYQqejCoKSona2V1PNRVm29ERyNazV2FDciPBCf"} | rate | validator | 6 | 0.000414 | 0.0389 | 0.0444 |
| tn_worker_batch_requests_failed_total{worker="0",peer="nsxwdTeAJZEYe72jViRAc1Gv3S76NRD2g2t4RvntAHYbRxaHVB51zehNzMkhKpnujAYjGjwddz8scF3FaSqqSrYSan9NafuRtY139xVjDLiDAbH1njdUMTBYR4pNY4hbm5A"} | rate | validator | 2 | 0 | 0 | 0 |
| tn_worker_batch_requests_failed_total{worker="0",peer="oYq6NTTeRyZsGtQ9zi58WDY7Fu1t6o5shWTLu5CFmuJHH7vDt9p66pXAWUqxCtq93AH6mpAW7dJKE77JKQCg8DHGnUdQJnwNW3G6wvWD13jMxvZQCxLsqrEk6xbpuszHUuz"} | rate | validator | 2 | 0 | 0 | 0 |
| tn_worker_batch_requests_failed_total{worker="0",peer="otLeJWfYvzUbns4hYikGKYoGz226KKiyAibo7YgrzZ75zRPHyUeR5gNML1JwfMmdKvp7JY7AFs5AVQhjLoUeyPB7b84WdSz49rADMoCxLEQ9JdyxGvWwhZtAidJHa4rKVZa"} | rate | validator | 2 | 0 | 0 | 0 |
| tn_worker_batch_requests_failed_total{worker="0",peer="sVf6rdVnb2JprGawcrHv651LauKHsNrU9YFyj8CfQQWuSBaCcxCZZZyNxH4Cd7jwYwiH4XgBZvGmzKdzrg3qchfPrUSEKFUronouRWo3w4NmZaV7PhsidfjX4vpbUJhT6hD"} | rate | validator | 2 | 0 | 0 | 0 |
| tn_worker_batch_requests_failed_total{worker="0",peer="tAd3NTiH6dVTnnPBVQGACmdWMVFCWvU5RdpMWH9BuAinEi3pkhzLXdnqp2rcJiGjypmEdK3juQLF6FmdZmPYg31jEBvceUKKUNBTp5ozy8swv9VmZiZh8trCm7V29mSx1XY"} | rate | validator | 7 | 0 | 0.0167 | 0.0222 |
| tn_worker_batch_requests_failed_total{worker="0",peer="uWh9aawJ2gNHzV7pSryUJX72r3fHe6F8iDB1kC5q7YXxQkjjkWb7KUWLWqBc8JgdXYAfEkrZ8sjDVMWkXDyWmKuCT61bkm8Lmrqvp2NrQ769ebTiaRGW7xHjARnvFWH8crA"} | rate | validator | 3 | 0 | 0.0333 | 0.0444 |
| tn_worker_batch_requests_failed_total{worker="0",peer="yPh8F4LCWcQjfyKZatWqrq5H7qwS5zyTDw7TAi2BdyZvMQegULXoQbwpkpRDSG37SxWBu2SFAbfLbvvdyouXsdoAHW5L9KMir3bNzPWi6tAWwudwbEsZmPCPgAadfPdHK84"} | rate | validator | 3 | 0 | 0 | 0 |
| tn_node_epoch_record_signers | max | validator | 10 | 8.49 | 10 | 10 |
| tn_node_epoch_record_signers | max | observer | 1 | 9.07 | 10 | 10 |
| tn_node_epoch_record_missing_signers_total{signer="2DCK5j4xmRh2S7BwQ5R6BST3UpcUJo2ubKzbTrwKX8Jh"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_node_epoch_record_missing_signers_total{signer="2DCK5j4xmRh2S7BwQ5R6BST3UpcUJo2ubKzbTrwKX8Jh"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_node_epoch_record_missing_signers_total{signer="2i2dxF6uefXyS87MLN8Hic8wMJ64po5hGwGiQjsEJWnW"} | rate | validator | 10 | 0.000473 | 0.0166 | 0.0222 |
| tn_node_epoch_record_missing_signers_total{signer="2i2dxF6uefXyS87MLN8Hic8wMJ64po5hGwGiQjsEJWnW"} | rate | observer | 1 | 0.000496 | 0.0145 | 0.0193 |
| tn_node_epoch_record_missing_signers_total{signer="6azyk4NmEfHamXEY9kQK3cnNH3W3rL8R14sN1ixzSgsg"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_node_epoch_record_missing_signers_total{signer="6azyk4NmEfHamXEY9kQK3cnNH3W3rL8R14sN1ixzSgsg"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_node_epoch_record_missing_signers_total{signer="8h6kX97Cs66wqtsswGym86GkuRbR8fWnKkwtZn5VeJzs"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_node_epoch_record_missing_signers_total{signer="8h6kX97Cs66wqtsswGym86GkuRbR8fWnKkwtZn5VeJzs"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_node_epoch_record_missing_signers_total{signer="9REQ4Cn46SwZffUpbaUZo7xcEszesF325wDVY5QhYQQP"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_node_epoch_record_missing_signers_total{signer="9REQ4Cn46SwZffUpbaUZo7xcEszesF325wDVY5QhYQQP"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_node_epoch_record_missing_signers_total{signer="BCUVdtwG3Xjwi99f6gXHSbC95G461jJsiSLVb1C7M3hy"} | rate | validator | 10 | 0.000335 | 0.0166 | 0.0221 |
| tn_node_epoch_record_missing_signers_total{signer="BCUVdtwG3Xjwi99f6gXHSbC95G461jJsiSLVb1C7M3hy"} | rate | observer | 1 | 0.000496 | 0.0145 | 0.0193 |
| tn_node_epoch_record_missing_signers_total{signer="C2S8yukvLNoFHrZV89mQZJzsPZ2zQuiZg4dkwxwh88un"} | rate | validator | 10 | 0.000473 | 0.0166 | 0.0222 |
| tn_node_epoch_record_missing_signers_total{signer="C2S8yukvLNoFHrZV89mQZJzsPZ2zQuiZg4dkwxwh88un"} | rate | observer | 1 | 0.000496 | 0.0145 | 0.0193 |
| tn_node_epoch_record_missing_signers_total{signer="EdzGQYtW4x9VTADCFHz6JURdVfwtwzAb4eF9HAs28Jsj"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_node_epoch_record_missing_signers_total{signer="EdzGQYtW4x9VTADCFHz6JURdVfwtwzAb4eF9HAs28Jsj"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_node_epoch_record_missing_signers_total{signer="FK99Q69fo6Ge5PqybG2dqAVn7x4A2SZUiNaya8rgVSay"} | rate | validator | 10 | 0.000117 | 0.00542 | 0.0217 |
| tn_node_epoch_record_missing_signers_total{signer="FK99Q69fo6Ge5PqybG2dqAVn7x4A2SZUiNaya8rgVSay"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_node_epoch_record_missing_signers_total{signer="L5cHimQmhttFbobChPjTVUVUyBXQZP3XcohGburWJRu"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_node_epoch_record_missing_signers_total{signer="L5cHimQmhttFbobChPjTVUVUyBXQZP3XcohGburWJRu"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_outbound_request_duration_seconds{outcome="failure",class="batch"} | p95 | validator | 4 | 13.3 s | 29.0 s | 29.0 s |
| tn_network_outbound_request_duration_seconds{outcome="failure",class="epoch_record"} | p95 | validator | 4 | 8,218 ms | 29.0 s | 29.0 s |
| tn_network_outbound_request_duration_seconds{outcome="failure",class="epoch_record"} | p95 | observer | 1 | 242 ms | 242 ms | 242 ms |
| tn_network_outbound_request_duration_seconds{outcome="failure",class="vote"} | p95 | validator | 6 | 10.1 s | 29.0 s | 29.0 s |
| tn_network_outbound_request_duration_seconds{outcome="response",class="batch"} | p95 | validator | 5 | 455 ms | 898 ms | 898 ms |
| tn_network_outbound_request_duration_seconds{outcome="response",class="epoch_record"} | p95 | validator | 3 | 372 ms | 479 ms | 479 ms |
| tn_network_outbound_request_duration_seconds{outcome="response",class="vote"} | p95 | validator | 3 | 1,460 ms | 2,246 ms | 2,276 ms |
| tn_network_closed_admission_denied_total{network="bench",direction="in"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_closed_admission_denied_total{network="bench",direction="in"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_closed_admission_denied_total{network="bench",direction="out"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_closed_admission_denied_total{network="bench",direction="out"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="in",reason="address_full"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="in",reason="address_full"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="in",reason="duplicate_connection"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="in",reason="duplicate_connection"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="in",reason="invalid_limits"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="in",reason="invalid_limits"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="in",reason="peer_full"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="in",reason="peer_full"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="in",reason="poisoned"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="in",reason="poisoned"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="in",reason="prefix_full"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="in",reason="prefix_full"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="in",reason="process_full"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="in",reason="process_full"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="in",reason="sources_full"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="in",reason="sources_full"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="in",reason="unsupported_address"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="in",reason="unsupported_address"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="out",reason="address_full"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="out",reason="address_full"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="out",reason="duplicate_connection"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="out",reason="duplicate_connection"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="out",reason="invalid_limits"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="out",reason="invalid_limits"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="out",reason="peer_full"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="out",reason="peer_full"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="out",reason="poisoned"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="out",reason="poisoned"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="out",reason="prefix_full"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="out",reason="prefix_full"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="out",reason="process_full"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="out",reason="process_full"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="out",reason="sources_full"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="out",reason="sources_full"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="out",reason="unsupported_address"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_source_admission_denied_total{network="bench",direction="out",reason="unsupported_address"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_admission_mode | max | validator | 10 | 2 | 2 | 2 |
| tn_network_admission_mode | max | observer | 1 | 2 | 2 | 2 |
| tn_network_admission_fallback | max | validator | 10 | 0 | 1 | 1 |
| tn_network_admission_fallback | max | observer | 1 | 0 | 0 | 0 |
| tn_network_outbound_request_failures_total{kind="connection"} | rate | validator | 10 | 0 | 1.69 | 2.7 |
| tn_network_outbound_request_failures_total{kind="connection"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_outbound_request_failures_total{kind="dial"} | rate | validator | 10 | 21.1 | 107 | 130 |
| tn_network_outbound_request_failures_total{kind="dial"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_outbound_request_failures_total{kind="io"} | rate | validator | 10 | 5.77 | 46.6 | 50.8 |
| tn_network_outbound_request_failures_total{kind="io"} | rate | observer | 1 | 0.309 | 0.852 | 1.08 |
| tn_network_outbound_request_failures_total{kind="timeout"} | rate | validator | 10 | 0.7 | 4.02 | 5.24 |
| tn_network_outbound_request_failures_total{kind="timeout"} | rate | observer | 1 | 0.00493 | 0.0304 | 0.0387 |
| tn_network_outbound_request_failures_total{kind="unsupported"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_outbound_request_failures_total{kind="unsupported"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="batch",reason="admission"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="batch",reason="admission"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="batch",reason="queue_budget"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="batch",reason="queue_budget"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="batch",reason="queue_full"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="batch",reason="queue_full"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="batch",reason="serve_budget"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="batch",reason="serve_budget"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="batch",reason="unsubscribed"} | rate | validator | 10 | 0.00692 | 215 | 271 |
| tn_network_inbound_requests_shed_total{class="batch",reason="unsubscribed"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="certificate_sync",reason="admission"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="certificate_sync",reason="admission"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="certificate_sync",reason="queue_budget"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="certificate_sync",reason="queue_budget"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="certificate_sync",reason="queue_full"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="certificate_sync",reason="queue_full"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="certificate_sync",reason="serve_budget"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="certificate_sync",reason="serve_budget"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="certificate_sync",reason="unsubscribed"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="certificate_sync",reason="unsubscribed"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="epoch_record",reason="admission"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="epoch_record",reason="admission"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="epoch_record",reason="queue_budget"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="epoch_record",reason="queue_budget"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="epoch_record",reason="queue_full"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="epoch_record",reason="queue_full"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="epoch_record",reason="serve_budget"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="epoch_record",reason="serve_budget"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="epoch_record",reason="unsubscribed"} | rate | validator | 10 | 0.405 | 1.18 | 1.56 |
| tn_network_inbound_requests_shed_total{class="epoch_record",reason="unsubscribed"} | rate | observer | 1 | 0.181 | 0.518 | 0.657 |
| tn_network_inbound_requests_shed_total{class="gossip",reason="admission"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="gossip",reason="admission"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="gossip",reason="queue_budget"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="gossip",reason="queue_budget"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="gossip",reason="queue_full"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="gossip",reason="queue_full"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="gossip",reason="serve_budget"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="gossip",reason="serve_budget"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="gossip",reason="unsubscribed"} | rate | validator | 10 | 0.00894 | 0.173 | 0.559 |
| tn_network_inbound_requests_shed_total{class="gossip",reason="unsubscribed"} | rate | observer | 1 | 0.0524 | 0.152 | 0.193 |
| tn_network_inbound_requests_shed_total{class="other",reason="admission"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="other",reason="admission"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="other",reason="queue_budget"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="other",reason="queue_budget"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="other",reason="queue_full"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="other",reason="queue_full"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="other",reason="serve_budget"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="other",reason="serve_budget"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="other",reason="unsubscribed"} | rate | validator | 10 | 0.0454 | 0.319 | 0.452 |
| tn_network_inbound_requests_shed_total{class="other",reason="unsubscribed"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="vote",reason="admission"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="vote",reason="admission"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="vote",reason="queue_budget"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="vote",reason="queue_budget"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="vote",reason="queue_full"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="vote",reason="queue_full"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="vote",reason="serve_budget"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="vote",reason="serve_budget"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_requests_shed_total{class="vote",reason="unsubscribed"} | rate | validator | 10 | 0.307 | 115 | 145 |
| tn_network_inbound_requests_shed_total{class="vote",reason="unsubscribed"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_network_inbound_request_service_seconds{class="batch"} | p95 | validator | 5 | 104 ms | 416 ms | 416 ms |
| tn_network_inbound_request_service_seconds{class="epoch_record"} | p95 | validator | 6 | 5 ms | 10 ms | 24 ms |
| tn_network_inbound_request_service_seconds{class="vote"} | p95 | validator | 4 | 770 ms | 2,425 ms | 2,425 ms |
| tn_network_established_connections | max | validator | 10 | 19.5 | 20 | 20 |
| tn_network_established_connections | max | observer | 1 | 18.4 | 20 | 20 |
| tn_worker_sync_streams_shed_total{reason="denied"} | rate | validator | 8 | 0.00141 | 0.82 | 0.82 |
| tn_worker_batch_fetch_duration_seconds | p95 | validator | 9 | 5 ms | 259 ms | 412 ms |
| tn_executor_batch_fetch_failures_total | rate | validator | 10 | 0 | 0 | 0 |
| tn_executor_batch_fetch_failures_total | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_votes_received_total | rate | validator | 10 | 13.3 | 16.7 | 16.8 |
| tn_primary_votes_received_total | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_vote_request_failures_total | rate | validator | 10 | 0.0115 | 1.54 | 2.07 |
| tn_primary_vote_request_failures_total | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_certificates_formed_total | rate | validator | 10 | 2.19 | 2.79 | 2.8 |
| tn_primary_certificates_formed_total | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_certificate_form_duration_seconds | p95 | validator | 10 | 521 ms | 3,950 ms | 7,000 ms |
| tn_engine_outputs_executed_total | rate | validator | 10 | 1.09 | 1.42 | 1.44 |
| tn_engine_outputs_executed_total | rate | observer | 1 | 1.09 | 1.41 | 1.42 |
| tn_engine_persist_failures_total | rate | validator | 10 | 0 | 0 | 0 |
| tn_engine_persist_failures_total | rate | observer | 1 | 0 | 0 | 0 |
| tn_node_consensus_sync_distance | max | validator | 10 | 8.98 | 492 | 494 |
| tn_node_consensus_sync_distance | max | observer | 1 | 2.42 | 4.75 | 7 |
| reth_db_table_size{table="AccountsHistory"} | max | validator | 10 | 68 MiB | 105 MiB | 106 MiB |
| reth_db_table_size{table="AccountsHistory"} | max | observer | 1 | 68 MiB | 105 MiB | 106 MiB |
| reth_db_table_size{table="AccountsTrie"} | max | validator | 10 | 6.8 MiB | 11 MiB | 11 MiB |
| reth_db_table_size{table="AccountsTrie"} | max | observer | 1 | 6.8 MiB | 11 MiB | 11 MiB |
| reth_db_table_size{table="BlockBodyIndices"} | max | validator | 10 | 1.4 MiB | 2.2 MiB | 2.3 MiB |
| reth_db_table_size{table="BlockBodyIndices"} | max | observer | 1 | 1.4 MiB | 2.2 MiB | 2.3 MiB |
| reth_db_table_size{table="HashedAccounts"} | max | validator | 10 | 42 MiB | 71 MiB | 72 MiB |
| reth_db_table_size{table="HashedAccounts"} | max | observer | 1 | 42 MiB | 71 MiB | 72 MiB |
| reth_db_table_size{table="HashedStorages"} | max | validator | 10 | 44 MiB | 46 MiB | 46 MiB |
| reth_db_table_size{table="HashedStorages"} | max | observer | 1 | 44 MiB | 46 MiB | 46 MiB |
| reth_db_table_size{table="HeaderNumbers"} | max | validator | 10 | 4.2 MiB | 6.8 MiB | 6.8 MiB |
| reth_db_table_size{table="HeaderNumbers"} | max | observer | 1 | 4.3 MiB | 6.8 MiB | 6.8 MiB |
| reth_db_table_size{table="StoragesHistory"} | max | validator | 10 | 117 MiB | 139 MiB | 139 MiB |
| reth_db_table_size{table="StoragesHistory"} | max | observer | 1 | 117 MiB | 139 MiB | 139 MiB |
| reth_db_table_size{table="StoragesTrie"} | max | validator | 10 | 17 MiB | 17 MiB | 17 MiB |
| reth_db_table_size{table="StoragesTrie"} | max | observer | 1 | 17 MiB | 17 MiB | 17 MiB |
| reth_db_table_size{table="TransactionBlocks"} | max | validator | 10 | 1.5 MiB | 2.4 MiB | 2.4 MiB |
| reth_db_table_size{table="TransactionBlocks"} | max | observer | 1 | 1.5 MiB | 2.4 MiB | 2.4 MiB |
| reth_db_table_size{table="TransactionHashNumbers"} | max | validator | 10 | 1.28 GiB | 2.01 GiB | 2.02 GiB |
| reth_db_table_size{table="TransactionHashNumbers"} | max | observer | 1 | 1.29 GiB | 2.01 GiB | 2.02 GiB |
| reth_db_freelist | max | validator | 10 | 81K | 113K | 117K |
| reth_db_freelist | max | observer | 1 | 80.8K | 112K | 116K |
| tn_engine_recover_seconds | p95 | validator | 10 | 294 ms | 2,425 ms | 2,425 ms |
| tn_engine_recover_seconds | p95 | observer | 1 | 278 ms | 847 ms | 871 ms |
| tn_engine_evm_seconds | p95 | validator | 10 | 472 ms | 2,214 ms | 2,214 ms |
| tn_engine_evm_seconds | p95 | observer | 1 | 411 ms | 743 ms | 781 ms |
| tn_engine_root_seconds | p95 | validator | 9 | 237 ms | 905 ms | 905 ms |
| tn_engine_root_seconds | p95 | observer | 1 | 205 ms | 244 ms | 256 ms |
| tn_engine_finish_seconds | p95 | validator | 10 | 372 ms | 892 ms | 900 ms |
| tn_engine_finish_seconds | p95 | observer | 1 | 232 ms | 345 ms | 384 ms |
| tn_engine_forward_wait_seconds | p95 | validator | 10 | 3,339 ms | 30.0 s | 30.0 s |
| tn_engine_forward_wait_seconds | p95 | observer | 1 | 1 ms | 4 ms | 6 ms |
| tn_engine_channel_depth | max | validator | 10 | 1.55 | 9.25 | 11 |
| tn_engine_channel_depth | max | observer | 1 | 0 | 0 | 0 |
| tn_engine_executed_transactions_total | rate | validator | 10 | 9.54K | 21.5K | 21.5K |
| tn_engine_executed_transactions_total | rate | observer | 1 | 9.47K | 20.3K | 20.3K |
| tn_executor_execution_wait_seconds | p95 | validator | 10 | 173 ms | 29.0 s | 29.0 s |
| tn_primary_commit_run_ahead_blocked_total | rate | validator | 10 | 0 | 0 | 0 |
| tn_primary_commit_run_ahead_blocked_total | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_consensus_exec_lag_rounds | max | validator | 10 | 16.9 | 69.5 | 74 |
| tn_primary_consensus_exec_lag_rounds | max | observer | 1 | 4.52 | 9.5 | 14 |
| tn_primary_commit_lag_rounds | max | validator | 10 | 2.24 | 3.5 | 5 |
| tn_primary_commit_lag_rounds | max | observer | 1 | 0 | 0 | 0 |
| tn_primary_rejoin_grace_holds_total | rate | validator | 10 | 0 | 0 | 0 |
| tn_primary_rejoin_grace_holds_total | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_votes_refused_inactive_total | rate | validator | 10 | 0 | 31.2 | 31.6 |
| tn_primary_votes_refused_inactive_total | rate | observer | 1 | 0 | 0 | 0 |
| tn_primary_votes_refused_execution_behind_total | rate | validator | 10 | 0.0823 | 1.27 | 1.49 |
| tn_primary_votes_refused_execution_behind_total | rate | observer | 1 | 0 | 0 | 0 |
| tn_batch_builder_pool_age_seconds | p95 | validator | 10 | 5,256 ms | 30.0 s | 30.0 s |
| tn_batch_builder_builds_total{reason="bytes_full"} | rate | validator | 10 | 0 | 0 | 0 |
| tn_batch_builder_builds_total{reason="bytes_full"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_batch_builder_builds_total{reason="drained"} | rate | validator | 10 | 1.19 | 2.37 | 2.51 |
| tn_batch_builder_builds_total{reason="drained"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_batch_builder_builds_total{reason="gas_full"} | rate | validator | 10 | 2.55 | 4.87 | 5.18 |
| tn_batch_builder_builds_total{reason="gas_full"} | rate | observer | 1 | 0 | 0 | 0 |
| tn_worker_batch_report_seconds | p95 | validator | 10 | 0 ms | 1 ms | 1 ms |
| tn_primary_digest_wait_seconds | p95 | validator | 9 | 936 ms | 30.0 s | 30.0 s |
| tn_primary_headers_proposed_total{reason="max_delay"} | rate | validator | 10 | 0.024 | 0.194 | 0.222 |
| tn_primary_headers_proposed_total{reason="min_delay"} | rate | validator | 10 | 2.11 | 2.79 | 2.8 |
| tn_primary_headers_proposed_total{reason="parents_and_threshold"} | rate | validator | 10 | 0.166 | 2.07 | 2.24 |
| tn_primary_digests_requeued_total{cause="canceled"} | rate | validator | 10 | 0.109 | 8.84 | 11.3 |
| tn_primary_digests_requeued_total{cause="committed"} | rate | validator | 10 | 0.00911 | 1.22 | 1.42 |
| tn_executor_consensus_pack_persist_seconds | p95 | validator | 10 | 22 ms | 57 ms | 68 ms |
| tn_batch_builder_seal_duration_seconds | p95 | validator | 10 | 318 ms | 953 ms | 953 ms |
| tn_worker_quorum_wait_seconds | p95 | validator | 9 | 340 ms | 947 ms | 947 ms |
| tn_primary_proposer_pending_digests | max | validator | 10 | 1.37 | 18.5 | 31 |
| tn_primary_proposer_pending_digests | max | observer | 1 | 0 | 0 | 0 |
| reth_transaction_pool_pending_pool_transactions | max | validator | 10 | 953 | 6.17K | 9.89K |
| reth_transaction_pool_pending_pool_transactions | max | observer | 1 | 0 | 0 | 0 |
| reth_transaction_pool_queued_pool_transactions | max | validator | 10 | 287 | 3.01K | 4.99K |
| reth_transaction_pool_queued_pool_transactions | max | observer | 1 | 0 | 0 | 0 |
| reth_transaction_pool_all_transactions_by_hash | max | validator | 10 | 1.71K | 7.51K | 9.89K |
| reth_transaction_pool_all_transactions_by_hash | max | observer | 1 | 0 | 0 | 0 |
| reth_storage_providers_database_save_blocks_total | p95 | validator | 10 | 237 ms | 16.3 s | 19.9 s |
| reth_storage_providers_database_save_blocks_total | p95 | observer | 1 | 205 ms | 296 ms | 327 ms |
| reth_storage_providers_database_save_blocks_mdbx | p95 | validator | 10 | 236 ms | 16.3 s | 19.9 s |
| reth_storage_providers_database_save_blocks_mdbx | p95 | observer | 1 | 193 ms | 279 ms | 307 ms |
| reth_storage_providers_database_save_blocks_sf | p95 | validator | 10 | 58 ms | 104 ms | 110 ms |
| reth_storage_providers_database_save_blocks_sf | p95 | observer | 1 | 45 ms | 66 ms | 67 ms |
| reth_storage_providers_database_save_blocks_commit_mdbx | p95 | validator | 10 | 452 ms | 851 ms | 940 ms |
| reth_storage_providers_database_save_blocks_commit_mdbx | p95 | observer | 1 | 480 ms | 793 ms | 820 ms |
| reth_storage_providers_database_save_blocks_commit_sf | p95 | validator | 10 | 1 ms | 1 ms | 1 ms |
| reth_storage_providers_database_save_blocks_commit_sf | p95 | observer | 1 | 0 ms | 0 ms | 0 ms |
| reth_storage_providers_database_save_blocks_write_state | p95 | validator | 10 | 0 ms | 1 ms | 1 ms |
| reth_storage_providers_database_save_blocks_write_state | p95 | observer | 1 | 0 ms | 0 ms | 0 ms |
| reth_storage_providers_database_save_blocks_write_hashed_state | p95 | validator | 10 | 26 ms | 1,770 ms | 1,877 ms |
| reth_storage_providers_database_save_blocks_write_hashed_state | p95 | observer | 1 | 23 ms | 29 ms | 30 ms |
| reth_storage_providers_database_save_blocks_write_trie_updates | p95 | validator | 9 | 38 ms | 1,043 ms | 1,067 ms |
| reth_storage_providers_database_save_blocks_write_trie_updates | p95 | observer | 1 | 32 ms | 40 ms | 45 ms |
| tn_node_switch{name="digest_order_hold"} | max | validator | 10 | 1 | 1 | 1 |
| tn_node_switch{name="digest_order_hold"} | max | observer | 1 | 1 | 1 | 1 |
| tn_node_switch{name="epoch_record_collect_past_uncertified"} | max | validator | 10 | 1 | 1 | 1 |
| tn_node_switch{name="epoch_record_collect_past_uncertified"} | max | observer | 1 | 1 | 1 | 1 |
| tn_node_switch{name="epoch_record_conflict_halt"} | max | validator | 10 | 1 | 1 | 1 |
| tn_node_switch{name="epoch_record_conflict_halt"} | max | observer | 1 | 1 | 1 | 1 |
| tn_node_switch{name="epoch_record_recertify"} | max | validator | 10 | 1 | 1 | 1 |
| tn_node_switch{name="epoch_record_recertify"} | max | observer | 1 | 1 | 1 | 1 |
| tn_node_switch{name="quorum_exec_block"} | max | validator | 10 | 1 | 1 | 1 |
| tn_node_switch{name="quorum_exec_block"} | max | observer | 1 | 1 | 1 | 1 |
| tn_node_switch{name="quorum_exec_block_starved_rounds"} | max | validator | 10 | 4 | 4 | 4 |
| tn_node_switch{name="quorum_exec_block_starved_rounds"} | max | observer | 1 | 4 | 4 | 4 |
| tn_node_switch{name="vote_queue_fix"} | max | validator | 10 | 1 | 1 | 1 |
| tn_node_switch{name="vote_queue_fix"} | max | observer | 1 | 1 | 1 | 1 |
| tn_primary_epoch_entry_rounds_behind | max | validator | 10 | 3 | 36 | 36 |
| tn_primary_epoch_entry_rounds_behind | max | observer | 1 | 0 | 0 | 0 |
| reth_transaction_pool_pending_pool_size_bytes | max | validator | 10 | 339.3 KiB | 2.1 MiB | 3.5 MiB |
| reth_transaction_pool_pending_pool_size_bytes | max | observer | 1 | 0 B | 0 B | 0 B |
| reth_transaction_pool_queued_pool_size_bytes | max | validator | 10 | 102.6 KiB | 867.8 KiB | 1.3 MiB |
| reth_transaction_pool_queued_pool_size_bytes | max | observer | 1 | 0 B | 0 B | 0 B |
| reth_transaction_pool_pending_transactions_evicted | max | validator | 10 | 0 | 0 | 0 |
| reth_transaction_pool_pending_transactions_evicted | max | observer | 1 | 0 | 0 | 0 |
| reth_transaction_pool_queued_transactions_evicted | max | validator | 10 | 0 | 0 | 0 |
| reth_transaction_pool_queued_transactions_evicted | max | observer | 1 | 0 | 0 | 0 |
| reth_transaction_pool_basefee_transactions_evicted | max | validator | 10 | 0 | 0 | 0 |
| reth_transaction_pool_basefee_transactions_evicted | max | observer | 1 | 0 | 0 | 0 |
| reth_transaction_pool_removed_transactions | max | validator | 10 | 2.03M | 3.66M | 3.68M |
| reth_transaction_pool_removed_transactions | max | observer | 1 | 0 | 0 | 0 |
| reth_transaction_pool_invalid_transactions | max | validator | 10 | 0 | 0 | 0 |
| reth_transaction_pool_invalid_transactions | max | observer | 1 | 0 | 0 | 0 |
| tn_engine_recovery_fallback_total | max | validator | 10 | 0 | 0 | 0 |
| tn_engine_recovery_fallback_total | max | observer | 1 | 0 | 0 | 0 |
tn_primary_commit_latency_seconds
tn_primary_round − tn_primary_committed_round
tn_engine_queued_outputs, max by node
The share of each validator's own headers that formed a certificate, per window (tools/cert-rate.py on the node logs). bench-validator-06 certified fewer than 90 % of its own headers in a window where it proposed at least 50. Own leader % is the validator's share of the committed leaders and not committed % the share of its certificates no committed leader reached, both over the run window; the fair share is 100 / 10 validators = 10.0 %. Greyed: fewer than 50 headers proposed, not judged.
| Validator | Region | blast 0 preamble | blast 0 warmup | blast 0 mixed | blast 0 cooldown | blast 1 preamble | blast 1 warmup | blast 1 mixed | blast 1 cooldown | blast 2 preamble | blast 2 warmup | blast 2 mixed | blast 2 cooldown | run | Own leader % | Not committed % |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| bench-validator-01 | us-west2 (Los Angeles) | 100.0 | 100.0 | 100.0 | 101.1 | 98.3 | 100.0 | 100.1 | 102.0 | 102.0 | 97.1 | 94.3 | 98.8 | 97.0 | 12.5 | 0.1 |
| bench-validator-02 | europe-west2 (London) | 100.0 | 100.0 | 100.0 | 101.1 | 98.2 | 100.0 | 99.6 | 98.0 | 98.0 | 97.4 | 97.0 | 98.8 | 98.3 | 1.7 | 39.7 |
| bench-validator-03 | australia-southeast1 (Sydney) | 112.5 | 100.0 | 99.9 | 101.1 | 101.8 | 100.0 | 100.0 | 100.0 | 100.0 | 99.1 | 98.4 | 98.8 | 99.2 | 13.5 | 0.2 |
| bench-validator-04 | asia-northeast1 (Tokyo) | 100.0 | 100.6 | 99.9 | 101.1 | 101.8 | 100.0 | 100.0 | 98.0 | 100.0 | 98.8 | 99.6 | 97.5 | 99.8 | 12.9 | 0.1 |
| bench-validator-05 | us-east4 (Ashburn) | 88.9 | 99.4 | 99.0 | 100.0 | 100.0 | 99.5 | 99.9 | 100.0 | 102.0 | 98.8 | 90.8 | – | 96.3 | 10.1 | 1.1 |
| bench-validator-06 below 90 % | europe-west4 (Netherlands) | 112.5 | 99.4 | 99.4 | 98.9 | 98.2 | 99.5 | 99.5 | 98.0 | 100.0 | 96.5 | 76.4 | 100.0 | 87.5 | 0.4 | 46.8 |
| bench-validator-07 | asia-southeast1 (Singapore) | 88.9 | 100.6 | 99.9 | 100.0 | 98.3 | 100.0 | 100.1 | 100.0 | 100.0 | 98.3 | 98.6 | 98.8 | 99.2 | 13.4 | 0.1 |
| bench-validator-08 | asia-east2 (Hong Kong) | 100.0 | 100.6 | 99.9 | 100.0 | 100.0 | 100.0 | 100.1 | 100.0 | 100.0 | 98.3 | 98.5 | 98.8 | 99.2 | 13.3 | 0.1 |
| bench-validator-09 | asia-northeast3 (Seoul) | 100.0 | 100.6 | 99.9 | 100.0 | 101.8 | 100.0 | 100.0 | 100.0 | 100.0 | 97.7 | 99.0 | 98.8 | 99.4 | 14.1 | 0.1 |
| bench-validator-10 | asia-south1 (Mumbai) | 100.0 | 100.0 | 99.9 | 101.1 | 100.0 | 100.0 | 100.0 | 100.0 | 102.0 | 96.8 | 95.5 | 96.3 | 97.6 | 10.7 | 6.3 |
| Node | Class | Peak RssAnon | Peak RssFile | Peak cache | PSI mem | PSI io | PSI cpu | db growth | static_files growth | Root used | OOM Δ |
|---|---|---|---|---|---|---|---|---|---|---|---|
| bench-observer-11 | observer | 955 MiB | 5.14 GiB | – | 0.0 % | 7.3 % | 2.8 % | 3.29 GiB | 9.48 GiB | 22.0 % | 0 |
| bench-validator-01 | validator | 1.99 GiB | 4.96 GiB | – | 0.0 % | 9.1 % | 14.7 % | 3.28 GiB | 9.48 GiB | 24.0 % | 0 |
| bench-validator-02 | validator | 1.96 GiB | 4.98 GiB | – | 0.0 % | 11.3 % | 13.1 % | 3.28 GiB | 9.48 GiB | 24.0 % | 0 |
| bench-validator-03 | validator | 1.89 GiB | 5.04 GiB | – | 0.0 % | 11.2 % | 14.3 % | 3.28 GiB | 9.48 GiB | 24.0 % | 0 |
| bench-validator-04 | validator | 2.31 GiB | 4.98 GiB | – | 0.0 % | 10.3 % | 11.7 % | 3.28 GiB | 9.48 GiB | 24.0 % | 0 |
| bench-validator-05 | validator | 2.51 GiB | 5.08 GiB | – | 0.0 % | 14.1 % | 15.6 % | 2.83 GiB | 9.29 GiB | 24.0 % | 0 |
| bench-validator-06 | validator | 1.88 GiB | 5.00 GiB | – | 0.0 % | 10.0 % | 14.6 % | 3.28 GiB | 9.48 GiB | 24.0 % | 0 |
| bench-validator-07 | validator | 1.81 GiB | 4.95 GiB | – | 0.0 % | 9.1 % | 16.2 % | 3.28 GiB | 9.48 GiB | 24.0 % | 0 |
| bench-validator-08 | validator | 1.85 GiB | 5.06 GiB | – | 0.0 % | 11.4 % | 15.6 % | 3.28 GiB | 9.48 GiB | 24.0 % | 0 |
| bench-validator-09 | validator | 1.87 GiB | 4.99 GiB | – | 0.0 % | 7.7 % | 14.7 % | 3.28 GiB | 9.48 GiB | 24.0 % | 0 |
| bench-validator-10 | validator | 1.82 GiB | 4.95 GiB | – | 0.0 % | 11.6 % | 12.7 % | 3.28 GiB | 9.48 GiB | 24.0 % | 0 |
/proc/<pid>/status of the telcoin process on the node with the largest RSS
Not collected: consensus-db/cache size.
/proc/pressure on the node with the highest memory PSI
Per role and per node, from sizing.json (p95 over the landed window; PSI and RssAnon max over the whole sampler run). The lines follow the hardware doc's tier rules: CPU p95 over 70 % of vCPUs; memory used p95 over 75 % of RAM, or telcoin RSS p95 over 85 % of RAM; disk write p95 over 60 % of the PD MiB/s limit, or write IOPS p95 over 60 % of the IOPS limit; IO pressure over 20 % or memory pressure over 5 % (PSI some avg10, max); network p95 over 50 % of 1 Gbps; root disk over 80 %. A line crossed on any node puts the role at the limit; a nonzero reading within 15 points of its line is tight; otherwise the role has headroom. OOM kills, disk throttling and degraded disk performance are flagged too.
| Signal | Class | Worst node | Value | Share of capacity | Line | Nodes over / tight | Status |
|---|---|---|---|---|---|---|---|
| CPU p95 | validator | bench-validator-03 | 56.5 % | 56.5 % | > 70 % | 0 / 6 | tight |
| Memory used p95 | validator | bench-validator-05 | 21.0 % | 21.0 % | > 75 % | 0 / 0 | headroom |
| telcoin RSS p95 | validator | bench-validator-05 | 7.70 GB | 44.8 % | > 85 % | 0 / 0 | headroom |
| PSI memory max | validator | bench-validator-01 | 0.0 % | 0.0 % | > 5 % | 0 / 0 | headroom |
| RssAnon peak | validator | bench-validator-05 | 2.84 GB | 16.5 % | info | – | info |
| Disk write p95 | validator | bench-validator-06 | 300 MB/s | 35.7 % | > 60 % | 0 / 0 | headroom |
| Write IOPS p95 | validator | bench-validator-03 | 20,039 | 100.2 % | > 60 % | 10 / 0 | at the limit |
| PSI io max | validator | bench-validator-05 | 14.1 % | 14.1 % | > 20 % | 0 / 10 | tight |
| Root disk max | validator | bench-validator-09 | 23.7 % | 23.7 % | > 80 % | 0 / 0 | headroom |
| Network p95 | validator | bench-validator-02 | 196 Mbps | 19.6 % | > 50 % | 0 / 0 | headroom |
| Consensus cache peak | validator | – | – | – | info | – | not collected |
| OOM kills | validator | – | – | any | any | – | none |
| Disk throttling | validator | – | – | metric type unavailable in project | any | – | not collected |
| Disk performance degraded | validator | – | – | any sample | any | – | none |
| CPU p95 | observer | bench-observer-11 | 32.1 % | 32.1 % | > 70 % | 0 / 0 | headroom |
| Memory used p95 | observer | bench-observer-11 | 11.4 % | 11.4 % | > 75 % | 0 / 0 | headroom |
| telcoin RSS p95 | observer | bench-observer-11 | 6.37 GB | 37.1 % | > 85 % | 0 / 0 | headroom |
| PSI memory max | observer | bench-observer-11 | 0.0 % | 0.0 % | > 5 % | 0 / 0 | headroom |
| RssAnon peak | observer | bench-observer-11 | 1.01 GB | 5.9 % | info | – | info |
| Disk write p95 | observer | bench-observer-11 | 303 MB/s | 36.2 % | > 60 % | 0 / 0 | headroom |
| Write IOPS p95 | observer | bench-observer-11 | 17,721 | 88.6 % | > 60 % | 1 / 0 | at the limit |
| PSI io max | observer | bench-observer-11 | 7.3 % | 7.3 % | > 20 % | 0 / 1 | tight |
| Root disk max | observer | bench-observer-11 | 21.8 % | 21.8 % | > 80 % | 0 / 0 | headroom |
| Network p95 | observer | bench-observer-11 | 10 Mbps | 1.0 % | > 50 % | 0 / 0 | headroom |
| Consensus cache peak | observer | – | – | – | info | – | not collected |
| OOM kills | observer | – | – | any | any | – | none |
| Disk throttling | observer | – | – | metric type unavailable in project | any | – | not collected |
| Disk performance degraded | observer | – | – | any sample | any | – | none |
| Node | Class | CPU p95 | Memory used p95 | telcoin RSS p95 | PSI memory max | RssAnon peak | Disk write p95 | Write IOPS p95 | PSI io max | Root disk max | Network p95 | Consensus cache peak |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Line | > 70 % | > 75 % | > 85 % | > 5 % | info | > 60 % | > 60 % | > 20 % | > 80 % | > 50 % | info | |
| bench-validator-01 | validator | 56.2 % | 18.1 % | 7.34 GB 43 % | 0.0 % | 2.14 GB 12 % | 296 MB/s 35 % | 19,390 97 % | 9.1 % | 23.4 % | 195 Mbps 20 % | – |
| bench-validator-02 | validator | 53.6 % | 17.8 % | 7.29 GB 42 % | 0.0 % | 2.10 GB 12 % | 297 MB/s 35 % | 19,838 99 % | 11.3 % | 23.5 % | 196 Mbps 20 % | – |
| bench-validator-03 | validator | 56.5 % | 17.5 % | 7.26 GB 42 % | 0.0 % | 2.03 GB 12 % | 291 MB/s 35 % | 20,039 100 % | 11.2 % | 23.6 % | 196 Mbps 20 % | – |
| bench-validator-04 | validator | 53.8 % | 19.9 % | 7.61 GB 44 % | 0.0 % | 2.53 GB 15 % | 296 MB/s 35 % | 18,596 93 % | 10.3 % | 23.4 % | 190 Mbps 19 % | – |
| bench-validator-05 | validator | 56.3 % | 21.0 % | 7.70 GB 45 % | 0.0 % | 2.84 GB 17 % | 292 MB/s 35 % | 19,992 100 % | 14.1 % | 22.7 % | 195 Mbps 20 % | – |
| bench-validator-06 | validator | 55.7 % | 17.4 % | 7.20 GB 42 % | 0.0 % | 2.02 GB 12 % | 300 MB/s 36 % | 19,728 99 % | 10.0 % | 23.6 % | 189 Mbps 19 % | – |
| bench-validator-07 | validator | 55.1 % | 16.9 % | 7.14 GB 42 % | 0.0 % | 1.94 GB 11 % | 293 MB/s 35 % | 20,026 100 % | 9.1 % | 23.5 % | 188 Mbps 19 % | – |
| bench-validator-08 | validator | 54.7 % | 17.0 % | 7.17 GB 42 % | 0.0 % | 1.99 GB 12 % | 298 MB/s 36 % | 19,584 98 % | 11.4 % | 23.7 % | 185 Mbps 18 % | – |
| bench-validator-09 | validator | 53.3 % | 17.2 % | 7.22 GB 42 % | 0.0 % | 2.02 GB 12 % | 292 MB/s 35 % | 19,092 95 % | 7.7 % | 23.7 % | 194 Mbps 19 % | – |
| bench-validator-10 | validator | 55.4 % | 17.0 % | 7.13 GB 42 % | 0.0 % | 1.95 GB 11 % | 289 MB/s 34 % | 19,704 99 % | 11.6 % | 23.7 % | 191 Mbps 19 % | – |
| bench-observer-11 | observer | 32.1 % | 11.4 % | 6.37 GB 37 % | 0.0 % | 1.01 GB 6 % | 303 MB/s 36 % | 17,721 89 % | 7.3 % | 21.8 % | 10 Mbps 1 % | – |
Small figures are the share of capacity: RAM for RSS, the PD limit for disk write (VM cap applied), 1 Gbps for network. Hover a cell for its JSON path.
A = Fleet c3-hdb · c3-highcpu-8 · r20261115-1653
B = Fleet c3-hdb · c3-highcpu-8 · r20261115-1131
at the limit c3-highcpu-8 validators at 12,594 sustained TPS: at the limit on disk. Disk at the limit: write IOPS p95 18,596–20,039, up to 100.2 % of the 20,000 IOPS limit, over the 60 % line on all 10 validators (bench-validator-01, 02, 03, 04, 05, 06, 07, 08, 09, 10); IO pressure (PSI some avg10) max 14.1 % (bench-validator-05), tight against the 20 % line. CPU tight: CPU p95 56.5 % of 8 vCPUs (bench-validator-03), tight against the 70 % line. Memory has headroom: memory used p95 21.0 % of RAM (bench-validator-05); telcoin RSS p95 7.70 GB, 44.8 % of 16 GiB RAM (bench-validator-05); memory pressure (PSI some avg10) max 0.0 % (bench-validator-01). Network has headroom: network p95 196 Mbps, 19.6 % of 1 Gbps (bench-validator-02). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).
at the limit c3-highcpu-8 observers at 12,594 sustained TPS: at the limit on disk. Disk at the limit: write IOPS p95 17,721, 88.6 % of the 20,000 IOPS limit on bench-observer-11, over the 60 % line; IO pressure (PSI some avg10) max 7.3 % (bench-observer-11), tight against the 20 % line. CPU has headroom: CPU p95 32.1 % of 8 vCPUs (bench-observer-11). Memory has headroom: memory used p95 11.4 % of RAM (bench-observer-11); telcoin RSS p95 6.37 GB, 37.1 % of 16 GiB RAM (bench-observer-11); memory pressure (PSI some avg10) max 0.0 % (bench-observer-11). Network has headroom: network p95 10 Mbps, 1.0 % of 1 Gbps (bench-observer-11). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).
at the limit c3-highcpu-8 validators at 11,921 sustained TPS: at the limit on disk. Disk at the limit: write IOPS p95 18,789–19,924, up to 99.6 % of the 20,000 IOPS limit, over the 60 % line on all 10 validators (bench-validator-01, 02, 03, 04, 05, 06, 07, 08, 09, 10); IO pressure (PSI some avg10) max 14.6 % (bench-validator-05), tight against the 20 % line. CPU tight: CPU p95 55.8 % of 8 vCPUs (bench-validator-04), tight against the 70 % line. Memory has headroom: memory used p95 20.8 % of RAM (bench-validator-05); telcoin RSS p95 7.59 GB, 44.2 % of 16 GiB RAM (bench-validator-07); memory pressure (PSI some avg10) max 0.0 % (bench-validator-01). Network has headroom: network p95 204 Mbps, 20.4 % of 1 Gbps (bench-validator-07). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).
at the limit c3-highcpu-8 observers at 11,921 sustained TPS: at the limit on disk. Disk at the limit: write IOPS p95 18,194, 91.0 % of the 20,000 IOPS limit on bench-observer-11, over the 60 % line; IO pressure (PSI some avg10) max 7.7 % (bench-observer-11), tight against the 20 % line. CPU has headroom: CPU p95 30.2 % of 8 vCPUs (bench-observer-11). Memory has headroom: memory used p95 11.9 % of RAM (bench-observer-11); telcoin RSS p95 6.27 GB, 36.5 % of 16 GiB RAM (bench-observer-11); memory pressure (PSI some avg10) max 0.0 % (bench-observer-11). Network has headroom: network p95 9 Mbps, 0.9 % of 1 Gbps (bench-observer-11). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).
Validators: Fleet A (c3-highcpu-8) is at the limit on disk, tight on CPU, with headroom on memory and network; Fleet B (c3-highcpu-8) is at the limit on disk, tight on CPU, with headroom on memory and network. The same disk limit binds both fleets: every validator runs a 100 GB hyperdisk-balanced, which allows 20,000 IOPS on both; its throughput limit is 800 MiB/s on both. Disk is at the limit on both (Fleet A (c3-highcpu-8): write IOPS p95 20,039, 100.2 % of the 20,000 IOPS limit; Fleet B (c3-highcpu-8): write IOPS p95 19,924, 99.6 % of the 20,000 IOPS limit). Changing the machine shape did not clear it; the volume is the binding resource.
Observers: Fleet A (c3-highcpu-8) is at the limit on disk, with headroom on CPU, memory and network; Fleet B (c3-highcpu-8) is at the limit on disk, with headroom on CPU, memory and network. The same disk limit binds both fleets: every observer runs a 100 GB hyperdisk-balanced, which allows 20,000 IOPS on both; its throughput limit is 800 MiB/s on both. Disk is at the limit on both (Fleet A (c3-highcpu-8): write IOPS p95 17,721, 88.6 % of the 20,000 IOPS limit; Fleet B (c3-highcpu-8): write IOPS p95 18,194, 91.0 % of the 20,000 IOPS limit). Changing the machine shape did not clear it; the volume is the binding resource.
| KPI | Fleet A | Fleet B | B ÷ A |
|---|---|---|---|
| Sustained mixed TPS (own) | 12,593.5 tx/s | 11,921.4 tx/s | 0.95× |
| Sustained mixed TPS (chain) | 12,593.5 tx/s | 11,921.4 tx/s | 0.95× |
| Landed / accepted | 100.0 % | 100.0 % | 1.00× |
| Reverted (own) | 0 | 0 | – |
| Latency p50 | 1,662 ms | 1,479 ms | 0.89× |
| Latency p95 | 8,771 ms | 7,763 ms | 0.89× |
| Gas / s (own) | 471M gas/s | 466M gas/s | 0.99× |
| Capacity at mix | 18,696.2 tx/s | 19,007.7 tx/s | 1.02× |
| Signal | Class | Fleet A | Fleet B | Line |
|---|---|---|---|---|
| CPU p95 | validator | 56.5 % tight | 55.8 % tight | > 70 % |
| Memory used p95 | validator | 21.0 % headroom | 20.8 % headroom | > 75 % |
| telcoin RSS p95 | validator | 7.70 GB 44.8 % headroom | 7.59 GB 44.2 % headroom | > 85 % |
| PSI memory max | validator | 0.0 % headroom | 0.0 % headroom | > 5 % |
| Disk write p95 | validator | 300 MB/s 35.7 % headroom | 301 MB/s 35.8 % headroom | > 60 % |
| Write IOPS p95 | validator | 20,039 100.2 % at the limit | 19,924 99.6 % at the limit | > 60 % |
| PSI io max | validator | 14.1 % tight | 14.6 % tight | > 20 % |
| Root disk max | validator | 23.7 % headroom | 24.1 % headroom | > 80 % |
| Network p95 | validator | 196 Mbps 19.6 % headroom | 204 Mbps 20.4 % headroom | > 50 % |
| CPU p95 | observer | 32.1 % headroom | 30.2 % headroom | > 70 % |
| Memory used p95 | observer | 11.4 % headroom | 11.9 % headroom | > 75 % |
| telcoin RSS p95 | observer | 6.37 GB 37.1 % headroom | 6.27 GB 36.5 % headroom | > 85 % |
| PSI memory max | observer | 0.0 % headroom | 0.0 % headroom | > 5 % |
| Disk write p95 | observer | 303 MB/s 36.2 % headroom | 288 MB/s 34.3 % headroom | > 60 % |
| Write IOPS p95 | observer | 17,721 88.6 % at the limit | 18,194 91.0 % at the limit | > 60 % |
| PSI io max | observer | 7.3 % tight | 7.7 % tight | > 20 % |
| Root disk max | observer | 21.8 % headroom | 21.7 % headroom | > 80 % |
| Network p95 | observer | 10 Mbps 1.0 % headroom | 9 Mbps 0.9 % headroom | > 50 % |
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
aligned on each fleet's mixed-phase start
Not collected: reference chains.