This is the full report of the run “The v0.2.0-devnet release on operator-deployed nodes with closed admission”. Back to the run page.
r20261103-1922 · Fleet c3-hdb · c3-highcpu-8

Telcoin Network benchmark: mixed workload

Throughput is measured from blocks the chain produced (own senders vs every sender), resource use from Cloud Monitoring, Prometheus and the on-node sampler. Summaries cover the mixed phase. Hover any number for the JSON field it came from.

10 blaster(s), 6K senders, chain 32286, schema tn-blast-combined/v2 · mixed phase 2026-11-03 23:33–00:13 UTC · 1 observers, 10 validators

Preflight: WTEL from genesis (0x0000…37e1), v3 fee tier 3000, v4 available, Multicall3 present · Cooldown ended: all_landed ×1, idle_30s ×9

Headline numbers

Sustained mixed TPS (own)
7,599.3 tx/s
best 60-s mean of our own landed tx in the mixed phase
Sustained mixed TPS (chain)
7,599.3 tx/s
all tx in blocks, same window
Landed / accepted
99.6 %
12.1M of 12.2M accepted
Reverted (own)
0
0.00 % of landed
Latency p50
3,494 ms
submit → block timestamp; seen p50 12,982 ms
Latency p95
14,173 ms
seen p95 31,428 ms
Gas / s (own)
198M gas/s
chain 198M gas/s
Capacity at mix
8,037.3 tx/s
gas-limit basis 5,508.4 tx/s; block gas limit 30M

Per transaction type

Landed counts only our own senders; latency is submit → block timestamp.

TypeSubmittedAcceptedLandedRevertedUnlandedSkipsGas limitGas used avgp50p95
native_transfer4.3M4.27M4.26M09.38K024.1K21K3,473 ms13,960 ms
batched_self_send1.7M1.67M1.67M08.5K024.1K21K3,563 ms14,675 ms
uniswap_v2_swap1.53M1.51M1.5M06.64K0180K106K3,474 ms13,928 ms
stablecoin_transfer1.28M1.26M1.26M05.39K075K43.9K3,474 ms13,966 ms
wtel_wrap1.02M1.01M1M04.59K050K27.9K3,472 ms13,945 ms
wtel_unwrap682K671K669K02.92K045K35.2K3,470 ms13,906 ms
stablecoin_approve508K500K498K02.18K060K31.8K3,478 ms14,004 ms
uniswap_v2_add_liquidity341K336K334K01.44K0250K128K3,473 ms14,005 ms
contract_deploy256K252K251K01.15K0140K74.2K3,470 ms13,855 ms
uniswap_v4_swap255K252K250K01.11K0250K124K3,471 ms13,901 ms
uniswap_v3_swap171K168K167K07930220K120K3,475 ms13,962 ms
uniswap_v2_remove_liquidity171K168K167K07510220K129K3,470 ms13,860 ms
faucet_drip120K120K119K0580307K150K107K4,225 ms42,514 ms

Submission by RPC node

NodeSubmittedAcceptedAccepted %Top errorsSend p50Send p95
bench-validator-01
bench-validator-01:8545
1.92M1.91M99.3 %known 6.79K6 ms21 ms
bench-validator-02
bench-validator-02:8545
377K298K79.0 %known 27.4K5 ms30 ms
bench-validator-03
bench-validator-03:8545
1.78M1.77M99.3 %known 5.08K9 ms32 ms
bench-validator-04
bench-validator-04:8545
1.58M1.56M98.7 %known 10.8K10 ms39 ms
bench-validator-05
bench-validator-05:8545
1.1M612K55.5 %other 473K, known 6.38K2 ms29 ms
bench-validator-06
bench-validator-06:8545
486K417K85.8 %known 15.9K, pool_full 2.28K3 ms21 ms
bench-validator-07
bench-validator-07:8545
1.75M1.74M99.2 %known 6.48K9 ms31 ms
bench-validator-08
bench-validator-08:8545
1.09M1.05M96.2 %known 22.7K7 ms30 ms
bench-validator-09
bench-validator-09:8545
2.15M2.14M99.8 %known 1.12K8 ms29 ms
bench-validator-10
bench-validator-10:8545
808K762K94.4 %known 22.9K5 ms20 ms

Throughput over time

Shaded: phases outside the mixed window. Hairlines: epoch closes. Dashed orange: chaos events.

Landed transactions per second

own senders vs chain total, per block-timestamp second

Gas per second

own vs chain gas used, per block-timestamp second

CPU and memory per node

CPU utilization

compute.googleapis.com/instance/cpu/utilization, 60-s mean, % of all vCPUs; summaries over the mixed phase

Table view
NodeClassMeanp95Peak 60-s meanMax
bench-observer-11observer11.0 %13.8 %15.5 %15.5 %
bench-validator-01validator20.7 %26.6 %30.2 %30.2 %
bench-validator-02validator19.4 %24.6 %29.2 %29.2 %
bench-validator-03validator20.4 %26.4 %29.7 %29.7 %
bench-validator-04validator19.9 %24.0 %28.5 %28.5 %
bench-validator-05validator17.4 %24.9 %27.9 %27.9 %
bench-validator-06validator20.2 %25.7 %30.4 %30.4 %
bench-validator-07validator20.5 %26.5 %29.9 %29.9 %
bench-validator-08validator19.1 %24.3 %27.9 %27.9 %
bench-validator-09validator20.7 %26.8 %30.5 %30.5 %
bench-validator-10validator19.6 %24.8 %26.7 %26.7 %

CPU: mean vs peak 60-s mean

One row per node, over the mixed phase.

telcoin resident memory

agent processes/rss_usage summed over telcoin pids; summaries over the mixed phase

Table view
NodeClassMeanp95Peak 60-s meanMax
bench-observer-11observer2.22 GiB3.14 GiB3.32 GiB3.32 GiB
bench-validator-01validator5.31 GiB6.32 GiB6.56 GiB6.56 GiB
bench-validator-02validator5.30 GiB6.34 GiB6.53 GiB6.53 GiB
bench-validator-03validator4.82 GiB5.78 GiB5.92 GiB5.92 GiB
bench-validator-04validator5.01 GiB5.95 GiB6.30 GiB6.30 GiB
bench-validator-05validator4.53 GiB5.96 GiB6.11 GiB6.11 GiB
bench-validator-06validator6.06 GiB7.14 GiB7.67 GiB7.67 GiB
bench-validator-07validator5.60 GiB7.10 GiB7.30 GiB7.30 GiB
bench-validator-08validator5.32 GiB6.57 GiB6.74 GiB6.74 GiB
bench-validator-09validator4.86 GiB5.76 GiB5.91 GiB5.91 GiB
bench-validator-10validator5.47 GiB6.61 GiB6.81 GiB6.81 GiB

telcoin RSS: mean vs peak 60-s mean

One row per node, over the mixed phase.

Memory used

agent memory/percent_used, state=used; summaries over the mixed phase

Table view
NodeClassMeanp95Peak 60-s meanMax
bench-observer-11observer9.7 %10.9 %11.2 %11.2 %
bench-validator-01validator27.8 %29.1 %30.5 %30.5 %
bench-validator-02validator27.8 %29.2 %30.1 %30.1 %
bench-validator-03validator24.5 %25.6 %25.9 %25.9 %
bench-validator-04validator25.7 %26.7 %27.4 %27.4 %
bench-validator-05validator20.0 %25.2 %26.6 %26.6 %
bench-validator-06validator32.4 %34.5 %36.1 %36.1 %
bench-validator-07validator29.4 %33.7 %34.7 %34.7 %
bench-validator-08validator27.8 %30.5 %31.1 %31.1 %
bench-validator-09validator24.8 %25.6 %25.8 %25.8 %
bench-validator-10validator28.7 %30.5 %31.3 %31.3 %

Memory used: mean vs peak 60-s mean

One row per node, over the mixed phase.

Disk

Disk throttling (validator)
not collected –
metric type unavailable in project
Disk performance degraded (validator)
none –
any sample

Disk read + write throughput

instance/disk/{read,write}_bytes_count rate, all devices; summaries over the mixed phase

Table view
NodeClassMeanp95Peak 60-s meanMaxLimit
bench-observer-11observer406.9 MiB/s502.1 MiB/s575.1 MiB/s575.1 MiB/s800.0 MiB/s
bench-validator-01validator460.2 MiB/s577.7 MiB/s599.1 MiB/s599.1 MiB/s800.0 MiB/s
bench-validator-02validator461.2 MiB/s584.6 MiB/s607.4 MiB/s607.4 MiB/s800.0 MiB/s
bench-validator-03validator459.9 MiB/s576.0 MiB/s599.7 MiB/s599.7 MiB/s800.0 MiB/s
bench-validator-04validator460.0 MiB/s579.7 MiB/s601.2 MiB/s601.2 MiB/s800.0 MiB/s
bench-validator-05validator321.6 MiB/s461.1 MiB/s511.0 MiB/s511.0 MiB/s800.0 MiB/s
bench-validator-06validator458.0 MiB/s582.5 MiB/s594.4 MiB/s594.4 MiB/s800.0 MiB/s
bench-validator-07validator458.0 MiB/s579.0 MiB/s604.4 MiB/s604.4 MiB/s800.0 MiB/s
bench-validator-08validator459.9 MiB/s580.9 MiB/s599.5 MiB/s599.5 MiB/s800.0 MiB/s
bench-validator-09validator458.3 MiB/s573.7 MiB/s598.5 MiB/s598.5 MiB/s800.0 MiB/s
bench-validator-10validator458.8 MiB/s580.0 MiB/s602.6 MiB/s602.6 MiB/s800.0 MiB/s

Disk read + write IOPS

instance/disk/{read,write}_ops_count rate, all devices; summaries over the mixed phase

Table view
NodeClassMeanp95Peak 60-s meanMaxLimit
bench-observer-11observer2.91K IOPS5.49K IOPS5.86K IOPS5.86K IOPS20K IOPS
bench-validator-01validator2.16K IOPS2.78K IOPS2.98K IOPS2.98K IOPS20K IOPS
bench-validator-02validator2.16K IOPS2.81K IOPS3.02K IOPS3.02K IOPS20K IOPS
bench-validator-03validator2.15K IOPS2.8K IOPS2.98K IOPS2.98K IOPS20K IOPS
bench-validator-04validator2.16K IOPS2.78K IOPS2.99K IOPS2.99K IOPS20K IOPS
bench-validator-05validator4.14K IOPS10K IOPS11.7K IOPS11.7K IOPS20K IOPS
bench-validator-06validator2.15K IOPS2.91K IOPS2.95K IOPS2.95K IOPS20K IOPS
bench-validator-07validator2.25K IOPS3.08K IOPS3.75K IOPS3.75K IOPS20K IOPS
bench-validator-08validator2.16K IOPS2.8K IOPS2.98K IOPS2.98K IOPS20K IOPS
bench-validator-09validator2.15K IOPS2.76K IOPS2.96K IOPS2.96K IOPS20K IOPS
bench-validator-10validator2.17K IOPS2.8K IOPS2.99K IOPS2.99K IOPS20K IOPS
Disk limits used
NodeMachinevCPUDiskIOPS limitMiB/s limitBasis
bench-observer-11c3-highcpu-88hyperdisk-balanced 100 GB20K IOPS800.0 MiB/shyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget
bench-validator-01c3-highcpu-88hyperdisk-balanced 100 GB20K IOPS800.0 MiB/shyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget
bench-validator-02c3-highcpu-88hyperdisk-balanced 100 GB20K IOPS800.0 MiB/shyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget
bench-validator-03c3-highcpu-88hyperdisk-balanced 100 GB20K IOPS800.0 MiB/shyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget
bench-validator-04c3-highcpu-88hyperdisk-balanced 100 GB20K IOPS800.0 MiB/shyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget
bench-validator-05c3-highcpu-88hyperdisk-balanced 100 GB20K IOPS800.0 MiB/shyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget
bench-validator-06c3-highcpu-88hyperdisk-balanced 100 GB20K IOPS800.0 MiB/shyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget
bench-validator-07c3-highcpu-88hyperdisk-balanced 100 GB20K IOPS800.0 MiB/shyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget
bench-validator-08c3-highcpu-88hyperdisk-balanced 100 GB20K IOPS800.0 MiB/shyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget
bench-validator-09c3-highcpu-88hyperdisk-balanced 100 GB20K IOPS800.0 MiB/shyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget
bench-validator-10c3-highcpu-88hyperdisk-balanced 100 GB20K IOPS800.0 MiB/shyperdisk-balanced 100 GB: provisioned 20,000 IOPS, provisioned 800 MiB/s; c3 8 vCPU cap 50,000 IOPS / 800 MiB/s; reads and writes share this budget

Network

Network sent

instance/network/sent_bytes_count rate; summaries over the mixed phase

Table view
NodeClassMeanp95Peak 60-s meanMax
bench-observer-11observer0.3 Mbps0.3 Mbps0.3 Mbps0.3 Mbps
bench-validator-01validator77.3 Mbps103.2 Mbps120.4 Mbps120.4 Mbps
bench-validator-02validator69.0 Mbps93.2 Mbps111.3 Mbps111.3 Mbps
bench-validator-03validator72.9 Mbps96.5 Mbps113.4 Mbps113.4 Mbps
bench-validator-04validator72.0 Mbps90.1 Mbps108.2 Mbps108.2 Mbps
bench-validator-05validator66.4 Mbps92.1 Mbps106.3 Mbps106.3 Mbps
bench-validator-06validator68.9 Mbps88.5 Mbps109.6 Mbps109.6 Mbps
bench-validator-07validator78.1 Mbps102.8 Mbps166.9 Mbps166.9 Mbps
bench-validator-08validator69.9 Mbps91.0 Mbps107.0 Mbps107.0 Mbps
bench-validator-09validator74.7 Mbps99.3 Mbps114.9 Mbps114.9 Mbps
bench-validator-10validator70.0 Mbps92.5 Mbps100.9 Mbps100.9 Mbps

Network received

instance/network/received_bytes_count rate; summaries over the mixed phase

Table view
NodeClassMeanp95Peak 60-s meanMax
bench-observer-11observer3.8 Mbps5.1 Mbps6.5 Mbps6.5 Mbps
bench-validator-01validator7.7 Mbps11.1 Mbps12.1 Mbps12.1 Mbps
bench-validator-02validator5.6 Mbps7.4 Mbps9.1 Mbps9.1 Mbps
bench-validator-03validator7.5 Mbps10.8 Mbps11.4 Mbps11.4 Mbps
bench-validator-04validator7.0 Mbps8.9 Mbps10.0 Mbps10.0 Mbps
bench-validator-05validator11.5 Mbps43.4 Mbps61.7 Mbps61.7 Mbps
bench-validator-06validator6.0 Mbps7.8 Mbps11.4 Mbps11.4 Mbps
bench-validator-07validator7.4 Mbps10.6 Mbps11.8 Mbps11.8 Mbps
bench-validator-08validator6.1 Mbps7.7 Mbps9.7 Mbps9.7 Mbps
bench-validator-09validator8.1 Mbps11.6 Mbps12.8 Mbps12.8 Mbps
bench-validator-10validator6.2 Mbps8.1 Mbps9.0 Mbps9.0 Mbps

Consensus health

MetricQueryClassNodesMedian of node meansWorst peak 60-s meanMax
tn_primary_commit_latency_secondsp95validator92,957 ms29.0 s29.0 s
tn_engine_execution_duration_secondsp95validator104,046 ms8,125 ms8,750 ms
tn_engine_execution_duration_secondsp95observer13,624 ms5,070 ms6,250 ms
tn_worker_batch_size_bytesp95validator10239.2 KiB246.4 KiB246.4 KiB
tn_worker_batch_transactionsp95validator104841.49K1.49K
tn_executor_output_transactionsp95validator1020.5K39.5K43.8K
tn_primary_consensus_output_bytesmaxvalidator10790.4 KiB1.9 MiB3.3 MiB
tn_primary_consensus_output_bytesmaxobserver1802.1 KiB1.8 MiB2.7 MiB
tn_engine_queued_outputsmaxvalidator103.8888
tn_engine_queued_outputsmaxobserver12.047.258
tn_primary_roundmaxvalidator107751.81K1.82K
tn_primary_roundmaxobserver17661.8K1.82K
tn_primary_committed_roundmaxvalidator107731.8K1.82K
tn_primary_committed_roundmaxobserver17661.8K1.82K
tn_epoch_currentmaxvalidator104.8366
tn_epoch_currentmaxobserver14.8466
tn_batch_builder_pending_pool_transactionsmaxvalidator106896.83K8.69K
tn_batch_builder_pending_pool_transactionsmaxobserver1000
reth_process_resident_memory_bytesmaxvalidator105.35 GiB7.66 GiB7.67 GiB
reth_process_resident_memory_bytesmaxobserver12.22 GiB3.32 GiB3.32 GiB
tn_primary_subdags_committed_totalratevalidator100.4890.8890.911
tn_primary_subdags_committed_totalrateobserver1000
tn_primary_round_laglagvalidator102.3428.836
tn_primary_round_laglagobserver1000
tn_batch_builder_seal_failures_totalratevalidator500.01670.0222
tn_node_modemaxvalidator10011
tn_node_modemaxobserver1000

Commit latency p95

tn_primary_commit_latency_seconds

Round lag

tn_primary_round − tn_primary_committed_round

Engine queued outputs

tn_engine_queued_outputs, max by node

Certification by node

The share of each validator's own headers that formed a certificate, per window (tools/cert-rate.py on the node logs). bench-validator-02 and bench-validator-06 certified fewer than 90 % of their own headers in a window where they proposed at least 50. Own leader % is the validator's share of the committed leaders and not committed % the share of its certificates no committed leader reached, both over the run window; the fair share is 100 / 10 validators = 10.0 %. Greyed: fewer than 50 headers proposed, not judged.

ValidatorRegionphase preamblephase warmupphase mixedphase cooldownrunOwn leader %Not committed %
bench-validator-01us-west2 (Los Angeles)99.4100.599.6100.099.713.90.3
bench-validator-02 below 90 %europe-west2 (London)41.473.470.141.665.82.743.0
bench-validator-03australia-southeast1 (Sydney)100.0100.099.7100.099.813.40.5
bench-validator-04asia-northeast1 (Tokyo)––99.8100.099.812.50.6
bench-validator-05us-east4 (Ashburn)99.498.598.80.098.713.03.2
bench-validator-06 below 90 %europe-west4 (Netherlands)7.251.289.126.675.66.627.9
bench-validator-07asia-southeast1 (Singapore)99.4100.595.0100.096.113.00.6
bench-validator-08asia-east2 (Hong Kong)––90.4100.092.611.31.4
bench-validator-09asia-northeast3 (Seoul)––99.7100.099.812.20.3
bench-validator-10asia-south1 (Mumbai)––96.4100.096.910.910.3

On-node sampler

NodeClassPeak RssAnonPeak RssFilePeak cachePSI memPSI ioPSI cpudb growthstatic_files growthRoot usedOOM Δ
bench-observer-11observer803 MiB2.54 GiB– 0.0 %32.0 %0.2 %0 B2.70 GiB13.0 %0
bench-validator-01validator3.90 GiB2.80 GiB– 0.0 %32.2 %2.6 %0 B2.70 GiB13.0 %0
bench-validator-02validator3.82 GiB2.81 GiB– 0.0 %32.8 %1.9 %0 B2.70 GiB13.0 %0
bench-validator-03validator3.18 GiB2.78 GiB– 0.0 %32.3 %2.2 %0 B2.70 GiB13.0 %0
bench-validator-04validator3.44 GiB2.88 GiB– 0.0 %32.5 %2.1 %0 B2.70 GiB14.0 %0
bench-validator-05validator3.33 GiB3.00 GiB– 0.0 %25.8 %1.7 %0 B2.70 GiB14.0 %0
bench-validator-06validator4.83 GiB2.85 GiB– 0.0 %31.5 %2.6 %0 B2.70 GiB14.0 %0
bench-validator-07validator4.64 GiB2.77 GiB– 0.0 %32.6 %2.7 %0 B2.70 GiB13.0 %0
bench-validator-08validator4.03 GiB2.79 GiB– 0.0 %33.2 %2.2 %0 B2.70 GiB13.0 %0
bench-validator-09validator3.16 GiB2.77 GiB– 0.0 %33.1 %2.7 %0 B2.70 GiB13.0 %0
bench-validator-10validator4.08 GiB2.77 GiB– 0.0 %32.4 %2.0 %0 B2.70 GiB13.0 %0

RssAnon vs RssFile

/proc/<pid>/status of the telcoin process on the node with the largest RSS

consensus-db/cache size

Not collected: consensus-db/cache size.

Pressure stall (some, avg10)

/proc/pressure on the node with the highest memory PSI

Headroom

Per role and per node, from sizing.json (p95 over the landed window; PSI and RssAnon max over the whole sampler run). The lines follow the hardware doc's tier rules: CPU p95 over 70 % of vCPUs; memory used p95 over 75 % of RAM, or telcoin RSS p95 over 85 % of RAM; disk write p95 over 60 % of the PD MiB/s limit, or write IOPS p95 over 60 % of the IOPS limit; IO pressure over 20 % or memory pressure over 5 % (PSI some avg10, max); network p95 over 50 % of 1 Gbps; root disk over 80 %. A line crossed on any node puts the role at the limit; a nonzero reading within 15 points of its line is tight; otherwise the role has headroom. OOM kills, disk throttling and degraded disk performance are flagged too.

SignalClassWorst nodeValueShare of capacityLineNodes over / tightStatus
CPU p95validatorbench-validator-0927.4 %27.4 %> 70 %0 / 0 headroom
Memory used p95validatorbench-validator-0634.8 %34.8 %> 75 %0 / 0 headroom
telcoin RSS p95validatorbench-validator-067.83 GB45.6 %> 85 %0 / 0 headroom
PSI memory maxvalidatorbench-validator-010.0 %0.0 %> 5 %0 / 0 headroom
RssAnon peakvalidatorbench-validator-065.18 GB30.2 %info– info
Disk write p95validatorbench-validator-02613 MB/s73.1 %> 60 %9 / 1 at the limit
Write IOPS p95validatorbench-validator-0510,29251.5 %> 60 %0 / 1 tight
PSI io maxvalidatorbench-validator-0833.2 %33.2 %> 20 %10 / 0 at the limit
Root disk maxvalidatorbench-validator-0513.3 %13.3 %> 80 %0 / 0 headroom
Network p95validatorbench-validator-07113 Mbps11.3 %> 50 %0 / 0 headroom
Consensus cache peakvalidator–––info– not collected
OOM killsvalidator––anyany– none
Disk throttlingvalidator––metric type unavailable in projectany– not collected
Disk performance degradedvalidator––any sampleany– none
CPU p95observerbench-observer-1114.3 %14.3 %> 70 %0 / 0 headroom
Memory used p95observerbench-observer-1111.0 %11.0 %> 75 %0 / 0 headroom
telcoin RSS p95observerbench-observer-113.45 GB20.1 %> 85 %0 / 0 headroom
PSI memory maxobserverbench-observer-110.0 %0.0 %> 5 %0 / 0 headroom
RssAnon peakobserverbench-observer-110.88 GB5.1 %info– info
Disk write p95observerbench-observer-11526 MB/s62.8 %> 60 %1 / 0 at the limit
Write IOPS p95observerbench-observer-115,49327.5 %> 60 %0 / 0 headroom
PSI io maxobserverbench-observer-1132.0 %32.0 %> 20 %1 / 0 at the limit
Root disk maxobserverbench-observer-1112.1 %12.1 %> 80 %0 / 0 headroom
Network p95observerbench-observer-115 Mbps0.5 %> 50 %0 / 0 headroom
Consensus cache peakobserver–––info– not collected
OOM killsobserver––anyany– none
Disk throttlingobserver––metric type unavailable in projectany– not collected
Disk performance degradedobserver––any sampleany– none

Per node

NodeClassCPU p95Memory used p95telcoin RSS p95PSI memory maxRssAnon peakDisk write p95Write IOPS p95PSI io maxRoot disk maxNetwork p95Consensus cache peak
Line> 70 %> 75 %> 85 %> 5 %info> 60 %> 60 %> 20 %> 80 %> 50 %info
bench-validator-01validator27.1 %29.7 %6.99 GB 41 %0.0 %4.19 GB 24 %606 MB/s 72 %2,782 14 %32.2 %12.9 %104 Mbps 10 %–
bench-validator-02validator25.5 %29.7 %6.96 GB 41 %0.0 %4.11 GB 24 %613 MB/s 73 %2,810 14 %32.8 %12.9 %94 Mbps 9 %–
bench-validator-03validator27.1 %25.6 %6.28 GB 37 %0.0 %3.42 GB 20 %604 MB/s 72 %2,797 14 %32.3 %13.0 %97 Mbps 10 %–
bench-validator-04validator24.6 %27.0 %6.56 GB 38 %0.0 %3.69 GB 21 %608 MB/s 72 %2,784 14 %32.5 %13.1 %93 Mbps 9 %–
bench-validator-05validator25.7 %25.2 %6.40 GB 37 %0.0 %3.64 GB 21 %483 MB/s 58 %10,292 51 %25.8 %13.3 %94 Mbps 9 %–
bench-validator-06validator26.3 %34.8 %7.83 GB 46 %0.0 %5.18 GB 30 %611 MB/s 73 %2,911 15 %31.5 %13.0 %91 Mbps 9 %–
bench-validator-07validator27.0 %34.3 %7.78 GB 45 %0.0 %4.98 GB 29 %607 MB/s 72 %3,064 15 %32.6 %13.0 %113 Mbps 11 %–
bench-validator-08validator24.9 %30.7 %7.19 GB 42 %0.0 %4.32 GB 25 %609 MB/s 73 %2,800 14 %33.2 %13.0 %92 Mbps 9 %–
bench-validator-09validator27.4 %25.6 %6.26 GB 36 %0.0 %3.39 GB 20 %602 MB/s 72 %2,762 14 %33.1 %13.0 %101 Mbps 10 %–
bench-validator-10validator26.6 %31.1 %7.21 GB 42 %0.0 %4.38 GB 26 %608 MB/s 73 %2,804 14 %32.4 %13.0 %94 Mbps 9 %–
bench-observer-11observer14.3 %11.0 %3.45 GB 20 %0.0 %0.88 GB 5 %526 MB/s 63 %5,493 27 %32.0 %12.1 %5 Mbps 1 %–

Small figures are the share of capacity: RAM for RSS, the PD limit for disk write (VM cap applied), 1 Gbps for network. Hover a cell for its JSON path.

Verdict

Fleet A vs Fleet B

A = Fleet c3-hdb · c3-highcpu-8 · r20261103-1922
B = Fleet c3-hdb · c3-highcpu-8 · r20261007-0316

Verdict

at the limit c3-highcpu-8 validators at 7,599 sustained TPS: at the limit on disk. Disk at the limit: write p95 602–613 MB/s, up to 73.1 % of the 800 MiB/s limit, over the 60 % line on 9 of 10 validators (bench-validator-01, 02, 03, 04, 06, 07, 08, 09, 10); IO pressure (PSI some avg10) max 25.8–33.2 %, over the 20 % line on all 10 validators (bench-validator-01, 02, 03, 04, 05, 06, 07, 08, 09, 10); write IOPS p95 10,292, 51.5 % of the 20,000 IOPS limit (bench-validator-05), tight against the 60 % line. CPU has headroom: CPU p95 27.4 % of 8 vCPUs (bench-validator-09). Memory has headroom: memory used p95 34.8 % of RAM (bench-validator-06); telcoin RSS p95 7.83 GB, 45.6 % of 16 GiB RAM (bench-validator-06); memory pressure (PSI some avg10) max 0.0 % (bench-validator-01). Network has headroom: network p95 113 Mbps, 11.3 % of 1 Gbps (bench-validator-07). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).

at the limit c3-highcpu-8 observers at 7,599 sustained TPS: at the limit on disk. Disk at the limit: write p95 526 MB/s, 62.8 % of the 800 MiB/s limit on bench-observer-11, over the 60 % line; IO pressure (PSI some avg10) max 32.0 % on bench-observer-11, over the 20 % line. CPU has headroom: CPU p95 14.3 % of 8 vCPUs (bench-observer-11). Memory has headroom: memory used p95 11.0 % of RAM (bench-observer-11); telcoin RSS p95 3.45 GB, 20.1 % of 16 GiB RAM (bench-observer-11); memory pressure (PSI some avg10) max 0.0 % (bench-observer-11). Network has headroom: network p95 5 Mbps, 0.5 % of 1 Gbps (bench-observer-11). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).

at the limit c3-highcpu-8 validators at 6,910 sustained TPS: at the limit on disk. Disk at the limit: write IOPS p95 16,653–17,933, up to 89.7 % of the 20,000 IOPS limit, over the 60 % line on all 10 validators (bench-validator-01, 02, 03, 04, 05, 06, 07, 08, 09, 10); IO pressure (PSI some avg10) max 20.4–22.7 %, over the 20 % line on 6 of 10 validators (bench-validator-02, 04, 05, 06, 09, 10); write p95 446 MB/s, 53.1 % of the 800 MiB/s limit (bench-validator-10), tight against the 60 % line. Memory tight: memory pressure (PSI some avg10) max 0.3 % (bench-validator-09), tight against the 5 % line. CPU has headroom: CPU p95 45.9 % of 8 vCPUs (bench-validator-01). Network has headroom: network p95 120 Mbps, 12.0 % of 1 Gbps (bench-validator-08). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).

at the limit c3-highcpu-8 observers at 6,910 sustained TPS: at the limit on disk. Disk at the limit: write IOPS p95 16,262, 81.3 % of the 20,000 IOPS limit on bench-observer-11, over the 60 % line; write p95 444 MB/s, 52.9 % of the 800 MiB/s limit (bench-observer-11), tight against the 60 % line; IO pressure (PSI some avg10) max 17.0 % (bench-observer-11), tight against the 20 % line. CPU has headroom: CPU p95 17.3 % of 8 vCPUs (bench-observer-11). Memory has headroom: memory used p95 11.7 % of RAM (bench-observer-11); telcoin RSS p95 4.56 GB, 26.5 % of 16 GiB RAM (bench-observer-11); memory pressure (PSI some avg10) max 0.0 % (bench-observer-11). Network has headroom: network p95 6 Mbps, 0.6 % of 1 Gbps (bench-observer-11). Next step: a faster volume (pd-ssd adds 30 IOPS and 0.48 MiB/s per GB up to the per-VM cap; past the cap, a larger VM).

Validators: Fleet A (c3-highcpu-8) is at the limit on disk, with headroom on CPU, memory and network; Fleet B (c3-highcpu-8) is at the limit on disk, tight on memory, with headroom on CPU and network. The same disk limit binds both fleets: every validator runs a 100 GB hyperdisk-balanced, which allows 20,000 IOPS on both; its throughput limit is 800 MiB/s on both. Disk is at the limit on both (Fleet A (c3-highcpu-8): write p95 613 MB/s, 73.1 % of the 800 MiB/s limit, IO pressure (PSI some avg10) max 33.2 %; Fleet B (c3-highcpu-8): write IOPS p95 17,933, 89.7 % of the 20,000 IOPS limit, IO pressure (PSI some avg10) max 22.7 %). Changing the machine shape did not clear it; the volume is the binding resource.

Observers: Fleet A (c3-highcpu-8) is at the limit on disk, with headroom on CPU, memory and network; Fleet B (c3-highcpu-8) is at the limit on disk, with headroom on CPU, memory and network. The same disk limit binds both fleets: every observer runs a 100 GB hyperdisk-balanced, which allows 20,000 IOPS on both; its throughput limit is 800 MiB/s on both. Disk is at the limit on both (Fleet A (c3-highcpu-8): write p95 526 MB/s, 62.8 % of the 800 MiB/s limit, IO pressure (PSI some avg10) max 32.0 %; Fleet B (c3-highcpu-8): write IOPS p95 16,262, 81.3 % of the 20,000 IOPS limit). Changing the machine shape did not clear it; the volume is the binding resource.

KPIFleet AFleet BB ÷ A
Sustained mixed TPS (own)7,599.3 tx/s6,909.7 tx/s0.91×
Sustained mixed TPS (chain)7,599.3 tx/s6,909.7 tx/s0.91×
Landed / accepted99.6 %99.7 %1.00×
Reverted (own)00–
Latency p503,494 ms2,441 ms0.70×
Latency p9514,173 ms12,564 ms0.89×
Gas / s (own)198M gas/s268M gas/s1.35×
Capacity at mix8,037.3 tx/s11,256.8 tx/s1.40×

Headroom, worst node per class

SignalClassFleet AFleet BLine
CPU p95validator27.4 % headroom45.9 % headroom> 70 %
Memory used p95validator34.8 % headroom46.5 % headroom> 75 %
telcoin RSS p95validator7.83 GB 45.6 % headroom9.83 GB 57.2 % headroom> 85 %
PSI memory maxvalidator0.0 % headroom0.3 % tight> 5 %
Disk write p95validator613 MB/s 73.1 % at the limit446 MB/s 53.1 % tight> 60 %
Write IOPS p95validator10,292 51.5 % tight17,933 89.7 % at the limit> 60 %
PSI io maxvalidator33.2 % at the limit22.7 % at the limit> 20 %
Root disk maxvalidator13.3 % headroom46.6 % headroom> 80 %
Network p95validator113 Mbps 11.3 % headroom120 Mbps 12.0 % headroom> 50 %
CPU p95observer14.3 % headroom17.3 % headroom> 70 %
Memory used p95observer11.0 % headroom11.7 % headroom> 75 %
telcoin RSS p95observer3.45 GB 20.1 % headroom4.56 GB 26.5 % headroom> 85 %
PSI memory maxobserver0.0 % headroom0.0 % headroom> 5 %
Disk write p95observer526 MB/s 62.8 % at the limit444 MB/s 52.9 % tight> 60 %
Write IOPS p95observer5,493 27.5 % headroom16,262 81.3 % at the limit> 60 %
PSI io maxobserver32.0 % at the limit17.0 % tight> 20 %
Root disk maxobserver12.1 % headroom15.9 % headroom> 80 %
Network p95observer5 Mbps 0.5 % headroom6 Mbps 0.6 % headroom> 50 %

Own TPS, trailing 60-s mean

aligned on each fleet's mixed-phase start

CPU, hottest validator

aligned on each fleet's mixed-phase start

Memory used, hottest validator

aligned on each fleet's mixed-phase start

telcoin RSS, hottest validator

aligned on each fleet's mixed-phase start

Disk MiB/s, hottest validator

aligned on each fleet's mixed-phase start

Network sent, hottest validator

aligned on each fleet's mixed-phase start

Reference chains

Not collected: reference chains.