Aarkam - SAT (Standalone Tier Primary Substrate) Consensus & Fabric AM CLI • ARK-CLI-0302

Cluster, Quorum & Fabric Network Commands

Authoritative command reference for am cluster, am mon (Raft Quorum), am network (Latency Mesh), and am upgrade.

Last updated: Nov 03, 2026 Classification: Sovereign Tier-4 Enterprise

---
title: "Cluster, Quorum & Fabric Network Commands"
description: "Authoritative command reference for am cluster, am mon (Raft Quorum), am network (Latency Mesh), and am upgrade."
category: "AM CLI"
order: 2
badge: "Consensus & Fabric"
icon: "command"
documentId: "ARK-CLI-0302"
status: "Production Standard"
classification: "Sovereign Tier-4 Enterprise"
version: "V-1.0.0-GA (Production Stable)"
readingTime: "4 min read"
audience: "Storage SREs, Network Engineers & Cluster Operators"
scope: "Aarkam Standalone (SAT) & Storage Centers (SCT)"
tier: "Aarkam - SAT (Standalone Tier Primary Substrate)"
---

<div class="wiki-spec-card">
  <div class="wiki-spec-grid">
    <div class="wiki-spec-item">
      <span class="wiki-spec-label">Document Identifier</span>
      <span class="wiki-spec-value text-[#10B981]">ARK-CLI-0302</span>
    </div>
    <div class="wiki-spec-item">
      <span class="wiki-spec-label">Standard Status</span>
      <div><span class="status-pill status-normative">Production Standard</span></div>
    </div>
    <div class="wiki-spec-item">
      <span class="wiki-spec-label">Architecture Tier</span>
      <span class="wiki-spec-value text-amber-300">Aarkam - SAT (Storage Substrate)</span>
    </div>
    <div class="wiki-spec-item">
      <span class="wiki-spec-label">Release Version</span>
      <span class="wiki-spec-value text-cyan-300">V-1.0.0-GA (Production Stable)</span>
    </div>
  </div>
</div>

<div class="wiki-alert wiki-alert-note my-4 p-4 rounded-xl border border-emerald-500/20 bg-emerald-500/5 text-xs text-slate-300">
  <strong class="text-emerald-400 block mb-1">Architecture Tier Scope: Aarkam - SAT (Standalone Tier)</strong>
  These commands interact directly with the <strong>Rokka Coordinator MON Quorum</strong> and consensus daemons. They govern low-level cluster membership, Raft term leadership, network latency meshes, and safe rolling software upgrades across the storage substrate.
</div>

<p>This reference provides production syntax, options, and operational snippets for managing holistic cluster topology, Raft consensus monitors, network transport verification, and software upgrades using <code>am</code>.</p>

<hr />

<h2 id="am-cluster">1. <code>am cluster</code> — Topology, Capacity &amp; Doctor</h2>
<p>The <code>am cluster</code> suite manages global topology epochs, membership registration, quorum health, and automated diagnostic scorecards.</p>

<h3 id="cluster-status">1.1 <code>am cluster status</code></h3>
<p>Interrogates the coordinator and Raft consensus leader to output active epoch, monitor leadership, online storage nodes, and raw capacity:</p>
<div class="wiki-code-block relative group my-3 rounded-xl border border-slate-800 bg-[#060a14] overflow-hidden">
  <div class="code-header flex items-center justify-between px-3 py-1.5 bg-slate-900/90 border-b border-slate-800 text-[10px] font-mono text-slate-400">
    <span class="uppercase font-bold text-emerald-400">bash</span>
    <button type="button" onclick="copyCodeSnippet(this)" class="hover:text-white px-2 py-0.5 rounded bg-slate-800 border border-slate-700 transition cursor-pointer print:hidden">Copy</button>
  </div>
  <pre class="p-3.5 overflow-x-auto text-xs font-mono text-slate-200 leading-relaxed m-0"><code class="language-bash"># Summary status
am cluster status

# Detailed per-node breakdown with Kdouja sync state
am cluster status --detailed

# Live refresh mode during maintenance
am cluster status --watch 3s</code></pre>
</div>

<h3 id="cluster-health">1.2 <code>am cluster health</code></h3>
<p>Machine-verifiable health check with strict exit code guarantees (<code>0</code> for Healthy, <code>8</code> for Degraded/Critical):</p>
<div class="wiki-code-block relative group my-3 rounded-xl border border-slate-800 bg-[#060a14] overflow-hidden">
  <div class="code-header flex items-center justify-between px-3 py-1.5 bg-slate-900/90 border-b border-slate-800 text-[10px] font-mono text-slate-400">
    <span class="uppercase font-bold text-emerald-400">bash</span>
    <button type="button" onclick="copyCodeSnippet(this)" class="hover:text-white px-2 py-0.5 rounded bg-slate-800 border border-slate-700 transition cursor-pointer print:hidden">Copy</button>
  </div>
  <pre class="p-3.5 overflow-x-auto text-xs font-mono text-slate-200 leading-relaxed m-0"><code class="language-bash">am cluster health --strict --min-nodes 4</code></pre>
</div>

<h3 id="cluster-doctor">1.3 <code>am cluster doctor</code></h3>
<p>Automated 5-point fabric diagnostic scanner evaluating Raft consensus, node capacity headroom (&gt;15% free), rack failure domain diversity, and CPU SIMD acceleration (AVX2 / AVX-512):</p>
<div class="wiki-code-block relative group my-3 rounded-xl border border-slate-800 bg-[#060a14] overflow-hidden">
  <div class="code-header flex items-center justify-between px-3 py-1.5 bg-slate-900/90 border-b border-slate-800 text-[10px] font-mono text-slate-400">
    <span class="uppercase font-bold text-emerald-400">bash</span>
    <button type="button" onclick="copyCodeSnippet(this)" class="hover:text-white px-2 py-0.5 rounded bg-slate-800 border border-slate-700 transition cursor-pointer print:hidden">Copy</button>
  </div>
  <pre class="p-3.5 overflow-x-auto text-xs font-mono text-slate-200 leading-relaxed m-0"><code class="language-bash">am cluster doctor</code></pre>
</div>

<h3 id="cluster-register-remove">1.4 Node Registration &amp; Removal</h3>
<div class="wiki-code-block relative group my-3 rounded-xl border border-slate-800 bg-[#060a14] overflow-hidden">
  <div class="code-header flex items-center justify-between px-3 py-1.5 bg-slate-900/90 border-b border-slate-800 text-[10px] font-mono text-slate-400">
    <span class="uppercase font-bold text-emerald-400">bash</span>
    <button type="button" onclick="copyCodeSnippet(this)" class="hover:text-white px-2 py-0.5 rounded bg-slate-800 border border-slate-700 transition cursor-pointer print:hidden">Copy</button>
  </div>
  <pre class="p-3.5 overflow-x-auto text-xs font-mono text-slate-200 leading-relaxed m-0"><code class="language-bash"># Register newly provisioned node
am cluster register-node storage-05 https://10.0.1.15:57775 --int-id 5 --type NVMe

# Evict decommissioned node from topology
am cluster remove-node storage-old-01 --yes</code></pre>
</div>

<hr />

<h2 id="am-mon">2. <code>am mon</code> — Raft Consensus &amp; Election Control</h2>
<p>The <code>am mon</code> suite inspects and administers the Raft consensus group operating on Port <code>57777</code> / <code>57774</code>:</p>

<h3 id="mon-status-peers">2.1 Inspect Quorum Status &amp; Peers</h3>
<div class="wiki-code-block relative group my-3 rounded-xl border border-slate-800 bg-[#060a14] overflow-hidden">
  <div class="code-header flex items-center justify-between px-3 py-1.5 bg-slate-900/90 border-b border-slate-800 text-[10px] font-mono text-slate-400">
    <span class="uppercase font-bold text-emerald-400">bash</span>
    <button type="button" onclick="copyCodeSnippet(this)" class="hover:text-white px-2 py-0.5 rounded bg-slate-800 border border-slate-700 transition cursor-pointer print:hidden">Copy</button>
  </div>
  <pre class="p-3.5 overflow-x-auto text-xs font-mono text-slate-200 leading-relaxed m-0"><code class="language-bash"># Display active term, leader node, and consensus state
am mon status

# Probe all peer coordinators and measure round-trip keepalives
am mon peers --ping</code></pre>
</div>

<h3 id="mon-elect-failover">2.2 Leadership Election &amp; Planned Failover</h3>
<div class="wiki-code-block relative group my-3 rounded-xl border border-slate-800 bg-[#060a14] overflow-hidden">
  <div class="code-header flex items-center justify-between px-3 py-1.5 bg-slate-900/90 border-b border-slate-800 text-[10px] font-mono text-slate-400">
    <span class="uppercase font-bold text-emerald-400">bash</span>
    <button type="button" onclick="copyCodeSnippet(this)" class="hover:text-white px-2 py-0.5 rounded bg-slate-800 border border-slate-700 transition cursor-pointer print:hidden">Copy</button>
  </div>
  <pre class="p-3.5 overflow-x-auto text-xs font-mono text-slate-200 leading-relaxed m-0"><code class="language-bash"># Transfer leadership to nominated peer prior to node reboot
am mon elect --target coord-02 --force</code></pre>
</div>

<hr />

<h2 id="am-network">3. <code>am network</code> — Fabric Transport, MTU &amp; Latency Mesh</h2>
<p>Verifies inter-node high-bandwidth storage fabrics, Jumbo Frame support, and fabric-wide latency matrices:</p>

<div class="wiki-code-block relative group my-3 rounded-xl border border-slate-800 bg-[#060a14] overflow-hidden">
  <div class="code-header flex items-center justify-between px-3 py-1.5 bg-slate-900/90 border-b border-slate-800 text-[10px] font-mono text-slate-400">
    <span class="uppercase font-bold text-emerald-400">bash</span>
    <button type="button" onclick="copyCodeSnippet(this)" class="hover:text-white px-2 py-0.5 rounded bg-slate-800 border border-slate-700 transition cursor-pointer print:hidden">Copy</button>
  </div>
  <pre class="p-3.5 overflow-x-auto text-xs font-mono text-slate-200 leading-relaxed m-0"><code class="language-bash"># Ping target storage node over gRPC
am network ping storage-02

# Generate cluster-wide latency mesh table
am network matrix

# Test MTU 9000 (Jumbo Frames) payload transmission
am network mtu-test --size 9000</code></pre>
</div>

<hr />

<h2 id="am-upgrade">4. <code>am upgrade</code> — Zero-Downtime Rolling Upgrades</h2>
<p>Safely plans, validates, and coordinates rolling binary upgrades across the storage substrate without downtime:</p>

<div class="wiki-code-block relative group my-3 rounded-xl border border-slate-800 bg-[#060a14] overflow-hidden">
  <div class="code-header flex items-center justify-between px-3 py-1.5 bg-slate-900/90 border-b border-slate-800 text-[10px] font-mono text-slate-400">
    <span class="uppercase font-bold text-emerald-400">bash</span>
    <button type="button" onclick="copyCodeSnippet(this)" class="hover:text-white px-2 py-0.5 rounded bg-slate-800 border border-slate-700 transition cursor-pointer print:hidden">Copy</button>
  </div>
  <pre class="p-3.5 overflow-x-auto text-xs font-mono text-slate-200 leading-relaxed m-0"><code class="language-bash"># 1. Generate safe sequential upgrade plan
am upgrade plan --package /opt/releases/aarkam-v1.0.0.tar.gz

# 2. Apply rolling upgrade node by node with health gating
am upgrade apply --yes

# 3. Verify cluster protocol version
am upgrade verify</code></pre>
</div>

Document Identifier ARK-CLI-0302

Standard Status

Production Standard

Architecture Tier Aarkam - SAT (Storage Substrate)

Release Version V-1.0.0-GA (Production Stable)

Architecture Tier Scope: Aarkam - SAT (Standalone Tier) These commands interact directly with the Rokka Coordinator MON Quorum and consensus daemons. They govern low-level cluster membership, Raft term leadership, network latency meshes, and safe rolling software upgrades across the storage substrate.

This reference provides production syntax, options, and operational snippets for managing holistic cluster topology, Raft consensus monitors, network transport verification, and software upgrades using am.

1. `am cluster` — Topology, Capacity & Doctor

The am cluster suite manages global topology epochs, membership registration, quorum health, and automated diagnostic scorecards.

1.1 `am cluster status`

Interrogates the coordinator and Raft consensus leader to output active epoch, monitor leadership, online storage nodes, and raw capacity:

bash

# Summary status
am cluster status

# Detailed per-node breakdown with Kdouja sync state
am cluster status --detailed

# Live refresh mode during maintenance
am cluster status --watch 3s

1.2 `am cluster health`

Machine-verifiable health check with strict exit code guarantees (0 for Healthy, 8 for Degraded/Critical):

bash

am cluster health --strict --min-nodes 4

1.3 `am cluster doctor`

Automated 5-point fabric diagnostic scanner evaluating Raft consensus, node capacity headroom (>15% free), rack failure domain diversity, and CPU SIMD acceleration (AVX2 / AVX-512):

bash

am cluster doctor

1.4 Node Registration & Removal

bash

# Register newly provisioned node
am cluster register-node storage-05 https://10.0.1.15:57775 --int-id 5 --type NVMe

# Evict decommissioned node from topology
am cluster remove-node storage-old-01 --yes

2. `am mon` — Raft Consensus & Election Control

The am mon suite inspects and administers the Raft consensus group operating on Port 57777 / 57774:

2.1 Inspect Quorum Status & Peers

bash

# Display active term, leader node, and consensus state
am mon status

# Probe all peer coordinators and measure round-trip keepalives
am mon peers --ping

2.2 Leadership Election & Planned Failover

bash

# Transfer leadership to nominated peer prior to node reboot
am mon elect --target coord-02 --force

3. `am network` — Fabric Transport, MTU & Latency Mesh

Verifies inter-node high-bandwidth storage fabrics, Jumbo Frame support, and fabric-wide latency matrices:

bash

# Ping target storage node over gRPC
am network ping storage-02

# Generate cluster-wide latency mesh table
am network matrix

# Test MTU 9000 (Jumbo Frames) payload transmission
am network mtu-test --size 9000

4. `am upgrade` — Zero-Downtime Rolling Upgrades

Safely plans, validates, and coordinates rolling binary upgrades across the storage substrate without downtime:

bash

# 1. Generate safe sequential upgrade plan
am upgrade plan --package /opt/releases/aarkam-v1.0.0.tar.gz

# 2. Apply rolling upgrade node by node with health gating
am upgrade apply --yes

# 3. Verify cluster protocol version
am upgrade verify

← Previous Article

AM CLI Architecture & Global Execution Reference

Storage Fleet, Nodes & Volumes Reference

Cluster, Quorum & Fabric Network Commands

1. am cluster — Topology, Capacity & Doctor

1.1 am cluster status

1.2 am cluster health

1.3 am cluster doctor

1.4 Node Registration & Removal

2. am mon — Raft Consensus & Election Control

2.1 Inspect Quorum Status & Peers

2.2 Leadership Election & Planned Failover

3. am network — Fabric Transport, MTU & Latency Mesh

4. am upgrade — Zero-Downtime Rolling Upgrades

1. `am cluster` — Topology, Capacity & Doctor

1.1 `am cluster status`

1.2 `am cluster health`

1.3 `am cluster doctor`

2. `am mon` — Raft Consensus & Election Control

3. `am network` — Fabric Transport, MTU & Latency Mesh

4. `am upgrade` — Zero-Downtime Rolling Upgrades