Team Leader - Nutanix Technology Champion - Nutanix NTC Storyteller

Julien DUMUR
Infrastructure in a Nutshell
Hyperconvergence, the end of the monolithic era

I will never forget the day the reality of hyperconvergence hit me. We were in the middle of an infrastructure migration. On one side, we had two full 42U racks from the 3-tier era, packed with servers and storage arrays. On the other side, to replace them, we only needed… 6U.

Two 2U Nutanix blocks (with 4 nodes in each block) and two Top of Rack switches. That was it. 84 rack units reduced to 6. The contrast was so violent it almost felt suspicious. How could such a small physical footprint replace our historic cabinets?

But make no mistake. Beneath this apparent simplicity lay a major technological rupture. We had moved from a “Hardware-Defined” era, where intelligence resided in expensive proprietary ASICs, to a “Software-Defined” era.

This void in the racks wasn’t just aesthetic. It told another story: one of exploding density, radically changing the economic equation of the datacenter. Less cooling, less floor space, less power consumption for tenfold computing power. The storage array hadn’t disappeared: it had been absorbed and virtualized by software.

Legacy architecture footprint versus hyperconvergence

The Legacy of Web Giants

To understand where this magic comes from, we have to go back to the early 2000s, far from air-conditioned enterprise server rooms, into the labs of Google and Amazon.

At that time, these giants were hitting a wall: the 3-tier model didn’t scale. To index the entire web, using traditional storage arrays like EMC or NetApp would have cost an astronomical amount. They had to find another way.

Their stroke of genius was to flip the table. Instead of buying “Premium” hardware designed never to fail (and sold at a gold price), they decided to use “Commodity Hardware”. Standard x86 servers, cheap, almost disposable.

The philosophy changed completely: hardware will fail. It is a statistical certainty. Rather than fighting this reality with redundant components, they decided to manage failure at the software level.

For purists and tech historians, the founding moment is captured in a PDF document published in October 2003: The Google File System (SOSP’03). This research paper is the bible of modern infrastructure. It describes a system where thousands of unreliable hard drives are aggregated by intelligent software that ensures resilience. If a drive dies? The system doesn’t care. No need to rush to replace the disk at 3 AM. The software has already replicated the data elsewhere.

Hyperconvergence is simply the arrival of this “Web Scale” technology, packaged and democratized for our enterprises.

Anatomy of an HCI Node: How Does It Work?

Concretely, what changes at the hardware level? In a hyperconverged infrastructure, we no longer separate Compute and Storage. Everything is reunited in the same chassis, called a “Node”.

Each node contains its own processors, RAM, and its own disks (SSD, NVMe, HDD). But unlike a classic server, these disks aren’t just for installing the local OS. They are aggregated with the disks of other nodes in the cluster to form a global storage pool.

This is where the real revolution comes in: the CVM (Controller VM).

Imagine taking the physical controllers of your old SAN array (the compute part) and turning them into software. On each physical server in the cluster, a special virtual machine (the CVM) runs permanently. It is the conductor.

For the technical expert, the feat lies in hardware management. The hypervisor (ESXi or AHV) does not manage the storage disks. Thanks to a technology called PCI Passthrough (or I/O Passthrough), the CVM bypasses the hypervisor to speak directly to the disks. Result: raw performance without the classic virtualization overhead.

Cutaway of an HCI node with the CVM and PCI Passthrough

The Strengths of Hyperconvergence

Beyond the hype, three technical arguments have hit the mark in enterprises.

1. Scale-Out (The LEGO Approach)

Gone is the headache of 5-year sizing. With 3-Tier, when the array was full, it was panic mode (Scale-Up). With HCI, if you need more resources, you buy a new node and plug it in. The cluster automatically absorbs the new CPU power and storage capacity. It is linear and predictable growth.

Scale-out by stacking nodes

2. Data Locality

This is the Holy Grail of performance. In a classic architecture, data had to cross the SAN network to reach the processor. With HCI, software intelligence ensures that data used by a VM is (whenever possible) stored on the disks of the physical server where it is running. The path is near-instantaneous. The network is no longer a bottleneck.

3. Distributed Rebuild (Many-to-Many)

This is often the argument that finally convinces administrators traumatized by RAID rebuilds. On a classic array (RAID 5 or 6), if a 4TB drive breaks, a single “hot spare” drive has to rewrite everything. This can take days, during which performance collapses. In HCI, data is replicated in chunks all over the cluster. If a drive dies, all other disks in all other nodes participate simultaneously in reconstructing the missing data. We move from a “1 to 1” problem to a “Many to Many” solution. Result: resilience is restored in minutes.

Classic RAID rebuild versus HCI distributed rebuild

The Weaknesses: What Marketing Forgets to Mention

If hyperconvergence seems magical, it is not without flaws. As an expert, it is crucial to understand the trade-offs of this architecture.

The first is the “CVM Tax”. Intelligence isn’t free. Since the storage controller is now software, it consumes CPU and RAM resources that are no longer available for your applications. On very small clusters, reserving 20GB or 24GB of RAM per node just to “run the shop” can seem heavy, even if it is the price of peace of mind.

The second technical limitation is the critical dependence on “East-West” network traffic. In a 3-Tier array, replication traffic remained confined within the array. In HCI, to secure data (RF2 or RF3), the CVM must write it locally but also immediately send it over the network to another node. If your 10/25 GbE network is unstable or poorly configured, the entire performance and stability of the cluster collapses. The network is no longer a simple commodity; it is the nervous system of your cluster. I repeat it to every client: an HCI cluster is 80% network. If your network has a problem, your HCI cluster has a problem.

Nutanix, The Pioneer

Hyperconvergence marked the end of an era. It proved that software could supplant specialized hardware, transforming our rigid datacenters into agile private clouds.

But an idea, however brilliant (like the Google File System), is useless if it remains confined to a research lab. Someone had to take these complex concepts and make them accessible to any system administrator in less than an hour.

That is where Nutanix comes in.

Founded by former Google employees who had worked on GFS, this company created NDFS (Nutanix Distributed File System). They succeeded in the crazy bet of running a “Google-type” infrastructure on standard Dell, HP, or Lenovo servers.

How did Nutanix manage to become the undisputed leader of this market, surviving even the assault of VMware with vSAN? That is what we will dissect in the next article of this series.

Read More

This is a question that comes up regularly when people discover the Nutanix environment: “but what do all these expressions and acronyms mean?”

I took a little time to compile as many of these acronyms and technical terms as possible with their associated definitions.

There are probably some missing, but this page is destined to live in time.

AC2 – Acropolis Compute Cloud

ACS – Acropolis Container Services

ADE – Acropolis Data Encryption

ADFS – Acropolis Distributed FileSystem

ADS – Acropolis Dynamic Scheduler

AHV – Acropolis HyperVisor

AOS – Acropolis Operating System

Block awareness – When certain conditions are met, Nutanix clusters are “block aware”, which means that redundant copies of any data required to serve I/O are placed on nodes that are not in the same block

CVM – Controller Virtual Machine

FT2, FT3 – Redundancy Factor – (Fault Tolerance) – by default every Nutanix cluster has FT2, which means cluster can tolerate a loss of one node at time. With FT3, cluster can tolerate 2 nodes failures at the same time

HCI – HyperConverged Infrastructure

LWS – Nutanix Light Weight Snapshots

NC2 – Nutanix Cloud Clusters

NCC – Nutanix Cluster Check

NCM – Nutanix Cloud Manager

NGT – Nutanix Guest Tools

NIST – National Institute of Standards and Technology

Nutanix BEAM – SaaS service for multi-cloud governance platform to manage spending, security and application flow

Nutanix Buckets – Nutanix Object storage

Nutanix CE – Nutanix Community Edition – Free version of commercial Nutanix AOS

Nutanix DataBase (former Era) – PaaS offerings to streamline and automate database operations

Nutanix DVP – Nutanix Docker Volume Plugin

Nutanix Files – Nutanix file server service

Nutanix Flow – Nutanix software define networking (SDN)

Nutanix Foundation – Nutanix clusters orchestration and automation provisioning tool

Nutanix LCM – Life Cycle Management

Nutanix Leap – (former name was Nutanix Xi DR – Nutanix Enterprise Cloud)

Nutanix Metis – allows you to qualify your platform hardware for compatibility with Nutanix software

Nutanix PC – Nutanix Prism Central (multi-cluster management)

Nutanix PE – Nutanix Prism Element (single cluster management)

Nutanix Pulse – call home feature

Nutanix Self Service (former Calm) – Nutanix Cloud Application Life-cycle Management

Nutanix SSP – Nutanix Self-Service Portal

Nutanix VirtIO – Nutanix drivers for virtual machines

Nutanix Volumes – (former name was ABS – Acropolis Block Services (iSCSI block storage presented to Guest VMs))

Nutanix X-Ray – X-Ray allows users to create custom test scenarios from X-Ray’s current test scenarios to better fit your needs

Nutanix Xplorer – scans your Microsoft SQL Server instances to automatically create recommended hardware configurations and platforms, so that you can migrate your SQL Server instances to a Nutanix Cloud Platform

OVS – Open vSwitch

RBAC -Role-Based Authentication Controls

RF=2, RF=3 – Replication Factor – simply saying, with RF=2 cluster keeps 2 copies of data, with RF=3 cluster keeps 3 copies of data

SAML – Security Assertion Markup Language

SCMA – Securitu Configuration Management Automation

STIGs – Security Technical Implementation Guides

SVM – Service Virtual Machine (legacy name for CVM)

xTract – Nutanix migration tool

Read More