STORAGE PERFORMANCE

RAID, Storage Performance and Resilience Playbook

Usable capacity, failure tolerance, rebuild risk, IOPS, latency, cache and why RAID is not backup.

RAID solves a different problem from backup

RAID capacity and failure tolerance are separate decisions
RAID 5 DataDataParity 1 drive equivalent for parity RAID 10 AA mirrorBB mirror Striped mirrors, about 50% raw capacity RAID improves availability. It is not an independent backup.

RAID can keep a storage set available after certain drive failures. It does not protect against accidental deletion, ransomware, corruption copied across the array, fire, theft or a failed storage controller that destroys data. A backup should be independently recoverable.

Capacity formulas using equal-size drives

LayoutUsable capacityBasic failure toleranceNotes
RAID 0N x SNoneAny member failure loses the array.
RAID 1, two drivesSOne driveMirrored pair.
RAID 5(N - 1) x SOne driveDistributed parity.
RAID 6(N - 2) x STwo drivesDual parity.
RAID 10(N / 2) x SDepends which members failStriped mirrored pairs, even drive count.

N is the drive count and S is the capacity of the smallest member drive. Controller metadata, filesystem overhead, decimal/binary units and spare drives reduce usable capacity further.

Why RAID 5 and RAID 6 writes can cost more

Parity RAID must maintain parity information when data changes. Depending on controller, workload and write size, this can involve reading existing data/parity and writing updated data/parity, or reconstructing full-stripe parity. The practical result is that small random writes can behave very differently from sequential reads.

RAID 10

RAID 10 avoids parity calculations and provides mirrored redundancy with striping across mirror sets. It uses about half the raw equal-drive capacity. It can survive more than one failed drive only when the failed drives are in different mirror pairs. It is not correct to say RAID 10 always tolerates any two drive failures.

Rebuilds

A degraded array runs with reduced redundancy and may have lower performance. Rebuild time depends on drive size, drive speed, controller behaviour, workload and rebuild priority. Large-capacity drives can take substantial time to rebuild under production load. Monitor the array until it returns to a protected state.

Hot spare

A hot spare lets the controller begin rebuilding without waiting for a technician to install a replacement, if the controller and policy support that behaviour. It does not add active usable capacity while idle, and it does not replace a backup.

Performance terms

  • IOPS: operations completed per second.
  • Latency: time taken to complete an I/O request.
  • Throughput: amount of data transferred per second.
  • Queue depth: number of outstanding I/O requests presented to a device or path.

High IOPS with poor latency can still produce a bad application experience. Large sequential transfers and small random database I/O are different workloads and should not be compared using one benchmark number.

Cache

Controller write-back cache can improve perceived write latency because data is acknowledged before it reaches the slower media. Safe write-back operation depends on protected cache and the controller/storage design. Do not enable unsafe write-back caching simply to make a benchmark look better.

Storage commissioning

  1. Confirm physical drives and firmware are recognised.
  2. Confirm intended RAID layout and hot-spare policy.
  3. Verify logical volume size.
  4. Run a consistency/background initialisation process if required by the controller.
  5. Measure workload-relevant performance, not only sequential throughput.
  6. Test alerting for failed/degraded drive state.
  7. Verify backup and restore separately from RAID health.

Storage Architecture Playbook | RAID Capacity Calculator | Server Hard Drives | Server SSD Drives