Scalable, resilient, highly performant storage. Today’s businesses need it, particularly for data-intensive workloads like analytics, artificial intelligence (AI), and machine learning (ML). All these workloads can significantly tax their underlying infrastructure, and scalable, high-performance storage lets organizations achieve their goals across multiple workload categories, including:

  • Data at rest (e.g., databases, data warehouses, and data lakes), which requires increased scalability, performance, and resilience.

  • Data on the move (e.g., automated data pipelines), which needs infrastructure that cuts the time needed to get to the right set of data.

  • Data in action (e.g., continuous integration and development [CI/CD], data analytics, and AI/ML), which requires ways to accelerate processes and increase the self-reliance of analysts and developers.

Start with a storage solution

Before a company embraces a storage solution, though, it’s important for that company to understand both the performance potential of that solution, as well as the workload-specific performance characteristics of the chosen infrastructure platform.

Red Hat Ceph Storage is a robust, software-defined storage solution that offers scalability, simplicity, and security features for workloads that include data analytics, media repositories, content streaming, and both OpenStack and OpenShift cloud infrastructures. Unlike many other software-defined storage solutions, Red Hat Ceph Storage supports block, object, and file storage, allowing support for a wide range of workloads and applications.

However, the performance of Red Hat Ceph Storage, like any software-defined storage, can be affected by processors, memory, and networking, as well as by the underlying storage media.

Test performance with storage media

Red Hat and Micron worked closely together to develop and evaluate Red Hat Ceph Storage solutions built with Micron all-flash storage, and Micron recently published reference architectures based on both Micron 9300 MAX NVMe SSDs and Micron 7300 MAX NVMe SSDs. Our testing used storage servers equipped with dual AMD EPYC 7002 series processors

Storage servers with Micron 9300 MAX NVMe SSDs

The Micron 9300 MAX NVMe SSD provides high performance with low latencies. It offers capacities up to 12.8TB and 32 NVMe namespaces while consistently providing read and write throughput of up to 3.5 GB/s of sequential data. 

The reference architecture using Micron 9300 Max NVMe SSDs and Red Hat Ceph Storage consumes six rack units, composed of one Ceph monitor node, four Ceph data nodes, and an Ethernet switch. Capacity per rack unit (RU) is maximized with 10 12.8TB NVMe SSDs per 1RU storage node. 

Using this reference architecture as a starting point, administrators can add data nodes, one rack unit and 128TB at a time. Block and object performance using Micron 9300 MAX NVMe SSDs and Red Hat Ceph Storage is detailed in these tables.

4KiB random block performance using Micron 9300 MAX NVMe SSDs

I/O profile

IOPS

Average latency

100% read

3,161,146

1.31ms

70%/30% read/write

1,325,888

Write: 6.2ms

Read: 1.82ms

100% write

645,655

6.44ms

 
4MiB object performance using Micron 9300 MAX NVMe SSDs

I/O profile

Throughput

Average latency

100% sequential read

41.03GiB/s

29.81ms

100% random read

43.77GiB/s

27.92ms

100% random write

19.15GiB/s

6.44ms

 

More detailed information can be found in the Micron blog describing this work, as well as in the full reference architecture utilizing Micron 9300 MAX NVMe SSDs.

Storage servers with Micron 7300 MAX NVMe SSDs

The Micron 7300 MAX NVMe SSD is an option for a lower-cost Ceph Storage solution that still provides strong performance. The Micron 7300 mainstream NVMe SSD family offers capacities of up to 8TB with up to 3GB per second of read throughput and 1.9GB per second of write throughput. 

Using the latest version of Red Hat Ceph Storage, the Micron 7300 enables more organizations to gain access to the performance of NVMe SSDs within a smaller budget. Block and object performance achieved in the reference architecture using the Micron 7300 MAX NVMe SSDs and Red Hat Ceph Storage is provided in these tables.

4KiB random block performance using Micron 7300 NVMe SSDs

I/O profile

IOPS

Average latency

100% read

2,970,481

1.42ms

70%/30% read/write

1,289,009

Write: 5.89ms

Read: 2.08ms

100% write

558,373

6.34ms

 
4MiB object performance using Micron 7300 NVMe SSDs

I/O profile

Throughput

Average latency

100% sequential read

41.22GiB/s

29.67ms

100% random read

43.77GiB/s

27.91ms

100% random write

21.8GiB/s

57.59ms

 

More detailed information on this testing can be found in the Micron blog describing this work, as well as the reference architecture utilizing Micron 7300 MAX NVMe SSDs.

Understand the platform impact

The impressive block and object workload performance demonstrated by Red Hat Ceph Storage in these Micron reference architectures has broad implications for accelerating the latest container-based workloads in Red Hat OpenShift Container Platform

As a broad trend, hybrid cloud platforms like Red Hat OpenShift Container Platform are rapidly replacing vertically integrated frameworks, and general-purpose infrastructure is replacing specialized data-processing infrastructure. To accelerate and inform their insights, data scientists are embracing technologies like Jupyter notebooks, Tensorflow, Pytorch, Apache Spark, and Starburst Enterprise for Presto. In these, containers and Red Hat OpenShift Container Storage play an increasingly vital role.

Red Hat OpenShift Container Storage is software-defined storage for containers—specifically engineered as the data and storage services platform for Red Hat OpenShift. Starting with Red Hat OpenShift Container Storage 4.5, an “external mode” option effectively decouples storage, allowing the Red Hat OpenShift Container Platform cluster to access an external Red Hat Ceph Storage cluster as the storage provider. 

A standalone Red Hat Ceph Storage cluster built on Micron accelerated all-flash storage can now provide scalability, resilience, and data performance to multiple Red Hat OpenShift Container Platform clusters, helping to accelerate and scale the container-based applications running there.

Harness the power of Micron and Ceph

All-flash storage from Micron, coupled with Red Hat Ceph Storage, is a compelling technology combination that offers strong block and object performance. With dense and performant storage servers equipped with all-flash storage, organizations can start small and build out Red Hat Ceph Storage clusters one RU (and up to 128TB) at a time. 

With Red Hat OpenShift Container Storage external mode support, Red Hat Ceph Storage clusters powered by Micron all-flash storage can now provide resilient, high-performance storage to the latest container-based hybrid cloud applications running in Red Hat OpenShift Container Platform.

Learn more

For more on Micron solutions for Red Hat Ceph Storage, visit red.ht/micron or read any of the following:

Reference architectures


About the author

Michael St-Jean is a Technical Alliance executive focused on building joint solutions with partners that accelerate time to value for organizations' strategic technology initiatives. For over two decades, Michael has worked with cross-functional teams helping organizations solve complex business challenges with innovative technology solutions and strategies.

Read full bio