Scalable, resilient, highly performant storage. Today’s businesses need it, particularly for data-intensive workloads like analytics, artificial intelligence (AI), and machine learning (ML). All these workloads can significantly tax their underlying infrastructure, and scalable, high-performance storage lets organizations achieve their goals across multiple workload categories, including:
Data at rest(e.g., databases, data warehouses, and data lakes), which requires increased scalability, performance, and resilience.
Data on the move(e.g., automated data pipelines), which needs infrastructure that cuts the time needed to get to the right set of data.
Data in action (e.g., continuous integration and development [CI/CD], data analytics, and AI/ML), which requires ways to accelerate processes and increase the self-reliance of analysts and developers.
Start with a storage solution
Before a company embraces a storage solution, though, it’s important for that company to understand both the performance potential of that solution, as well as the workload-specific performance characteristics of the chosen infrastructure platform.
Red Hat Ceph Storage is a robust, software-defined storage solution that offers scalability, simplicity, and security features for workloads that include data analytics, media repositories, content streaming, and both OpenStack and OpenShift cloud infrastructures. Unlike many other software-defined storage solutions, Red Hat Ceph Storage supports block, object, and file storage, allowing support for a wide range of workloads and applications.
However, the performance of Red Hat Ceph Storage, like any software-defined storage, can be affected by processors, memory, and networking, as well as by the underlying storage media.
Test performance with storage media
Red Hat and Micron worked closely together to develop and evaluate Red Hat Ceph Storage solutions built with Micron all-flash storage, and Micron recently published reference architectures based on both Micron 9300 MAX NVMe SSDs and Micron 7300 MAX NVMe SSDs. Our testing used storage servers equipped with dual AMD EPYC 7002 series processors.
Storage servers with Micron 9300 MAX NVMe SSDs
The Micron 9300 MAX NVMe SSD provides high performance with low latencies. It offers capacities up to 12.8TB and 32 NVMe namespaces while consistently providing read and write throughput of up to 3.5 GB/s of sequential data.
The reference architecture using Micron 9300 Max NVMe SSDs and Red Hat Ceph Storage consumes six rack units, composed of one Ceph monitor node, four Ceph data nodes, and an Ethernet switch. Capacity per rack unit (RU) is maximized with 10 12.8TB NVMe SSDs per 1RU storage node.
Using this reference architecture as a starting point, administrators can add data nodes, one rack unit and 128TB at a time. Block and object performance using Micron 9300 MAX NVMe SSDs and Red Hat Ceph Storage is detailed in these tables.
4KiB random block performance using Micron 9300 MAX NVMe SSDs
4MiB object performance using Micron 9300 MAX NVMe SSDs
100% sequential read
100% random read
100% random write
More detailed information can be found in the Micron blog describing this work, as well as in the full reference architecture utilizing Micron 9300 MAX NVMe SSDs.
Storage servers with Micron 7300 MAX NVMe SSDs
The Micron 7300 MAX NVMe SSD is an option for a lower-cost Ceph Storage solution that still provides strong performance. The Micron 7300 mainstream NVMe SSD family offers capacities of up to 8TB with up to 3GB per second of read throughput and 1.9GB per second of write throughput.
Using the latest version of Red Hat Ceph Storage, the Micron 7300 enables more organizations to gain access to the performance of NVMe SSDs within a smaller budget. Block and object performance achieved in the reference architecture using the Micron 7300 MAX NVMe SSDs and Red Hat Ceph Storage is provided in these tables.
4KiB random block performance using Micron 7300 NVMe SSDs
4MiB object performance using Micron 7300 NVMe SSDs
100% sequential read
100% random read
100% random write
More detailed information on this testing can be found in the Micron blog describing this work, as well as the reference architecture utilizing Micron 7300 MAX NVMe SSDs.
Understand the platform impact
The impressive block and object workload performance demonstrated by Red Hat Ceph Storage in these Micron reference architectures has broad implications for accelerating the latest container-based workloads in Red Hat OpenShift Container Platform.
As a broad trend, hybrid cloud platforms like Red Hat OpenShift Container Platform are rapidly replacing vertically integrated frameworks, and general-purpose infrastructure is replacing specialized data-processing infrastructure. To accelerate and inform their insights, data scientists are embracing technologies like Jupyter notebooks, Tensorflow, Pytorch, Apache Spark, and Starburst Enterprise for Presto. In these, containers and Red Hat OpenShift Container Storage play an increasingly vital role.
Red Hat OpenShift Container Storage is software-defined storage for containers—specifically engineered as the data and storage services platform for Red Hat OpenShift. Starting with Red Hat OpenShift Container Storage 4.5, an “external mode” option effectively decouples storage, allowing the Red Hat OpenShift Container Platform cluster to access an external Red Hat Ceph Storage cluster as the storage provider.
A standalone Red Hat Ceph Storage cluster built on Micron accelerated all-flash storage can now provide scalability, resilience, and data performance to multiple Red Hat OpenShift Container Platform clusters, helping to accelerate and scale the container-based applications running there.
Harness the power of Micron and Ceph
All-flash storage from Micron, coupled with Red Hat Ceph Storage, is a compelling technology combination that offers strong block and object performance. With dense and performant storage servers equipped with all-flash storage, organizations can start small and build out Red Hat Ceph Storage clusters one RU (and up to 128TB) at a time.
With Red Hat OpenShift Container Storage external mode support, Red Hat Ceph Storage clusters powered by Micron all-flash storage can now provide resilient, high-performance storage to the latest container-based hybrid cloud applications running in Red Hat OpenShift Container Platform.
For more on Micron solutions for Red Hat Ceph Storage, visit red.ht/micron or read any of the following: