Scalable, resilient, highly performant storage. Today’s businesses need it, particularly for data-intensive workloads like analytics, artificial intelligence (AI), and machine learning (ML). All these workloads can significantly tax their underlying infrastructure, and scalable, high-performance storage lets organizations achieve their goals across multiple workload categories, including:
-
Data at rest (e.g., databases, data warehouses, and data lakes), which requires increased scalability, performance, and resilience.
-
Data on the move (e.g., automated data pipelines), which needs infrastructure that cuts the time needed to get to the right set of data.
-
Data in action (e.g., continuous integration and development [CI/CD], data analytics, and AI/ML), which requires ways to accelerate processes and increase the self-reliance of analysts and developers.
Start with a storage solution
Before a company embraces a storage solution, though, it’s important for that company to understand both the performance potential of that solution, as well as the workload-specific performance characteristics of the chosen infrastructure platform.
Red Hat Ceph Storage is a robust, software-defined storage solution that offers scalability, simplicity, and security features for workloads that include data analytics, media repositories, content streaming, and both OpenStack and OpenShift cloud infrastructures. Unlike many other software-defined storage solutions, Red Hat Ceph Storage supports block, object, and file storage, allowing support for a wide range of workloads and applications.
However, the performance of Red Hat Ceph Storage, like any software-defined storage, can be affected by processors, memory, and networking, as well as by the underlying storage media.
Test performance with storage media
Red Hat and Micron worked closely together to develop and evaluate Red Hat Ceph Storage solutions built with Micron all-flash storage, and Micron recently published reference architectures based on both Micron 9300 MAX NVMe SSDs and Micron 7300 MAX NVMe SSDs. Our testing used storage servers equipped with dual AMD EPYC 7002 series processors.
Storage servers with Micron 9300 MAX NVMe SSDs
The Micron 9300 MAX NVMe SSD provides high performance with low latencies. It offers capacities up to 12.8TB and 32 NVMe namespaces while consistently providing read and write throughput of up to 3.5 GB/s of sequential data.
The reference architecture using Micron 9300 Max NVMe SSDs and Red Hat Ceph Storage consumes six rack units, composed of one Ceph monitor node, four Ceph data nodes, and an Ethernet switch. Capacity per rack unit (RU) is maximized with 10 12.8TB NVMe SSDs per 1RU storage node.
Using this reference architecture as a starting point, administrators can add data nodes, one rack unit and 128TB at a time. Block and object performance using Micron 9300 MAX NVMe SSDs and Red Hat Ceph Storage is detailed in these tables.
I/O profile |
IOPS |
Average latency |
100% read |
3,161,146 |
1.31ms |
70%/30% read/write |
1,325,888 |
Write: 6.2ms Read: 1.82ms |
100% write |
645,655 |
6.44ms |
I/O profile |
Throughput |
Average latency |
100% sequential read |
41.03GiB/s |
29.81ms |
100% random read |
43.77GiB/s |
27.92ms |
100% random write |
19.15GiB/s |
6.44ms |
More detailed information can be found in the Micron blog describing this work, as well as in the full reference architecture utilizing Micron 9300 MAX NVMe SSDs.
Storage servers with Micron 7300 MAX NVMe SSDs
The Micron 7300 MAX NVMe SSD is an option for a lower-cost Ceph Storage solution that still provides strong performance. The Micron 7300 mainstream NVMe SSD family offers capacities of up to 8TB with up to 3GB per second of read throughput and 1.9GB per second of write throughput.
Using the latest version of Red Hat Ceph Storage, the Micron 7300 enables more organizations to gain access to the performance of NVMe SSDs within a smaller budget. Block and object performance achieved in the reference architecture using the Micron 7300 MAX NVMe SSDs and Red Hat Ceph Storage is provided in these tables.
I/O profile |
IOPS |
Average latency |
100% read |
2,970,481 |
1.42ms |
70%/30% read/write |
1,289,009 |
Write: 5.89ms Read: 2.08ms |
100% write |
558,373 |
6.34ms |
I/O profile |
Throughput |
Average latency |
100% sequential read |
41.22GiB/s |
29.67ms |
100% random read |
43.77GiB/s |
27.91ms |
100% random write |
21.8GiB/s |
57.59ms |
More detailed information on this testing can be found in the Micron blog describing this work, as well as the reference architecture utilizing Micron 7300 MAX NVMe SSDs.
Understand the platform impact
The impressive block and object workload performance demonstrated by Red Hat Ceph Storage in these Micron reference architectures has broad implications for accelerating the latest container-based workloads in Red Hat OpenShift Container Platform.
As a broad trend, hybrid cloud platforms like Red Hat OpenShift Container Platform are rapidly replacing vertically integrated frameworks, and general-purpose infrastructure is replacing specialized data-processing infrastructure. To accelerate and inform their insights, data scientists are embracing technologies like Jupyter notebooks, Tensorflow, Pytorch, Apache Spark, and Starburst Enterprise for Presto. In these, containers and Red Hat OpenShift Container Storage play an increasingly vital role.
Red Hat OpenShift Container Storage is software-defined storage for containers—specifically engineered as the data and storage services platform for Red Hat OpenShift. Starting with Red Hat OpenShift Container Storage 4.5, an “external mode” option effectively decouples storage, allowing the Red Hat OpenShift Container Platform cluster to access an external Red Hat Ceph Storage cluster as the storage provider.
A standalone Red Hat Ceph Storage cluster built on Micron accelerated all-flash storage can now provide scalability, resilience, and data performance to multiple Red Hat OpenShift Container Platform clusters, helping to accelerate and scale the container-based applications running there.
Harness the power of Micron and Ceph
All-flash storage from Micron, coupled with Red Hat Ceph Storage, is a compelling technology combination that offers strong block and object performance. With dense and performant storage servers equipped with all-flash storage, organizations can start small and build out Red Hat Ceph Storage clusters one RU (and up to 128TB) at a time.
With Red Hat OpenShift Container Storage external mode support, Red Hat Ceph Storage clusters powered by Micron all-flash storage can now provide resilient, high-performance storage to the latest container-based hybrid cloud applications running in Red Hat OpenShift Container Platform.
Learn more
For more on Micron solutions for Red Hat Ceph Storage, visit red.ht/micron or read any of the following:
-
Micron Accelerated NVMeTM SSD Solution for Red Hat Ceph Storage (solution brief)
-
Micron 9200 MAX NVMe with 5210 QLS SATA SSDS for Red Hat Ceph Storage (blog post)
Reference architectures
執筆者紹介
Michael St-Jean is a Technical Alliance executive focused on building joint solutions with partners that accelerate time to value for organizations' strategic technology initiatives. For over two decades, Michael has worked with cross-functional teams helping organizations solve complex business challenges with innovative technology solutions and strategies.
チャンネル別に見る
自動化
テクノロジー、チームおよび環境に関する IT 自動化の最新情報
AI (人工知能)
お客様が AI ワークロードをどこでも自由に実行することを可能にするプラットフォームについてのアップデート
オープン・ハイブリッドクラウド
ハイブリッドクラウドで柔軟に未来を築く方法をご確認ください。
セキュリティ
環境やテクノロジー全体に及ぶリスクを軽減する方法に関する最新情報
エッジコンピューティング
エッジでの運用を単純化するプラットフォームのアップデート
インフラストラクチャ
世界有数のエンタープライズ向け Linux プラットフォームの最新情報
アプリケーション
アプリケーションの最も困難な課題に対する Red Hat ソリューションの詳細
オリジナル番組
エンタープライズ向けテクノロジーのメーカーやリーダーによるストーリー
製品
ツール
試用、購入、販売
コミュニケーション
Red Hat について
エンタープライズ・オープンソース・ソリューションのプロバイダーとして世界をリードする Red Hat は、Linux、クラウド、コンテナ、Kubernetes などのテクノロジーを提供しています。Red Hat は強化されたソリューションを提供し、コアデータセンターからネットワークエッジまで、企業が複数のプラットフォームおよび環境間で容易に運用できるようにしています。
言語を選択してください
Red Hat legal and privacy links
- Red Hat について
- 採用情報
- イベント
- 各国のオフィス
- Red Hat へのお問い合わせ
- Red Hat ブログ
- ダイバーシティ、エクイティ、およびインクルージョン
- Cool Stuff Store
- Red Hat Summit