Use the following guidelines to determine the number of subscriptions required for Red Hat AI Enterprise, Red Hat AI Inference, OpenShift AI, or Red Hat Enterprise Linux AI.
Red Hat AI Enterprise sizing guidance:
While the self-managed OpenShift sizing framework provides a helpful foundation, Red Hat AI Enterprise requires a different approach. Unlike standard models based on core-pairs or socket-pairs, Red Hat AI Enterprise uses a per-node pricing model. This simplifies procurement by focusing solely on the total number of dedicated AI compute nodes—whether physical or virtual.
Follow these steps to estimate your organization’s Red Hat AI Enterprise entitlement requirements:
Step 1: Identify AI workload instances
Identify the number of AI pods or instances required for training, tuning, inference, and agent management.
Note: Red Hat AI Enterprise entitlements are strictly limited to AI-related workloads; standalone Red Hat OpenShift use for non-AI applications is not permitted under this SKU.
Step 2: Determine hardware requirements
Calculate the memory and compute power needed to support AI pods. Unlike standard sizing, Red Hat AI Enterprise costs are not tied to CPU core limits. Select high-performance hardware with high core density to maximize throughput without increasing the subscription count.
Step 3: Select AI compute nodes
Choose the physical servers or VMs that will serve as compute nodes. To maximize the value of the Red Hat AI Enterprise entitlement, these should ideally be equipped with hardware accelerators.
Step 4: Calculate total node subscriptions
Your organization’s total Red Hat AI Enterprise requirement is the sum of the nodes dedicated to AI. One subscription covers 1 node, regardless of its CPU or socket count.
- Bare metal: If Red Hat OpenShift is installed directly on a server, count the physical nodes.
- Virtual or cloud: If Red Hat OpenShift is running in a VM (e.g., in a public cloud or shared hypervisor where the underlying hardware is not entitled), count the virtual nodes.
Key inclusion: Red Hat AI Enterprise includes unlimited accelerator entitlements per subscribed node. Your organization can install as many GPUs as the hardware supports without needing additional SKUs.
Step 5: Optimize for virtualization
When deploying on bare-metal hosts fully dedicated to AI workloads, a single Red Hat AI Enterprise physical subscription entitles you to run unlimited Red Hat AI Enterprise VMs on that specific host. This allows you to scale the environment based on the hardware's total capacity rather than individual VM counts.
Red Hat AI Inference sizing guidance
To estimate entitlements for Red Hat AI Inference, shift your IT team’s focus from CPU core-pairs to the number of physical hardware accelerators required to serve your organization’s models.
Follow these steps to estimate your organization’s Red Hat AI Inference requirements:
Step 1: Identify inference workloads
Determine the number of LLM instances your organization intends to serve.
Note: Red Hat AI Inference is a containerized engine purpose-built for gen AI model inference; it does not support model training, tuning, or predictive AI.
Step 2: Identify the underlying platform
Determine which platform will host the Red Hat AI Inference container. Note the following requirements:
- Red Hat OpenShift: Requires a separate Red Hat OpenShift subscription. Distributed inferencing and the llm-d component are only available on Red Hat OpenShift.
- Red Hat Enterprise Linux: Requires a separate Red Hat Enterprise Linux subscription.
- Non-Red Hat platforms: Supported under Red Hat’s third-party policy. Red Hat supports Red Hat AI Inference, but the customer is responsible for platform issues that cannot be reproduced on Red Hat Enterprise Linux or Red Hat OpenShift.
Step 3: Determine accelerator requirements
Calculate the number of accelerators needed based on model size, memory consumption, and request volume. Because large models often span multiple GPUs to fit into memory, sizing is determined by the physical hardware footprint rather than CPU utilization.
Step 4: Choose compute nodes
Select the physical servers or vms that will host the accelerators. While Red Hat AI Inference can run on virtual nodes, the subscription is always calculated based on the count of underlying physical accelerator devices.
Step 5: Calculate total Red Hat AI Inference subscriptions
The total number of Red Hat AI Inference subscriptions equals the total count of physical AI accelerators used for inference.
- Key advantage: The Red Hat AI Inference SKU includes Red Hat AI Accelerator entitlements; your organization does not need to purchase a standalone Red Hat AI Accelerator SKU.
Step 6: Strategy for coverage
Red Hat recommends a full-coverage approach for accelerators that may serve inference workloads. Because inference tasks are often dynamic and ephemeral, entitling every accelerator simplifies management and prepares your organization for fluctuating demand. This removes the burden of tracking specific use and aligns with Red Hat's volume-based pricing value.
OpenShift AI sizing guidance
When sizing entitlements for OpenShift AI, keep in mind its role as a layered add-on. It mirrors the underlying Red Hat OpenShift unit of measure (either core-pairs or bare-metal nodes), providing a consistent framework for scaling.
Follow these steps to estimate OpenShift AI requirements:
Step 1: Identify AI workload instances
Determine the number of AI-specific pods or instances required, including workbenches, training or tuning pipelines, and model deployments.
Note: Unlike Red Hat AI Inference, OpenShift AI supports both generative and predictive AI workloads.
Step 2: Determine aggregate resources
Calculate the total compute (cores/vCPUs) and memory required to support these AI pods. Because OpenShift AI is an add-on, it uses the same sizing units as the OpenShift Container Platform to keep procurement simple.
Step 3: Select target compute nodes
Identify the physical or virtual worker nodes where the AI software will be deployed.
- Partial coverage: Organizations are permitted to subscribe to only a specific subset of nodes within a cluster for OpenShift AI, rather than entitling the entire environment.
Step 4: Calculate Red Hat OpenShift AI add-on subscriptions
An organization may choose a unit of measure (core-pair versus bare-metal) that differs from its underlying Red Hat OpenShift installation, though matching them is often simpler for administration:
- Core-based nodes: Count the aggregate cores or vCPUs across all nodes running AI workloads. Divide total cores by 2 (or vCPUs by 4) to determine the subscription count.
- Bare-metal nodes: Count the physical servers dedicated to AI. One subscription covers 1 server, regardless of CPU socket or core density.
- Prerequisite check: A corresponding base Red Hat OpenShift subscription (OpenShift Container Platform, OpenShift Kubernetes Environment, or OpenShift Platform Plus) is mandatory for each node receiving the OpenShift AI add-on.
Step 5: Calculate AI Accelerator subscriptions
If the nodes identified in step 3 use GPUs, TPUs, or other hardware accelerators, the Red Hat AI Accelerator SKU must be added.
- Calculation: One subscription per physical accelerator device (e.g., a node with 4 GPUs requires 4 Accelerator SKUs).
- Requirement: This is mandatory because AI Accelerator entitlements are not included in the base OpenShift AI subscription.
Red Hat Enterprise Linux AI sizing guidance
To determine the entitlements for Red Hat Enterprise Linux AI, shift your organization’s focus from CPU core-pairs to counting physical hardware accelerators (GPUs) within a single-server environment.
Red Hat Enterprise Linux AI is a foundation gen AI platform designed for organizations that want to serve LLMs on a dedicated, standalone machine. It is helpful to view Red Hat Enterprise Linux AI as a software appliance: it is delivered as a self-contained, bootable image that includes the Red Hat Enterprise Linux operating environment.
Key advantage: No separate operating system subscription
Unlike other offerings, Red Hat Enterprise Linux AI does not require a separate Red Hat Enterprise Linux subscription. The instance is tailored specifically to provide an isolated foundation for gen AI models on a single machine.
Follow these steps to estimate Red Hat Enterprise Linux AI requirements:
Step 1: Identify AI workload requirements
Verify that your use case involves serving LLMs using tools like vLLM.
Note: Red Hat Enterprise Linux AI is dedicated exclusively to gen AI and does not support predictive AI workloads.
Step 2: Choose the dedicated compute node
Select the physical hardware that will host the Red Hat Enterprise Linux AI image.
- Scaling limit: Red Hat Enterprise Linux AI supports single-machine deployment. If your organization’s workload requires a multinode distributed setup or cluster orchestration, you must transition to Red Hat AI Enterprise or Red Hat OpenShift AI.
Step 3: Calculate subscriptions based on accelerators
The primary unit of measure for Red Hat Enterprise Linux AI is the physical AI accelerator.
- Calculation: Count the total number of physical GPUs (or other accelerators) installed in a dedicated server.
- Entitlement: Purchase a corresponding number of Red Hat Enterprise Linux AI SKUs for each physical device. This is required.
Step 4: Account for included accelerator entitlements
When sizing the IT environment, your organization does not need to purchase the standalone Red Hat AI Accelerator SKU. Because Red Hat Enterprise Linux AI is inherently licensed based on GPU usage, the entitlements for those accelerators are already covered by the base Red Hat Enterprise Linux AI subscription.