AI510

Serving Models at Scale with Red Hat AI Enterprise

Impact

Course Description 

Deploying AI models in enterprise environments demands more than a working prototype.

Organizations must evaluate serving runtimes, optimize models for production hardware, manage inference at scale, and monitor deployed models to maintain performance and reliability.

Serving Models at Scale with Red Hat AI Enterprise (AI510) teaches students to deploy, serve, and manage AI models at enterprise scale by using Red Hat OpenShift AI. Students gain hands-on experience with the AI Factory framework, model serving with vLLM and KServe, NVIDIA NIM microservices, distributed inference with llm-d, workload scheduling with Kueue, and production model monitoring.

This course is based on Red Hat OpenShift AI 3.4.

Business Outcome 

Organizations struggle to move AI models from experimentation to production at scale, resulting in delayed time-to-value and underutilized infrastructure investments. This course equips teams to deploy, optimize, and operate AI models efficiently on Red Hat AI, reducing the gap between prototype and production and enabling reliable, cost-effective model serving across the enterprise

 Student Outcome 

After completing this course, students can evaluate serving runtimes, optimize and deploy generative and predictive AI models at scale using vLLM, KServe, and NVIDIA NIM on Red Hat OpenShift AI. They can also configure distributed inference and workload scheduling, and monitor deployed models in production.

 Readiness

Target Audience

AI Platform Engineers, ML operations teams, and infrastructure administrators responsible for deploying, serving, and managing AI models at scale on Red Hat OpenShift AI. 

Recommended Preparation

  • Familiarity with Red Hat OpenShift concepts, or completion of the Red Hat OpenShift Developer II: Building and Deploying Cloud-native Applications (DO288) course.
  • Basic understanding of large language models, AI/ML concepts, and model serving.
  • The Developing and Deploying AI/ML Applications on Red Hat OpenShift AI (AI267) course is recommended for students who are new to the Red Hat OpenShift AI platform. 

 

We recommend completing our no-cost skills assessment before enrolling in any Red Hat Training or Certification.  Learn more.

 What’s Next

Find your path forward. Explore recommended courses and certifications tailored to your experience level and career goals. View skills paths.

위치 선택 하기

시작하기

기술을 마스터하는 다양한 방법

전문가 주도 가상 교육과 자기 주도식 학습, 전문가의 지원, 자격증 시험 등 두 가지 방식의 장점을 모두 누릴 수 있습니다. Red Hat Learning Subscription에 모두 포함되어 있습니다.

가용한 현장 교육

원하는 때에 팀원 전체를 교육하세요. 대면 교육, 원격 교육 모두 가능합니다.

Red Hat Learning Subscription

Red Hat 제품에 대한 통합 교육 및 학습 경로, 업계에서 인증된 자격증, 유연하고 다이나믹한 IT 학습 경험.