AI510

Serving Models at Scale with Red Hat AI Enterprise

Impact

Course Description 

Deploying AI models in enterprise environments demands more than a working prototype.

Organizations must evaluate serving runtimes, optimize models for production hardware, manage inference at scale, and monitor deployed models to maintain performance and reliability.

Serving Models at Scale with Red Hat AI Enterprise (AI510) teaches students to deploy, serve, and manage AI models at enterprise scale by using Red Hat OpenShift AI. Students gain hands-on experience with the AI Factory framework, model serving with vLLM and KServe, NVIDIA NIM microservices, distributed inference with llm-d, workload scheduling with Kueue, and production model monitoring.

This course is based on Red Hat OpenShift AI 3.4.

Business Outcome 

Organizations struggle to move AI models from experimentation to production at scale, resulting in delayed time-to-value and underutilized infrastructure investments. This course equips teams to deploy, optimize, and operate AI models efficiently on Red Hat AI, reducing the gap between prototype and production and enabling reliable, cost-effective model serving across the enterprise

 Student Outcome 

After completing this course, students can evaluate serving runtimes, optimize and deploy generative and predictive AI models at scale using vLLM, KServe, and NVIDIA NIM on Red Hat OpenShift AI. They can also configure distributed inference and workload scheduling, and monitor deployed models in production.

 Readiness

Target Audience

AI Platform Engineers, ML operations teams, and infrastructure administrators responsible for deploying, serving, and managing AI models at scale on Red Hat OpenShift AI. 

Recommended Preparation

  • Familiarity with Red Hat OpenShift concepts, or completion of the Red Hat OpenShift Developer II: Building and Deploying Cloud-native Applications (DO288) course.
  • Basic understanding of large language models, AI/ML concepts, and model serving.
  • The Developing and Deploying AI/ML Applications on Red Hat OpenShift AI (AI267) course is recommended for students who are new to the Red Hat OpenShift AI platform. 

 

We recommend completing our no-cost skills assessment before enrolling in any Red Hat Training or Certification.  Learn more.

 What’s Next

Find your path forward. Explore recommended courses and certifications tailored to your experience level and career goals. View skills paths.

Wählen Sie Ihren Standort aus

Mehr erfahren

Mehr Möglichkeiten zur Weiterentwicklung Ihrer Kompetenzen

Das Beste aus beiden Welten: von Expertinnnen und Experten geleitetes virtuelles Training und selbstbestimmtes Lernen, dazu fachkundige Unterstützung und eine Zertifizierungsprüfung. All das ist in der Red Hat Learning Subscription enthalten.

Onsite-Training verfügbar

Wenn Ihr gesamtes Team geschult werden soll, können wir das Training bei Ihnen vor Ort durchführen – als Remote- oder Präsenzschulung.

Red Hat Learning Subscription

Umfassende Trainings und Lernpfade zu Produkten von Red Hat, branchenweit anerkannte Zertifizierungen und ein flexibles, dynamisches IT-Lernerlebnis.