* [Topics](/en/topics "Topics") * [Artificial intelligence](/en/topics/ai "Artificial intelligence") * What is Kubeflow? What is Kubeflow? ================= Published May 22, 2023•*4*-minute read Copy URL Jump to section --------------- OverviewWhat is Kubeflow used for?Why run ML workloads on Kubernetes?Kubeflow componentsHow Red Hat can help Overview -------- Kubeflow is a [Kubernetes](/en/topics/containers/what-is-kubernetes)-native, open-source framework for developing, managing, and running [machine learning](/en/topics/ai/what-is-machine-learning) (ML) workloads. Kubeflow is an AI/ML platform that brings together several tools covering the main AI/ML use cases: data exploration, data pipelines, model training, and model serving. Kubeflow allows data scientists to access those capabilities via a portal which provides high-level abstractions to interact with these tools. This means data scientists do not need to be concerned about having to learn low-level details of how Kubernetes plugs into each of these tools. Kubeflow itself is specifically designed to run on Kubernetes and fully embraces many of the key concepts, including the operator model. [Explore Red Hat AI](/en/products/ai "Explore Red Hat AI ") What is Kubeflow used for? -------------------------- Kubeflow solves many of the challenges involved in orchestrating machine learning pipelines by providing a set of tools and [APIs](/en/topics/api/what-are-application-programming-interfaces) that simplify the process of training and deploying ML models at scale. A “pipeline” denotes an ML workflow, including the components of the workflow and how those components interact. Kubeflow is able to accommodate the needs of multiple teams in one project and allows those teams to work from any infrastructure. This means that data scientists can train and serve ML models from the cloud of their choice, including IBM Cloud, Google Cloud, Amazon’s AWS, or Azure. Overall, Kubeflow standardizes [machine learning operations (MLOps)](/en/topics/ai/what-is-mlops) by organizing projects while leveraging the power of cloud computing. Some of the key use cases for Kubeflow include data preparation, model training, evaluation, optimization, and deployment. [Learn more about MLOPs on OpenShift](/en/resources/mlops-architecture-openshift-infographic "MLOPs on Red Hat OpenShift") Red Hat resources ----------------- [Keep reading](/en/resources "Keep reading") Why run machine learning workloads on Kubernetes? ------------------------------------------------- Kubernetes is key to accelerating the ML lifecycle as these technologies provide data scientists the much needed agility, flexibility, portability, and scalability to train, test, and deploy ML models. **Scalability:** Kubernetes allows users to scale ML workloads up or down, depending on demand. This ensures that machine learning pipelines can accommodate large-scale processing and training without interfering with other elements of the project. **Efficiency:** Kubernetes optimizes resource allocation by scheduling workloads onto nodes based on their availability and capacity. By ensuring that computing resources are being utilized with intention, users can expect a reduction in cost and an increase in performance. **Portability:** Kubernetes provides a standardized, platform-agnostic environment that allows data scientists to develop one ML pipeline and deploy it across multiple environments and cloud platforms. This means not having to worry about compatibility issues and vendor lock-in. **Fault tolerance:** With built-in fault tolerance and self-healing capabilities, users can trust Kubernetes to keep ML pipelines running even in the event of a hardware or software failure. What are Kubeflow’s components? ------------------------------- 1. The **Kubeflow Central Dashboard** offers an authenticated web interface for accessing Kubeflow and its ecosystem components. Serving as a centralized hub, it aggregates the user interfaces of various tools and services within the cluster, providing a unified access point for managing your machine learning platform. 2. Kubeflow integrates with **Jupyter Notebooks**, providing an interactive environment for data exploration, experimentation, and model development. Notebooks support various programming languages, including Python, R, and Scala, and allow users to create and execute ML workflows in a collaborative and reproducible manner. 3. **Kubeflow Pipelines** enable users to define and execute complex ML workflows as directed acyclic graphs (DAGs). Kubeflow Pipelines provide a way to orchestrate and automate the end-to-end process of data preprocessing, model training, evaluation, and deployment which promotes reproducibility, scalability, and collaboration in ML projects. The Kubeflow Pipelines [SDK](https://www.redhat.com/en/topics/cloud-native-apps/what-is-SDK) is a collection of Python packages, allowing users to define and execute their machine learning workflows with precision and efficiency. 4. The **Kubeflow Training Operator** provides tools for training machine learning models at scale. This includes support for distributed training using frameworks like TensorFlow, PyTorch, and XGBoost. Users can leverage Kubernetes' scalability and resource management capabilities to train models efficiently across clusters of machines. 5. **Kubeflow Serving** allows users to deploy trained ML models as scalable, production-ready services. It provides a consistent interface for serving models using popular frameworks like TensorFlow Serving, Seldon Core, or custom inference servers. Models can be deployed in real-time or batch processing scenarios, serving predictions over HTTP endpoints. 6. **Kubeflow Metadata** is a centralized repository for tracking and managing metadata associated with ML experiments, runs, and artifacts. It provides a consistent view of ML metadata across the entire workflow, enabling reproducibility, collaboration, and governance in ML projects. In addition, Kubeflow provides web-based user interfaces (UIs) for monitoring and managing ML experiments, model training jobs, and inference services. These UIs offer visualizations, metrics, and logs to help users track the progress of their ML workflows, troubleshoot issues, and make informed decisions. As it embraces the Kubernetes operator model, Kubeflow is extensible and supports customization to adapt to specific use cases and environments. Users can integrate additional components, such as data preprocessing tools, feature stores, monitoring solutions, and external data sources, to enhance the capabilities of their ML workflows. How Red Hat can help -------------------- Red Hat’s close involvement with the [Kubeflow community](/en/blog/open-source-ai-red-hat-our-journey-kubeflow-community)—from managing new releases and upgrading security features to developing design and future code contributions—helps us build better, stronger solutions that really work. [Red Hat® AI](/en/products/ai) is our portfolio of AI products built on solutions our customers already trust. This foundation helps our products remain reliable, flexible, and scalable. Red Hat AI can help organizations: * Adopt and innovate with AI quickly. * Break down the complexities of delivering AI solutions. * Deploy anywhere. [Explore Red Hat AI](/en/products/ai) ### Bridging Kubeflow and AI capabilities Red Hat AI offers Granite family LLMs, bring-your-own model flexibility, and an integrated MLOps platform for managing the AI/ML lifecycle across hybrid cloud environments and the edge. Red Hat OpenShift AI is based on KubeFlow pipelines: a visual editor for creating and automating data science pipelines and experimentation that helps developers streamline data exploration and model training, validation and storing. The combination of data science pipelines and MLOps increases teams’ operational efficiency when delivering models and AI-enabled applications to development, testing, and production environments across the organization. [Learn how Red Hat OpenShift AI can help](/en/products/ai/openshift-ai) The official Red Hat blog ------------------------- Get the latest information about our ecosystem of customers, partners, and communities. [Keep reading](/en/blog "The official Red Hat blog") All Red Hat product trials -------------------------- Our no-cost product trials help you gain hands-on experience, prepare for a certification, or assess if a product is right for your organization. [Keep reading](/en/products/trials "All Red Hat product trials") Keep reading ------------ ### vLLM vs. Ollama: When to use each framework When integrating large language models (LLMs) into an AI application, vLLM is great for high-performance production, and Ollama is great for local development. [Read the article](/en/topics/ai/vllm-vs-ollama "vLLM vs. Ollama: When to use each framework") ### What is explainable AI? Explainable AI (XAI) techniques, applied during the machine learning (ML) lifecycle, make AI outputs more understandable and transparent to humans. [Read the article](/en/topics/ai/what-explainable-ai "What is explainable AI?") ### Agentic AI vs. generative AI Agentic AI and generative AI explained: Learn how each works, their unique strengths, and how they can collaborate for smarter solutions. [Read the article](/en/topics/ai/agentic-ai-vs-generative-ai "Agentic AI vs. generative AI") Artificial intelligence resources --------------------------------- ### Related content * Blog post [Navigating secure AI deployment: Architecture for enhancing AI system security and safety](/en/blog/navigating-secure-ai-deployment-architecture-enhancing-ai-system-security-and-safety) * Blog post [Smarter troubleshooting with the new MCP server for Red Hat Enterprise Linux (now in developer preview)](/en/blog/smarter-troubleshooting-new-mcp-server-red-hat-enterprise-linux-now-developer-preview) * Blog post [The AI resolution that will still matter in 2030](/en/blog/ai-resolution-will-still-matter-2030) * Case study [RTLZWEI hones competitive edge with Red Hat OpenShift AI](/en/resources/rtlzwei-case-study) ### Related articles * [vLLM vs. Ollama: When to use each framework](/en/topics/ai/vllm-vs-ollama) * [What is explainable AI?](/en/topics/ai/what-explainable-ai) * [Containers vs. VMs: Similarities, differences, and combined approaches](/en/topics/containers/containers-vs-vms) * [How vLLM accelerates AI inference: 3 enterprise use cases](/en/topics/ai/how-vllm-accelerates-ai-inference-3-enterprise-use-cases) * [Agentic AI vs. generative AI](/en/topics/ai/agentic-ai-vs-generative-ai) * [What is retrieval-augmented generation?](/en/topics/ai/what-is-retrieval-augmented-generation) * [What are foundation models for AI?](/en/topics/ai/what-are-foundation-models) * [What is machine learning?](/en/topics/ai/what-is-machine-learning) * [What is agentic AI?](/en/topics/ai/what-is-agentic-ai) * [Edge computing with Red Hat OpenShift](/en/technologies/cloud-computing/openshift/edge-computing) * [What is llm-d?](/en/topics/ai/what-is-llm-d) * [What is InstructLab?](/en/topics/ai/what-is-instructlab) * [What is distributed inference?](/en/topics/ai/what-is-distributed-inference) * [What is Model Context Protocol (MCP)?](/en/topics/ai/what-is-model-context-protocol-mcp) * [AIOps explained](/en/topics/ai/what-is-aiops) * [What is AI security?](/en/topics/ai/what-is-ai-security) * [What are large language models?](/en/topics/ai/what-are-large-language-models) * [What is Models-as-a-Service?](/en/topics/ai/what-is-models-as-a-service) * [What is AI in the public sector?](/en/topics/ai/what-is-ai-in-the-public-sector) * [What is a Linux container?](/en/topics/containers/whats-a-linux-container) * [SLMs vs LLMs: What are small language models?](/en/topics/ai/llm-vs-slm) * [What is enterprise AI?](/en/topics/ai/what-is-enterprise-ai) * [What is container orchestration?](/en/topics/containers/what-is-container-orchestration) * [What is parameter-efficient fine-tuning (PEFT)?](/en/topics/ai/what-is-peft) * [Why choose Red Hat Ansible Automation Platform as your AI foundation?](/en/topics/automation/automation-and-ai) * [LoRA vs. QLoRA](/en/topics/ai/lora-vs-qlora) * [Stateful vs stateless applications](/en/topics/cloud-native-apps/stateful-vs-stateless) * [What is vLLM?](/en/topics/ai/what-is-vllm) * [What is AI inference?](/en/topics/ai/what-is-ai-inference) * [What is Kubernetes?](/en/topics/containers/what-is-kubernetes) * [Red Hat OpenShift on VMware](/en/technologies/cloud-computing/openshift/vmware) * [Predictive AI vs generative AI](/en/topics/ai/predictive-ai-vs-generative-ai) * [What is KubeVirt?](/en/topics/virtualization/what-is-kubevirt) * [What are Granite models?](/en/topics/ai/what-are-granite-models) * [Why use Red Hat Ansible Automation Platform with Red Hat OpenShift?](/en/technologies/cloud-computing/openshift/ansible-on-openshift) * [RAG vs. fine-tuning](/en/topics/ai/rag-vs-fine-tuning) * [What is Podman Desktop?](/en/topics/containers/what-is-podman-desktop) * [Understanding AI in telecommunications with Red Hat](/en/topics/ai/understanding-ai-in-telecommunications) * [Edge solutions for real-time decision making](/en/topics/edge-computing/edge-solutions-real-time-decision-making) * [What are intelligent applications?](/en/topics/ai/what-are-intelligent-applications) * [What is Podman?](/en/topics/containers/what-is-podman) * [What is the Kubernetes Java client?](/en/topics/cloud-computing/what-is-kubernetes-java-client) * [What are hosted control planes?](/en/topics/containers/what-are-hosted-control-planes) * [What is kubernetes security?](/en/topics/containers/kubernetes-security) * [What is an AI platform?](/en/topics/ai/what-is-an-ai-platform) * [Red Hat OpenShift for developers](/en/technologies/cloud-computing/openshift/developers) * [What is LLMops](/en/topics/ai/llmops) * [What is deep learning?](/en/topics/ai/what-is-deep-learning) * [What are predictive analytics](/en/topics/automation/how-predictive-analytics-improve-it-performance) * [AI in banking](/en/topics/ai/ai-in-banking) * [AI infrastructure explained](/en/topics/ai/ai-infrastructure-explained) * [Understanding AI/ML use cases](/en/topics/ai/ai-ml-use-cases) * [What is MLOps?](/en/topics/ai/what-is-mlops) * [How Kubernetes can help AI/ML](/en/topics/cloud-computing/how-kubernetes-can-help-ai) * [What is generative AI?](/en/topics/ai/what-is-generative-ai) * [What is edge AI?](/en/topics/edge-computing/what-is-edge-ai) * [What are microservices?](/en/topics/microservices/what-are-microservices) * [What is container security?](/en/topics/security/container-security) * [OpenShift vs. OpenStack: What are the differences?](/en/technologies/cloud-computing/openshift/openshift-vs-openstack) * [What are sandboxed containers](/en/topics/containers/sandboxed-containers) * [What is Buildah?](/en/topics/containers/what-is-buildah) * [Accelerate MLOps with Red Hat OpenShift](/en/technologies/cloud-computing/openshift/aiml) * [Kubernetes vs OpenStack](/en/topics/openstack/kubernetes-vs-openstack) * [What are validated patterns?](/en/topics/cloud-computing/what-are-validated-patterns) * [Kubernetes on AWS: Self-Managed vs. Managed Applications Platforms](/en/topics/containers/kubernetes-on-aws) * [What is an image builder?](/en/topics/linux/what-is-an-image-builder) * [Red Hat OpenShift vs. OKD](/en/topics/containers/red-hat-openshift-okd) * [What is AI in healthcare?](/en/topics/ai/what-is-ai-in-healthcare) * [Red Hat OpenShift vs. Kubernetes: What's the difference?](/en/technologies/cloud-computing/openshift/red-hat-openshift-kubernetes) * [Spring on Kubernetes with Red Hat OpenShift](/en/technologies/cloud-computing/openshift/spring) * [What is high availability and disaster recovery for containers?](/en/topics/containers/high-availability-containers) * [Why run Apache Kafka on Kubernetes?](/en/topics/integration/why-run-apache-kafka-on-kubernetes) * [What is a golden image?](/en/topics/linux/what-is-a-golden-image) * [What are Red Hat OpenShift cloud services?](/en/technologies/cloud-computing/openshift/what-are-red-hat-openshift-cloud-services) * [VNF and CNF, what’s the difference?](/en/topics/cloud-native-apps/vnf-and-cnf-whats-the-difference) * [What is a container registry?](/en/topics/cloud-native-apps/what-is-a-container-registry) * [What is Skopeo?](/en/topics/containers/what-is-skopeo) * [What are Red Hat OpenShift Operators?](/en/technologies/cloud-computing/openshift/what-are-openshift-operators) * [Using Helm with Red Hat OpenShift](/en/technologies/cloud-computing/openshift/helm) * [Kubernetes security best practices](/en/topics/containers/kubernetes-security-best-practices) * [Orchestrating Windows containers on Red Hat OpenShift](/en/technologies/cloud-computing/openshift/windows-containers-on-red-hat-openshift) * [What is a Kubernetes operator?](/en/topics/containers/what-is-a-kubernetes-operator) * [High performance computing with Red Hat OpenShift](/en/technologies/cloud-computing/openshift/high-performance-computing) * [Advantages of Kubernetes-native security](/en/topics/containers/advantages-of-kubernetes-native-security) * [What is KubeLinter?](/en/topics/containers/what-is-kubelinter) * [Intro to Kubernetes security](/en/topics/containers/intro-kubernetes-security) * [Container and Kubernetes compliance considerations](/en/topics/containers/compliance) * [How microservices support IT integration in healthcare](/en/topics/microservices/microservices-in-healthcare) * [Kubernetes cluster management](/en/technologies/cloud-computing/openshift/kubernetes-cluster-management) * [Red Hat OpenShift on IBM IT infrastructure](/en/technologies/cloud-computing/openshift/what-is-red-hat-openshift-on-IBM-IT-infrastructure) * [Red Hat OpenShift for business leaders](/en/technologies/cloud-computing/openshift/business-leaders) * [How to deploy Red Hat OpenShift](/en/technologies/cloud-computing/openshift/deploy-red-hat-openshift) * [Cost management for Kubernetes on Red Hat OpenShift](/en/technologies/cloud-computing/openshift/cost-management) * [Kubernetes-native Java development with Quarkus](/en/technologies/cloud-computing/openshift/quarkus) * [What is enterprise Kubernetes?](/en/topics/containers/what-is-enterprise-kubernetes) * [What makes Red Hat OpenShift the right choice for IT operations?](/en/technologies/cloud-computing/openshift/it-operations) * [Why choose Red Hat for Kubernetes?](/en/topics/containers/why-choose-red-hat-kubernetes) * [What makes Red Hat OpenShift the right choice for SAP?](/en/technologies/cloud-computing/openshift/sap) * [What is Kubernetes role-based access control (RBAC)](/en/topics/containers/what-kubernetes-role-based-access-control-rbac) * [What is containerization?](/en/topics/cloud-native-apps/what-is-containerization) * [What was CoreOS and CoreOS container Linux](/en/technologies/cloud-computing/openshift/what-was-coreos) * [Learning Kubernetes basics](/en/topics/containers/learning-kubernetes-tutorial) * [What is service-oriented architecture?](/en/topics/cloud-native-apps/what-is-service-oriented-architecture) * [What is the Kubernetes API?](/en/topics/containers/what-is-the-kubernetes-api) * [What is Kubernetes cluster management?](/en/topics/containers/what-is-kubernetes-cluster-management) * [What is a Kubernetes deployment?](/en/topics/containers/what-is-kubernetes-deployment) * [Why choose the Red Hat build of Quarkus?](/en/topics/cloud-native-apps/why-choose-red-hat-quarkus) * [Introduction to Kubernetes architecture](/en/topics/containers/kubernetes-architecture) * [What is CaaS?](/en/topics/cloud-computing/what-is-caas) * [Introduction to Kubernetes patterns](/en/topics/cloud-native-apps/introduction-to-kubernetes-patterns) * [What is a Kubernetes cluster?](/en/topics/containers/what-is-a-kubernetes-cluster) * [What is Quarkus?](/en/topics/cloud-native-apps/what-is-quarkus) * [What is Jaeger?](/en/topics/microservices/what-is-jaeger) * [What is a data lake?](/en/topics/data-storage/what-is-a-data-lake) * [What is etcd?](/en/topics/containers/what-is-etcd) * [What is container-native virtualization?](/en/topics/containers/what-is-container-native-virtualization) * [What is Clair?](/en/topics/containers/what-is-clair) * [What is Knative?](/en/topics/microservices/what-is-knative) * [Why choose Red Hat for microservices?](/en/topics/microservices/why-choose-red-hat-microservices) * [Why choose Red Hat for containers?](/en/topics/containers/why-choose-red-hat-containers) * [What is Docker?](/en/topics/containers/what-is-docker) * [What is a Kubernetes pod?](/en/topics/containers/what-is-kubernetes-pod) [More about this topic](/en/topics/ai "More about this topic")