1. Home
  2. Interactive demos
  3. RAG LLM using MSFT SQL DB on Azure

RAG LLM using MSFT SQL DB on Azure

Interactive demo•4 mins• Red Hat OpenShift AI

Published on September 9, 2026 by Drew Minnear

This interactive demo helps users deploy a Retrieval-Augmented Generation (RAG) Large Language Model (LLM) solution on Red Hat OpenShift. It leverages Azure services to enhance AI-powered content generation and walks through the full setup and configuration experience for an AI-driven proposal generation workflow.
Cursor arrow pointing at a purple target
What you'll learn Next steps Related resources & demos Feedback

What you'll learn in this interactive demo

The tour highlights:

  • Forking and cloning the rag-llm-gitops repository from GitHub and modifying overrides/values-Azure.yaml to configure AZURESQL.
  • Creating and configuring values-secret-rag-llm-gitops.yaml with Hugging Face token and Azure SQL credentials.
  • Provisioning a new Azure SQL Server instance in the Azure portal with SQL authentication and firewall rules.
  • Logging into the Red Hat OpenShift cluster and creating a GPU machineset for the LLM.
  • Verifying application synchronization and vector DB embedding job completion in Hub ArgoCD.
  • Generating an AI-powered project proposal using the RAG LLM Demonstration UI on OpenShift AI.

Next steps

Red Hat OpenShift AI

Try Red Hat OpenShift

Red Hat Developer Sandbox

Blog post
Blog post
Blog post
Blog post
Blog post
Interactive demo

Analyze Cluster Readiness with  AI in Red Hat OpenShift

Learn how to run an AI-powered cluster readiness assessment in Red Hat OpenShift to evaluate update paths, monitor live analysis logs, and address potential operator compatibility issues prior to upgrading.

1 min

Red Hat OpenShift

 Interactive demo

RAG VP UI for Summit

Deploy and explore Retrieval-Augmented Generation (RAG) AI patterns on Red Hat OpenShift. This demo guides users through installing RAG validated patterns and interacting with LLM models for enhanced information retrieval.

4 mins

Red Hat OpenShift AI

We'd like to hear from you

We welcome your thoughts on our interactive demos at Red Hat. We're committed to delivering engaging, hands-on learning resources, and your input helps us continue to improve our offerings.

Share feedback
A woman wearing a Red Hat hoodie and headphones smiles while using a laptop

About the author of this page

2 headshot

Drew Minnear

Senior Software Engineer

As a Senior Software Engineer on Red Hat's Validated Patterns team, Drew architects and builds automation for OpenShift to create reliable, repeatable solutions for enterprise customers. He joined the team in February 2025, bringing a unique perspective shaped by his experience in front-end and back...