1. Home
  2. Interactive demos
  3. RAG LLM using MSFT SQL DB on Azure

RAG LLM using MSFT SQL DB on Azure

Interactive demo•4 mins• Red Hat OpenShift AI

Publié le September 9, 2026 par Drew Minnear

This interactive demo helps users deploy a Retrieval-Augmented Generation (RAG) Large Language Model (LLM) solution on Red Hat OpenShift. It leverages Azure services to enhance AI-powered content generation and walks through the full setup and configuration experience for an AI-driven proposal generation workflow.
Cursor arrow pointing at a purple target
What you'll learn Next steps Feedback

What you'll learn in this interactive demo

The tour highlights:

  • Forking and cloning the rag-llm-gitops repository from GitHub and modifying overrides/values-Azure.yaml to configure AZURESQL.
  • Creating and configuring values-secret-rag-llm-gitops.yaml with Hugging Face token and Azure SQL credentials.
  • Provisioning a new Azure SQL Server instance in the Azure portal with SQL authentication and firewall rules.
  • Logging into the Red Hat OpenShift cluster and creating a GPU machineset for the LLM.
  • Verifying application synchronization and vector DB embedding job completion in Hub ArgoCD.
  • Generating an AI-powered project proposal using the RAG LLM Demonstration UI on OpenShift AI.

Next steps

Red Hat OpenShift AI

Try Red Hat OpenShift

Red Hat Developer Sandbox

Blog post
Blog post
Blog post
Blog post
Overview

About the author of this page

2 headshot

Drew Minnear

Senior Software Engineer

As a Senior Software Engineer on Red Hat's Validated Patterns team, Drew architects and builds automation for OpenShift to create reliable, repeatable solutions for enterprise customers. He joined the team in February 2025, bringing a unique perspective shaped by his experience in front-end and back...