RAG LLM using MSFT SQL DB on Azure

Interactive demo•4 mins• Red Hat OpenShift AI

게시됨 September 9, 2026 등록자 Drew Minnear

This interactive demo helps users deploy a Retrieval-Augmented Generation (RAG) Large Language Model (LLM) solution on Red Hat OpenShift. It leverages Azure services to enhance AI-powered content generation and walks through the full setup and configuration experience for an AI-driven proposal generation workflow.
Cursor arrow pointing at a purple target
What you'll learn Next steps Feedback

What you'll learn in this interactive demo

The tour highlights:

  • Forking and cloning the rag-llm-gitops repository from GitHub and modifying overrides/values-Azure.yaml to configure AZURESQL.
  • Creating and configuring values-secret-rag-llm-gitops.yaml with Hugging Face token and Azure SQL credentials.
  • Provisioning a new Azure SQL Server instance in the Azure portal with SQL authentication and firewall rules.
  • Logging into the Red Hat OpenShift cluster and creating a GPU machineset for the LLM.
  • Verifying application synchronization and vector DB embedding job completion in Hub ArgoCD.
  • Generating an AI-powered project proposal using the RAG LLM Demonstration UI on OpenShift AI.

Next steps

Red Hat OpenShift AI

Try Red Hat OpenShift

Red Hat Developer Sandbox

Case study
Blog post
Blog post
Overview
E-book

About the author of this page

2 headshot

Drew Minnear

Senior Software Engineer

As a Senior Software Engineer on Red Hat's Validated Patterns team, Drew architects and builds automation for OpenShift to create reliable, repeatable solutions for enterprise customers. He joined the team in February 2025, bringing a unique perspective shaped by his experience in front-end and back...