Azure OpenAI RAG chat template

Components in this architecture diagram

• Employees
• Teams or web chat
• Container App: chat API
• Entra ID: user groups
• Prompt Flow orchestration
• Azure AI Search: hybrid + semantic
• SharePoint
• Indexer & skillset
• Blob documents
• Embedding model
• Azure OpenAI chat model
• Content Safety
• Cosmos DB chat history
• App Insights & evaluations

How to use this architecture diagram template

1. Click Open in the editor. The architecture diagram opens on a new page in FlowDiagram — nothing is uploaded and there is no sign-up.
2. Rename, add or delete shapes and drag them where you want; connectors stay attached as things move.
3. Drop in vendor logos from the library — 1,160 of them, including every AWS, Azure and Google Cloud service icon — or restyle it with the colour and theme controls.
4. Prefer text? Edit the Mermaid source below and paste it in through ☰ → Import diagram (see the Mermaid editor); it imports as an editable diagram.
5. Export to PNG, SVG or PDF, or press Ctrl+L for a link that carries the whole diagram.

Mermaid source

The whole template is the text below. Paste it into FlowDiagram, keep it in Git next to the code it describes, or hand it to an AI assistant to extend.

flowchart LR
  U((Employees)) --> TEAMS[Teams or web chat]
  TEAMS --> API[Container App: chat API]
  API --> ENTRA[Entra ID: user groups]
  API --> PF[Prompt Flow orchestration]
  PF --> SRCH[Azure AI Search: hybrid + semantic]
  ENTRA --> SRCH
  SP[(SharePoint)] --> IDX[Indexer & skillset]
  BLOB[(Blob documents)] --> IDX
  IDX --> EMB[Embedding model]
  EMB --> SRCH
  PF --> AOAI[Azure OpenAI chat model]
  AOAI --> CS[Content Safety]
  CS --> API
  API --> COS[(Cosmos DB chat history)]
  API --> AI[App Insights & evaluations]

Related: System architecture diagram tool · Mermaid editor · All cloud & devops infrastructure templates · All 521 templates