What Is Retrieval-Augmented Generation (RAG)? A Leader's Guide
Retrieval-augmented generation (RAG) is a way of building an AI assistant so that it looks up relevant passages in your own documents before it writes an answer. Instead of relying only on what a large language model memorized during training, the system retrieves current, approved content (such as your HR handbook or IT knowledge base) and asks the model to answer from it. For business leaders, RAG is the most common pattern behind "ask our policies" chatbots, and its quality depends far more on your content and access controls than on the model itself. This guide explains how RAG works step by step, how it compares to fine-tuning and prompt-only approaches, where it fits in HR and IT, and what risks and governance steps you should plan for before you approve a rollout. Key takeaways RAG pairs a language model with a search step over your own content, so answers can reflect current policies instead of stale training data. The pipeline has five parts: indexing, embeddi...