Explain like I'm five · AI

What is RAG?

Retrieval-augmented generation, told as a story about a librarian who finds the right page and puts it on the tray before the parrot answers.

full refund within 14 days!(our rule is actually 7 days)what is our company refund rule?it never read that rulebook — yet it answers plausibly

The guest asks about our company refund rule. The parrot never read that rulebook.Yet it answers plausibly — it is the plausible parrot.

the books it readourrulebook×not in the pilecontinues without knowingDRILL IT IN?new facts stick poorlyrules change, drill againno idea where it came fromthe drill is for manners, not for new factsit is not in the books, and the drill barely helps

Our rule is not in its books. And drilling new facts in barely works.The short drill is for manners, not new facts. And you can't re-drill every time a rule changes.

guestrefund rule?librarianrulebook p.12refund within 7 daysreceipt required…the page foundtrayrulebook p.12refund within 7 daysQanswer from thisrefund within 7 dayssource: rulebook p.12RAG: before the parrot answers, the librarian finds the relevant page and puts it on the tray

RAG: before the parrot answers, the librarian finds the relevant page and puts it on the tray.The parrot is never retrained. Each time, a page goes on the tray with the words answer from this. That way it can cite its source too.

Turn the question into a tagso it can be found by meaning
A few near pages from the shelfnot the whole book
On the tray: answer from thisright beside the question
Attach the sourcewith the page number
① questionthe guest asks② tagquestion to coordinates③ shelffind the near cell④ 3 pagesclosest first⑤ trayplaced with the question⑥ answer + sourcewith the page numberrefund?(3, 9)p.12p.31p.8→ guest→ traysee p.12the tray holds only so many beans, so a few near pages go on — never the whole book

The question becomes a tag, and a few near pages travel from the shelf to the tray.The tag is the coordinate tag; the shelf is the shelf organized by tags. The tray holds only so many beans, so just a few pages go on.

shipping p.40arrives in 3 daysthe wrong pagerefund in 3 days!a wrong page means a wrong answersearch quality is answer qualitythe whole rulebook………………traybigger than the traya page bigger than the tray gets cut downgood finding plus a page that fits the tray — that is what makes a good answer

If the librarian brings the wrong page, the parrot answers wrongly. And a page bigger than the tray must be cut down.Search quality is answer quality. And the page has to fit the tray. The answer can still be wrong, so check the source — the plausible parrot never fully goes away.

In one breath

RAG = before the parrot answers, the librarian finds the relevant page and puts it on the tray. No retraining, yet it answers from our books and can cite sources. If the librarian finds the wrong page, the answer is wrong too.

The question is embedded, a retriever pulls related chunks from a vector DB, a reranker orders them, and they go into the context window so the LLM answers from that evidence. Unlike fine-tuning, knowledge lives outside the model, so it is easy to update and can be cited. Retrieval quality and chunking decide answer quality; hallucination drops but never vanishes.

When grown-ups say it

RAG
The page the librarian brought. Retrieval-augmented generation: find it, put it on the tray, then answer.
Retriever
The librarian. The part that takes the question tag and pulls near pages from the shelf.
Chunking
Cutting the book into pages. Pre-cut to tray size before shelving. Too big won't fit; too small loses the surrounding context.
Reranking
Re-ordering the pages found. Pull 10 from the shelf, re-sort by true relevance, put only 3 on the tray.
Citation
The source attached to the answer. It says which page it came from, so the guest can check.
Context window
The tray. Where the found pages go. It has a fixed size. → the tray in front of the parrot
vs. fine-tuning
The drill is manners; RAG is knowledge. New facts go on the tray; tone gets fixed by drilling. → the short drill
Hallucination
The plausible lie. Giving it the page reduces it but never removes it. → the plausible parrot
Next story
The Parrot's Notebook →
Want another term as a picture book? Request →