The arrival of 1-million+ token context windows was hailed as the death of Retrieval-Augmented Generation (RAG). Prompts like "Just drop the entire 800-page codebase into the context window" became common advice.
However, moving from single-user experiments to enterprise-scale production load reveals a harsh