RAG and Beyond: LLM Wiki and Recursive Language Model (RLM)
Andrej Karpathy proposed an approach to knowledge management called LLM Wiki, in which an LLM maintains a persistent, interconnected base of Markdown pages instead of re-retrieving raw documents for every query. The arch…