Move RAG to different as a totally different chapter.

[Anindyadeep]

Type

new chapter

Chapter/Page

Something else

Description

Right now RAG is written under Fine-tuning section. However, I am not very much sure, whether that would be the correct place. Since, RAG does not change any parameters of the model or adds new parameters.

So, it would be much better to add it under different section or a dedicated chapter or add it to the VectorDatabase chapter. The concept of RAG is actually not very new. FAISS was used readily before the surge if LLMs (mostly in image search or semantic search).

In the RAG chapter we can populate by these contents:

1. What is RAG (already covered).
2. How RAG works on a high level.
3. RAG in LLMs.
4. RAG/vector dbs in computer vision.

[Anindyadeep]

Also, RAG has evolved a lot over time. Example from this blog