long_llama
long_llama copied to clipboard
Compared to RAG techniques
Hi! It is a great work and I'm very interested in FoT. But I'm curious about how it compares to RAG techniques. For example, would it be better to use Openai's text-embedding-ada-002 for the passkey retrieval task? What is the advantage of FoT? I would appreciate your insight @CStanKonrad