Why RAG Is Big

I wonder how far you can push RAG and it's comparison to methods like LoRA

https://github.com/microsoft/LoRA

It seems like you can only get so far with a sophisticated prompt engineering framework like RAG. but I dunno, I haven't tested them against each other.