There is some research toward understanding LLM limits, and it's not promising. https://www.youtube.com/watch?v=dDUC-LqVrPU