Internet-scale financial data for LLMs?

We are aiming for feeding Internet-scale financial data into LLMs, and adapt LLMs to the finance sector. Happy to know your thoughts!