> Langchain actually doesn't make getting the full text of what's being sent to the LLM easy (or at least I couldn't find a good way to do it).

I ran into the same problem, which is why I ended up building https://github.com/amosjyng/langchain-visualizer . Hopefully that is useful for you too :)