I haven't read it in detail, and I don't know how difficult it is, but there's a free book on how to (among other things) automate Office applications with Python:
https://automatetheboringstuff.com/
Chapter 12-14 look relevant to you (Excel, Word, and CSV).