This is a textbook as a book, personally I'd do a reading/study group to get the most out of it. I don't have a math specialty but even with some of mid-level uni math courses around signals, random processes, and machine learning I still feel uhhh behind for this book

Second this. Plus you can skip the socratic dialogs (the turtle and Achiles ones) without feeling guilty.