When I was in university, we learned graphics programming by taking a linear algebra course or two. This was applied in a graphics course in which all students built their own software renderer, from top to bottom.
I have seen coworkers who never learned matrix math fumble with obfuscated code that could be replaced with one line of matrix operations. Several game companies I have interviewed at make linear algebra a very big part of their technical interview process. IMO if you are even remotely comfortable with math, learning matrix math is a HUGE benefit (maybe even a necessity) if you want a serious job as a game developer... the easiest way to get going with it is to just take a university-level intro to linear algebra course. That is all you need to understand the math underneath the entire rendering pipeline.