If you don't know anything about vectors, start with some game programming. If you are talking things more along the lines of Hilbert Spaces or advanced physics, there's no alternative to a good book IMO.