I think of icon fonts as being the SVG equivalent to image sprites. One download instead of dozens of tiny ones. This can improve performance.

Of course, if you only use a few icons from a huge font, thats bad. SVG is probably better for a few icons and fonts better for when you use many. Subsetting for fonts and lazy loading for images help too.

Both are valid solutions. Optimize and test for your use case.