That's probably the initial build, though, right? If you've already got dev-server running and it has to rebuild, it shouldn't have to rebuild the entire bundle again.
Also every time you add/remove a file or make similar breaking changes.
Yes, that is just the time for the initial (or production) build.
The dev server is not as fast as it has been initially, but it is fast enough.