Always fix errors in reverse order, from the bottom of the file to the top. That way the line numbers don't change as you go.
But I also do M-x compile, and emacs is clever enough to still find the right line when doing next-error, even if I edit things before.