Yes, this sort of programming was pretty common. Today we don't have to do much about that but we do something very similar if we want lots of performance: we make sure that our instructions are in the CPU cache.
Yup. GPU pipelines are another very common example, with the notable difference that pretty much every GPU programmer will optimise for the render pipeline, which is not the case for the CPU.