See also Roofline Model https://en.wikipedia.org/wiki/Roofline_model

and Memory Wall https://www.google.co.in/search?q=memory+wall+computer+archi...