Look at the prior art in the patent itself, e.g.:
US5844547 May 9, 1995 Dec 1, 1998 Fujitsu Limited Apparatus for manipulating an object displayed on a display device by using a touch screen
US6567102 Nov 25, 2001 May 20, 2003 Compal Electronics Inc. Touch screen using pressure to control the zoom ratio
US20050168488 Jan 31, 2005 Combination tool that zooms in, zooms out, pans, rotates, draws, or manipulates during a drag
All Apple did was jumble these same longstanding into some arguably-new form, and, viola, they had a patent for something everybody was doing.
I doubt you really contend that, in late 2007, Apple invented scrolling and zooming with your fingers, or that you contend that Apple's implementation was substantially different (and both novel and useful) from those prior forms. If you don't contend either of those, then why, exactly, should Apple have a patent over their implementation, which was at best modestly different from prior implementations?