e-readers and physical books just don't provide as many possibilities for distraction.
The day I find a baby swiping up on an iPad will be momentous in my mind :).
But personally I can recall the specific size, weight, smell and texture of physical books I've read. It adds context and helps distinguish books as independent physical entities which (I believe) helps with recall. On the other hand digital books have begun to blend together for me.
Again very anecdotal.
All in all, I can read for hours on a e-ink display, but my eyes hurt soon on a normal screen. But az least they improved a lot compared from the old bulky ones.
The only time I flick forwards is to see how much is left of the chapter, backwards is max one page, kindle have status for how much is left. So guess that depends on how you normally read