I think of frisbee as being at its peak in maybe the 70s and 80s although organized ultimate frisbee probably came in later in the cycle and maybe was fairly common even after the peak for casual recreation.
ADDED: As you and others note, I guess disc golf is actually a fairly big thing although I confess I've never actually played it.