Then again, a good number of the people I do know don't even understand the concept of a web address or even how to use bookmarks -- nevermind speed dial. Usually when I watch someone try to find a site, they just search for it in Google, and if Google isn't the default search provider, they search for Google in whatever search engine is the default. They also rarely use any browser "feature" except the back button, and they're afraid to try out new features. Even tabs and multiple windows are often underutilized or avoided by simply using one window at a time and closing it if they want to start over or visit a new site.
In fact, whenever they accidentally activate a feature they don't use (history, right-click context menu, rss feed view, gestures, etc.), it often just leads to confusion because they weren't paying attention to what they did to set off the unfamiliar feature's action. As a result, they just close the window and start over, and if it happens again they get frustrated and do something else.
Also, learning new features isn't free. There's a cognitive cost involved and it takes a certain amount of training and repetition to solidify the ability to use new features. For some people, it's higher than for others, and eventually it gets to a point where people like my Dad have to basically relearn the same features over and over again every time they use a computer. Listening to older relatives talk about their computer experiences, it also sounds like most of the time they're too deeply afraid of accidentally breaking their computer by clicking or doing the wrong thing to learn features by experimenting, further reducing the ability for them to solidify their learning through repetition and practice.
By comparison, those individuals I see who are willing to learn new features or who can notice what they did to set off a feature are usually pretty tech-savvy (or soon will be) and would be able to figure out how to use and install extensions anyway.
So personally, I think it's a good idea to aim for a default, minimalist interface and avoid gestures and interactive UI elements that users can accidentally click or activate. But that's just based on my casual observations of people using computers, which is why I'd love to hear yours, since apparently you disagree.