You can disable it per-site buried under two levels of menus in Safari but it's annoying.