In principal, Western Jews like Hertzl himself did not plan to go anywhere. They saw themselves as Europeans were already emancipated since the first half of the 19th century and integrated (which led to growing anti-Semitism in Western Europe, but that's a different story).
Hertzl was secular and agnostic. Very different circumstances to those in the southern part of the Russian Empire (Pale of Settlement).