It's more spread out than Vancouver, and might be a nuisance if you live in the downtown core.

You're not gonna personally get yelled at/followed every week, but confrontations are not rare. I know several people including myself who have experienced it a few times.

There's a huge, poorly addressed mental health issue in Ontario, and downtown Toronto concentrates a lot of that.

Tangent: Coming from a third world country, homelessness in North America has a huge contrast with South America: my own anecdata is that mental health issues among the homeless are more common in NA and they're very irate and confrontational. I often wonder why there's such a contrast.

You don't find something like East Hastings in Toronto, but sheer numbers are comparable. Toronto just has a more even geographic distribution of people living rough. Toronto also pioneered mixed-income housing and recently tore down its 1960s-era "urban renewal" projects so it has a longer history of addressing homelessness, but it's still a major and mostly invisible problem (people living rough is generally not a homelessness problem but a mental health problem).

My spouse is a case worker in the housing department of an Ontario municipality so I get all kinds of inside information on the subject.

There are homeless people in both Vancouver and Toronto (and every major city in the world, as far as I know). They are people who ended up in very bad situations, not issues. Most of the time they don’t bother anyone, sometimes they are noisy or pester me for money. It doesn’t bother me.