> there are the ones avoiding regular society, etc.

Indeed, something as simple as smoking weed (regardless of the reason) will exclude you from most government assistance. Living indoors is not always a suitable trade-off for giving up medications that work.