Transient: a person who is staying or working in a place for only a short time.

I don't think most people mean someone is only temporarily homeless when they call them transients.