Poor merchants, prostitutea and all kinds of people serving/scavenging from the army would follow the train in those times.

/r/askhistorians has a great thread on this, will try and find it.