I took it as labor people - those who do manual work for compensation. Field, work, carpenter, etc. It did existed during that time period in states where slavery was not legal.

There was much less of it in states where slavery was legal.