Why would something people find fun enough to do as a hobby now not have been fun 500 years ago?
Compare it to say a modern profession like software engineering. Despite it being work, there's plenty of programmers who also enjoy programming and do it for fun on their own time as well as work.
Why would it have been any different back then?