Progress implies moving toward a goal. What goal are we moving toward? Our society and economy aren't optimized for scenarios involving large scale unemployment. What use is automation if it only leads to mass human suffering?
The goal seems to be making the rich even richer.
You are right in that the goal is key, because much time and effort will be spent towards the goal. When Kennedy said we should go to the moon, we did. Our leaders today have other goals, and they too will reach their goals. Choose wisely.
So yes, I am looking forward to get even more richer in time. Like most of people. And this is way easier than it ever was before.
The problem the Luddites had is that they were skilled labour facing the possibility of destitution with no welfare state to provide time and money for retraining into new occupations. They could see that there was no future for their occupation, but they were arguing for better terms with their employers so that their short-medium term future wasn't so bleak (e.g. their family being sent to the [workhouse](https://en.wikipedia.org/wiki/Workhouse), and likely a drawn out and dehumanising death).
We have a welfare state now in all developed countries (by varying degrees), so the problems that the Luddites faced have been greatly mitigated from those past extremes. However, all welfare states assume that any state of unemployment is merely temporary, and provides on that basis.
The past is not a wholly reliable indicator for the future, and present indications are that with increasing automation there won't be enough good (interpret as you will) new jobs. Further, many of the new good jobs will be out of reach for a significant portion of our populations without the luck of latent ability and/or the luck being born into the right (well-off) family with access to high quality education and social connections.
The institutions that solved the Luddite problem can't solve a problem of truly long-term/permanent unemployment or very irregular employment.
The Luddites were basically correct - they were trading "good jobs" for fundamental unemployment. Demographically speaking the families involved did not on average recover from the damage for a few generations.
So while from a global perspective the overall change may be positive over time, you can't discount people out of hand for saying "wait a minute, we're going to get screwed hard here". They may well be right. It may still be the right thing to do.
What the policy implications of such are or should be is a separable issue.
Another potentially deep issue: the industrial revolution creating a bunch of new jobs and job categories does not demonstrate that the same will be true of a putative automation revolution that we are entering....
Which is the point, really. This is exactly the sort of assertion that is often made ... and often the Luddites are trotted out as an example. But they are a better counterexample to what you assert than an example.
I started my career as a journalist/editor when paper magazines were still a thing. Soon, the publishing house I was working in went out of business, so I have to learn the new trade: software development. Which also may become obsolete soon, at least for simpler tasks, so I'll be ready to learn something new.
Capitalism works because it needs rich enough customers on mass scale, the middle class. If there will be not enough jobs for the middle class to exist, there will be no capitalism anymore.
Unfortunately I can't show you what life was like before the industrial revolution, because we don't have images or movies from that time, suffice to say that life then "was short, brutish and hard". Child mortality was rampant, according to Adam Smith it was not unusual that a woman who had had 10 children didn't see any of them grew up to be adults.
There is no goal, but progress is moving as far away from that condition as humanely possible, as fast as possible. This is best achieved with capitalism.
If you want full scale employment just create another world war, so that we can draft everybody and piss all our wealth away.
The point wasn't that automation is bad (it clearly is not), but that if we continue to automate without a plan for how we deal with mass unemployment, then automation will lead to mass human suffering of a different kind.