Companies LOVE requiring all of these sexy over-engineered tools in the requirements for the jobs they post.
I've definitely used these overkill solutions in my own work, sometimes because they were the right tool for the job, but many times simply because I knew that one day in the future, I'd be applying for another job, and that job would likely require that I have experience in these technologies. It sucks, but it's the way the world works for now.
This has a couple of downstream effects too. If I'm trying to hire, I need to include at least some of those sexy tech stacks in my posting if I want to get good applicants. Why? for the same reason I need to use those things myself even when they're not the best tool for the job.
The folks applying to my role know that they're not going to work for me for the rest of their lives and want to been able to check the right boxes when it comes time apply for their next job. Then of course when they get hired in we have to use at least some of these technologies even when we don't totally need them, because after all, it said right on the job posting that we use those technologies.
I saw the inverse of this too. There was a team managing a series of small-ish but incredibly important databases. They had these thing running on Microsoft sql server and were doing a beautiful job. There was exactly zero reason to migrate them to something else. But....when the folks in this department went to apply for other jobs inside the company or out, they were greeted with: "You're not using Snowflake??!!", "you're not doing Cloud?!!", "you don't even have an EMR cluster??!!".
Not surprisingly, after a while this group had a hard time hiring because folks saw it as a career dead end.
TL;DR people do what they're incentivized to do. Stop incentivizing dumb behaviors.