Question for OP - How big is the company you work for?
I work for a company that has around 50 technical employees and I'd say use of LLMs is putting pressure on the company against hiring more employess rather than actually laying people off.
My armchair estimate is LLMs make the employees ~5% more efficient "on average" (not everyone is using it or using it effectively), which is 15-30 minutes more efficient per day. That would mean you'd start thinking about laying off 5 people if you're a company with 100 technical employees. If you're a smaller company, it would be premature to lay off employees based solely off of the impact of LLMs.