I think Github Co-Pilot is most annoying from what I've tried... it's great for finishing off a task that's half done where the structure is laid out, as long as you put blinders keeping it focused on it. OpenAI and Google's options seem to get things mostly right, but do some really goofy wrong things from my own experiences.
They all seem to have trouble using state of the art and current libraries by default, even when you explicitly request them.
Is the problem you observed true regardless of the model you picked?
If the default option isn't at least arguably the best option I can't really speak to that. I would suggest that maybe metrics on a given set of technologies be done and that based on the project in use, that it should choose the best option dynamically by default. Such as C#+MS-SQL vs Node+Postgres vs Python+Matlab+DuckDB.