It’s not even good at writing unit tests. It’s good at writing bad unit tests but that’s not the same thing.
Have you tried o1-pro or o1-2024-12-17?
Actually writing tests often requires more contextual knowledge than writing code itself.
I get you hate writing unit tests (we all do), but in reality it's a more technically difficult and intricate problem than writing business logic code itself. Testing is the very last place I'd trust an AI.
The hard part is knowing what to test. Once I do, AIs do a pretty good job at doing most of the typing for me.
writing useful unit tests is not basic at all. it's only basic if it's purpose is to lift the test coverage.
You put your finger on something really interesting there!
probably the last comment i'd have expected an explicit thank you for. but anyway, you're welcome. care to share why it feels so relevant to you?
Once I read your comment I could feel that quality (something uncanny valley about his "empathy") in those videos, which I hadn't picked up on before you pointed it out.
IME the tests these tools write are complete shit and need to be rewritten by hand.