Hacker News Reader

Comment by knodi123 | Hacker News Reader

> nobody is really replacing somebody with a program that confidently get half it's answers wrong

I gotta tell you, I use copilot to help with my coding, and it still sends a shiver down my spine when it writes the entire database migration based off of the filename, or writes 4 pages of automated tests that work right on the first try.

View on HN

> writes 4 pages of automated tests that work right on the first try

Not sure that’s the right criterion to assess the quality and adequacy of tests.

But my GitHub badge says I have 105% test coverage! That means there are negative bugs, right...?

I'd be impressed if AI wrote a test suite that immediately found a bunch of valid bugs. I'd be nonplussed if it wrote a test suite that "passed" on the first try. The presence of passing tests does not imply an absence of bugs, and the hard part of developing a test suite is the test design, not the implementation.

lol, fair enough, but I would never commit a line of code I hadn't carefully read myself. my new class was basic, so the new unit test was basic as well, but it was thorough and correct. And I exaggerated a bit; I did write 3 or 4 comments to give the ai some idea of where I was heading.

I've had it freak me out with how prescient can be, but it also gets a lot of things subtly wrong, like its programming against an API similar to the one in my application, but not identical.

Do you check that those tests can fail at all? That seems like a common human error, might be present here?

Which programming languages do you use?

Reply on news.ycombinator.com