PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Judging the Plausibility Machine

"AI-generated unit tests can contain incorrect expected values and require human correction before they become reliable checks."

Ardic and colleagues observed twelve undergraduate students using ChatGPT for unit testing and found cases in which generated assertions had incorrect expectations. Their study illustrates how automatic test generation can shift engineering effort toward validating the tests themselves.

View Source