Format Online paper / PDF "Automating the validation of test outputs is a significant bottleneck in software testing, even when test inputs can be generated automatically." View Source Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Judging the Plausibility Machine Source title The Oracle Problem in Software Testing: A Survey Source authors Earl T. Barr; Mark Harman; Phil McMinn; Muzammil Shahbaz; Shin Yoo Source year 2015 Confidence high Importance high
Format Online paper / PDF "A plain fuzzer can miss a program that returns wrong answers without crashing because the checker needs a way to determine what the correct output should be." View Source Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Judging the Plausibility Machine Source title The Oracle Problem in Software Testing: A Survey Source authors Earl T. Barr; Mark Harman; Phil McMinn; Muzammil Shahbaz; Shin Yoo Source year 2015 Confidence high Importance high
Format Online paper / PDF "There is more than seventy years of history behind attempts to verify that programs behave correctly." View Source Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Judging the Plausibility Machine Source title Checking a large routine Source authors Alan Turing Source year 1949 Confidence high Importance mid
Format Web Page "Confronted with a shrinking constraint space, the models produced inconsistent outputs, including lists containing eliminated teams and unanswered predictions." View Source Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Judging the Plausibility Machine Source title The Final Breakdown: Why AI Models Fail Simple Constraints at the Finish Line Source authors AnansiBox team Source year 2026 Confidence high Importance high
Format Web Page "The demand for five names remained even when only two valid answers existed." View Source Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Judging the Plausibility Machine Source title The Final Breakdown: Why AI Models Fail Simple Constraints at the Finish Line Source authors AnansiBox team Source year 2026 Confidence high Importance high
Format Web Page "In the closing days of the 2026 World Cup, AnansiBox repeatedly sent the same prompt to five AI models, asking for leading contenders while excluding eliminated teams." View Source Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Judging the Plausibility Machine Source title The Final Breakdown: Why AI Models Fail Simple Constraints at the Finish Line Source authors AnansiBox team Source year 2026 Confidence high Importance high
Format Online paper / PDF "Universal OOD learnability cannot be guaranteed without appropriate conditions on the detection problem." View Source Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Crossing the Bounds Source title On the Learnability of Out-of-distribution Detection Source authors Zhen Fang, Yixuan Li, Feng Liu, Bo Han, Jie Lu Source year 2024 Confidence high Importance high
Format Online paper / PDF "Universal, assumption-free OOD completeness is off the table in principle, rather than merely awaiting better detectors." View Source Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Crossing the Bounds Source title Understanding Failures in Out-of-Distribution Detection with Deep Generative Models Source authors Lily H. Zhang, Mark Goldstein, Rajesh Ranganath Source year 2021 Confidence high Importance high
Format Online paper / PDF "Even small estimation errors in a model of the reference distribution can produce OOD detection failures." View Source Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Crossing the Bounds Source title Understanding Failures in Out-of-Distribution Detection with Deep Generative Models Source authors Lily H. Zhang, Mark Goldstein, Rajesh Ranganath Source year 2021 Confidence high Importance high
Format Online paper / PDF "When predictions shape real-world decisions, the resulting actions can themselves change the data distribution." View Source Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Crossing the Bounds Source title Performative Prediction Source authors Juan C. Perdomo, Tijana Zrnic, Celestine Mendler-Dünner, Moritz Hardt Source year 2020 Confidence high Importance mid
