Evidence

Format Web Page

"Variation in server load and batch size can cause nondeterministic LLM outputs even when inference runs on CPUs or TPUs rather than GPUs."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Are Your Abstractions Managed?

Source title Defeating Nondeterminism in LLM Inference

Source authors Horace He with collaborators at Thinking Machines Lab

Source year 2025

Confidence high

Importance mid

Format Web Page

"The primary reason many LLM inference endpoints are nondeterministic is that server load changes the batch size used during inference."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Are Your Abstractions Managed?

Source title Defeating Nondeterminism in LLM Inference

Source authors Horace He with collaborators at Thinking Machines Lab

Source year 2025

Confidence high

Importance high

Format Online paper / PDF

"LLM code generators can produce semantically different implementations when mathematically equivalent formulas are expressed differently in prompts."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Are Your Abstractions Managed?

Source title Assessing, Exploiting, and Mitigating Syntactic Robustness Failures in LLM-Based Code Generation

Source authors Laboni Sarker; Mara Downing; Achintya Desai; Tevfik Bultan

Source year 2026

Confidence high

Importance high

Format Online paper / PDF

"Natural-language specifications given to coding agents can be incomplete or ambiguous, causing generated implementations to diverge from intended behavior."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Are Your Abstractions Managed?

Source title Challenges and Paths Towards AI for Software Engineering

Source authors Alex Gu; Naman Jain; Wen-Ding Li; Manish Shetty; Yijia Shao; Ziyang Li; Diyi Yang; Kevin Ellis; Koushik Sen; Armando Solar-Lezama

Source year 2025

Confidence high

Importance high

Format Web Page

"Agent-generated code still needs independent human review and validation before integration and execution."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Are Your Abstractions Managed?

Source title Introducing Codex

Source authors OpenAI

Source year 2025

Confidence high

Importance high

Format Web Page

"A coding agent can generate and modify source code in response to a user’s requested software task."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Are Your Abstractions Managed?

Source title Introducing Codex

Source authors OpenAI

Source year 2025

Confidence high

Importance high

Format Online paper / PDF

"Higher-level programming languages can be translated through defined compiler stages, and some compiler implementations formally prove that key stages preserve source-program behavior."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Are Your Abstractions Managed?

Source title The CompCert C verified compiler - Documentation and user's manual

Source authors Xavier Leroy

Source year 2026

Confidence high

Importance high

Format Online paper / PDF

"The health of shared software abstractions depends on coordination and investment in their maintainers."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Are Your Abstractions Managed?

Source title Census II of Free and Open Source Software - Application Libraries

Source authors Frank Nagle; James Dana; Jennifer Hoffman; Steven Randazzo; Yanuo Zhou

Source year 2022

Confidence high

Importance mid

Format Online paper / PDF

"Commercial applications routinely depend on third-party open-source libraries that are developed outside the application team."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Are Your Abstractions Managed?

Source title Census II of Free and Open Source Software - Application Libraries

Source authors Frank Nagle; James Dana; Jennifer Hoffman; Steven Randazzo; Yanuo Zhou

Source year 2022

Confidence high

Importance high

Format Web Page

"PHP processes higher-level source code through defined tokenization, parsing, opcode compilation, and interpretation stages."

View Source

Location PART 3 - THE THIRD AXIS CHAPTER 15: DEPLOY NOW, PRAY LATER Are Your Abstractions Managed?

Source title High-level overview

Source authors PHP project

Source year 2026

Confidence high

Importance high