"Security researchers have applied normalization-of-deviance theory to increasing reliance on LLM outputs in agentic systems."
Rehberger applies Diane Vaughan's concept to the treatment of probabilistic LLM outputs as dependable components in software systems, particularly when AI agents can take consequential actions. His discussion connects organizational tolerance of deviations with technical risks involving prompt injection, weak security boundaries, and insufficient downstream controls.
View Source