"LLM debugging is complicated by opaque, probabilistic behavior but can be approached systematically with evaluation, interpretability, error analysis, and iterative refinement."
The paper describes LLM failures as difficult to isolate because of opaque and probabilistic behavior and proposes structured debugging rather than prompt trial and error alone.
View Source