Human tendency to over-trust automated output—reviewers nod through AI-generated code, operators miss alerts the AI missed. Amplified by fluent, confident LLM outputs.
Automation bias is well-documented in aviation and medicine; it applies directly to AI coding tools and decision-support systems. Counter with forced-verification steps, dissent prompts, and human-in-the-loop design that gives humans real decision authority, not a rubber stamp.