Deck, a company that builds automation infrastructure for computer-use agents, observed that agents repeatedly failed on vendor portals when faced with ambiguous UI elements, such as a form with two buttons labeled “Continue” and “Submit” where the agents chose the wrong one and stalled. The issue was seen across thousands of agent runs, highlighting that the same UX problems that humans gloss over are exposed as hard failures for agents, surfacing hidden design debt in utility accounts, payment pages, and back‑office tools.
Because agents cannot guess, backtrack, or ask coworkers, each UI flaw becomes a measurable failure, turning invisible usability debt into a quantifiable reliability risk for automated workflows. This visibility forces product teams to confront design shortcomings that otherwise inflate support costs and reduce automation ROI.