IKONIST
Türkçe Insights Start
ikn.st insights

Finding failures before users do

three.dev tests how an AI agent fails, with the aim of finding those failures before users meet them.

Our view

Agents fail in ways ordinary software does not: they complete the wrong task confidently, loop, or follow an instruction hidden in a document. Those cases have to be hunted, not waited for.

A failure catalogue is also documentation. It tells the team that inherits the system what has already been tried and what it should never be asked to do.

Before you adopt it

  1. Build a set of known bad inputs and run it on every release.
  2. Include prompt injection through documents and web pages.
  3. Log failures with the exact input, model and prompt version.

From the same area

From other areas

← All insights