Skip to main content

Follow up on the lowest-scored work

Each week Jaah's AI review reads a sample of the work your organization delivered and scores each task from 1 (poor) to 5 (excellent), with a one-line reason. Do this when you want to check what went wrong in the work it scored lowest, and decide whether to fix it, change how an agent runs, or let it go.

Who can do this: Requires the org admin role. Only Owners and Admins see the command center.

  1. In the sidebar, select Reports. The command center opens.
  2. In the bar, set the range to 7d or 30d. The review runs once a week, so the default 24h often holds no reviews. To look at one project only, pick it in Project.
  3. Select the Quality tab and scroll past the tiles. If it shows only No reviews yet, with the date of the first run, no review has run yet and there is nothing to follow up.
  4. Read Review score: the score trend, one line per agent. An agent whose line drops is the one to look at first.
  5. Read Score spread: how many reviews landed on each score, from 1 to 5. Hover the reviews/week figure beside it for the weekly sample size and the next run. If it is red, the last run failed, and the hover says why.
  6. Read Lowest scored: up to ten tasks, each with its score and the reviewer's reason under the title. A score of 1 or 2 is red, and a score of 3 is amber.
  7. Select a task's title to open its page, and check its result against the reviewer's reason.
  8. If the work needs fixing, start a new task that names what to fix. See Start a task. If the same agent keeps scoring low, compare it with other setups before you change anything: Compare agents and models by outcome.

The range and project stay in the page's address, so a copied link opens the same view for another Owner or Admin.