PracticeWorking with AI: Delegation & Oversight
Should Dev be worried?
Critique the agent's output
The situation
A weekly account-health summary for twelve enterprise accounts is generated by an agent and sent to the CS leads, where it feeds the Thursday save/expand call. Dev in CS ops has gone through this week's run line by line for the first time and found three things he knows are wrong.
Dev · CS ops: “Three things I know are wrong, from memory. It’s been running since August and this is the first time I’ve gone through it line by line. Should I be worried?”
The summary reads cleanly: twelve rows, a score and a status each, 'portfolio health is stable week-over-week'. Dev has given you three errors he happens to know about. Choose what to look at before you answer him.
What you can see
E01 · The summary line
health-agent v2.3, run 0412, generated Nov 18, 06:00, twelve accounts in the enterprise tier. Distributed to CS leads weekly; feeds the Thursday save/expand call. Summary: 8 healthy, 3 watch, 1 at risk. Portfolio health is stable week-over-week. Recommended focus for Thursday: Brightpath Logistics.
E02 · Dev's note: three things he knows are wrong
Ironside's renewal is Nov 30, twelve days away, and it is listed as healthy with no flag; the date is right, the treatment isn't. Fairhaven's 'three requests for additional seats': Dev was on that call, and they were asking about seat reassignment because they are cutting headcount. Corveau: their CSM told Dev last week they are evaluating a competitor. The agent has been running since August and this is the first time Dev has gone through it line by line. 'Should I be worried?'
E03 · The three rows Dev named
Fairhaven Systems, 91, Healthy: strong growth in weekly actives (+22%); expansion signal: three requests for additional seats in the last month; renewal Sep 1. Ironside Manufacturing, 79, Healthy: usage steady; renewal Nov 30; champion active. Corveau Retail, 88, Healthy: usage data unavailable for this period; no support tickets, no escalations; renewal Jun 30.
Step 1 of 2
What do you look at before answering Dev?
Your first choice is kept. Changing your mind later counts as a retry.