Every major ATS and CRM vendor now sells you an "AI agent." The word is doing a lot of work, and most of it is marketing.
In August 2026, both ASA and SIA flagged the same problem. The term "AI agent" now covers everything from a scripted chatbot to a system that sources, screens, and books candidates on its own. Those are not the same product. They are not even close. But they show up on the same slide, with the same badge, at wildly different prices.
If your renewal is coming up, you need a way to tell them apart. Not a vendor's way. Your own. Here is the framework I give staffing VPs before they sign anything.
The three things vendors call an "agent"
When a vendor says "AI agent," they mean one of three things. Your job is to figure out which one, fast.
1. A chatbot with a new label. This answers questions and follows a script. It can tell a candidate the job pays $28 an hour. It can schedule an interview if you hand it a calendar link. It does not decide anything. It waits for a human or a rule to tell it what comes next. This is fine technology. It is also five years old, and you should not pay agent prices for it.
2. A copilot. This suggests. It drafts an outreach message, ranks a candidate list, or writes a job summary. A human still clicks approve on every action. Copilots save real time. A recruiter who writes 40 outreach messages a day can cut that to editing 40 drafts. That is worth money. But it is a helper, not an agent. It never acts alone.
3. An actual agent. This takes an action, checks what happened, and decides the next step without a human in the loop. It sources candidates against an open req, sends the first message, reads the reply, and either books the screen or moves on. It works a list overnight and hands you three qualified people by morning. This is the thing worth paying for, and it is the rarest of the three.
Most "AI agent" products on the market today are the first two wearing the third one's name tag.
Four questions that cut through the pitch
You do not need a data science degree to evaluate this. You need four questions and the discipline to wait for real answers.
Question 1: Name three decisions this makes without a human clicking approve. If the vendor stalls or lists things like "it suggests" or "it recommends," you have a copilot. That is not bad. It is just not what they said. A real agent makes decisions and lives with them.
Question 2: What does it do when it is wrong? Real agents fail sometimes. The good ones catch the failure and correct it. Ask what happens when the agent messages the wrong candidate or misreads a reply. If the answer is "a human catches it," then the human is doing the agent's job.
Question 3: Run it on my data, not your demo. Demos use clean records and perfect reqs. Your ATS has duplicate candidates, half-finished job descriptions, and notes that say "call back re: rate." Ask the vendor to run the agent on your actual data during the trial. Watch what breaks. That gap is what you are really buying.
Question 4: What metric moves, and by how much? A real agent changes a number you already track. Time to first submittal. Recruiter hours per placement. Candidate response rate. If the vendor cannot tie the agent to one specific metric with a target, they are selling you a feeling.
Why this matters at renewal, not next year
Renewal is when the price jumps and the pressure is on. The vendor adds an "AI agent" tier, marks it up 30 percent, and tells you the market is moving. Your competitors are buying it, they say. You need it to keep up.
Some of that is true. AI is changing how fast a firm can source and screen. But "you need to keep up" is not a reason to buy a rebranded chatbot at a premium.
Here is the trap I see PE-backed staffing firms fall into. Ops leaders approve the AI tier because it looks bad to say no to AI in a board deck. Six months later, nobody can point to a single number that moved. The recruiters still do the same work. The line item just got bigger.
Do not let the label drive the decision. Let the outcome drive it. If the agent moves a real metric on your real data, buy it. If it does not, keep your money and revisit next cycle.
One more thing on price. A real autonomous agent that sources and books overnight is worth a lot, and vendors know it. If the price feels cheap for what they claim, the claim is probably inflated. Match the price to the tier. Chatbot money for a chatbot. Agent money only for something that actually acts alone.
The one thing to do this week
Pull your current ATS contract and find the renewal date. Then write down one number you want an AI agent to move: time to first submittal, recruiter hours per placement, or candidate response rate. Pick the one that hurts most right now.
Bring that number to your next vendor call. Ask them to run their agent on your data and show you movement in 60 days. If they will not, you have your answer. If they will, you have a real test instead of a sales pitch. Either way, you walk into the renewal with facts, not a badge.