Human Oversight in HR AI: Which Decisions Must Stay Human
Turn this article into takeaways for your work.
Each assistant summarizes the article only for you and suggests best practices for your work.
Human oversight in HR AI means a named person with the authority, information and time to question an AI output and change the outcome before it affects an employee or candidate. Having someone click "approve" doesn't count. Regulators and researchers have both said so, and the research on how people actually behave around AI recommendations says why.
This page is for HR directors, people managers and compliance leads who are deciding where AI can recommend, where it can act, and where a human has to own the call. It covers which HR decisions belong in which tier, what the law says "meaningful" involvement means, how to design review that isn't theatre, and what to document. It pairs with AI in HR for the wider picture and with the human-in-the-loop concept for the pattern itself. This is general information, not legal advice.
Key Facts
- Under GDPR Article 22, a person has the right not to be subject to a decision based solely on automated processing that produces legal effects or similarly significantly affects them (GDPR Article 22).
- European data protection regulators said human involvement only counts if oversight is "meaningful, rather than just a token gesture," and is done by someone "who has the authority and competence to change the decision" (Article 29 Working Party, WP251).
- The EU AI Act classes AI tools for employment and worker management, such as CV-sorting software, as high-risk, with obligations applying from 2 December 2027 (European Commission).
- In a University of Washington study of 528 people screening candidates with simulated AI recommendations, participants' choices followed severely biased AI picks about 90% of the time (University of Washington, November 2025).
- A widely cited human-factors review found automation bias occurs in both novices and experts and "cannot be prevented by training or instructions" (Parasuraman and Manzey, Human Factors, 2010).
What the Law Actually Requires
Two instruments do most of the work for HR teams hiring or managing people in Europe, and a third framework helps everywhere else.
GDPR Article 22
Article 22(1) gives individuals the right not to be subject to a decision based solely on automated processing, including profiling, that produces legal effects or similarly significantly affects them. Exceptions exist where the decision is necessary for a contract, authorized by law with safeguards, or based on explicit consent. Even then, for the contract and consent cases the controller must implement suitable safeguards, at least the right to obtain human intervention, to express a point of view and to contest the decision (GDPR Article 22).
The regulators' guidelines are blunt about the trick everyone is tempted to try. A controller can't avoid Article 22 by fabricating human involvement. Someone who routinely applies automatically generated profiles without any actual influence on the result still leaves the decision "solely automated." The guidelines also list "e-recruiting practices without any human intervention" as a typical example of a decision that significantly affects someone (WP251).
Then there's the question of how far "solely" stretches. In the SCHUFA case, the Court of Justice of the EU held on 7 December 2023 that a credit agency's automated probability score counted as an automated individual decision where the third party receiving it "draws strongly" on that score to decide on a contract with the person (CJEU, C-634/21). The case concerned credit, not employment. But the logic travels: if a recruiter nearly always follows a screening score, the score may be the decision in substance, and the human step doesn't protect you.
The EU AI Act
The Act treats AI used in employment and worker management as high-risk, with CV-sorting software named as an example. Following the Digital Omnibus amendment, the obligations for these systems apply from 2 December 2027, and the Commission lists "appropriate human oversight measures" among the requirements, with deployers ensuring human oversight and monitoring (European Commission). The amendment entered into force on 27 July 2026 (Lewis Silkin).
Two articles matter most to HR:
- Article 14 says high-risk systems must be designed so people can effectively oversee them. The people assigned oversight must be enabled to understand the system's capabilities and limits, to stay aware of "the possible tendency of automatically relying or over-relying on the output (automation bias)," to interpret outputs correctly, and to decide not to use the system or to "disregard, override or reverse the output" (AI Act Article 14).
- Article 26 puts duties on the employer as deployer. You must assign oversight to people with "the necessary competence, training and authority," keep the system's automatically generated logs for at least six months unless other law says otherwise, and inform workers' representatives and affected workers before a high-risk system is used (AI Act Article 26).
Article 86 adds a right to "clear and meaningful explanations of the role of the AI system in the decision-making procedure" for people affected by decisions based on Annex III high-risk outputs (AI Act Article 86). That's a practical reason to keep records of what the AI contributed. More on that below.
Outside the EU
Elsewhere the rules are a patchwork, and several US state laws on automated decisions have been amended or delayed, so check each place you hire. NIST's AI Risk Management Framework, released on 26 January 2023, is a voluntary US framework you can use as a governance skeleton in any jurisdiction (NIST). And employment discrimination law applies whether or not software was involved. Group-level monitoring, such as the four-fifths comparison in 29 CFR 1607.4, is a standard first check for any selection tool.
Why "A Human Reviews It" Often Isn't Enough
The legal tests assume a human who can really disagree with the machine. The research suggests that's harder than it sounds.
A 2010 review in Human Factors found that automation bias leads people to make both omission errors (missing something the tool didn't flag) and commission errors (following wrong advice). It occurs in novices and experts, and it "cannot be prevented by training or instructions" (Parasuraman and Manzey). A one-hour course on AI limits isn't a control.
The hiring-specific evidence points the same way. In the University of Washington study, 528 participants screened candidates for 16 jobs with simulated AI recommendations. With no AI or neutral AI they chose white and non-white applicants at equal rates. With a moderately biased AI they mirrored whichever group it favored, and with a severely biased AI they followed its picks about 90% of the time (University of Washington). The recommendations were simulated, so this shows how people respond to a skewed suggestion, not how any real product performs. Still, it's a direct warning: a reviewer who sees the AI's pick first tends to confirm it.
Which means oversight is a design problem, not a staffing one. You can't fix it by telling reviewers to be careful.
A Decision Tier Table
There's no single legal list of which HR decisions must stay human, and the answer depends on jurisdiction. The tiers below are a practical way to apply the legal tests above: the more a decision affects someone's livelihood, rights or dignity, the more a person must own it. Treat this as a starting policy for your counsel to adjust, not as a statement of what any law requires.
| Decision | AI role allowed | Human role required | Documentation |
|---|---|---|---|
| Rejecting a candidate on a knockout or ranking | Parse, flag, rank, explain | Reviewer with authority reads the record and the reason before any rejection that rests on the AI output; samples the rest | Criteria used, reviewer, reason, any override |
| Promotion or internal mobility | Surface candidates, summarize evidence | Manager and HR decide, with the AI's inputs visible and challengeable | Evidence considered, decision maker, rationale |
| Pay changes and bonus allocation | Benchmark, model scenarios, flag outliers | Manager approves and owns each individual outcome; HR checks group patterns | Inputs, scenario chosen, approver |
| Performance rating | Draft summaries, highlight data | Manager forms the rating from their own observation; employee can respond | Sources, final rating author, employee response |
| Discipline and warnings | Compile records, check policy consistency | Human investigates, hears the employee, decides | Investigation notes, employee's account, decision maker |
| Termination or redundancy selection | Analyze data, model options | Senior human decision with legal and HR review; never an automated trigger | Selection criteria, review record, approval chain |
| Accommodation or leave requests | Route, check eligibility paperwork, answer process questions | Trained human decides and handles every denial or edge case | Request, decision maker, reasoning |
| Scheduling, FAQs, routine admin | Act and execute within rules | Spot checks and an escalation path | Rules, logs, exceptions |
Two principles sit behind the table. First, the closer the decision is to ending, denying or reducing something for a person, the less the AI should be able to do without a human reading the reasons. Second, "sole" decisions aren't only the ones that run without a person. They include ones where a person reliably follows the output. If you can't show a reviewer ever disagrees, you may have an Article 22 problem even though a human is nominally in the loop.
Real Examples by HR Function
- Recruiting. An applicant tracking system auto-ranks 800 applicants for a support role. A recruiter reads the top 40. Applicants ranked below that cutoff are effectively rejected by the algorithm. The fix is to review a random sample of the unread pile each week and to require a person to see the stated reason before any knockout rejection. See AI resume screening.
- Performance and promotion. A tool summarizes a manager's notes and project data and suggests a "ready for promotion" flag. The manager treats the flag as the answer. Good practice is to have the manager write their own assessment first, then compare it with the tool, so the machine isn't anchoring the judgment. More on this in AI in performance management.
- Compensation. A model recommends raises within a budget. A manager approving 40 recommendations in ten minutes isn't reviewing. Cap the batch size, show the reasoning for outliers first, and have HR check group-level patterns separately.
How to Build Oversight That Isn't Rubber-Stamping
- List every AI-assisted decision in HR. Include the quiet ones: ranking, flags, nudges, drafted ratings. You can't tier what you haven't found. A small inventory often turns up tools managers adopted without telling anyone.
- Assign each decision to a tier and a named owner. Use the table above as a template. The owner is a role with real authority, not "the HR team."
- Give reviewers authority. Article 14 and Article 26 both turn on the ability to disregard, override or reverse the output, and on assigning oversight to people with competence and authority (Article 14, Article 26). If overriding the tool needs three sign-offs and an apology, nobody will.
- Give reviewers information. Show the inputs, the reason for the output, and the confidence where the system provides one. A bare score invites deference. This is where explainable AI earns its keep.
- Give reviewers time. Set sensible batch sizes. If throughput targets make real review impossible, you've designed a rubber stamp.
- Change the order of work for high-stakes calls. Where it's practical, ask the person for their own assessment before showing the AI's. This reduces anchoring on the machine's suggestion.
- Track override rates and review depth. If reviewers agree with the AI 99% of the time, ask whether they're agreeing or just clicking. A near-zero override rate is a warning sign, not a success metric (see measuring AI in HR for how to track it alongside other fairness metrics). Compare override rates across reviewers and across groups of candidates or employees.
- Give people a route to a human. For anything significant, tell people AI is involved, let them ask for a person to look again, and let them add their side. That mirrors the safeguards in Article 22(3) and the explanation right in Article 86.
- Re-tier when things change. A new model version, a new data source or a new use of an old score can move a decision up a tier.
Monitoring the tool itself belongs here too. See AI hiring bias for how to test outcomes by group.
What to Document
Records are how you prove oversight happened, and they're what a regulator, auditor or employee's lawyer will ask for. The regulators' guidelines say a controller should identify and record the degree of human involvement in the decision-making process and at what stage it takes place (WP251). A workable minimum:
- The decision, its tier and its owner.
- What the AI produced, which version produced it, and what the reviewer saw.
- The reviewer's decision, their reasoning if they overrode the output, and the time it took.
- Any contact from the affected person, such as a request for human review or an explanation, and the outcome.
- Logs retained for the period your law requires. For EU high-risk systems, deployers keep the automatically generated logs for at least six months unless other law provides otherwise (Article 26).
A structured AI audit trail makes this far easier than reconstructing events from email.
Common Pitfalls
- Counting a click as oversight. If the reviewer cannot change the outcome, or never does, regulators may treat the decision as automated.
- Hiding the reason. Reviewers who see only a score defer to it.
- Overloading reviewers. A queue of 200 items a day guarantees approval by default.
- Treating training as the fix. Research says awareness alone doesn't remove automation bias, so build structure, not just a course.
- Using override rate as a performance metric against reviewers. If people get marked down for disagreeing with the tool, they'll stop.
- Ignoring the pile nobody opens. Rejections that no one reads are where errors and bias hide.

Senior Customer Retention Strategist