How to design fair job simulations in 7 steps (2026)

Regulators and candidates are now asking the same question about hiring technology: can you show that it is fair? New York City already requires an independent bias audit of automated employment decision tools before you use them. Illinois has added disclosure and anti-discrimination rules for AI in hiring. State-level rules keep shifting, and even where a specific law is on hold, the federal baseline under Title VII, the ADA, and the ADEA has not moved. The safe response to a moving target is to design for fairness by default, not to chase each new statute.

Structured job simulations are one of the most direct ways to do that. They give every candidate the same chance to prove what they can actually do, and they replace impressions with evidence tied to the real requirements of the role. That makes a decision easier to explain if a candidate, an auditor, or a court ever asks how you reached it.

This guide walks through seven steps for designing job simulations that give candidates an equal opportunity to demonstrate relevant skills, reduce common sources of bias, and stay anchored to genuine job requirements. It is general information, not legal advice, so confirm your obligations with your own counsel. Vervoe, an AI-powered skills intelligence platform, runs through the guide as a worked example of how the approach comes together in practice.

Quick guide: how to design fair job simulations in 7 steps

1. Identify the essential skills for the role. Map duties to observable, measurable skills tied to daily tasks.
2. Write a clear, inclusive job description. Remove requirements that could deter qualified applicants.
3. Choose the right simulation format. Match task types to the role.
4. Design tasks that mirror real work. Build scenarios candidates would meet on an ordinary day.
5. Standardize instructions and time limits. Give every candidate the same information, tools, and deadlines.
6. Use transparent, criteria-based grading. Score against predefined rubrics, not personal impressions.
7. Review results and refine. Audit outcomes for consistency and update after each round.

How to build structured job simulations for fairer hiring

1. Identify the essential skills for the role

Start by listing the tasks a new hire will perform in their first 90 days. For each one, name the specific skill it requires, such as data entry accuracy, customer communication, or equipment operation.

Focusing on essential duties keeps your simulation anchored to genuine job requirements. Under Title VII, a selection procedure that produces adverse impact must be job related and consistent with business necessity, so a simulation built on real job tasks is far easier to defend than one that tests for polish or pedigree. Rank each skill by how critical it is to on-the-job success. That ranking later determines how you weight your grading rubric.

2. Write a clear, inclusive job description

Your job description is the foundation of every simulation task. Write it in plain, gender-neutral language, and separate the essential criteria from the preferred ones so candidates know exactly what matters.

Avoid wording that hints at age, national origin, or appearance. Phrases like "young and dynamic," "digital native," or "recent graduate" can screen out protected groups and discourage qualified people from applying. Consider an equal opportunity statement that welcomes applicants regardless of race, sex, age, disability, or veteran status.

3. Choose the right simulation format

Different roles call for different task types. A customer service position might need a situational judgment scenario, while a data analyst role benefits from a live spreadsheet exercise.

Vervoe's AI Assessment Builder reads your job description, identifies the competencies the role demands, and generates a role-specific assessment in minutes across a range of question formats, from video responses to code challenges, so you can match the format to the skill. Matching the format to the work improves the predictive value of the result, which means the outcome tells you more about how someone is likely to perform on the job.

4. Design tasks that mirror real work

A fair simulation asks candidates to do the work, not talk about it. If the role involves writing customer emails, ask them to draft one. If it involves resolving complaints, present a realistic scenario and ask for their response.

Tasks grounded in real duties are harder to game, and they give every candidate an equal opportunity to demonstrate ability. Pairing realistic tasks with skills-based assessments keeps the focus on what a person can do, regardless of their educational or professional history. Keep tasks short enough to respect candidate time. A simulation of 20 to 40 minutes is usually enough to capture meaningful evidence without placing an unreasonable burden on applicants.

5. Standardize instructions and time limits

Consistency is the backbone of fairness. Every candidate should receive identical written instructions, the same tasks, and the same deadline.

Build in reasonable accommodations for candidates with disabilities, as required under the ADA. That might mean extending a time limit or offering an alternative format for a specific task. Document your standardization process. If an outcome is ever challenged, clear records show that you treated candidates consistently.

6. Use transparent, criteria-based grading

Grade every response against a rubric that maps directly to the skills you identified in step one. Each criterion should describe what a strong, adequate, and weak response looks like, so graders apply the same standard to everyone.

Vervoe's AI grading scores responses against your defined criteria and links each result back to the specific evidence that produced it, so you can explain a decision to a candidate or a reviewer. AI does not replace human judgment here. Where possible, have a second reviewer assess borderline responses, and keep a person accountable for the final call. If your tool is an automated employment decision tool used in a jurisdiction like New York City, this kind of explainability also supports the bias-audit and notice obligations you may face.

7. Review results and refine

After each hiring round, look at the data. Did some tasks produce unclear results? Did one group consistently drop off at a particular stage? Patterns like these can signal design issues worth investigating.

Vervoe tracks demonstrated performance across candidates, which makes it easier to see where a simulation might need adjustment. Keep a changelog of every update. Iterating after each round, and documenting it, is how a good process becomes a genuinely fairer one over time, and how you build the evidence trail an audit expects.

What do US laws say about hiring discrimination and AI?

At the federal level, Title VII of the Civil Rights Act of 1964, the Age Discrimination in Employment Act of 1967, and the Americans with Disabilities Act of 1990 make it unlawful to discriminate against applicants on the basis of protected characteristics, and they apply at every stage of hiring. These do not change when a hiring tool is powered by AI. On top of that federal floor sits a growing state and local patchwork: New York City's Local Law 144 requires an independent bias audit and candidate notice for automated employment decision tools, and Illinois has added AI disclosure and anti-discrimination requirements. Colorado's original AI Act has since been repealed and replaced by a narrower law covering automated decision-making technology, now set to take effect January 1, 2027. Connecticut has added its own AI employment law, requiring employers to disclose and give notice when automated employment-related decision technology factors into a decision, and California's expanded FEHA regulations already cover employment automated-decision systems, with broader rules from the state privacy regulator due in 2027. Because the state rules keep moving, the durable strategy is to design hiring around demonstrated, job-relevant skills so your process holds up regardless of which rule applies. Structured simulations support that goal, but they do not, on their own, guarantee compliance.

How do you measure fairness in a recruitment process?

Fairness becomes measurable when you track selection rates by group. The long-standing benchmark is the four-fifths rule in the federal Uniform Guidelines on Employee Selection Procedures: if the selection rate for any group is less than 80% of the rate for the highest-scoring group, that is generally treated as evidence of adverse impact worth investigating.

Record pass rates, shortlist rates, and hire rates by demographic group where candidates have voluntarily disclosed that information, and watch for stages where one group falls behind. If a gap appears, check whether the design introduces barriers, such as culturally specific language, inaccessible technology, or tasks unrelated to the role. A 2025 socio-legal study by Sheard in the Journal of Law and Society found that AI hiring systems can facilitate discrimination when they rely on proxy indicators rather than job-relevant evidence. Vervoe's candidate analytics make these comparisons straightforward, so you can act on the numbers rather than guess.

How Vervoe helps you design fairer job simulations

Vervoe gives US talent acquisition teams a practical way to move from fair-hiring policy to fair-hiring practice. As an AI-powered skills intelligence platform, it is built on tasks that mirror real job duties, so candidates are evaluated on what they can do rather than where they studied or what their name sounds like. The AI Assessment Builder turns a job description into a role-specific assessment quickly, with questions generated from your JD rather than pulled from a static bank, and every response autograded by transparent AI that links each result to the evidence behind it. Vervoe also publishes AI bias audit results, which supports the kind of scrutiny that laws like Local Law 144 now expect.

That same verified skills evidence does not stop at the hiring moment. It can extend across your existing workforce to show where capability and gaps sit, which is increasingly what HR and transformation leaders need to see.

For high-volume hiring teams, this means you can assess many candidates at once and still support every decision with real evidence. Want to see how structured, skills-based simulations work in practice? Explore Vervoe's job simulations, or book a tailored demo when you are ready to discuss your own roles.

Book a tailored demo