12 Questions to Ask Your HR AI Vendor
Your vendor’s AI is your liability. Send these 12 questions before you buy or renew, and ask for the answers in writing.
Scope and decisions
- 1. What decisions does the tool influence? Does it inform, recommend, rank, score or decide, and at which stage of hiring?
- 2. Which jurisdictions is it designed and tested for? Name the laws it has been assessed against, such as NYC Local Law 144, California FEHA, Colorado, Illinois and the EU AI Act.
Bias and fairness
- 3. How do you test for adverse impact? Which groups, which metrics, how often, and on whose data? Can we see the latest results?
- 4. Will you support an independent audit using our data? Including data access and the methodology documentation an auditor needs.
- 5. How do you control proxies? Zip codes, graduation years, employment gaps, names, accents and similar features.
- 6. For speech and video tools, how accurate is transcription across accents, dialects and speech disabilities?
Generated content
- 7. Can the tool generate interview questions or summaries? If so, how do you stop prohibited questions, such as those about age, health, family status or criminal history, by jurisdiction, and how do you check summaries for invented or omitted content?
Transparency and oversight
- 8. What notices, explanations and consent flows does the product support? For candidates, and for adverse-decision explanations.
- 9. How do human reviewers see the evidence behind an output, and can they override it? Are overrides logged?
Data and records
- 10. What do you log, for how long, and can we export it? Inputs, outputs, model version and reviewer actions.
- 11. Do you train models on our candidate or employee data? Where is data stored, and what are your security certifications?
Documentation and change
- 12. What documentation will you provide, and how will you tell us about material changes? Intended uses, known limitations and training-data categories, as Colorado and the EU AI Act will require.
Copy this list into your RFP or renewal questionnaire. Fairly AI can independently verify vendors’ answers. Book a call.
Map your hiring AI against the laws that apply to you
Whether you build HR AI or deploy it, Fairly AI tests it, monitors the rules where you operate and keeps the evidence.
Schedule a discovery call