HR Generalist - AI Evaluation

Company: Ambitus Research

About Ambitus
Ambitus is an applied AI product and research company that partners with domain experts and enterprises to advance frontier AI capabilities.
About the role
We are working to build the future of AI by pushing the boundaries of what frontier models can achieve. The focus of this role will be reading real HR documents that we provide, working out the questions an HR generalist would need to answer from them, and judging whether AI models get those answers right.
Responsibilities
* Read employee handbooks, leave policies, benefits enrollment guides, and collective bargaining agreements, and work out the questions an HR generalist would face, such as applying leave eligibility rules and their exceptions to an employee's situation.
* Write challenging questions that can only be answered by combining information from several parts of a document, along with the correct answer and a checklist for grading responses.
* Review answers written by AI models and other experts, flag anything that is wrong, missing, or unsupported by the document, and write clear feedback on how it should change.
* Judge whether each task reflects how these documents are used in real HR work, keeping your judgments consistent across reviews.
Qualifications
* Bachelor's degree in any discipline.
* At least 3 years of experience as an HR generalist, HR business partner, or benefits specialist.
Required Skills
* Be experienced answering employee policy and benefits questions from the written documents, including leave rules, plan tiers, and premium tables.
* Have exceptional attention to detail and be comfortable applying the same standard across reviews.
* Possess English communication skills, with a focus on written proficiency.
* A SHRM or HRCI certification, or benefits administration experience, is a plus but not required.
Application process
Apply on our site: Link. The hiring team reviews resumes and reaches out to shortlisted candidates with next steps.

apply