Senior Insurance Reasoning & AI Scoring Expert
Job Description
The opportunity
IXO is engaging US-based insurance professionals for paid evaluation of complex AI reasoning. This senior route requires both substantial insurance practice and previous direct assessment of AI outputs. Experience using a chatbot, without evaluating its answers against explicit scoring criteria, does not satisfy the assessment requirement.
Work and deliverables
• Help research and engineering colleagues identify weaknesses in how a model handles underwriting questions, claims analysis and insurance risk.
• Develop demanding insurance problems that reflect actual professional decisions, with enough evidence to test judgment rather than recall.
• Produce reference solutions that show the reasoning, important assumptions and evidence behind an answer.
• Evaluate generated responses using structured rubrics, separating errors of fact from poor judgment, incomplete reasoning or unsupported conclusions.
• Give written feedback that explains both the deficiency and what an acceptable professional response needs to address.
• Refine insurance-specific assessment guidance and compare scoring with other experts so that evaluations remain accurate and consistent.
Deliverables include complete task packages, reference answers, annotated assessments and improved grading instructions. Your contribution should make specialist judgment clear enough that another reviewer can understand and apply the same standard.
Required background
• At least eight years of dedicated work in insurance, including areas such as underwriting, claims, actuarial analysis or risk management, at a recognized leading organization or an equivalent institution.
• Previous hands-on evaluation of AI or large-language-model responses against rubrics or structured scoring rules. This is mandatory: describe the evaluation work you personally performed when applying.
• A clear record of increasing responsibility, such as progression from underwriting work into senior practitioner and leadership positions.
• Strong spoken and written communication, practical problem-solving and the ability to work reliably with other specialists.
Engagement and pay
Remote work within the United States pays $65 • $85/hr USD. Availability for at least 35 weekday hours per week is an indicative planning assumption. IXO confirms the actual rate, hours, scope and duration before an engagement begins. This is an IXO expert opportunity; applying does not guarantee selection or a particular volume of work.
Use only public, synthetic or explicitly authorized material. Do not submit confidential employer information, identifiable client records or material nonpublic information. Training outputs do not authorize live client transactions or formal professional opinions.