AI Trainer | $50/hr Remote

Summary: The AI Trainer role is a contract position focused on designing and refining assessment rubrics for AI training. The trainer will analyze performance, provide feedback, and ensure scoring methodologies are effective and consistent. This remote position requires a commitment of 10-40 hours per week and emphasizes quality control and validation of assessment outputs. Candidates should have expertise in rubric design and strong communication skills.

Key Responsibilities:

• Design, develop, and refine comprehensive rubrics tailored to AI training and assessment needs.
• Analyze task performance and provide structured, actionable feedback to guide improvement and calibration.
• Establish and document effective scoring methodologies that ensure consistency, fairness, and high-quality outcomes.
• Lead calibration sessions to align evaluators and maintain rubric integrity across projects.
• Validate assessment outputs for accuracy, reliability, and alignment with project objectives.
• Oversee quality control processes, making data-driven recommendations for rubric enhancements.

Key Skills:

• Proven expertise in rubric design, performance analysis, and feedback structuring for complex assessment environments.
• Strong background in scoring methodology development and calibration for AI or educational projects.
• Success in assessment validation and quality control processes.
• Exceptional written and verbal communication skills, with the ability to convey nuanced judgment and rationale.
• Practical, hands-on grocery shopping experience to inform realistic scenario assessments.

Salary (Rate): £50.00/hour

City: undetermined

Country: United Kingdom

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: Other