Data Analyst (English) | $11/hr Remote

Summary: The LLM – AI Quality Analyst (Personalization) role involves evaluating and designing conversational prompts for AI systems, focusing on the relevance and accuracy of personalized responses. The position requires strong analytical skills and attention to detail, with responsibilities including assessing AI outputs and maintaining data hygiene. This is a short-term remote contract requiring 30-40 hours per week for a duration of 2 months. Immediate start is expected.

Key Responsibilities:

• Design multi-turn conversational prompts based on personal context
• Evaluate personalized AI responses for relevance, grounding, and helpfulness
• Assess correct and incorrect use of personal data in model outputs
• Perform side-by-side (SxS) evaluation and ranking of AI responses
• Identify grounding errors, poor inferences, and forced personalization
• Write clear, structured rationales referencing specific conversation turns
• Extract and verify model debug information and data source usage
• Maintain strict data hygiene by deleting evaluation conversations

Key Skills:

• English fluency (reading and writing)
• Strong experience in data annotation, AI quality evaluation, content moderation, or related roles
• Strong analytical thinking and attention to detail
• Ability to evaluate nuanced and ambiguous AI responses
• Comfortable using a primary personal Google account with enabled data sources
• BS/BA degree or equivalent experience in a relevant analytical field
• Strong written communication and structured feedback skills
• Self-motivated and able to work independently in a remote setting
• Reliable desktop/laptop with stable internet connection

Salary (Rate): £10.00/hr

City: undetermined

Country: United Kingdom

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT