Content Risk Analyst, ASCI

1. AI Data Annotation, Quality Auditing & Model Improvement - Perform multi-domain data annotation and golden dataset curation for AI model improvement, following established SOPs and quality benchmarks - Validate and audit LLM judge outputs through human-in-the-loop review; use AI tools to flag patterns and anomalies - Maintain annotation accuracy and audit throughput targets; use AI-assisted error analysis to identify systematic failures and escalate to Process Experts - Participate in calibration exercises to ensure reviewer consistency and draft audit reports for program leads 2. Red Teaming Execution - Execute adversarial testing across multiple Alexa experiences (Alexa+, Ring, Automotive, Kids), using AI to generate diverse attack vectors and edge cases - Identify, document, and categorize policy violations, safety gaps, and vulnerabilities by severity and impact - Draft red teaming documentation and vulnerability summaries, ensuring findings are clearly categorized for program leads 3. Customer Feedback Triage & Analysis - Classify and triage daily customer feedback records per SOPs, using AI to pre-sort and surface emerging patterns - Identify recurring issues, escalation-worthy trends, and edge cases in customer interaction data - Handle complex cases req BASIC QUALIFICATIONS - Bachelor's degree - Experience in Artificial Intelligence/Machine Learning (AI/ML) Standards Law - 1+ years of experience in content moderation, data annotation, AI/ML operations, or compliance operations - Ability to follow SOPs and apply judgment in a fast-changing environment PREFERRED QUALIFICATIONS - Experience working with Data & AI related technologies, including, but not limited to, AI/ML, GenAI, Analytics, Database, and/or Storage - Experience with AI annotation tools, LLM outputs, or model evaluation frameworks - Familiarity with red teaming, content safety, or responsible AI operations - Exposure to incident management or escalation handling workflows

Amazon is a global technology company operating in e-commerce, cloud computing (AWS), digital streaming, advertising and artificial intelligence. Its India operations span development centres in Bengaluru, Hyderabad, Chennai, Pune, Gurugram and Mumbai, covering retail technology, AWS infrastructure, Alexa, advertising, payments and supply-chain systems.