Circle
Lead Engineer, AI Quality
About this role
Description: Lead the AI Quality engineering team to build evaluation frameworks, observability tooling, and diagnostic infrastructure for AI-powered features. Focus on improving the reliability, efficiency, and scalability of AI systems. Requirements: 7+ years of experience in production software, particularly with LLM-powered agents. Proficiency in Ruby on Rails and Python, with experience in building evaluation or observability infrastructure for ML/AI systems. Experience in designing datasets and annotation workflows for ML/AI evaluation. Ability to thrive in a fast-paced, dynamic environment and strong alignment with company values. Proficient in English at CEFR Level C2 / ILR Level 5. Benefits: U.S.-benchmarked compensation globally, equity in the company, and 35 days of paid time off annually. Remote-only work with biannual company retreats and a benefits package supporting health, wellbeing, and professional growth.