OpenTeams
Senior AI/ML Test and Evaluation Engineer
About this role
Description: Seeking a Senior AI/ML Test and Evaluation Engineer to build and operate benchmarking and evaluation capabilities for AI models. Focus on identifying model failures and developing methodologies for performance comparison against operational baselines. Requirements: U.S. citizenship and eligibility for a U.S. security clearance. 6+ years in software or machine learning engineering, with 3+ years in evaluating or deploying ML models. Strong Python skills and experience with ML frameworks like PyTorch. Experience in developing evaluation harnesses and metrics, and documenting evaluation results. Bachelor's degree in computer science, mathematics, engineering, or related field. Benefits: 100% paid medical, dental, and vision for employees; 75% for dependents. 401(k) match up to 5% with full vesting after 2 years. Unlimited PTO with a minimum of 15 days off annually. Fully remote setup with up to $3,000 equipment reimbursement. Continuous education reimbursement up to $500.