Senior Applied AI Engineer, Agent Quality & Evaluations

Description: Flodesk is a rapidly growing email marketing company focused on providing tools for small businesses to grow and monetize their email lists. The Senior Applied AI Engineer will shape AI systems to enhance member experiences by managing AI behavior, creating evaluation criteria, and improving system performance. Requirements: Proven experience in building or improving production-level LLM or agentic products. Strong software engineering skills in Python, TypeScript, or similar languages. Familiarity with LLM evaluation, observability, and experimental design. Ability to translate member feedback into actionable quality definitions and system changes. Excellent communication skills across technical and non-technical disciplines. Bonus: Experience with content-generation tools, multi-turn agents, and platforms like Langfuse or Braintrust. Benefits: Competitive salary range of $150,000 - $250,000 based on location and experience. Fully paid health insurance for individual coverage. Generous parental leave policies (16 weeks for non-birthing parents, 22 weeks for birthing parents). Unlimited flexible time off and 401(k) match for US employees. $1,000 annual stipend for learning and development.