Software Engineer

Description: Design and ship features end to end: data model, API, background workers, and UI. Build and improve evaluation processes for agents and models, ensuring reliability and trust in results. Enhance quality-checking methods for benchmark tasks and integrate new models and benchmarks efficiently. Maintain system performance and reliability as usage scales, including efficient queries and safe migrations. Review code and maintain consistency in the codebase. Requirements: 5+ years of experience in building and operating production backend systems. Bachelor's degree in Software Engineering, Computer Science, or related field. Proficient in Python, experience with Django, PostgreSQL, and task queues like Celery. Hands-on experience in LLM evaluation and understanding of benchmark task construction. Strong judgment on task quality and ability to identify ambiguous instructions. Good tradeoff skills in design and ownership of projects from request to deployment. Familiarity with TypeScript and React for frontend changes. Clear writing skills for documentation and pull request descriptions. Benefits: Work at the forefront of AI, contributing to advanced models and benchmarks. Opportunity to showcase work at top AI conferences. Apply AI innovations to solve real-world business challenges. Collaborate with experienced colleagues from leading tech companies. Enjoy the speed and impact of a startup environment.