Senior Staff Software Engineer - AI/ML Inference Engineering

Description: Lead the architecture, optimization, and operational excellence of the AI inference platform. Own the end-to-end inference lifecycle, deploying optimized inference engines in production across multiple backends on Kubernetes. Architect the intelligent gateway layer using Envoy and ext_proc for access control and observability. Requirements: 8+ years of backend software engineering experience. 4+ years of designing and operating distributed systems. Expertise in Go or Python, OOP, Design Patterns, and efficient algorithms. Experience with model-serving and runtime systems like vLLM, TensorRT-LLM, Triton Inference Server. Bachelor’s degree in computer science or related field; a master’s may offset experience. Benefits: Base pay range of $201,300 - $352,300, plus equity and variable compensation. Health plans, 401(k) with company match, ESPP, flexible time away plan, and family leave programs.