Zifo
Senior Data Engineer
About this role
Description: Design, build, and operate data infrastructure for a clinical trial design platform. Own pipelines for ingesting, parsing, transforming, and serving clinical data from various sources. Develop embedding and vectorization pipelines for LangGraph-based workflows. Implement ETL/ELT workflows for transforming unstructured clinical content into queryable data. Ensure data quality validation specific to clinical data. Build data serving APIs using Python/FastAPI. Set up data lineage tracking for regulatory traceability. Requirements: Strong Python development experience, including PDF/document parsing libraries. Advanced SQL skills, particularly with Amazon Aurora; experience with schema design and query optimization. Hands-on experience with graph databases like Neptune or Neo4j; proficiency in SPARQL or Cypher. Familiarity with AWS services for data pipeline orchestration. Experience with PDF text extraction and named entity recognition for clinical text. Experience building data-serving APIs using FastAPI. Knowledge of preparing data for LangChain/LangGraph applications. Experience with workflow orchestration tools like Airflow or Prefect. Familiarity with Terraform, Docker, and Git for automated testing and deployment. Understanding of clinical trial structure and regulatory data integrity requirements. Benefits: Competitive compensation package including vacation, medical, dental, and vision insurance. 401k with company matching and life insurance. Flexible spending accounts. Opportunity to work in a curious and science-focused culture.