Senior Data QA-Onshore

Description: Seeking a Senior Data QA Automation Engineer to lead quality strategy and automated testing frameworks for big data platforms. Responsible for end-to-end data validation strategy within Databricks Lakehouse architecture, ensuring high-quality and compliant data. Requirements: Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field. 8+ years of experience in data engineering, data QA, or SDET, with 2+ years in test automation in Databricks. Mastery of Python and PySpark for processing large datasets. Deep expertise in advanced SQL queries and Spark query execution plans. Hands-on experience with big-data validation libraries (e.g., Great Expectations, pytest). Strong knowledge of Databricks deployment on major cloud providers (AWS, Azure, GCP). Benefits: Opportunity to lead and mentor junior engineers in data quality best practices. Work with cutting-edge technologies in a collaborative environment.