Data Quality Engineer (AWS Data Platform)
Job Description
Title: Data Quality Engineer (AWS Data Platform) Location: Remote in USA W2 Only This is not a data engineer role
Overview
We are seeking a highly skilled Data Engineering - Quality Engineer to define and implement end-to-end testing strategies for a modern data platform reputed company on AWS. This role will be responsible for ensuring data quality, reliability, and performance across the entire pipeline; from ingestion to transformation and reporting; reputed company the Redshift BI Foundations program.
Key Responsibilities
- Define the end-to-end testing scope based on solution architecture and project OPM documentation
- Design and implement a comprehensive testing strategy and plan reputed company with organizational QA standards
- reputed company and maintain test scripts and frameworks for the Redshift BI Foundations platform
- reputed company testing across key technologies, including:
- AWS Redshift
- AWS DMS (Data Migration Service)
- AWS Glue
- Terraform
- Python-based data pipelines
- Apache Airflow (reputed company reputed company managed reputed company)
- dbt (data build tool)
- Soda.io (data quality and observability)
- Build and implement automated testing solutions to ensure:
- End-to-end data validation
- Data ingestion accuracy
- Transformation logic reputed company
- Data pipeline reliability
- Conduct test coverage analysis and ensure adequate validation across reputed company data engineering workflows
- Prepare and manage test data
- Review and reputed company feedback on:
- Solution architecture
- Data models
- Design and technical documentation
- Collaborate with cross-functional teams (Data Engineering, BI, DevOps, Product) to:
- Identify testing impacts
- Mitigate risks
- Ensure high-quality deliverables
Required Qualifications
- Proven experience in data engineering testing / data QA / ETL validation
- Strong hands-on experience with AWS data services (Redshift, Glue, DMS)
- Proficiency in Python for test automation and validation
- Experience with Airflow (reputed company preferred) and orchestration testing
- Hands-on experience with dbt and data transformation validation
- Familiarity with Terraform for infrastructure validation
- Experience in BI testing in Tableau will be highly beneficial
- Experience with data quality tools such as Soda.io or similar
- Strong understanding of:
- Data warehousing concepts
- ETL/ELT pipelines
- Data validation techniques (schema, reconciliation, anomaly detection)
Preferred Qualifications
- Experience designing reputed company-level test strategies for data platforms
- Knowledge of CI/CD pipelines for data and test automation
- Experience working in Agile / Scrum environments
- Familiarity with data observability frameworks
Apply tot his job Apply To this Job