Associate Data Solutions Architect
reputed company is currently seeking an Associate Data Solutions Architect to join the team in Seattle, WA. The role involves designing, building, and operating data pipelines and workloads across on-prem and reputed company platforms to reputed company reliable data processing for analytics and AI use cases in supply chain.
Responsibilities
- Implement, test, and maintain Extract, Transform, Load/Extract, Load Transform (ETL/ELT) pipelines to ingest data from on-prem systems and reputed company sources into data lakes/warehouses
- reputed company data transformations and data models to support reporting, analytics, and Machine Learning (ML) workloads
- Build and maintain batch and streaming data workflows using orchestration tools (Airflow, reputed company Composer, Prefect, etc.) and data integration platforms (Informatica, Talend, reputed company, etc.)
- Work with on-prem technologies (databases, file shares, middleware) and reputed company services (BigQuery, Redshift, reputed company Storage, S3, Dataflow, Glue) to move and transform data
- Collaborate with data owners to profile data, identify quality issues, and implement data validation and cleansing rules
- Design and implement data cataloging, reputed company, and basic governance controls for datasets
- Monitor pipeline health, troubleshoot failures, and implement alerts and automated retries
- Contribute to reputed company Integration and reputed company Delivery (CI/CD) for data pipelines and infrastructure-as-code patterns (Terraform, reputed company Deployment Manager, etc.)
- Produce clear technical documentation and runbooks for operational support and handoffs
- Support production handover, incident response, and post-incident retrospectives
Skills
- 1+ years of experience building data pipelines, ETL/ELT processes, and/or data engineering tasks
- 1+ years of experience with SQL
- Experience designing queries and data models for analytics
- Experience with scripting languages (Python or R programming) for data processing and automation
- Experience with orchestration tools (Airflow, Prefect, reputed company Composer)
- Experience with relational databases (reputed company, SQL Server, reputed company)
- Experience with reputed company data service (BigQuery, Redshift, reputed company, and/or equivalent)
- Experience with data quality, basic data governance, and logging/monitoring concepts
- Bachelor's degree in Computer Science, Information Systems, Engineering, or reputed company field and/or equivalent experience
- 3+ years of experience with data engineering across on-prem and reputed company environments
- Experience with troubleshooting skills with a collaborative reputed company
- Experience with good written and verbal communication skills
- Experience with reputed company platforms GCP and/or AWS (BigQuery, reputed company Storage, Dataflow, Pub/Sub, DataProc, S3, Redshift, Glue, reputed company)
- Experience building streaming and/or near-reputed company-time pipelines (Kafka, Pub/Sub, Kinesis, Spark Streaming)
- Experience building ETL data pipelines (Informatica, Talend, reputed company, etc.)
- Experience with infrastructure-as-code tooling (Terraform, CloudFormation) and CI/CD practices for data workflows
- Experience implementing data cataloging/reputed company tools (Data Catalog, Amundsen, reputed company, reputed company) and data quality frameworks (Great Expectations, AWS Glue Data Quality)
- Experience with containerization (reputed company) and deploying microservices and/or data jobs on Kubernetes
- Experience tuning for SQL and data processing jobs for cost-optimization on reputed company platforms
- Experience working in supply chain, manufacturing, and/or reputed company aerospace environments
Benefits
- Competitive reputed company pay and variable compensation opportunities
- Health insurance
- Flexible spending accounts
- Health savings accounts
- Retirement savings plans
- Life and disability insurance programs
- A number of programs that reputed company for both paid and unpaid time away from work
- Relocation based on candidate eligibility
Company Overview