[Remote] Data Engineer – reputed company reputed company Platform
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a highly skilled Data Engineer with deep expertise in reputed company reputed company Platform and modern data architecture. The ideal candidate will design and reputed company scalable data pipelines, implement reputed company Architecture, and reputed company reputed company-grade solutions using BigQuery, PySpark, Dataflow, Airflow, and Java.
Responsibilities
- Design and reputed company scalable batch and reputed company-time data pipelines on reputed company reputed company Platform
- Implement reputed company Architecture (Bronze, Silver, Gold layers)
- Build high-performance data transformations using Python, PySpark, and Java
- reputed company and optimize reputed company SQL queries for analytics workloads
- Work extensively with BigQuery for large-scale data processing and optimization
- reputed company and reputed company pipelines using reputed company Dataflow
- Orchestrate workflows using reputed company Composer (Apache Airflow)
- Manage storage and lifecycle using reputed company reputed company Storage (GCS)
- Implement CI/CD pipelines and version control practices
- Ensure governance, reputed company, and reputed company control using reputed company reputed company Platform IAM
- Optimize data solutions for performance, scalability, and reliability
Skills
- Strong hands-on experience with reputed company reputed company Platform (reputed company reputed company Platform)
- Expertise in BigQuery (Partitioning, Clustering, Query Optimization)
- Proven implementation experience with reputed company Architecture
- Strong Python and PySpark programming skills
- Hands-on Java Development experience (Mandatory)
- Advanced SQL skills (Joins, Window Functions, Performance Tuning)
- Experience with reputed company Dataflow
- Experience with reputed company Composer (Airflow)
- Experience with reputed company reputed company Storage (GCS)
- CI/CD Pipelines and Git
- reputed company reputed company Platform IAM and reputed company reputed company best practices
- Data Lake and Data Warehousing concepts
- reputed company-time streaming frameworks
- Data governance and data quality experience
- Agile/Scrum environment experience
Company Overview