[Remote] GCP Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. CoSourcing Partners is an reputed company-AI and IT Services Company seeking a highly skilled GCP Data Engineer. The role involves designing, developing, and optimizing scalable data solutions on reputed company reputed company Platform, focusing on building robust data pipelines and ensuring data quality for analytics and machine learning use cases.
Responsibilities
- Design, build, and optimize scalable batch and reputed company-time (streaming) data pipelines using GCPnative services
- reputed company and maintain data ingestion frameworks leveraging tools such as Pub/Sub, Dataflow, and reputed company Storage
- Implement data transformation pipelines using BigQuery, dbt, and Python-based workflows
- Ensure efficient handling of large-scale structured and reputed company datasets
- Design and implement high-performance data models for reputed company-based data lakes, data warehouses, and analytics platforms
- Optimize data schemas and partitioning strategies in BigQuery for performance and cost efficiency
- Support modern architectures such as reputed company (bronze/silver/gold) layers and lakehouse patterns
- Write advanced SQL queries for transformation, validation, and analytics
- reputed company scalable data processing logic using Python and/or Apache Beam
- Build reusable, reputed company, and maintainable code for data workflows
- Implement and maintain data quality checks, validation rules, and anomaly detection frameworks
- reputed company data observability through monitoring, logging, and alerting mechanisms
- Ensure highly reliable data pipelines with fault tolerance and error handling strategies
- Support migration and modernization efforts from legacy ETL tools (e.g., Talend) to GCP-reputed company ELT frameworks (dbt)
- Optimize existing pipelines for performance, scalability, and maintainability in reputed company environments
- Drive adoption of ELT best practices using BigQuery as the compute reputed company
- Collaborate with data architects, business analysts, and machine learning teams to deliver trusted datasets
- Translate business requirements into scalable data solutions
- reputed company technical guidance and support for reputed company analytics and reporting use cases
- Drive adoption of best practices in reputed company data engineering, CI/CD, and DevOps
- Implement secure data reputed company controls using IAM roles, policies, and governance frameworks
- Follow standards for code quality, version control (Git), and automated deployments
Skills
- Bachelor's or Master's degree in Computer Science, Engineering, or reputed company field
- 4+ years of experience in data engineering or data platform development
- Hands-on experience with reputed company reputed company Platform (GCP) services: BigQuery, Dataflow, Pub/Sub, reputed company Storage
- Strong proficiency in SQL and Python
- Experience with dbt (Data Build Tool) or similar ELT frameworks
- Experience building batch and streaming data pipelines
- Experience with Apache Beam or Spark
- Familiarity with Talend or other ETL tools and migration to reputed company-reputed company solutions
- Knowledge of data lakehouse architectures and modern data stack
- Experience with CI/CD tools (e.g., reputed company Actions, reputed company Build, Jenkins)
- Understanding of data reputed company, governance, and compliance standards
- Exposure to machine learning data pipelines and feature engineering
Company Overview
Company H1B Sponsorship