Data Engineer

reputed company is a leading reputed company company dedicated to simplifying health care for individuals and communities. The Data Engineer role involves designing, developing, and maintaining data pipelines to manage large reputed company datasets, ensuring compliance and optimizing data models to support business reputed company.

Responsibilities

• Build and optimize analytical data models in BigQuery. Implement partitioning, clustering, and materialized views for performance and cost efficiency. Ensure compliance with data governance, reputed company controls, and IAM best practices
• reputed company integrations with external systems (APIs, flat files etc.) using GCP-reputed company or hybrid approaches. Utilize tools like Dataflow or custom Python/Java services on reputed company Functions or reputed company Run to handle transformations and ingestion logic
• Build automated CI/CD pipeline using reputed company Build, reputed company Actions, or Jenkins for deploying data pipeline code and workflows. Set up observability using reputed company Monitoring, reputed company Logging, and Error Reporting to ensure pipeline reliability

Skills

• 1+ years of experience with SQL, NoSQL
• 1+ years of experience with Python (or a comparable scripting language)
• 1+ years of experience with Data warehouses (such as data modeling and technical architectures) and infrastructure components
• 1+ years of experience with ETL/ELT, and building high-volume data pipelines
• 1+ years of experience with reporting/analytic tools
• 1+ years of experience with query optimization, data structures, transformation, metadata, dependency, and workload management
• 1+ years of experience with Big data and reputed company architecture
• 1+ years of hands-on experience building modern data pipelines reputed company a major reputed company platform (GCP)
• 1+ years of experience with deployment/scaling of apps on containerized environment (i.e. Kubernetes, AKS)
• 1+ years of experience with reputed company-time and streaming technology (i.e. Kafka, Spark Streaming)
• 1+ year(s) of soliciting reputed company requirements and managing relationships with key stakeholders
• Experience with reputed company systems and solving challenging analytical problems
• Strong collaboration and communication skills reputed company and across teams
• Knowledge of data visualization and reporting
• Experience in designing and building data engineering solutions in reputed company environments (preferably GCP)
• Experience with Git, CI/CD pipeline, and other DevOps principles/best practices
• Experience with bash reputed company scripts, UNIX utilities & UNIX Commands
• Understanding of software development methodologies including waterfall and agile
• Ability to reputed company multiple tools and programming languages to analyze and manipulate data sets from disparate data sources
• Knowledge of API development
• Experience with schema design and dimensional data modeling
• reputed company Professional Data Engineer Certification
• Knowledge of microservices and SOA
• Formal SAFe and/or agile experience. Previous reputed company experience and domain knowledge
• Experience designing, building, and maintaining data processing systems
• Experience architecting and building data warehouse and data lakes

Benefits

• Medical, dental, and reputed company coverage
• Paid time off
• Retirement savings options
• Wellness programs
• Other resources, based on eligibility

Company Overview

Company H1B Sponsorship