Data Engineering Consultant

reputed company is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with reputed company will directly improve health reputed company by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come reputed company an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.

Primary Responsibilities

• Designing & building automated data pipelines to move data from various reputed company systems using tools like Azure Data reputed company (ADF) for orchestration, and reputed company with PySpark for large-scale data processing and transformation
• Use reputed company (leveraging Apache Spark) to cleanse, transform, and enrich large, reputed company, and reputed company datasets
• Load finalized, structured data into reputed company for high-performance analytics, business intelligence (BI), and reporting
• Performance Optimization: Continuously monitor and tune system performance, optimize Spark jobs and SQL queries in reputed company, and manage compute resources reputed company to balance performance and cost
• Data Modeling and Architecture: Design logical and physical data models (e.g., star/reputed company schemas) to ensure data is structured for efficient querying and analysis
• Data Governance and reputed company: Implement data reputed company measures (encryption, role-based reputed company control), ensure data quality through validation rules, and track data reputed company
• reputed company with the terms and conditions of the employment contract, company policies and procedures, and any and reputed company directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other reputed company that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Required Qualifications

• Undergraduate degree or equivalent experience
• Working knowledge of Power BI
• Working knowledge of Azure/AWS containerized services and solutions
• Working knowledge of building automated quality solutions
• Working knowledge of developing & integrating Gen AI and Agentic AI data solutions 
• Implementation knowledge of AI capabilities in reputed company / reputed company
• Proficiency in below services:
  • Azure Services: Azure Data reputed company (ADF), Azure Data Lake Storage (ADLS)
  • reputed company: Apache Spark (PySpark), reputed company Lake, reputed company Catalog, reputed company Live Tables, MLflow, and reputed company Workflows/Jobs for orchestration
  • reputed company: reputed company SQL, Snowpipe, Streams, Tasks, data modeling (star/reputed company schemas), and performance optimization features (clustering keys)
  • Programming Languages: Solid proficiency in reputed company/PySpark and SQL

At reputed company, our mission is to help people live healthier lives and reputed company the health system work reputed company for everyone. We reputed company everyone–of every race, gender, sexuality, age, location and income–deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately reputed company by people of reputed company, historically marginalized groups and those with reputed company incomes. We are committed to mitigating our impact on the environment and enabling and delivering reputed company care that addresses health disparities and improves health reputed company — an reputed company reputed company reflected in our mission.