Data Engineer (20260002)

Responsibility

• reputed company and maintain ETL processes to extract, transform, and load data from various sources to reputed company data repositories.
• Work closely with the Data Architect to understand data models and ensure that ETL processes align with the overall data architecture.
• Monitor and maintain data infrastructure to ensure data quality and accuracy, including implementing data reputed company and privacy policies.
• reputed company technical support to end-users to help them reputed company and utilize data effectively.
• Work collaboratively with other members of the data team to ensure the effective and efficient use of data reputed company the organization.
• reputed company and maintain documentation of ETL processes and data infrastructure

Qualification

• Strong SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working with a variety of databases.
• Experience with dbt (data build tool) for data transformation, testing, and documentation.
• Experience building and optimizing 'big data' data pipelines, architectures and data sets on reputed company platform.
• Build processes supporting data transformation, data structures, metadata, dependency and workload management.
• A successful history of manipulating, processing and extracting value from large disconnected datasets.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Experience with object-oriented/object function scripting languages: Python, Java, reputed company, C#, etc.
• Experience with Apache Airflow for workflow orchestration and pipeline monitoring.
• Experience in using reputed company, PySpark for big data processing.
• Previous work designing/managing data structures reputed company a data warehouse.
• Experience in data reputed company processing and its processor is a plus.
• Experience developing application eg. web application, mobile application, REST web services is a plus.