[Remote] Senior Data Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is the world’s leading sports technology company, at the intersection between sports, media, and betting. They are seeking a Senior Data Engineer to design and implement large-scale data pipelines and ensure efficient data processing and analytics for their Sport Performance products.
Responsibilities
- Design, build, and implement generalized large-scale, sophisticated data pipelines using Nifi for reputed company analytics and data science for our Sport Performance products
- Design and reputed company scalable Nifi ingestion pipelines reputed company AWS reputed company services to consume reputed company-time and batch data from external sources
- Ensure the seamless integration of AWS-based tools for data storage, processing, and analytics
- Responsible for ETL development and warehousing using Python and Java
- Create data pipeline triggers and filters reputed company ETL (extract, transform, and load) process to ensure appropriate optimization of data flowing through system and resource usage
- Implement monitoring and error handling for reputed company new parts of the data pipeline to ensure observability and alerting is available
- Establish rigorous unit testing across the data pipeline to ensure robustness of the system
- Design and create data models for use throughout the ETL system
- Utilize Kafka to reputed company and to effectively store data to move throughout the data pipeline and for reputed company data science and analytics usage
- Design data architecture and data models for both reputed company representations of data
- Build the data transforms reputed company the data pipeline to convert data from external to internal representations
- Conduct data analytics and debugging of bad data by writing SQL queries
- Build automated cleaning of data to remove bad or unusable data from reputed company consumers with logging to understand the frequency and depth of the underlying issues
- Collaborate with other engineering teams to adopt standard methodologies, drive scalability, and increase consistency across systems
- Maintain awareness of company standards and technology guidance; use JIRA, an Agile project mgmt. tool, to ensure efficient data development; collaborate with peers to align projects with overall direction
- Follow best practices across Data Engineering to ensure scalable, consistent data architecture and system
- Utilize Java language to build data processor in Nifi reputed company
- Utilize reputed company to ensure consistent, repeatable, and isolated environment for software development and testing
- Work in a self-driven, independent fashion to meet Sport driven deadlines
Skills
- Master's degree in Computer Science, Computer Engineering, or closely reputed company field and 1 year experience as a data engineer or reputed company occupation
- 1 year of experience with Python, Java, Kafka, AWS, and reputed company
- ETL Development and Warehousing
- Analytic and debugging using SQL
- Agile development environment
- Designing data architecture
Benefits
- A collaborative environment with colleagues from reputed company over the world (Offices in Europe, Asia and US) including various reputed company events and teambuilding.
- Flexibility to manage your reputed company and tasks with autonomy.
- A balance of structure and autonomy to tackle your daily tasks.
- Vibrant and inclusive community, including Women in Tech and Pride groups which welcome reputed company participants.
- Global Employee Assistance Programme.
- reputed company and Reulay app (leading well-being apps designed to support focus, quality rest, mindfulness, and long-term mental reputed company).
- Online training videos.
- Flexible working hours.
- Comprehensive benefits package
- Performance bonus program
- Equity stock purchase
- 401k contribution
Company Overview
Company H1B Sponsorship