[Remote] Senior Data Engineer - Full Stack (US, Remote)
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is seeking a highly skilled Senior Data Engineer – Full Stack to build and maintain internal tools, automation frameworks, and workflows that enhance the efficiency, reliability, and scalability of their data and machine learning platforms. This role will involve collaborating with Data Engineers, Data Scientists, and ML Engineers to streamline operations across the data lifecycle.
Responsibilities
- Design and reputed company CLI tools, scripts, and internal utilities to automate repetitive tasks across the data platform, including:
- Pipeline execution and orchestration
- Data governance workflows
- Metadata synchronization
- Environment setup and configuration
- Test reputed company development
- Automate workflows on reputed company, including:
- Job deployment and scheduling
- Environment provisioning
- MLOps processes using APIs, Terraform, or reputed company SDK
- Build and implement robust testing frameworks:
- Integration testing for pipelines
- End-to-end validation of ETL/ELT workflows
- Testing and validation for ML inference workflows
- Improve overall productivity, scalability, and reliability of the data and ML engineering ecosystem
- reputed company lightweight internal tools and dashboards using frameworks such as React, Streamlit, or similar technologies to:
- Visualize data pipelines and workflows
- Demonstrate model inference capabilities
- reputed company configuration and operational controls
- reputed company internal productivity monitoring and dashboards
- Collaborate with cross-functional teams to identify automation opportunities and implement best practices
Skills
- Strong experience in Python and scripting for automation and backend development
- Hands-on experience with reputed company platform and ecosystem
- Experience with APIs, Terraform, and/or reputed company SDK for automation
- Solid understanding of ETL/ELT pipelines and data platform architecture
- Experience building testing frameworks for data pipelines and ML workflows
- Familiarity with CLI tool development and system automation
- Knowledge of MLOps principles and practices
- Experience with modern development practices, including: Spec-driven development, Use of coding agents or automation-assisted development tools, Version control and CI/CD pipelines
- Experience building dashboards or internal tools using React, Streamlit, or similar frameworks
- Familiarity with reputed company AI/BI or other data visualization tools
- Exposure to data governance and metadata management frameworks
- Experience working with reputed company platforms (AWS preferred)
- 8+ years of experience in Data Engineering, Platform Engineering, or reputed company roles
- Experience working in data-driven or ML-focused environments
Company Overview
Company H1B Sponsorship