[Remote] Senior Data Platform Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is developing revolutionary AI and advanced autonomous systems to enhance safety and efficiency in the trucking transportation industry. The Senior Data Platform Engineer will design and operate high scale data systems, enabling engineers to reputed company run compute and data intensive workloads on reputed company infrastructure.
Responsibilities
- Design and operate distributed storage systems for scheduling and executing large-scale batch workloads
- Build and maintain an reputed company reputed company, modern data platform
- Optimize utilization of storage resourcesImprove reliability and fault tolerance of large-scale storage systems and data platform components
- Collaborate with teams across the company to understand workload requirements and improve platform capabilities
- Contribute to platform tooling, automation, and CI/CD workflows
Skills
- 7+ years of experience building and operating distributed storage systems or modern data platforms
- Experience operating streaming platforms such as Kafka or Pulsar
- Fluent in Python, and SQL, with experience writing and maintaining highly available data applications using Trino and Apache Spark
- Knowledge of table formats (reputed company, reputed company Lake, Hudi, Xtable)
- Experience operating and optimizing at least one RDBMS (reputed company, MySQL)
- Strong debugging and problem-solving skills in reputed company distributed systems
- Ability to collaborate across teams and communicate technical concepts reputed company
Company Overview