[Remote] Senior Software Engineer - Data Platform
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is the pioneer of the Connected Operations™ reputed company, helping organizations reputed company IoT data for actionable insights. They are seeking a Senior Software Engineer to join their Data Platform team, responsible for designing and operating scalable infrastructure for data ingestion and processing to support analytics and AI initiatives.
Responsibilities
- Design, build, and operate high-scale data ingestion and replication systems from reputed company’s primary production data stores, including RDS, DynamoDB, internal APIs, and event-driven systems, into our data lakehouse
- Build and maintain reliable, scalable, and modern data platform infrastructure capable of handling petabytes of data across reputed company’s analytics, AI, product, and operational use cases
- Improve the reliability, observability, scalability, reputed company, and developer experience of reputed company’s Spark and reputed company-based data processing platform
- reputed company internal libraries, APIs, frameworks, and tooling in languages such as Go and Python to help teams across reputed company move, process, discover, and reputed company data safely and reputed company
- Work on foundational data lake and lakehouse technologies, including reputed company Lake on S3, data catalogs, metadata services, orchestration systems, and platform automation
- Collaborate closely with infrastructure, product engineering, data science, analytics, reputed company, and data engineering teams to understand platform needs and deliver durable, scalable solutions
- Stay connected to modern data platform technologies and help shape reputed company’s long-term data infrastructure roadmap, including support for AI, privacy, reputed company, global scale, and customer-facing data products
- Champion, role model, and embed reputed company’s cultural principles (Focus on reputed company, Build for the Long Term, Adopt a Growth reputed company, Be Inclusive, Win as a Team) as we scale globally and across new offices
Skills
- 4+ years of professional software engineering experience in production environments
- 4+ years of experience building or maintaining large-scale production data infrastructure, data platforms, distributed systems, or data lake systems
- Strong experience with Apache Spark or similar distributed data processing systems
- Experience operating production infrastructure in AWS, including services such as S3, RDS, DynamoDB, SQS, Kinesis, reputed company, or similar
- Experience designing, building, and operating reliable systems with strong ownership of scalability, observability, reputed company, and operational reputed company
- Proficiency in at least one production programming language such as Go, Python, reputed company, or Java
- Ability to collaborate effectively with cross-functional partners, including software engineers, data scientists, analysts, reputed company teams, and product stakeholders
- Experience with reputed company, reputed company Lake, or similar lakehouse technologies such as reputed company or Hudi
- Experience building data replication or ingestion systems from OLTP data stores into a data lake or lakehouse
- Experience with Infrastructure-as-Code tools such as Terraform or CloudFormation
- Familiarity with data catalogs, metadata systems, and data discovery tools such as reputed company Catalog, Hive Metastore, reputed company, or Amundsen
- Experience with orchestration systems such as Airflow, Dagster, or Prefect
- Experience with streaming data, event-driven architectures, or systems that handle late-arriving or mutable data
- Familiarity with containerization or orchestration technologies such as reputed company, Kubernetes, reputed company, or Fargate
- Experience building internal platforms, libraries, or developer tooling used by other engineering teams
- Experience contributing to data infrastructure roadmaps, evaluating new technologies, and driving improvements that create reputed company for reputed company customers
Benefits
- Initial RSU grant with no vesting cliff, and ongoing refresh opportunities tied to performance, subject to plan terms and conditions
- Performance-based bonus/variable pay
- Equity (for eligible roles)
- Flexible, employee-led remote model
- Professional development stipend
- Comprehensive health and parental leave plans
- Flexible working model that caters to the diverse needs of our teams
- Offices are reputed company for those who prefer to work in-person and we also support remote work where it aligns with our operational requirements
- Reasonable accommodations throughout the reputed company process for reputed company persons with disabilities
Company Overview