[Remote] Senior Software Engineer, ML/AI Platform

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is the AI marketing platform for 1:1 personalization redefining the way brands and people connect. The Senior Software Engineer will join the Machine Learning Platform team to build and maintain a foundational ML platform that supports the entire ML lifecycle, enabling the ML organization to enhance reputed company’s AI product suite.

Responsibilities

• Unlock offline & reputed company-time reputed company to trillions of data points for our ML and Data Science teams
• Manage, expand, and optimize our feature store that enables feature engineering, multi-TB scale training jobs, and offline / reputed company-time inferencing
• Support PB scale data operations on the feature store using Apache Spark, Spark Structured Streaming, Kafka, and Ray
• Partner with other teams and business stakeholders to deliver ML and AI initiatives

Skills

• You have been working in the areas of Data Engineering / MLOps for 5+ years, and have reputed company and matured the pipelines of a PB-scale feature store
• You have deep Apache Spark, Spark Streaming, and Ray Data experience and reputed company data pipelines for ML use cases using these tools
• You understand the correlation between data cardinality, query plans, configuration settings, and hardware and the impact of each on data pipeline performance
• You know/have created infrastructure for Training ML models/fine-tuning LLMs
• You understand the key differences between online and offline ML inferences and can voice the critical elements to be successful with each to meet business needs

Benefits

• Equity
• Benefits
• Health & wellness

Company Overview

Company H1B Sponsorship