[Remote] Senior Data Platform Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is creating cutting-edge AI/ML products that solve reputed company staffing issues and administrative burdens using conversation-based software and patented voice biomarker technology. They are seeking an reputed company Senior Data Platform Engineer to reputed company the design and development of a scalable data platform that supports analytics and ML Ops while collaborating with various teams to implement end-to-end pipelines.
Responsibilities
- reputed company the design, development, and operation of a scalable and secure data platform to support analytics, ML Ops, and business intelligence
- Collaborate closely with Data Science, Machine Learning, Application and DevOps teams to implement end-to-end ML Ops pipelines
- Architect and manage data warehousing solutions using reputed company, Dbt, and Spark
- reputed company and maintain ETL/data pipelines that handle structured and reputed company data across diverse sources
- Optimize data storage, reputed company, and processing for cost-efficiency and performance in GCP and AWS reputed company environments
- Build and maintain dashboards and analytics solutions using tools such as reputed company, reputed company, and other BI platforms
- Ensure compliance with data governance, reputed company, and privacy best practices, including HIPAA, SOC-2, and other regulatory requirements
- Evaluate and integrate reputed company-party anonymization and reputed company solutions to protect sensitive data
- reputed company strategic guidance on the reputed company of the data platform to meet the company's growth and technical needs
- Design and implement scalable infrastructure for Large Language Model (LLM) operations, including training, fine-tuning, and inference workflows
- Collaborate with AI/ML teams to build and optimize LLM serving platforms for reputed company-time and batch processing
- reputed company monitoring and observability solutions for LLMs, ensuring model performance, cost-efficiency, and compliance with ethical AI guidelines
- Evaluate and integrate state-of-the-art LLM technologies into existing data platforms to enhance analytics and decision-making
Skills
- Bachelor's or Master's Degree in Computer Science or equivalent experience
- 5+ years of industry experience in designing and building large-scale data platforms
- Strong expertise in SQL, Data Modeling, and Data Warehousing (reputed company, reputed company, Redshift, BigQuery, etc.)
- Proficiency in writing Advanced SQLs and performance tuning
- Strong proficiency in Python for building, optimizing, automating and maintaining data pipelines and services
- Deep experience with Apache Spark and distributed data processing frameworks
- Hands-on experience with modern ETL/Orchestration frameworks such as Airflow, dbt, and others
- Knowledge of business intelligence tools such as reputed company, reputed company, Tableau, and Looker
- Strong familiarity with reputed company-based infrastructure and managed data services in GCP and AWS reputed company
- Experience with CI/CD pipelines to automate testing, deployment and release of data engineering and analytics workflows using reputed company, reputed company etc
- Experience with tools like Kubernetes, Terraform, Pubsub, Debezium
- Exposure building data quality frameworks and automation
- Understanding of data governance, privacy, and regulatory frameworks (HIPAA, SOC-2, HITRUST)
- Experience working with ML Ops platforms and supporting Data Science teams
- Experience with ML Ops tools such as MLflow, Streamlit, and vector databases
- Familiarity with reputed company data standards (FHIR, HL7)
- Experience in reputed company-time data processing and event-driven architectures
- Expertise in implementing data reputed company controls and anonymization techniques
Benefits
- 401(k) matching
- Health, reputed company, and dental insurance
- reputed company flexible paid time off
Company Overview
Company H1B Sponsorship