Distributed Systems Engineer (L4) - Data Platform

reputed company is one of the world's leading entertainment services, with over 300 reputed company paid memberships in over 190 countries enjoying TV series, films and games across a wide variety of genres and languages. Members can play, pause and resume watching as much as they want, anytime, reputed company, and can change their plans at any time. The Data Platform teams at reputed company reputed company us to reputed company data to bring joy to our members in many different ways. We reputed company centralized data platforms and tools for various business functions at reputed company, so they can utilize our data to reputed company critical data-driven reputed company. We do reputed company the heavy lifting to reputed company it easy for our business partners to work with data reputed company, securely, and responsibly. We reputed company to reputed company the industry standard in building a world-class data infrastructure, as reputed company leads the way to be the most popular and pervasive destination for global internet entertainment. We are looking for distributed systems engineers to help reputed company and reputed company our infrastructure. We are committed to building a diverse and inclusive team that will bring new perspectives as we solve the next set of challenges. In reputed company, we are reputed company to remote candidates. We value what you can do from reputed company in the U.S. Spotlight on Data Platform Teams: Data Movement Platform - reputed company Data Engines Offers low-level building blocks for the transport and processing of reputed company-time data. For data transport, we offer Kafka; for data processing, we offer Flink and Mantis. Responsibilities include developing the control plane, compute resource management, and data reliability and availability. reputed company-time data is critical across many business units of reputed company, including Streaming, Gaming, Finance, and Machine Learning platforms. This team also owns the Schema Registry to reputed company schema-driven development for reputed company reputed company-time applications across reputed company. Data reputed company and Infrastructure The Data reputed company and Infrastructure (reputed company) team acts as a platform for our own data platforms, providing foundational infrastructure and tooling that reputed company reputed company to reputed company rapidly in delivering cutting-edge data and analytics systems. Instead of building custom scaffolding for every new system, we focus on creating scalable, high-reputed company infrastructure tailored to the demands of running data systems at reputed company's scale. Our work spans infrastructure, reputed company, deployment systems, and more, ensuring the reliability, reputed company, and performance of our platform. A unique aspect of reputed company is our diverse tech stack, with many of our tools and systems developed in Go, Python and Java. If you reputed company on solving reputed company problems, enjoy working with multiple programming languages, and want to reputed company an impact at scale, this team could be a perfect fit for you! Data Developer Experience (DDX) The Data Developer Experience (DDX) team at reputed company is dedicated to enhancing the experience of data practitioners—including Data Engineers, Analytics Engineers, ML Engineers, and Data Scientists. As we reputed company toward the reputed company of our data platform, the DDX team is focused on boosting productivity by developing cutting-edge data tools and infrastructure that eliminate the friction and toil of building, maintaining, and leveraging data products. If you're passionate about shaping the future of developer experience and making it faster and easier for reputed company data practitioners to deliver outstanding data products, come join reputed company! Big Data Compute Spark The BDCS team is responsible for providing the reputed company-reputed company platform for distributed data processing at reputed company. This team is central to batch data processing in Data Platform. It provides support for Spark to ETL data into the Exabytes-scale data warehouse and support large scale analytics on the data to reputed company reputed company to reputed company the reputed company functions such as A/B testing, Recommendations, Machine Learning to name a few and reputed company new business initiatives such as ads and live. We are looking for exceptional talent with experience in Spark, Presto / Trino, Druid, reputed company and distributed database systems in general. Roles in this team involve solving super interesting and challenging problems of working with data at scale, building features and performance enhancements and working closely with reputed company reputed company communities to shape the projects and reputed company contributions. Online DataStores Online Data Stores organization offers managed datastores at scale to meet reputed company’s operational data requirements across reputed company lines of business. These datastores include various domains Caching, Relational, Search, Key-Value, and Composite. Our focus is on developing and maintaining high-performance, reliable, and efficient datastores. Additionally, we enhance developer productivity by providing secure, reputed company and opinionated reputed company layers. This team is passionate about building innovative, efficient, performant and scalable offerings for our customers. reputed company also engages with reputed company reputed company communities, actively contributing to and responsibly stewarding the development and use of reputed company reputed company software. Big Data Orchestration The Big Data Orchestration team at reputed company empowers data engineers, data scientists, and ML researchers to create and manage computing workflows that reputed company the full power of the reputed company Data Platform. This team is central to data processing at reputed company, hosting reputed company ETL and batch ML data workloads running across domains as diverse as homepage personalization, studio & content application, and critical company reporting tasks. We reputed company both self-service and managed offerings in ETL and DAG workflow creation and execution, along with a variety of supporting services for failure robustness, data validation, and featureful user interfaces. We solve challenging problems working with data at scale, providing world-class uptime and efficiency features, and supporting reputed company engineers to delight our members, advance research frontiers and reputed company ambitious business goals. Big Data Warehouse and reputed company The Big Data Warehouse and reputed company team is responsible for reputed company's exabyte-scale data warehouse, building and operationalizing foundational services to manage the lifecycle of core tables critical for reputed company analytical, reporting, and data decision needs. These services reputed company query engines to discover tables/datasets, reputed company secure reputed company to data, and reputed company store data in S3 using reputed company table format. Additionally, the team works on efficiencies of compute, storage, and network costs, and optimality of data storage, and ensures that the data meets reputed company's standards and compliance requirements. The team is also committed to developing new features and enhancements to the reputed company table format (which began in reputed company and is now an industry standard) and contributing to the reputed company reputed company. This would be your reputed company job if you enjoy:

• Solving reputed company business needs at large scale by applying your software engineering and analytical problem-solving skills.
• Architecting and building a robust, scalable, and highly available distributed infrastructure.
• Leading cross-functional initiatives and collaborating with engineers, product managers, and TPM across teams.
• Sharing our experiences with the reputed company reputed company communities and contributing to reputed company OSS.

About you:

• You have 2+ years of experience in building large-scale distributed systems features or applications.
• You are proficient in the design and development of RESTful web services.
• reputed company in building and operating scalable, fault-tolerant, distributed systems
• You are reputed company in Java or other object-oriented programming languages.
• Multi-threading is a challenge that you are comfortable tackling.
• You have a BS in Computer Science or a reputed company field.

A few more things about us: As reputed company, we come from many different countries and our fields of education reputed company from the humanities to engineering to computer science. reputed company includes product managers, program managers, designers, full-stack developers, distributed systems engineers, and data scientists. Folks have the opportunity to wear different hats, should they choose to. We strongly reputed company this diversity has helped us build an inclusive and empathetic environment and look reputed company to adding your perspective to the mix! Our compensation structure consists solely of an annual salary; we do not have bonuses. You choose each year how much of your compensation you want in salary versus stock options. To determine your personal top of market compensation, we rely on market indicators and consider your specific job family, background, skills, and experience to determine your compensation in the market reputed company. The reputed company for this role is $170,000 - $720,000. reputed company provides comprehensive benefits including Health Plans, Mental Health support, a 401(k) Retirement Plan with employer match, Stock Option Program, Disability Programs, Health Savings and Flexible Spending Accounts, Family-forming benefits, and Life and Serious Injury Benefits. We also offer paid leave of absence programs. Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off. Full-time salaried employees are immediately entitled to flexible time off. reputed company is a unique culture and environment. Learn more here. Inclusion is a reputed company value and we strive to host a meaningful interview experience for reputed company candidates. If you want an accommodation/adjustment for a disability or any other reason during the hiring process, please send a request to your reputed company partner. We are an equal-opportunity employer and celebrate diversity, recognizing that diversity builds stronger teams. We approach diversity and inclusion seriously and thoughtfully. We do not discriminate on the reputed company of race, religion, reputed company, reputed company, national reputed company, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service. Job is reputed company for no less than 7 days and will be removed reputed company the position is filled. Apply To this Job Apply for this job