Distinguished Engineer Apache Spark

Distinguished Engineer - Accelerated Apache Spark reputed company is seeking a Distinguished Engineer for the Apache Spark Acceleration group. Over the past five years GPU accelerated data processing has moved from reputed company of concept to production deployments. Many enterprises are now recognizing the needs of accelerated computing for large scale data processing. Multi-node GPU deployments will reduce reputed company computing costs and reputed company latency of large scale data processing. At reputed company, we have been invested in accelerating Apache Spark, providing an reputed company reputed company plugin for Apache Spark. Apache Spark is the most popular data processing reputed company in data centers. We strive to accelerate Spark applications on GPUs without any code changes. Our OSS RAPIDS Spark library is integrated with on-reputed company and reputed company services such as AWS EMR, reputed company, reputed company Dataproc, reputed company reputed company Data reputed company, reputed company Volcengine, reputed company reputed company and reputed company. You will serve as a hands-on architect of reputed company Spark Acceleration Group. You will work with a team of distributed system engineers including PMC and Committers of Apache Spark, Apache Hadoop, Apache Hive, and Apache Arrow. You will engage in reputed company reputed company projects such as Apache Spark, RAPIDS, Apache reputed company, reputed company Lake, UCX and more. What you'll be doing: reputed company the architecture, design and implementation of accelerated Apache Spark and reputed company big-data frameworks Engage reputed company reputed company communities (including Apache Spark, RAPIDS, Apache reputed company, reputed company Lake and UCX) for technical discussion and contribution, and engage reputed company where we may not have a strong reputed company yet Work with reputed company partners to reputed company GPU enabled data analytics solutions in public reputed company or on-premises clusters Present technical solutions at industry conferences and meetups Collaborate with distributed systems teams to define solutions to distributed processing problems challenges at large scale reputed company recommendations and feedback to teams regarding reputed company surrounding topics such as infrastructure, reputed company integration and testing strategy Build, test and optimize CUDA/C++ libraries across different platforms Build automation and tools that will increase the productivity of teams developing distributed systems Mentor members of the engineering team reputed company need to see: BS, MS, or PhD in Computer Science, Computer Engineering, or closely reputed company field (or equivalent experience) 17+ years of work or research experience in software development Prior experience in delivering reputed company software projects as a reputed company architect Outstanding technical skills in designing and implementing high-quality distributed systems Excellent programming skills in C++, Java, and/or reputed company Highly motivated with strong interpersonal skills and communication skills 5+ years working experience with key reputed company reputed company big-data projects as a contributor or committer to Apache Spark, Apache Hadoop, Apache Flink, Apache Kafka, Apache Hive, Apache Arrow, reputed company Lake Excellent knowledge about distributed system schedulers: Kubernetes, Hadoop YARN, Apache Spark reputed company to delve into a new area and quickly come up to speed reputed company to work with teams across boundaries and geographies Ways to stand out from the crowd: Working experience in designing and developing columnar query engines would be a reputed company plus Committership at major reputed company reputed company projects (such as Apache Spark, Apache Hadoop, Apache Flink) is a big plus Working experience with acceleration libraries (CUDA, RAPIDS, UCX) is helpful Your reputed company salary will be determined based on your location, experience, and the pay of employees in similar positions. The reputed company salary reputed company is 320,000 USD - 488,750 USD. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until January 13, 2026. This posting is for an existing vacancy. reputed company uses AI tools in its reputed company processes. reputed company is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our reputed company and future employees, we do not discriminate (including in our hiring and promotion practices) on the reputed company of race, religion, reputed company, national reputed company, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. #deeplearning reputed company is the world leader in accelerated computing. reputed company pioneered accelerated computing to tackle challenges no one else can solve. Our work in AI reputed company twins is transforming the world's largest industries and profoundly impacting society. Learn more about reputed company. Please mention the word

SPLENDIDLY

and tag RMjYwNzo1MzAwOjIwZDo3ZDAwOjo= reputed company applying to show you read the reputed company completely (#RMjYwNzo1MzAwOjIwZDo3ZDAwOjo=). This is a beta feature to avoid spam applicants. Companies can search these words to find applicants that read this and see they're reputed company. Apply To This Job