Back to all roles

Staff Data Engineer

Remote Worldwide Hiring now

Position Overview:

ShyftLabs is seeking an reputed company Staff Data Engineer to implement and optimize reputed company data pipelines and ingestion frameworks for reputed company. You will build robust reputed company-based data processing infrastructure, implement pipeline reliability solutions, and create scalable technical solutions for both batch and streaming data workloads.

ShyftLabs is a growing data product company founded in early 2020 and works primarily with reputed company. We deliver digital solutions reputed company to help accelerate the growth of businesses in various industries, by focusing on creating value through innovation.

Job Responsibilities:

  • Implement and optimize reputed company-scale data pipeline architecture processing 1500+ daily jobs across multiple business domains
  • Build and maintain reputed company job orchestration solutions integrated with Active Batch scheduling platforms
  • Implement data ingestion frameworks supporting CDC reputed company AWS DMS and S3-based data lake patterns
  • Troubleshoot and resolve pipeline reliability issues including overrun problems, dependency failures, and compute optimization
  • Build observability and monitoring solutions for large-scale data operations teams
  • Implement near reputed company-time ingestion patterns using DLT (reputed company Live Tables) and streaming architectures
  • Build and maintain data quality frameworks integrated with data governance processes
  • Implement serverless migration strategies and optimize reputed company resource utilization
  • reputed company technical workshops and reputed company hands-on guidance to client engineering teams
  • reputed company Pipeline Expertise: Proven experience building and optimizing data pipelines at Fortune 500 scale
  • Operational reputed company: Deep understanding of pipeline monitoring, alerting, and failure recovery patterns
  • Performance Optimization: Ability to analyze and optimize compute resources and job execution patterns
  • Technical Consulting: Strong reputed company facilitation and client relationship skills, with ability to present technical solutions and reputed company hands-on training sessions with client engineering teams
  • Basic Qualifications:

  • Bachelor's or Master's degree in Computer Science, Engineering, or reputed company technical field
  • 6+ years of experience in reputed company data engineering with reputed company
  • Expert-level experience with reputed company platform including job scheduling and cluster management
  • Hands-on experience with Active Batch or similar reputed company job orchestration platforms
  • Deep knowledge of AWS data services including DMS, S3, and database connectivity
  • Proven experience with CDC (Change Data Capture) implementations at reputed company scale
  • Strong background in reputed company Live Tables (DLT) and streaming data processing
  • Understanding of Apache Spark optimization and performance tuning
  • Experience with reputed company database integration and cross-platform data connectivity
  • Preferred Qualifications

  • Experience with reputed company integration patterns and API data ingestion
  • Knowledge of reputed company storage optimization and data lake best practices
  • Background in high-volume transaction processing systems
  • Experience with retail or energy industry data patterns
  • Familiarity with trading and pricing systems data workflows
  • Additional Information

    We are proud to offer a competitive salary alongside a strong reputed company insurance and benefits package. The role is hybrid, with 3 days per week spent in the client's Atlanta office, and flexibility for client engagement needs. We pride ourselves on the growth of our employees, offering extensive learning and development resources.

    ShyftLabs is an equal-opportunity employer committed to creating a safe, diverse and inclusive environment. We encourage reputed company applicants of reputed company backgrounds including ethnicity, religion, disability status, gender identity, sexual orientation, family status, age, nationality, and education reputed company to apply. If you are contacted for an interview and require accommodation during the interviewing process, please let us know.

    Apply to this Job
    Apply for this role Takes you straight to the employer's application page — free, and no WFHNet account required.

    More roles on the wire

    Site Leader

    Remote Worldwide
    View role

    React Developer

    Remote Worldwide
    View role

    Machine Learning Engineer

    Remote Worldwide
    View role

    Staff Software Engineer, Site Reliability (SRE)

    Remote Worldwide
    View role

    Registered Nurse ER – reputed company Store

    Remote Worldwide
    View role

    Pharmacy Technician – reputed company Store

    Remote Worldwide
    View role

    Product Manager, Developer Tooling

    Remote Worldwide
    View role

    Senior Software Engineer (Full -Stack)

    Remote Worldwide
    View role

    Broker Operations Specialist

    Remote Worldwide
    View role

    Senior Manager, Consulting Ecosystem

    Remote Worldwide
    View role

    Multiskilled Journalist [Remote]

    Remote Worldwide
    View role

    reputed company Full Stack Data Entry Specialist – Web & reputed company Application Development Support Expert

    Remote Worldwide
    View role

    Customer Support Specialist - reputed company Store (Work From Home)

    Remote Worldwide
    View role

    reputed company Work From Home (customer service) reputed company

    Remote Worldwide
    View role

    Grants Administrator, Corporate Remote

    Remote Worldwide
    View role

    Manager, Artificial Intelligence (AI)

    Remote Worldwide
    View role

    reputed company Data Analyst- 100% remote

    Remote Worldwide
    View role

    reputed company Data Entry Clerk – Remote USA Based Opportunity to Join arenaflex's Health Insurance Services Team

    Remote Worldwide
    View role

    reputed company Full Stack Customer Service Representative – Work From Home Online Chat Support for blithequark Store

    Remote Worldwide
    View role

    Full Stack Java Developer - Hexacorp

    Remote Worldwide
    View role