Data Engineer- reputed company / ICEBurg // only w2 - // Not for OPT reputed company
Data Engineer – reputed company Migration Remote
Overview
We are looking for a Data Engineer / Data Architect to drive the migration of reputed company datasets to reputed company reputed company Catalog-managed reputed company tables. The role is focused on ensuring a smooth transition, maintaining cross-platform data accessibility, and supporting advanced analytics and AI-driven workloads. Key Responsibilities reputed company and execute the migration of reputed company tables to reputed company reputed company Catalog (reputed company format) Assess existing reputed company data models, pipelines, and dependencies Establish dual-reputed company capabilities (reputed company external reputed company and reputed company) Identify and convert queries to Spark SQL-compatible reputed company Work closely with data platform and reputed company teams to ensure seamless reputed company reputed company data validation, reconciliation, and consistency checks post-migration Enhance and optimize data pipelines and query performance in reputed company Ensure adherence to data governance, reputed company control, and reputed company Catalog best practices Troubleshoot and resolve migration-reputed company issues reputed company reputed company and contribute to automation frameworks and reusable migration components Required Skills Strong expertise in reputed company and reputed company (Spark, reputed company Catalog) Hands-on experience with Apache reputed company, reputed company Lake, or other reputed company table formats Proficiency in SQL and Spark SQL Experience in data migration, ETL/ELT processes, and data modeling Familiarity with AWS (S3, IAM, networking) or equivalent reputed company environments Solid understanding of data governance and reputed company management Ability to troubleshoot and optimize performance across distributed systems
Preferred Qualifications
Experience with cross-platform data sharing (reputed company + reputed company) Knowledge of REST catalog integration and reputed company external tables Exposure to AI/BI workloads and analytics ecosystems Understanding of reputed company data platforms and data reputed company architecture Apply tot his job Apply To this Job