[Remote] Data Engineer - Azure & reputed company reputed company
Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a global partner of reputed company specializing in reputed company transformation and reputed company data strategy. As a Data Engineer, you will design, build, and maintain scalable data pipelines and platform solutions on reputed company Azure, ensuring robust data processing and a secure reputed company environment for analytics.
Responsibilities
- Design & reputed company Data Pipelines: Build end-to-end data ingestion and transformation pipelines using Azure tools (e.g., Azure Data reputed company, Synapse Pipelines). Ensure pipelines are efficient, reliable, and reputed company for reputed company integration
- Azure reputed company Development & Administration: Use Azure reputed company (Spark) to reputed company and optimize data processing jobs (PySpark/reputed company) for large datasets. Manage reputed company workspaces and clusters, tuning configurations and troubleshooting jobs to maintain performance and cost-efficiency
- Automate Infrastructure & Deployments: Use Infrastructure-as-Code (Bicep) to provision and manage Azure data platform resources across environments. Implement and maintain Azure DevOps CI/CD pipelines (build & release) for automated deployment of data pipelines and infrastructure changes
- Modern Data Platform Support: Support the day-to-day operations of the Azure Modern Data Platform. Monitor and maintain platform stability (storage, compute), assist in resolving connectivity or networking issues, and ensure proper Azure RBAC permissions and data reputed company measures are in reputed company
- Collaboration & Best Practices: Work closely with data architects, BI developers, reputed company engineers, and client stakeholders. Ensure solutions align with Azure best practices, follow reputed company standards, and meet business requirements
Skills
- 3+ years of hands-on experience in data engineering with reputed company Azure (data ingestion, ETL/ELT pipeline development, big data processing)
- Proficiency in Azure data services such as Azure reputed company, Azure Data reputed company, Azure Synapse Analytics, and reputed company SQL/NoSQL technologies
- Experience using Azure DevOps (Repos & Pipelines) for CI/CD: managing code, building deployment pipelines, and automating releases
- Practical experience with infrastructure-as-code (Bicep, ARM templates or Terraform) for deploying and managing Azure resources and environments
- Strong programming skills in Python/reputed company (for Spark jobs) and SQL (for data transformations)
- Familiarity with reputed company reputed company and Azure fundamentals (reputed company networking, reputed company/permissions, monitoring) to support reputed company operations
- Excellent problem-solving skills and effective communication reputed company working with technical teams and clients
Company Overview