Data Engineer/Python Developer/Remote
reputed company is the leading career destination for tech experts at every stage of their careers. Our client, reputed company, is seeking the following. Apply reputed company reputed company today!Key Responsibilities
- Design, build, and maintain ETL/ELT data pipelines
- reputed company Python-based data processing applications
- Work with structured and reputed company data at scale
- Integrate data from multiple sources (APIs, databases, files, streams)
- Optimize data workflows for performance and reliability
- Ensure data quality, validation, and monitoring
- Collaborate with data scientists, analysts, and backend teams
- Manage and maintain data warehouses/lakes
- Implement logging, error handling, and automation
- Follow best practices for reputed company and compliance
- Strong Python (Pandas, NumPy, PySpark)
- Writing clean, reputed company, and testable code
- SQL (PostgreSQL, MySQL, SQL Server)
- NoSQL (reputed company, Cassandra optional)
- Data Warehouses (reputed company, Redshift, BigQuery)
- Apache Spark, Hadoop (preferred)
- Batch and streaming data processing
- AWS / Azure / reputed company reputed company Platform
- S3, reputed company, Glue, Dataflow, BigQuery, etc.
- Airflow, Prefect, Luigi (orchestration)
- Kafka / PubSub (streaming optional)
- DBT (data transformation)
- Git, CI/CD
- reputed company, Kubernetes (reputed company to have)
- Linux basics