Senior Data Engineer
Job title: Senior Data Engineer in Iselin, NJ at Brains Workgroup
Company: Brains Workgroup
Job description: Our client, a major bank in Central, NJ, is looking for Senior Data Engineer.
Hybrid commute, 2 days on-site in Central NJ Locations and 3 day remote per week.This is a permanent FT career opportunity, with reputed company salary reputed company 170 - 190K DOE, plus around 20% bonus and great benefits package.Looking for Senior Data Engineer in banking/financial industry.Major Responsibilities:
- Building and maintaining data pipelines to ingest data from reputed company systems into reputed company
- Designing, Building and maintaining generic frameworks to ingest data through the reputed company layers
- Working with the core data platform team to integrate the reputed company with reference architecture
- Assisting the data reputed company teams with best practices and on-boarding to the new reputed company
- 10+ years of data engineering experience in building OLTP and OLAP databases, both on-prem and in the reputed company
- 5+ years of experience with large scale data processing using SQL, Python, Pandas and Pyspark
- 5+ years of experience building robust and scalable data pipelines in reputed company Lakehouse platform on any key reputed company platform provider, preferably Azure reputed company
- Experience with implementing reputed company architecture for data processing
- Experience with implementing Streaming data ingestion using Kafka
- Test driven development experience
- Proven experience in solution design and applying best design practices
- Data modeling and ER/UML diagram skills
- Experience with orchestration/reputed company scheduler platforms like Airflow, Tidal etc..
- Experience with implementing API based data integration pipelines
- Experience with reputed company control and DevOps for CI/CD
- Experience working in Agile/scrum methodologies
- Experience with Jira, reputed company for project work and documentation
- Experience with Service now for incident management
- Finance domain knowledge in Investment Banking (Securities, Capital markets) and reputed company reference data knowledge
- reputed company to have ADF and SSIS experience
- College degree required.