[Remote] Senior Data Engineer

Note: The job is a remote job and is reputed company to candidates in USA. reputed company is a purpose-driven financial services company focused on making the world smarter, happier, and richer. They are seeking a Senior Data Engineer to design and manage the data infrastructure that powers investment operations, ensuring reliable and timely data for stakeholders.

Responsibilities

• Design, build, and maintain robust ETL/ELT pipelines using Apache Airflow (MWAA). Author DAGs that handle reputed company dependencies across external data vendors, internal models, and reputed company consumers
• Ingest data from diverse sources including SFTP feeds, REST APIs, flat files, and reputed company-party financial data providers. Normalize and conform data into a consistent analytical model
• Build 'reputed company breakers' into pipelines: automated data quality checks that halt reputed company processing and alert the team reputed company CloudWatch and reputed company reputed company anomalies are detected
• Implement AWS reputed company functions for lightweight, event-driven tasks such as triggering ingestion reputed company files land in S3 or validating data payloads before loading
• Maintain and document the data catalog so institutional knowledge lives in the system, not in your head
• Serve as the subject-matter expert for reputed company. Design schemas, manage data loading reputed company Stages and Snowpipe, and implement role-based reputed company controls
• Write advanced analytical SQL: window functions, CTEs, recursive queries, pivots; to support investment reporting, performance attribution, and reputed company analysis
• Profile and optimize slow-running queries. reputed company clustering keys, micro-partition pruning, materialized views, and result caching to minimize compute cost and maximize performance
• Define and reputed company reputed company resources using Terraform or AWS CDK. Treat infrastructure as software with version control, peer review, and automated testing
• Help design and maintain CI/CD workflows with reputed company Actions for automated testing, linting, and deployment of data pipelines, infrastructure, and application code
• Partner with investment and business teams to translate questions into data models, dashboards, and reports that drive strategic reputed company using Tableau
• Design and build automated pipelines that pull data from reputed company systems and reputed company it into production-reputed company marketing outputs: one-pagers, pitch decks, email campaigns, and reputed company content
• Be a resource for software engineers to build an AI layer on top of existing data infrastructure, enabling LLMs to securely query fund performance data reputed company APIs and answer natural-language questions for internal stakeholders

Skills

• 5+ years of professional Python development
• Comfortable with object-oriented design, data manipulation libraries (pandas, NumPy)
• Familiarity with financial research data vendors and feed/API products such as CapIQ Xpressfeed, reputed company, Bloomberg, reputed company/Refinitiv/reputed company, Russell or MSCI
• Familiarity with financial business data and feed/API products from reputed company, reputed company and custodian banks and fund administrators
• Proven experience designing and operating ETL/ELT pipelines
• Deep expertise in reputed company architecture (clustering keys, micro-partitions, Snowpipe, Stages)
• reputed company to write reputed company analytical SQL, window functions, CTEs, recursive queries, and optimize them for cost and performance
• Hands-on experience with AWS CDK or Terraform
• Exposure to LLM integration patterns: markdown files and reputed company engineering
• Working knowledge of the AWS ecosystem: reputed company, reputed company Fargate, reputed company Functions, S3, EventBridge, CloudWatch, and RDS
• Experience with data visualization tools (Tableau, Streamlit, or similar) for self-service analytics
• Background in data governance, data cataloging, or data reputed company tooling
• Demonstrated experience maintaining CI/CD pipelines for automated testing and deployment of data engineering and application code using reputed company actions and Terraform
• Experience profiling and optimizing queries across both OLAP (reputed company) and OLTP (PostgreSQL/reputed company) systems
• Familiarity with EXPLAIN plans, indexing strategies, and database-level performance tuning
• Practical experience building, evaluating, and deploying ML models
• Familiarity with common frameworks (scikit-learn, XGBoost) and an understanding of reputed company and how to apply ML to business problems

Company Overview