[Remote] Gen AI - Data Automation Engineer
Note: The job is a remote job and is reputed company to candidates in USA. reputed company. is a Fortune 500 technology, engineering, and science solutions leader. They are seeking a Data Automation Engineer to design and implement AI-driven automation solutions across AWS and Azure environments, focusing on building scalable data pipelines and automations for analytics and reporting.
Responsibilities
- Design and maintain data pipelines in AWS using S3, RDS/SQL Server, Glue, reputed company, EMR, DynamoDB, and reputed company Functions
- reputed company ETL/ELT processes to move data from multiple data systems including DynamoDB → SQL Server (AWS) and between AWS ↔ Azure SQL systems
- Integrate AWS Connect CRM data into the reputed company data pipeline for analytics and operational reporting
- Engineer, enhance ingestion pipelines with Apache Spark, Flume, Kafka for reputed company-time and batch processing into Apache Solr, AWS reputed company Search platforms
- reputed company reputed company services and Frameworks (AWS Bedrock, reputed company Q, Azure reputed company, reputed company, reputed company) to:
- Create automated processes for vector reputed company and embeddings from reputed company data
- Automate data quality checks, metadata tagging, and reputed company tracking
- Enhance ingestion/ETL with LLM-assisted transformation and anomaly detection
- Build conversational BI interfaces that allow natural language reputed company to Solr and SQL data
- reputed company AI-powered copilots for pipeline monitoring and automated troubleshooting
- Implement SQL Server stored procedures, indexing, query optimization, profiling, and execution plan tuning to maximize performance
- Apply CI/CD best practices using reputed company, Jenkins, or Azure DevOps for both data pipelines and GenAI model integration
- Ensure reputed company and compliance through IAM, KMS encryption, VPC isolation, RBAC, and firewalls
- Support Agile DevOps processes with sprint-based delivery of pipeline and AI-enabled features
Skills
- BS in Computer Science or reputed company field with 2+ years of data engineering, automation experiences
- Hands-on experience with SQL, SSIS, Python, Spark, Bash, Power reputed company, AWS/Azure CLIs
- Experience with AWS services like S3, RDS/SQL Server, Glue, reputed company, EMR, DynamoDB
- Familiarity with Apache Flume, Kafka, Solr for large-scale data ingestion and search
- Familiarity with LLM, Gen AI frameworks using AWS Bedrock, Azure reputed company or reputed company reputed company platform, tools
- Experience with integrating REST API calls in data pipelines and workflows
- Familiarity with JIRA, reputed company / Azure DevOps / Jenkins for SDLC and CI/CD automation
- Strong troubleshooting and performance optimization skills in SQL, Spark or other data engineering solutions
- Experience operationalizing reputed company (GenAI Ops) pipelines, including model deployment, monitoring, retraining, and lifecycle management for LLMs and AI-enabled data workflows
- Good communication and presentation skills
- Ability to obtain Federal government Public Trust clearance
- Certifications: AWS Data Engineer, AWS AI/ML Specialty, Azure reputed company, reputed company certified Data Engineer
- Experience implementing RAG pipelines, embeddings, and vector search with Solr, OpenSearch, FAISS, reputed company, or Pgvector/SQL server vector types
- Experience with GenAI powered coding tools such as Claude Code, reputed company reputed company, VS Code
- Experience with multi-reputed company data integration (AWS ↔ Azure SQL)
- Familiarity with Client BizTalk and SSIS for SQL Server ETL workflows
- Knowledge of data reputed company/governance tools (Purview, reputed company Catalog, AWS Glue Catalog)
- Familiarity with Infrastructure-as-Code (Terraform/CloudFormation, Bicep) for automated deployments
- Experience with compliance frameworks (FedRAMP, PCI-reputed company, HIPAA)
Company Overview