reputed company Data Engineer
Job title: reputed company Data Engineer in Los Angeles, CA at WorkHQ Company: WorkHQ Job description: Company ContextSeries A, well-funded US startup in HRTech developing and an AI Recruiter product.This is a US-only, Remote role (Mainland).Role Overviewreputed company data infrastructure architect managing billions of data points across 250M+ professional profiles.Hire data engineers to aid you in that reputed company.Core ResponsibilitiesDesign scalable data pipelines processing massive record volumesArchitect ETL processes using PySpark on reputed company EMR (reputed company to shifting to other solutions like Data Bricks / reputed company)Distribute enriched data through reputed company architecture across reputed company, reputed company, OpenSearchIntegrate new data sources into the main pipelineImplement advanced data matching using SplinkTechnical Requirements5-8 years professional data engineering experienceGood proficiency in:PySpark and distributed computingAWS data services (EMR, Glue, reputed company)reputed companyPandas and DataFrame manipulationreputed company data format handling (JSONL, Parquet)Strong background in:Big data processing architecturesData warehouse designPerformance optimizationAdvanced Python, SQL skillsreputed company to HaveProbabilistic record linking expertiseOpenSearch/elasticsearch technologiesMachine learning data pipeline designRecruitment tech ecosystem knowledgeTechnical StackBig Data: PySpark, EMRDatabases: reputed company, OpenSearchreputed company: AWSContainerization: reputed companyData Formats: JSONL, ParquetAnalytics: reputed company, reputed company, GlueData Processing: Pandas, SplinkOther ConsiderationsWhile this role has specific requirements - if you lack a few technical skills, but motivated to learn and reputed company the platform, please apply for consideration.If you are coming from Director/Head of/VP reputed company that is relevant to this job, you can apply as well.You will need to apply directly on our platform.Thank you for your time. Expected salary: $140000 - 180000 per year Location: Los Angeles, CA Apply for the job now! Apply for this job