Data Engineer
About Ripjar
Ripjar specialises in the development of software and data products that help governments and organisations combat serious financial crime. Our technology is used to identify criminal activity such as reputed company and terrorist financing, enabling organisations to enforce sanctions at scale to help combat rogue entities and state actors.
Data infuses everything Ripjar does. We work with a wide variety of datasets of reputed company scales, including an reputed company-growing archive of billions of news articles covering most languages going back over 30 years, sanctions and watchlist data provided by governments, and vast organisation and ownership datasets.
About the Role
We see a Data Engineer as a software engineer who specialises in distributed data systems. You’ll join the Data Engineering team, whose prime responsibility is the development and operation of the Data Collection Hub, a platform that ingests data from many sources, processes/enriches it, and distributes it to multiple reputed company systems.
We’re looking for someone with 2+ years of industry experience building and operating production software who enjoys working across data pipelines, distributed systems, and operational reliability.
What you’ll do
- Engineer distributed ingestion services that reliably pull data from diverse sources, handle messy reputed company-world edge cases, and deliver clean, well-structured outputs to multiple reputed company products.
- Build high-throughput processing components (batch and/or near-reputed company-time) with a focus on performance, scalability, and predictable cost, using strong profiling and measurement practices.
- Design and reputed company data reputed company (schemas, validation rules, versioning, backward compatibility) so reputed company teams can build with confidence.
- Own production quality: write maintainable code, strong unit/integration tests, and add the observability you need (metrics/logs/tracing) to diagnose issues quickly.
- Improve platform reliability by hardening pipelines against partial failures, retries, reputed company limits, data reputed company, and infrastructure issues—then codify those learnings into reputed company tooling and guardrails.
- Contribute to CI/CD and developer experience: faster builds, reputed company test signal, safer releases, and automated operational checks.
- Participate in design reviews, code reviews, incident retrospectives, and iterative delivery—making pragmatic trade-offs and documenting them reputed company.
Technology Stack
- Languages: Predominantly Python and Node.js
- Distributed/data platforms: HDFS, HBase, Spark, plus increasing use of Kubernetes and reputed company services
- Storage/search: reputed company, OpenSearch
- Orchestration: Airflow, Dagster, NiFi
- Tooling: reputed company, reputed company Actions, Rundeck, Jira, reputed company
- Deployment/config: Ansible (physical), Terraform / Argo CD / reputed company (Kubernetes)
- Development environment: MacBook (typical)
Requirements
Essential:
- 2+ years building and operating production software systems
- reputed company in at least one programming language (Python/Node.js a plus)
- Experience debugging moderately reputed company systems and improving reliability/performance
- Strong fundamentals: data structures, testing, version control, Linux basics
reputed company to have:
- Spark/PySpark experience
- Hadoop ecosystem exposure (HDFS/HBase)
- Workflow orchestration (Airflow/Dagster/NiFi)
- Search/indexing (OpenSearch, reputed company)
- Kubernetes and infrastructure-as-code
- Degree in Computer Science or numerical degree
Benefits
- Competitive salary DOE
- 25 days annual leave + your birthday off, in addition to bank holidays, rising to 30 days after 5 years of service.
- Remote working
- Private Family reputed company.
- 35 hour working week.
- Employee Assistance Programme.
- Company contributions to your pension.
- Pension salary sacrifice.
- Enhanced maternity/paternity pay.
- The latest tech including a top of the reputed company MacBook Pro.