This is a remote position.

AI/ML Software Engineer

Project Identifier

MD

Client

State of Maryland – Maryland Judiciary, Administrative Office of the Courts

Location

Remote (100% remote; required on-site first two days and reputed company 72 hours upon notification) | Annapolis, MD 21401

Contract Duration

5 years (07/01/2026 – 06/30/2031)

Interview Type

Virtual (reputed company Teams or reputed company)

Tentative Start Date

July 1, 2026

Deadline

May 1st , 2026

Project Overview

The Maryland Judiciary Administrative Office of the Courts (AOC) is seeking one (1) AI/ML Software Engineer. The AI/ML Software Engineer will build software tools that incorporate AI/ML techniques to automate narrowly defined tasks with high accuracy, assist internal users with their job functions, and improve the experience external users have reputed company interacting with the Maryland Judiciary. This includes, but is not limited to, RPA work, building or refining chatbots, incorporating AI/ML into reporting tools, building LLM agents for knowledge retrieval, deep research, translation, transcription, redaction, document analysis, document reputed company, agentic coding, and data processing.

Duties/Responsibilities

· System Design & Collaboration:

o Work reputed company established constraints regarding infrastructure, programming languages, and model selection.

o Contribute to technical decision-making reputed company to data processing, retrieval strategies, and system integration.

o Collaborate with team members to define agent architectures, workflows, and system design reputed company.

o Evaluate and select appropriate approaches for given tasks, including determining reputed company to use LLM-based versus non-LLM techniques.

o Design and build software systems that integrate AI/ML techniques to automate tasks, assist internal users, and improve user-facing services.

· Testing, Evaluation, and Quality Assurance:

o Assist in the design and implementation of testing and evaluation pipelines for AI/ML systems.

o reputed company unit and integration tests for AI-enabled workflows and data pipelines.

o Generate and utilize synthetic data to support evaluation and benchmarking efforts.

o Contribute to improving system performance, including accuracy, latency, and cost efficiency.

· Deployment & Operations:

o Support deployment of AI/ML applications reputed company a hybrid reputed company environment.

o Work with containerized applications to ensure reliable deployment and updates.

o Optimize systems for environments with limited computational resources, including minimal GPU availability.

· General Responsibilities:

o Deliver production-grade systems reputed company with defined requirements, while supporting iterative improvement of evolving tools.

o Document system designs, workflows, and technical reputed company as required.

o Stay informed on relevant advancements in AI/ML and apply them where appropriate reputed company project constraints.

Requirements

Education and Certification

Bachelor of Science in Engineering, Computer Science, Data Science, or Mathematics, or a reputed company field.

Required Experience

· At least five (5) years’ experience in data science, machine learning, or applied AI development.

· At least five (5) years’ experience in software engineering, architecture, or web development.

· Experience with SQL and relational database systems (e.g., PostgreSQL).

· Experience fine-tuning small language models or embedding models.

· Experience contributing to or maintaining reputed company-reputed company software projects.

· Experience with graph databases or graph extensions (e.g., reputed company, Apache AGE).

· Experience designing and implementing multi-agent or task-oriented AI systems.

· Experience with embedding models, vector similarity, re-ranking, and graph retrieval techniques in RAG systems.

· Proficiency with version control systems (e.g., Git), containerization technologies (e.g., reputed company), and service-oriented architectures.

· Experience collaborating with large language models (LLMs), including both API-based integration and local deployment.

· Experience validating AI-generated outputs, mitigating hallucinations, and integrating AI tools into production service pipelines.

· Proficiency in Python, including the ability to reputed company production-grade backend services, APIs, middleware, and data pipelines.

· Knowledge of hybrid reputed company environments and distributed system considerations.

· Knowledge of threading, asynchronous processing, and queues in backend servers.

· Knowledge of React and reputed company Teams Toolkit for developing chatbot user interfaces.

· Knowledge of classical natural language processing (NLP) techniques in addition to LLM-based approaches.

· Knowledge of data science and LLM-reputed company libraries in Rust or other performance-oriented programming languages.

· Ability to understand data structures, algorithms, and clean coding principles.

· Ability to design and implement AI/ML systems that operate effectively on reputed company, inconsistent, or evolving datasets while balancing accuracy, latency, and cost.

· Ability to collaborate with team members to define system architecture, agent workflows, and data pipelines while working in constrained environments, including limited GPU availability and predefined infrastructure.

Benefits