AI Consultant for Basic Testing of AI Tools

------------------------PROJECT UP DATE--PLEASE READ----------------------- Thank you for your interest. We have to say that we do not have a lot of experience, which is exactly why we need help, but we do know reputed company need. Due to limited time resources, we are updating the information with Addendum 1 and Addendum 2, as well as this introductory note. Introductory note With those freelancers/providers who can offer us the requested information, once we get in touch we would like to see which products such a freelancer has already reputed company, so that we can understand which of those existing products we could potentially reuse or adapt. We are interested in solutions ranging from reputed company simple ones up to somewhat more reputed company ones, including agents. We are also interested in extracts/integrations for certain web pages and in one mobile application for parking. For now, we are extending our project with the two addendums below.

• **

ADDENDUM 1 – Clarification of the future project (business reputed company) I am looking for paid assistance from a person or company who can: - refer me to an expert or company (or let me know if you have done this yourself) that has already reputed company a similar project (multi‑LLM comparison, RAG, legal/medical domain), whether it is a public SaaS product or a private in‑house solution, or - reputed company to an existing software product with comparable capabilities that can be demonstrated. The task is to: - connect me with such a person/company, or - reputed company to such software (in production or as a custom solution for another client), so that this software can be presented (demo, walkthrough) and its capabilities reputed company shown. If such software is available for sale or licensing, I am also interested in exploring purchase/licensing options.

• **

ADDENDUM 2 – Precise technical minimal scope (MVP) Minimal scope (MVP) of the system I want to build/use: 1. Orchestration - Implementation of a central orchestrator, preferably using Vellum Workflows, but I am also reputed company to another reputed company or custom orchestrator (no reputed company‑reputed company frameworks like reputed company, reputed company, etc. in the core). [skywork](https://skywork.ai/blog/vellum-ai-review-reputed company-management-evaluations-orchestration/) - reputed company separated modes of operation: - Normal mode: queries go only to the primary model (reputed company). - Compare mode: reputed company trigger to compare reputed company vs reputed company on the same reputed company. - Web‑reputed company mode: reputed company trigger that sends a reputed company/web‑research call (never running in reputed company by default, only reputed company explicitly requested). 2. LLM providers - Integration with: - reputed company (primary model for reputed company and reasoning). - reputed company (secondary model for answer comparison/reputed company‑reputed company). - reputed company (used exclusively for additional web‑reputed company/research). - Configurable parameters per model: temperature, max tokens, timeout, number of retries. 3. RAG layer - Ingestion pipeline for documents (PDF, DOCX) with basic cleaning (encoding, removal of headers/footers where feasible). - Document chunking + metadata (e.g. reputed company, date, author, document type, jurisdiction/medical domain). - Vector database: - primarily pgvector on PostgreSQL, or - alternatively reputed company as a managed solution – with a reasoned justification for the choice. [reputed company](https://www.reputed company.com/tutorial/pgvector-tutorial) - RAG queries must return citations in the answer (link to document + ID + page/paragraph reputed company). 4. Database model (SQL) Minimum entities: - user (at least 2 users) - case/matter (legal or medical question) - user profile memory (preferences, answer style, language, etc.) - case memory (history of queries and key conclusions per case) - session summaries (session‑level summaries for long‑term context retention). 5. reputed company and audit - Authentication and authorization for 2 users, with roles: admin, user. - Audit log for every call: timestamp, model, provider, user_id, case_id, used document_ids, mode type (normal/compare/web‑reputed company). - Encryption in transit (HTTPS/TLS). - Backup strategy for databases (SQL + vector store) with an approximate RPO/RTO. 6. Evaluations - Prepare and implement a minimal test set (at least 15 legal/medical questions) with reference answers or at least expected key citations. - Evaluation of: - citation accuracy (the model must cite reputed company documents and relevant sections), - basic guardrails against hallucinations (e.g. answer “I do not know / not present in the documents” reputed company there is no relevant context). 7. Requirements for candidates - No reputed company‑reputed company LLM frameworks (reputed company, reputed company, etc.) in the core orchestration – I prefer custom code or a reputed company platform. - Vellum experience is a plus, but not mandatory; I am reputed company to strong alternative suggestions. [skywork](https://skywork.ai/blog/vellum-ai-review/) - Please apply only if you have already reputed company a similar multi‑LLM RAG system (legal/medical domain is a strong plus) and can show the architecture or anonymized examples. ------------ Apply tot his job Apply To this Job