168. Senior AI Engineer – LLM and Agent Systems

We’re looking for a Senior AI Engineer – LLM and Agent Systems to join Source Meridian

About Source Meridian

Source Meridian is a development software company that works to solve the industry’s most challenging problems in healthcare practices. We are laser focused on specific technologies in the healthcare and life science industries: Healthcare technology, artificial intelligence, and healthcare interoperability.

About the Role

AI Engineer with hands-on experience in building production-grade artificial intelligence systems using large language models (LLMs), agentic frameworks, and modern data infrastructure. The ideal candidate designs, develops, and deploys intelligent applications that leverage LLM orchestration, retrieval-augmented generation (RAG), and memory-managed architectures.

What You’ll Do

• Design and implement agentic workflows using LangGraph and LangChain, including multi-step reasoning, tool usage, and human-in-the-loop patterns.
• Integrate LLMs (OpenAI, Anthropic, Google Vertex AI, open-source models) via REST APIs and SDKs into scalable backend services.
• Build and maintain RESTful APIs (FastAPI) to serve AI-powered functionality to frontends and external consumers.
• Architect and manage vector database solutions (Milvus) for semantic search and retrieval-augmented generation (RAG).
• Design context engineering strategies, including prompt templates, dynamic context window management, token optimization, and context compression techniques.
• Implement short-term memory (conversational buffers, sliding windows, summary memory) and long-term memory (persistent vector stores, knowledge graphs, user profile stores) using MongoDB and vector databases.
• Store and manage structured and unstructured data in MongoDB, designing schemas that support conversation history, user state, and agent checkpoints.

• Evaluate and improve the quality of LLM responses through prompt engineering, few-shot examples, guardrails, and automated evaluation pipelines.
• Collaborate with DevOps teams to containerize and deploy AI services using Docker, Kubernetes, and CI/CD pipelines on AWS or GCP.

Required Qualifications

• Strong command of Python (3+ years)
• Demonstrable experience with LangChain and LangGraph (graph-based agent orchestration, state management, conditional edges, parallel execution).
• Solid understanding of the fundamentals of LLMs: tokenization, embeddings, temperature/sampling, RAG.
• Hands-on experience with vector databases and embedding models for semantic search and retrieval pipelines.
• Experience designing and consuming REST APIs; knowledge of authentication.
• Proficiency in MongoDB (document modeling, aggregation pipelines, indexing strategies).
• Understanding memory architectures for conversational AI: summary memory, entity memory, and long-term persistent stores.
• Familiarity with context engineering: token budget management, hybrid search (sparse + dense).
• English level: B2 or higher

Nice to Have

• Experience with assessment frameworks (RAGAS, Langfuse (LangSmith), customized assessments).
• Experience with streaming responses.

What We Offer

✔ Permanent contract
✔ Learning and continuous growth environment 🚀
✔ Benefits package focused on health and well-being 🎉
✔ Competitive salary based on experience 💰

📍 Apply only if you reside in Colombia or Ecuador

At Source Meridian, you’ll be part of a high-impact tech-health company, building products that truly make a difference.

If you meet the profile — or know someone who might be interested — apply now!

We’d love to meet you 💬