168. Senior AI Engineer – LLM and Agent Systems
We’re looking for a Senior AI Engineer – LLM and Agent Systems to join Source Meridian
About Source Meridian
Source Meridian is a development software company that works to solve the industry’s most challenging problems in healthcare practices. We are laser focused on specific technologies in the healthcare and life science industries: Healthcare technology, artificial intelligence, and healthcare interoperability.
About the Role
AI Engineer with hands-on experience in building production-grade artificial intelligence systems using large language models (LLMs), agentic frameworks, and modern data infrastructure. The ideal candidate designs, develops, and deploys intelligent applications that leverage LLM orchestration, retrieval-augmented generation (RAG), and memory-managed architectures.
What You’ll Do
• Design and implement agentic workflows using LangGraph and LangChain, including multi-step reasoning, tool usage, and human-in-the-loop patterns.
• Integrate LLMs (OpenAI, Anthropic, Google Vertex AI, open-source models) via REST APIs and SDKs into scalable backend services.
• Build and maintain RESTful APIs (FastAPI) to serve AI-powered functionality to frontends and external consumers.
• Architect and manage vector database solutions (Milvus) for semantic search and retrieval-augmented generation (RAG).
• Design context engineering strategies, including prompt templates, dynamic context window management, token optimization, and context compression techniques.
• Implement short-term memory (conversational buffers, sliding windows, summary memory) and long-term memory (persistent vector stores, knowledge graphs, user profile stores) using MongoDB and vector databases.
• Store and manage structured and unstructured data in MongoDB, designing schemas that support conversation history, user state, and agent checkpoints.
• Evaluate and improve the quality of LLM responses through prompt engineering, few-shot examples, guardrails, and automated evaluation pipelines.
• Collaborate with DevOps teams to containerize and deploy AI services using Docker, Kubernetes, and CI/CD pipelines on AWS or GCP.
Required Qualifications
Strong command of Python (3+ years)
Demonstrable experience with LangChain and LangGraph (graph-based agent orchestration, state management, conditional edges, parallel execution).
Solid understanding of the fundamentals of LLMs: tokenization, embeddings, temperature/sampling, RAG.
Hands-on experience with vector databases and embedding models for semantic search and retrieval pipelines.
Experience designing and consuming REST APIs; knowledge of authentication.
Proficiency in MongoDB (document modeling, aggregation pipelines, indexing strategies).
Understanding memory architectures for conversational AI: summary memory, entity memory, and long-term persistent stores.
Familiarity with context engineering: token budget management, hybrid search (sparse + dense).
English level: B2 or higher
Nice to Have
• Experience with assessment frameworks (RAGAS, Langfuse (LangSmith), customized assessments).
• Experience with streaming responses.
What We Offer
✔ Permanent contract✔ Learning and continuous growth environment 🚀✔ Benefits package focused on health and well-being 🎉✔ Competitive salary based on experience 💰
📍 Apply only if you reside in Colombia or Ecuador
At Source Meridian, you’ll be part of a high-impact tech-health company, building products that truly make a difference.
If you meet the profile — or know someone who might be interested — apply now!
We’d love to meet you 💬