Sr. Lead - AI Engineer

Job Title: Sr. Lead Software Engineer

Location: Boston, MA

This role is based in our Boston hub. We operate a hub‑first model, with regular in‑office collaboration expected.

About the Role

At Klaviyo, we believe the future of software isn’t just better productivity tools for humans—it’s intelligent systems that can run, optimize, and adapt themselves based on real-time outcome and reward signals. Having already built the infrastructure and applications that connect businesses with over 200,000 customers, billions of consumer profiles, and hundreds of billions of interaction events, we are now making foundational investments in Marketing AI and Service AI to power next-generation agentic capabilities across our entire ecosystem.

The Klaviyo Orchestrate pillar drives the core platform experience, providing the high-throughput capabilities our customers use daily to manage and execute complex marketing workflows. This team balances strict Tier-1 availability and low-latency scalability requirements with rapid agility across the Klaviyo ecosystem. Internally, we have fully embraced AI-native engineering methodologies and are dedicated to putting sophisticated AI-native capabilities directly into the hands of our builder-customers.

We are building a best-in-class, flexible orchestration platform designed to handle massive scale while continuously advancing reliability and performance to meet the expanding needs of our global customer base.

How You’ll Make a Difference

Architect and scale Klaviyo’s Core Orchestration platform, supporting high-traffic, low-latency services with extreme reliability.

Drive the technical vision for integrating AI-driven agentic workflows and automated decision-making into core customer interactions.

Lead the adoption of AI-native software development practices, continually improving engineering productivity and delivery speed across the team.

Design foundational frameworks and services adopted across engineering teams, championing high technical standards through design reviews and mentorship.

Partner closely with product management, data science, design, and executive leaders to shape strategic roadmaps and long-term platform architecture.

Who You Are

Experienced Backend Leader: 8+ years of professional software engineering experience centered on distributed systems, microservices architecture, and high-availability backend platform ownership.

AI & Agentic Systems Practitioner: Hands-on experience shipping production LLM workflows, retrieval-augmented generation (RAG) pipelines, or agentic frameworks with a solid understanding of evals, prompt architecture, and fine-tuning.

Distributed Systems Specialist: Proven track record of architecting event-driven architectures, asynchronous processing pipelines, and message queues (e.g., Kafka, Celery, SQS, Redis) for heavy throughput workloads.

Python & Tooling Mastery: Deep proficiency in Python and modern frameworks (FastAPI, Django) alongside experience with data processing platforms and object-relational mapping tools.

Cloud Infrastructure Native: Strong expertise with AWS, Kubernetes, CI/CD automation, and modern observability suites, integrating cloud architecture seamlessly into system design.

Quality & Evals Focused: Experience establishing automated evaluation frameworks for AI models, balancing latency, accuracy, cost, and safety in production environments.

Cross-Functional Influencer: A technical leader who elevates team performance through architectural direction, collaborative problem-solving, and clear communication across engineering and business domains.

Collaborative and customer‑first. You’re comfortable collaborating directly with PMs, ML engineers, and customers; you can translate between customer needs, product goals, and technical constraints, and you care deeply about the customer experience.

AI-First Engineer: Active use of AI coding tools and modern agentic development workflows in daily work to accelerate innovation and shorten feedback cycles.

Customer-Centric Mindset: Driven by user outcomes, with a knack for translating complex customer needs into resilient software architecture.

Nice to Haves

Experience designing or integrating shared AI/ML platforms consumed by multiple internal engineering teams.

Domain expertise in MarTech, e-commerce platforms, personalization engines, or real-time event streaming.

Massachusetts Applicants:

It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability.

Our salary range reflects the cost of labor across various U.S. geographic markets. The range displayed below reflects the minimum and maximum target salaries for the position across all our US locations. The base salary offered for this position is determined by several factors, including the applicant’s job-related skills, relevant experience, education or training, and work location.

In addition to base salary, our total compensation package may include participation in the company’s annual cash bonus plan, variable compensation (OTE) for sales and customer success roles, equity, sign-on payments, and a comprehensive range of health, welfare, and wellbeing benefits based on eligibility.

Your recruiter can provide more details about the specific salary/OTE range for your preferred location during the hiring process.

Base Pay Range For US Locations:

$216,000—$324,000 USD