Senior Software Engineer in Test

We are looking for a strong Senior Software Engineer in Test (SET) to build scalable automation frameworks for multi-language SDKs, Model Context Protocol (MCP), and AI-powered workflows. The role focuses on SDK testing, MCP protocol validation, prompt automation, and developer productivity tools. Strong programming and framework development skills are essential; UI and API automation are secondary.

Key Responsibilities

Design and develop reusable automation frameworks for SDKs across multiple languages, including TypeScript/JavaScript, Python, Java, and Go.

Automate SDK functionality, compatibility, error handling, integration, and release validation.

Build and maintain MCP test frameworks to validate clients, servers, tools, resources, prompts, transports, and protocol interactions.

Develop automated tests for prompts, AI workflows, tool calling, structured outputs, and LLM response quality.

Develop and maintain automated test coverage for XAA, validating functionality, integrations, error handling, and reliability across supported workflows.

Build reusable test utilities, mocks, test harnesses, and developer productivity tools.

Integrate automated tests into CI/CD pipelines and troubleshoot flaky tests, failures, and infrastructure issues.

Leverage GitHub Copilot, Claude Code, and other GenAI tools for test generation, debugging, and framework development.

Collaborate with developers, architects, and platform teams to improve quality, reliability, and release confidence.

Required Qualifications

Bachelor's degree in Computer Science, Software Engineering, or a related field.

5–8 years of experience in SDET, software testing, test infrastructure, or software engineering.

Strong programming skills in at least one language: TypeScript/JavaScript, Python, Java, or Go.

Experience building automation frameworks, reusable libraries, or developer tools.

Strong understanding of SDK testing, integration testing, regression testing, and compatibility testing.

Experience with Git, CI/CD, and debugging complex software systems.

Familiarity with AI-assisted development tools such as GitHub Copilot or Claude Code.

Strong problem-solving, ownership, and communication skills.

Preferred Qualifications

Experience with MCP clients/servers, protocol testing, or MCP SDKs.

Experience with prompt automation, LLM evaluation, AI agents, or AI-powered applications.

Experience testing SDKs across multiple programming languages.

Familiarity with Docker, Kubernetes, cloud environments, and performance testing.

Working knowledge of API automation and UI frameworks such as Playwright or Cypress.

Key Technologies

Primary: SDK Automation | TypeScript/JavaScript | Python | Java | Go | MCP | Prompt Automation | LLM Evaluation | Test Frameworks | GenAI

Additional: Git | CI/CD | GitHub Actions | Jenkins | Docker | Kubernetes | REST APIs | Playwright | Cypress | JMeter

Expected Outcomes

Scalable automation coverage across multiple SDKs and programming languages.

Reliable MCP protocol and integration testing.

Automated prompt and AI workflow regression testing.

Improved developer productivity, defect detection, and release confidence.

#LI-Hybrid

P22395_3583173

The Okta Experience