Software Engineer in Test

Roadie · REMOTE · Engineering

Posted 2026-08-11

Apply for this role →

Roadie is seeking a Software Engineer in Test to join our talented team of developers. In this role, you’ll advance our data science testing and automation capabilities, tackle complex challenges across the software delivery pipeline, and help ensure our data products, models, and insights are accurate, reliable, and ready to scale.

What You’ll Do

Build robust test infrastructure that powers automated regression testing for data science microservices

Troubleshoot and resolve automation issues across multiple environments

Improve the performance, reliability, and stability of automated test suites

Develop and execute comprehensive test strategies and high-impact test cases

Review product requirements to ensure alignment with established design and quality guidelines

Partner with software engineers and fellow test engineers to conduct end-to-end system testing and post-deployment validation

Identify, isolate, and clearly document product defects, then verify fixes through resolution

Champion quality at every stage of the software development lifecycle

What You Bring

3+ years experience in a developer, SDET or QA automation role

3+ years coding experience in Python preferred; coding/scripting in other languages such as Ruby, Bash or Javascript, a plus!

Experience with testing APIs and DBs

Experience in testing frameworks - Pytest preferred

Experience with monitoring tools like grafana, NewRelic or similar

Experience in CI/CD tools such as CircleCI, github action or similar

Be able to write and analyze SQL queries

Experience with cloud solutions such as AWS

Experience with tools such as github, JIRA, postman

Demonstrated background of writing clean, stable, maintainable code

Strong understanding of testing methodologies and automated testing approaches

Excellent troubleshooting and communication skills

Thrives in fast-paced environment, with ability to operate within short release-cycles

Bonus

Familiarity with performance testing and related tools

Familiarity with Data Science concepts

Experience with testing  ML models

Experience with Kafka, groundcover, Sentry, MLFlow

Understanding of the full application development lifecycle

Why Roadie?

Competitive total rewards package

100% company-paid health insurance for yourself

401(k) with company match

Tuition & student loan repayment assistance- yes, we’ll contribute directly to your student loans!

Remote-first environment

Unlimited PTO

Inclusive family leave policy that supports all new parents

Paid Wellness Days in addition to Company holidays

Monthly WFH stipend

Paid sabbatical leave- tenured Roadies are given extra time to unplug, rest, and explore

The technology you need to get the job done

This role is not eligible for Visa sponsorship. Applicants must be authorized to work for any employer in the U.S.

Apply for this role →

← Back to all jobs