Senior DevOps Engineer
You will join a client data team as the engineer who owns the platform beneath it. Working alongside data engineers and architects, you will build and run the AWS and Databricks infrastructure that keeps their pipelines, analytics and AI workloads secure, reliable and cost-effective. Every change goes through Terraform, so your code becomes the single source of truth for the platform. As AI use cases move from experiment to production, you will help shape the infrastructure that supports them.
Required Skills:
Commercial experience in a senior DevOps, platform or cloud engineering role
Strong hands-on AWS knowledge across VPC, IAM, S3, EC2, Lambda and related services
Expert Terraform skills, including module design, remote state management and working at scale
A solid understanding of Databricks infrastructure on AWS, from workspace deployment to cluster configuration
Experience with CI/CD tooling such as GitHub Actions, GitLab CI or Azure DevOps
A keen interest in AI and how it can be applied to modern data platforms
Clear communication with technical and non-technical stakeholders
Key responsibilities & duties include:
Design, build and maintain AWS infrastructure for the data platform using Terraform
Deploy and manage Databricks workspaces, cluster policies, Unity Catalog and the networking that connects them to AWS
Plan VPCs, subnets, routing, PrivateLink and peering so new components fit cleanly within the existing network design
Build CI/CD pipelines for infrastructure and data workloads
Put monitoring, alerting and cost controls in place across the platform
Support the team as it adopts AI and machine learning services such as Amazon Bedrock and SageMaker
Apply security best practice across IAM, encryption and secrets management
Mentor engineers and raise infrastructure as code standards across the team
Desirable skills:
Networking knowledge covering routers, subnets, route tables, Transit Gateway and VPN, with a clear grasp of how VPCs interact within an existing design
Python or Bash scripting for automation
Container experience with Docker and Kubernetes (EKS)
Certifications such as AWS Solutions Architect or DevOps Engineer Professional, Databricks Platform Administrator or HashiCorp Terraform Associate