Engineer IV
About the Role
We are looking for a curious and team-focused Data Infrastructure Engineer to join our dynamic engineering team. In this role, you will build and maintain the data pipelines that power operational insights for Anaplan. You will be responsible for bringing raw data into our Lakehouse to ensure users have the data they need to drive their decision-making. You will have a lead role in this system and will be responsible for contributing to architectural direction, mentoring junior developers, and ensuring standards are met.
You will work as a Data Infrastructure Engineer, responsible for building and maintaining the systems that bring data into our Lakehouse. This role suits an engineer who is accountable, collaborative, and comfortable moving between data sources and our Lakehouse. There will be opportunities to engage with and learn from other parts of the ODL platform including Data Science and BI Dashboarding, REST Services, and Front End UIs.
Key Responsibilities
Own the infrastructure for bringing data into the Anaplan Lakehouse.
Own the strategy and execution of CI/CD for resilient automated deployments.
Use metrics, traces, alerts, and dashboards to ensure a reliable data pipeline.
Partner with product, analytics, and platform stakeholders to translate business needs into end-to-end technical solutions.
Lead the investigation of correctness, performance, and scalability issues across the stack.
Mentor engineers; foster a team-focused, data-driven culture.
Take accountability for the health and scalability of the systems in scope.
Required Qualifications
8+ years of experience in software engineering, with a proven track record of technical leadership in data infrastructure.
Experience with message queues at scale, especially Pulsar.
Experience with distributed data processing frameworks at scale, especially Flink.
Experience with schema definition, enforcement, and migration.
Experience deploying to Kubernetes.
Experience working with a Lakehouse, especially Databricks.
Proven success with automated CI/CD pipelines.
Advanced SQL/notebook/Pandas experience for data validation and debugging.
Experience building dashboards and alerts in modern observability stacks (e.g., Prometheus, Grafana, ELK).
Experience mentoring engineers and leading complex cross-cutting technical projects.
Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
Preferred Qualifications
Deep experience with cloud platforms (AWS, GCP, Azure) and cloud-native design.
Experience with IaC, especially Terraform.
Experience with systems that cross regional boundaries.