Senior Data Engineer

The Senior Data Engineer is a highly skilled data management specialist in charge of developing and implementing complex data pipelines and data warehouse solutions. They will work closely with senior data engineers, architects and product owners to ensure high-quality delivery of Data Assets.

Required Experience:

At least 5 years of experience in Data Engineering or a related field

A minimum of 3 years of hands-on experience with Databricks in a production environment

Strong expertise in cloud platforms (e.g. AWS, Azure, GCP), Data Lake technologies and Data Warehousing

Experience with data ETL tools and BI solutions (e.g., Airflow, PowerBI)

Experience with data quality and governance tools (e.g., Atlan, Monte Carlo)

Solid knowledge of data modelling concepts

Excellent communication and collaboration skills

A problem-solving and analytical mindset

Ability to work autonomously and as part of a team

Key responsibilities & duties include:

Design, build and maintain scalable Databricks data pipelines to ingest, transform and deliver high-quality data into Data Lake and Data Warehouse environments

Develop and optimise ETL/ELT workflows and orchestration processes using tools such as Airflow to ensure reliable and automated data delivery

Manage and enhance cloud-based data platforms (AWS / Azure / GCP), focusing on performance, scalability, security and cost efficiency

Implement and maintain data quality, governance, lineage and monitoring frameworks using tools such as Atlan and Monte Carlo to ensure trusted and compliant data

Partner with business stakeholders, BI teams and engineering teams to design data models and deliver analytics-ready datasets that support reporting and decision-making

Desirable Experience:

Master's in Computer Science, Data Science or a related field

Proven experience in designing, developing and implementing complex data pipelines and data warehouse solutions in an enterprise environment

Experience with Scaled Agile planning and execution