Senior Azure Databricks Engineer
We are looking for a highly technical Senior Azure Databricks Engineer to take ownership of optimizing and productionizing Databricks workloads.
About the Client
The client is a reinsurance company, primarily working with enterprise clients and supporting long-term collaboration within established teams.
Key Responsibilities:
- Design and implement data processes (e.g., ADF Pipelines, Databricks).
- Develop and version data models.
- Work with Azure cloud-based data infrastructures.
- Develop and execute schema and data migrations.
- Optimize ETL performance.
Requirements:
- Must-Have: Proficiency in Databricks, Delta Lake, Python, PowerShell, MS SQL Server, and T-SQL.
- Azure Stack: Strong knowledge of Azure Data Factory, Azure Data Lake, and Cosmos DB.
- DevOps: Experience with Azure DevOps, Git, Visual Studio, testing, and optimizing complex data flows.
- Data Modeling: Solid understanding of data warehouse and transactional modeling concepts.
- Should-Have: Experience with Power BI.