Senior Data Engineer - Azure Databricks

Job Title: Senior Data Engineer - Azure Databricks

Key Skills: Azure Databricks, DBT, Snowflake, Python, SQL, Terraform

Experience: 5+ YOE.

Location: Costa Rica, Peru, Colombia, and Bolivia.

Mode: Remote.

We at Coforge are hiring Senior Data Engineer - Azure Databricks (#22146) with the following skill set.

Key Responsibilities

· Own the end-to-end delivery of data pipelines and data products from design through deployment and production support.

· Develop, maintain, and optimize scalable data pipelines using Azure Databricks, DBT, and Python.

· Support and execute large-scale data migrations from Snowflake (AWS) to Azure Databricks.

· Build and manage infrastructure-as-code solutions using Terraform.

· Ensure seamless integration across enterprise data platforms and environments.

· Implement data quality frameworks, testing, and validation processes.

· Enable observability through monitoring, logging, and alerting solutions.

· Contribute to the design of scalable data architectures aligned with Lakehouse principles.

· Monitor and support production environments, ensuring performance and reliability.

· Collaborate with cross-functional teams and mentor junior engineers through best practices and code reviews.

Required Skills & Qualifications

· 5 to 8+ years of experience in Data Engineering within enterprise-scale environments.

· Strong hands-on expertise with Azure Databricks, DBT, and Snowflake.

· Strong proficiency in Python and SQL.

· Proven experience building and managing large-scale data pipelines and transformations.

· Experience working with high-volume datasets and complex data models.

· Solid understanding of data modeling, ETL/ELT frameworks, distributed systems, and Lakehouse architectures.

· Experience with Terraform and Infrastructure as Code (IaC) principles.

· Strong experience with CI/CD pipelines and Git-based version control.

· Experience supporting production systems, including monitoring, alerting, and incident resolution.

· Knowledge of data quality, testing, and observability frameworks.

· Excellent analytical, problem-solving, and communication skills.

Preferred Skills

· Experience in insurance or financial services environments.

· Experience with real-time and streaming technologies such as Kafka, Event Hubs, or Delta Live Tables.

· Knowledge of security, compliance, and data protection standards in regulated industries.

· Experience with cloud cost optimization and performance tuning.

· Exposure to multi-cloud or hybrid architectures.

Posted On: 14-08-2026

At Coforge, we hire professionals based solely on their skills and qualifications and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.