Senior Data Engineer
The Opportunity:
The Senior Platform Engineer designs, builds, automates, and operates the shared data and AI platform capabilities used by engineering, analytics, governance, and AI teams.
This senior hands-on role establishes reusable platform patterns across Databricks, Microsoft Azure, Microsoft Fabric, CI/CD, observability, security, and cost management. The role also provides technical leadership for platform reliability, operational maturity, and developer enablement.
What you’ll do…
Platform Architecture & Engineering
Design and implement secure, scalable platform services for Databricks, Azure Data Lake, Microsoft Fabric, and supporting cloud services.
Create reusable environment patterns for development, test, and production workloads.
Implement workspace, network, identity, storage, compute, catalog, policy, and secrets-management configurations.
Partner with Architecture and Security to translate enterprise standards into practical platform controls and reference implementations.
Automation, DevOps & Developer Experience
Develop infrastructure-as-code modules, deployment pipelines, automated configuration, and policy-as-code controls.
Establish CI/CD patterns for data pipelines, notebooks, libraries, semantic assets, and AI workloads.
Build self-service templates and paved-road capabilities that improve delivery consistency and reduce manual provisioning.
Maintain source-control, release, artifact, environment-promotion, and rollback practices.
Reliability, Observability & Cost Management
Define and implement monitoring, alerting, logging, capacity, performance, availability, and recovery standards.
Lead troubleshooting and root-cause analysis for complex platform incidents and recurring reliability issues.
Implement operational dashboards, service-level indicators, runbooks, and on-call support patterns.
Analyze platform usage and cost drivers; implement guardrails, tagging, budgets, and optimization recommendations.
Technical Leadership & Governance
Lead platform design reviews and provide technical guidance to Platform Engineers and delivery teams.
Develop engineering standards, operating procedures, support models, and platform documentation.
Embed data governance, lineage, classification, access control, and audit requirements into platform capabilities.
Evaluate platform features and emerging technologies, recommending pragmatic adoption paths aligned with business outcomes.
Who you are?
• 2–4 years of experience in information security or cloud engineering, with at least 1–2 years working with Azure.
• Strong understanding of core security principles (identity, access control, encryption, network security).
• Hands-on experience with Azure security services, including: o Microsoft Defender for Cloud o Azure Sentinel (SIEM) o Azure Policy and Blueprints o Azure AD security features (MFA, Conditional Access, PIM)
• Ability to collaborate and communicate effectively with cross-functional teams.
• Hands-on experience configuring, integrating, and operating leading cloud security tools such as CrowdStrike, Wiz, Prisma Cloud, or similar solutions for threat detection, posture management, and compliance.
Preferred:
• Certification such as Microsoft Certified: Azure Security Engineer Associate (AZ-500).
• Experience with Infrastructure-as-Code (Terraform, Bicep) for secure deployments.
• Exposure to DevSecOps practices and CI/CD pipeline security.
#LI-VK