Requirements -
Infrastructure as Code (IaC)
• Further develop and maintain Azure and Databricks infrastructure using Terraform across multiple environments through modular and configuration-driven provisioning.
• Own and improve our GitHub Actions-based CI/CD pipelines for infrastructure.
• Contribute to tooling, module design, and documentation to reduce friction and improve the developer experience.
Databricks and Data Platform Infrastructure
• Manage and develop our Databricks environment on Azure, including networking, compute resources, policies, workspace configuration, and isolation per data product.
• Maintain and enhance the infrastructure surrounding Unity Catalog, including external locations, storage credentials, schemas, and permissions in accordance with our data classification model.
• Support onboarding of new data products by provisioning the infrastructure required for new teams and datasets.
Identity, Access, and Security
• Automate identity and access management in Azure and Databricks, including lifecycle management of groups, role assignments, and permissions at both environment and data product levels.
• Develop and maintain security patterns for networking, such as VNet Injection, private endpoints, and firewall configurations for Azure and Databricks.
We Are Looking For Someone Who
• Has extensive hands-on experience with Azure and Terraform in large-scale environments, with a focus on modular IaC and multi-environment deployments. Experience from a central platform team supporting multiple teams is an advantage.
• Has a solid understanding of Azure IAM and Entra ID, including group management, service principals, managed identities, PIM, and RBAC.
• Is comfortable working with Azure networking, such as VNets, subnets with service delegation, private endpoints, and NSG rules.
• Has experience with DevOps practices using GitHub.
• Has practical experience with Databricks on Azure, including Unity Catalog, VNet Injection, Access Connectors, cluster/compute policies, and workspace configuration.
• Is a team player who can quickly become a natural part of an established engineering team with a strong team spirit and a high technical standard.
