Senior Platform Engineer (Azure & Databricks)

SNI is serving as a trusted IT Outsourcing partner in line with the needs of World's most prestigious firms and carried out successful projects worldwide.

Responsibilities:

• Provision and manage Azure data platform infrastructure and Databricks workspaces using modular Terraform.

• Administer Databricks compute, cluster policies, SQL warehouses, and Unity Catalog resources (catalogues, schemas, volumes, external locations).

• Implement Azure RBAC, Microsoft Entra ID groups, managed identities, service principals, and Databricks access controls.

• Configure secure Azure networking, including VNet integration, private endpoints, private DNS, routing, and firewall controls.

• Build multi-stage Azure DevOps YAML pipelines with automated validation, security scanning, approval gates, and deployment controls.

• Develop production-grade Bash scripts (integrated with Azure CLI, Databricks CLI, and Terraform) for operational automation and provisioning.

• Support platform onboarding, troubleshoot infrastructure and CI/CD issues, and maintain operational runbooks, governance, and cost-optimization standards.

• Assist with secondary cloud infrastructure provisioning on AWS as needed.

Skills:

• 5+ years of experience in Azure cloud or platform engineering.

• 2-3+ years of production experience with Terraform (reusable modules, remote state, drift management, AzureRM, Entra ID, and Databricks providers).

• 2-3+ years of hands-on Azure Databricks administration (Unity Catalog, workspace policies, compute, SQL warehouses, access controls).

• Advanced proficiency in Azure core services: ADLS Gen2, Key Vault, Microsoft Entra ID, Azure RBAC, Log Analytics, and private networking.

• Strong Bash scripting skills for operational automation (error handling, ShellCheck, CLI integrations, secret management).

• Deep experience with Azure DevOps (multi-stage YAML pipelines, pipeline templates, Git pull requests, service connections, workload identity federation).

• Proven ability to independently troubleshoot complex network, security, and deployment issues.

Nice to have:

• Working knowledge of Python (Azure/Databricks Python SDKs, REST APIs) or PowerShell.

• Experience with Databricks Asset Bundles (DABs).

• Familiarity with Bicep, Azure Policy, policy-as-code, or AWS cloud infrastructure.

• Relevant Microsoft Azure, HashiCorp Terraform, or Databricks certifications.

Follow us on Linkedin! http://linkedin.com/company/snisourcing/