We are HCLTech, one of the fastest-growing large tech companies in the world and home to 219,000+ people across 54 countries, supercharging progress through industry-leading capabilities centered around Digital, Engineering and Cloud.

The driving force behind that work, our people, are diverse, creative, and passionate, raising the bar for excellence on a regular basis. We, in turn, work hard to bring out the best in them as we strive to help them find their spark and become the best version of themselves that they can be.

At HCLTech Australia, we value the unique perspective and contributions of all individual and we actively encourage applications from Aboriginal and Torres Strait Islander people to apply for this role.

Are you ready to be an important part of this ever-transformational journey?

Location: Sydney

Role Overview

The Databricks Platform Administrator is responsible for the administration, reliability, security, and performance of the enterprise Databricks platform. This role ensures that Databricks environments are scalable, available, cost‑efficient, and governed, while supporting data engineering, analytics, machine learning, and AI workloads across development, test, and production environments.

Key Responsibilities

• Administer and operate enterprise Databricks workspaces across development, QA, production, and disaster recovery environments.

• Manage Databricks workspace configuration including clusters, jobs, pools, policies, secrets, and init scripts.

• Design, configure, and enforce cluster policies to ensure security, stability, and cost control.

• Manage Databricks compute including autoscaling, instance pools, job clusters, and all‑purpose clusters.

• Administer Databricks Jobs, Workflows, and scheduling for batch and streaming workloads.

• Configure and manage Databricks security including workspace access controls, IAM integration, permissions, and secrets management.

• Implement and manage Databricks Unity Catalog for data governance, access control, and lineage.

• Configure and support integration with cloud storage (Azure Data Lake, S3, GCS) and external data sources.

• Administer Delta Lake features including table management, versioning, optimization, and retention policies.

• Monitor platform health, performance, and availability using logs, metrics, and alerts.

• Troubleshoot Spark workloads including job failures, performance degradation, memory issues, and scaling problems.

• Support ML and AI workloads using Databricks ML Runtime, Model Registry, Feature Store, and notebooks.

• Implement CI/CD processes for Databricks notebooks, jobs, and configurations using Git-based workflows.

• Manage Databricks REST APIs, CLI tools, and automation scripts for platform operations.

• Perform capacity planning, usage analysis, and cost optimisation across Databricks environments.

• Apply platform patches, runtime upgrades, and configuration changes following change management best practices.

• Act as the escalation point for Databricks production incidents and lead root cause analysis.

• Maintain operational documentation, standards, and platform runbooks.

• Collaborate with data engineers, data scientists, MLOps, cloud, and security teams.

• Provide on‑call production support through a rotation schedule.

Qualifications & Experience

• 5+ years experience administering data or analytics platforms in enterprise environments.

• Strong hands‑on experience administering Databricks workspaces and Spark‑based platforms.

• Deep understanding of Apache Spark architecture, execution, and performance tuning.

• Experience managing Databricks clusters, jobs, workflows, and autoscaling configurations.

• Strong understanding of Databricks security concepts including workspace access controls, IAM integration, and secrets management.

• Hands‑on experience with Unity Catalog and data governance concepts.

• Experience working with Delta Lake and lakehouse architectures.

• Strong knowledge of cloud platforms (Azure, AWS, or GCP) and cloud storage services.

• Proficiency in Python and Bash scripting.

• Good understanding of SQL and distributed data processing concepts.

• Experience implementing CI/CD pipelines for data platforms using Git‑based tooling.

• Strong troubleshooting, analytical, and problem‑solving skills.

• Strong communication and stakeholder engagement skills.

• Bachelor’s degree in Computer Science, Engineering, Data Engineering, or a related discipline.

Preferred Skills

• Databricks Administrator or Data Engineer certification.

• Experience supporting ML and AI workloads on Databricks.

• Experience with streaming technologies such as Spark Structured Streaming or Kafka.

• Familiarity with Infrastructure as Code tools such as Terraform for Databricks.

• Experience working in regulated or security‑sensitive environments.

• Familiarity with ITIL‑based enterprise service management processes.

 Why Us 

We are one of the fastest-growing large tech companies in the world, with offices in 50+ countries across the globe and 219,000 employees. 

• Our company is extremely diverse with 165 nationalities represented.

• We offer the opportunity to work with colleagues across the globe. 

• We offer a virtual-first work environment, promoting a good work-life integration and real flexibility. 

• We offer comprehensive benefits for all employees.  

• We are a certified great place to work and a top employer in 17 countries, offering a positive work environment that values employee recognition and respect. 

Equality & Opportunity for All

Representing 165 nationalities across the globe, we pride ourselves on being an equal opportunity employer, committed to providing equal employment opportunities to all applicants and employees regardless of race, religion, sex, colour, age, national origin, pregnancy, sexual orientation, physical disability or genetic information, military or veteran status, Aboriginal and Torres Strait Islander people or any other protected classification, in accordance with federal, state, and/or local law.

Candidate Data Privacy Notice | HCL Technologies

We are committed to respecting your privacy and for the protection of your personal data. Your personal data will be collected and processed in line with our candidate privacy notice: https://www.hcltech.com/candidate-privacy-notice. This privacy notice will help you to understand what personal data we collect about you, how we use this personal data, and what rights you have regarding your personal data.  By replying to this email or submitting any personal data to HCLTech, you acknowledge that you have read and understood the candidate privacy notice and  have  provided your consent to the processing of your data for recruitment purposes as described in the privacy notice”.