DataOps Engineer

CHEP helps move more goods to more people, in more places than any other organization on earth via our 300 million pallets, crates and containers. We employ 11,000 people and operate in more than 55 countries. Through our pioneering and sustainable share-and-reuse business model, the world’s biggest brands trust us to help them transport their goods more efficiently, safely and with less environmental impact. 
What does that mean for you? You’ll join an international organization big enough to take you anywhere, and small enough to get you there sooner. You’ll help change how goods get to market and contribute to global sustainability. You’ll be empowered to bring your authentic self to work and be surrounded by diverse and driven professionals. And you can maximize your work-life balance and flexibility through our Hybrid Work Model.

Job Description

Position Purpose

Our ambition is to support the growth of Brambles Digital by laying the foundations for DataOps, to support the provision of high performing, cost-effective and reliable data pipelines in our Data & Analytics ecosystem.

As a DataOps Engineer, you will undertake packages of work (Jira Align epics) which address our use of Infrastructure as Code tools and processes, particularly assisting in the management and availability of the Databricks platform and resources to internal analytics teams (Data Science, Data Engineering, Data Analytics).

In the role, you will act as direct support for our Databricks Admin team as they develop and implement the user, cluster and unity catalog governance scheme and processes. The DataOps Engineer will implement the various environment management CI/CD and IaC processes on behalf of the Databricks Admin team. This includes, but is not limited to, supporting user adoption of Databricks, implementing and maintaining security and resource provisioning best practices, disaster recovery processes, CI/CD processes and code repos, under the direction of the Databricks Admin team. As a DataOps Engineer, you will be expected to apply best practices for IaC, Enforcing Policies as Code, and Injecting Secrets into Terraform.

The role will collaborate closely with our Cloud Engineering team to ensure a joined-up approach to our environment management. Some of this work may be performed under the direction of the Cloud Engineering team.

Key Accountabilities

• Provide 2nd and 3rd line support for users of the Databricks Platform.
• Collaborate with our Data Science, Cloud Engineering & Data Engineering teams to align the Databricks environment with application requirements via IaC
• Work with Data Scientists & Machine Learning Engineers to ensure optimal performance of data models and pipelines following restoration of Databricks environment via IaC.
• Implement and maintain infrastructure as code (IaC) using Terraform for our Databricks environment and associated systems.
• Collaborate with data security teams to ensure our recovery strategies adhere to Brambles’ security standards.
• Support the implementation of a cluster policy governance framework for Databricks compute via Terraform in collaboration with the Databricks Admin team.
• Support & maintain implementation of a comprehensive application tagging process for workloads in Databricks via Terraform, under the direction of the Databricks Admin team.

Qualifications

• Bachelor’s degree in computer science, Engineering, or a related field; or equivalent work experience in Data Engineering, MLOps, or platform administration.

Experience

• At least three years’ experience in Data Engineering, IaC or MLOps.
• Experience of Databricks Administration and Terraform. Using Databricks as a Data Scientist or Data Engineer is useful experience but we’re really looking Databricks Administration experience.
• Proven experience building applications and programming using Python.
• Experience of using IaC, disaster recovery techniques and processes, or Databricks.
• Familiarity with cloud-based services and engineering.

Remote Type

Hybrid Remote

We are an Equal Opportunity Employer, and we are committed to developing a diverse workforce in which everyone is treated fairly, with respect, and has the opportunity to contribute to business success while realizing his or her potential. This means harnessing the unique skills and experience that each individual brings and we do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity, status as a veteran, and basis of disability or any other federal, state, or local protected class.

Individuals fraudulently misrepresenting themselves as Brambles or CHEP representatives have scheduled interviews and offered fraudulent employment opportunities with the intent to commit identity theft or solicit money. Brambles and CHEP never conduct interviews via online chat or request money as a term of employment. If you have a question as to the legitimacy of an interview or job offer, please contact us at recruitment@brambles.com.