UBDS Digital Logo

UBDS Digital

Principal Data Engineer - Azure

Posted 7 Days Ago
Be an Early Applicant
In-Office
2 Locations
Expert/Leader
In-Office
2 Locations
Expert/Leader
Lead design and delivery of enterprise Azure-native data platforms: architect lakehouse/medallion solutions, build production data pipelines with Python/PySpark/SQL, implement IaC (Terraform/Bicep), CI/CD, security and governance (Entra ID, RBAC, private endpoints), embed Purview lineage, integrate Azure ML/OpenAI, conduct design/code reviews, and mentor engineering teams.
The summary above was generated by AI

UBDS Group delivers modern cloud, data and AI solutions across public and private sector organisations. We design and build scalable, secure and production-ready platforms that solve real-world problems and deliver measurable outcomes.

We’re looking for a Principal Data Engineer (Azure) who combines deep Azure data expertise with strong engineering capability. This is a senior technical role for someone who sets direction, raises standards and mentors others, while remaining actively hands-on in delivery.

The Role

As a Principal Data Engineer at UBDS, you will lead the design and build of enterprise Azure data platforms across complex transformation programmes.

You will:

  • Architect Azure-native data solutions
  • Write and review production-grade code
  • Set engineering standards and patterns
  • Guide teams while remaining deeply involved in delivery

This role suits someone who enjoys solving hard platform problems, optimising performance, and building scalable data foundations that enable analytics and AI.

What You’ll Do
  • Design and implement Azure-native data architectures, including:
    • ADLS Gen2-based lakehouse platforms
    • Azure Databricks and/or Microsoft Fabric solutions
    • Azure Synapse and Azure SQL architectures
    • Event-driven pipelines using Event Hub and Service Bus
  • Build and optimise robust data pipelines using Python, SQL, PySpark and Spark.
  • Lead implementation of medallion/lakehouse models in production environments.
  • Design hybrid batch and streaming ingestion patterns.
  • Implement secure-by-design principles across:
    • Entra ID (Azure AD), RBAC and managed identities
    • Private endpoints and network isolation
    • Encryption and key management
  • Develop Infrastructure as Code using Terraform and/or Bicep.
  • Build and maintain CI/CD pipelines using Azure DevOps or GitHub Actions.
  • Embed governance, lineage and metadata management using Microsoft Purview.
  • Integrate AI capabilities into Azure data platforms, including:
    • Azure ML pipelines
    • Azure OpenAI / RAG architectures
    • Production-ready ML deployment patterns
  • Conduct design reviews, code reviews and technical assurance across teams.
  • Mentor engineers and elevate Azure data engineering standards across engagements.
What We’re Looking ForDeep Azure Engineering Experience
  • Strong hands-on experience delivering enterprise Azure data platforms.
  • Advanced SQL and Python skills, including performance optimisation.
  • Strong experience with Azure Databricks and/or Microsoft Fabric.
  • Proven experience implementing Lakehouse and medallion architectures.
  • Experience designing and implementing streaming/event-driven architectures in Azure.
  • Strong understanding of Azure networking, security and governance controls.
  • Experience working in production environments supporting live services.
DevOps & Platform Discipline
  • Strong Infrastructure as Code experience (Terraform/Bicep).
  • CI/CD implementation for both infrastructure and data workloads.
  • Experience building resilient, observable and maintainable data systems.
  • Understanding of monitoring and alerting using Azure Monitor and Log Analytics.
Leadership & Influence
  • Experience acting as a technical lead or design authority.
  • Ability to influence architecture direction while remaining delivery-focused.
  • Comfortable working directly with clients and senior stakeholders.
  • Experience in public sector or regulated environments is highly desirable.

Benefits

Why people choose to grow their careers at UBDS Group


Professionals choose to grow their careers at UBDS Group for its reputation as a dynamic and forward-thinking organisation that is deeply committed to both innovation and employee development. At UBDS Group, employees are given unique opportunities to work on cutting-edge projects across a diverse range of industries, exposing them to new challenges and learning opportunities that are pivotal for professional growth. The Group’s culture emphasises continuous improvement, offering ample training programs, mentorship, and the chance to gain certifications that enhance their skills and marketability.


UBDS Group fosters a collaborative environment where creativity and innovation are encouraged, allowing employees to contribute ideas and solutions that have a tangible impact on the company and its clients. This combination of professional development, a culture of innovation, and the opportunity to make meaningful contributions makes UBDS Group an attractive place for those looking to advance their careers and be at the forefront of technological and operational excellence.


Employee Benefits

  • Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
  • Private medical cover for you and your spouse/partner, offered via Vitality
  • Discretionary bonus based on a blend of personal and company performance
  • Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
  • Electric Vehicle leasing with salary sacrifice
  • Contributed Pension Scheme
  • Death in service cover

About UBDS Group

At UBDS Group our mission is to support entrepreneurs who are setting new standards with technology solutions across cloud services, cybersecurity, data and AI, ensuring that every investment advances our commitment to innovation, making a difference, and creating impactful solutions for organisations and society.

Equal Opportunities

We are an equal opportunities employer and do not discriminate on the grounds of gender, sexual orientation, marital or civil partner status, pregnancy or maternity, gender reassignment, race, colour, nationality, ethnic or national origin, religion or belief, disability or age.

Top Skills

Azure,Adls Gen2,Lakehouse,Medallion Architecture,Azure Databricks,Microsoft Fabric,Azure Synapse,Azure Sql,Event Hub,Service Bus,Python,Sql,Pyspark,Spark,Entra Id (Azure Ad),Rbac,Managed Identities,Private Endpoints,Azure Key Vault,Terraform,Bicep,Azure Devops,Github Actions,Microsoft Purview,Azure Ml,Azure Openai,Rag,Ci/Cd,Azure Monitor,Log Analytics

UBDS Digital Manchester, England Office

24 Mount Street, Industrious, Windmill Gree, Manchester, United Kingdom, M2 3NX

Similar Jobs

3 Days Ago
Hybrid
London, England, GBR
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Lead architecture and delivery of data solutions on Databricks within Azure, ensuring best practices in data pipeline design and implementation.
Top Skills: Azure DevopsCi/CdDatabricksDeltalakeGithub ActionsJenkinsPysparkPythonSpark Structured StreamingUnity Catalog
42 Minutes Ago
Hybrid
London, Greater London, England, GBR
Senior level
Senior level
Fintech • Mobile • Payments • Software • Financial Services
The Privacy and AI Counsel will provide legal advice on privacy matters, ensure compliance with laws, support AI initiatives, and handle data protections.
Top Skills: Ai Governance FrameworksData Protection Impact Assessments (Dpias)Privacy Policies
44 Minutes Ago
In-Office
Chessington, Surrey, England, GBR
Senior level
Senior level
Healthtech • Logistics • Pharmaceutical
The Senior IT Business Analyst will bridge business needs with technical teams, facilitate requirements gathering, and support Agile transition. Responsibilities include documenting requirements, conducting workshops, supporting testing, and ensuring delivery aligns with business goals.
Top Skills: Azure DevopsConfluenceJIRA

What you need to know about the Manchester Tech Scene

Home to a £5 billion digital ecosystem, including MediaCity, which consists of major players like the BBC, ITV and Ericsson, Manchester is one of the U.K.'s top digital tech hubs, at the forefront of advancements in film, television and emerging sectors like as e-sports, while also fostering a community of professionals dedicated to pushing creative and technological boundaries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account