CMSPI Logo

CMSPI

Data Engineer

Posted 2 Months Ago
Be an Early Applicant
In-Office
Manchester, Greater Manchester, England, GBR
Junior
In-Office
Manchester, Greater Manchester, England, GBR
Junior
Build and maintain secure, scalable data architectures and ETL/ELT workflows for a payments intelligence platform. Develop ingestion solutions using APIs, web scrapers, and SFTP; onboard client data; troubleshoot production issues; and contribute to Databricks-based data platform capabilities. Collaborate in an Agile squad, apply testing and CI/CD practices, create reusable Python libraries, and support continuous improvements across data engineering solutions.
The summary above was generated by AI

KEY INFORMATION

Position: Data Engineer

Reporting to: Data Engineering Manager

Location: Manchester Office, Hybrid working schedule

Role Overview

As a Data Engineer, you will help shape the evolution of CMSPI’s payments intelligence platform. You will work across the full data engineering lifecycle, designing secure data retrieval and ingestion capabilities, building reliable analytics workflows and supporting client onboarding. Working closely with a cross-functional development squad, you will turn business requirements into maintainable solutions while learning and applying modern engineering practices and technologies.


Requirements

JOB ROLE

Key accountability for this role: Deliver innovative, scalable and secure data solutions for CMSPI’s payments intelligence platform.

Key responsibilities will include:

• Design scalable data architectures and retrieval solutions across APIs, web scrapers and SFTP, with security and performance at the centre.

• Deliver prompt, efficient onboarding of CMSPI client data and contribute to new data features that create continuous business value.

• Collaborate with engineers, agile delivery leads and business stakeholders to define, refine and deliver requirements in an agile squad.

• Maintain high software quality through clean code, collaborative code and architecture reviews, automated testing and continuous integration.

• Respond to stakeholder issues and queries, troubleshoot production problems and drive practical improvements to data solutions.

• Help shape CMSPI’s next generation data platform using powerful tools such as Databricks AI Gateway, enabling governed, agent-powered capabilities that support self-building and self-healing data pipelines.

• Participate in sprint planning and daily stand-ups, keeping stories and tasks current and raising critical blockers early.

• Learn, adopt and promote best practices in data engineering, including reusable Python libraries and maintainable functional and object-oriented code.

• Stay aware of emerging technology trends and research ideas that can improve CMSPI’s data platforms and engineering practices.

• Work collaboratively as part of an Agile development squad and contribute to a culture of continuous learning and delivery.

WHAT WE’RE LOOKING FOR

You are a great match if:

• 2+ years’ professional experience as a Data Engineer or DevOps Engineer.

• Experience building ETL/ELT workflows for analytics using Spark or Hadoop.

• Strong Microsoft Azure experience across DevOps/CI/CD, Azure Data Factory, Azure Data Lake, Azure Functions, Key Vault, monitoring, networking, identity, and cloud deployment services.

• Databricks experience, including workflows/jobs, notebooks, Delta Lake, Unity Catalog and other Databricks-native tools.

• Advanced Python skills, including efficient functional and object-oriented code, reusable Python libraries, and practical experience with packages such as requests, Selenium, and Playwright.

• Strong problem-solving, analytical, communication and cross-functional collaboration skills.

• Bachelor’s degree in Computer Science, Mathematics or another analytical/numerical subject.

• Highly desirable: experience with Agile squads, payments, Terraform/Bicep, Docker/Kubernetes, Scala, PowerShell or YAML.


Benefits

What we offer…

• Competitive annual company bonus linked to company and individual performance.

• Future opportunity for equity (shadow stock) awarded to high performers.

• Competitive pension plan from day 1 plus Vitality healthcare cover & cycle to work (after 6-months)

• Monthly reimbursement for commuting costs.

• 22 days' annual leave, increasing with service, plus UK bank holidays.

• Wellbeing support, including an Employee Assistance Programme and mental health resources.

• Learn from payments industry experts and accelerate your career through ongoing training and development.

• Personal and professional growth opportunities, with personalised development plans tailored to your ambitions.

• Quarterly employee recognition awards including a financial prize.

• Regular officewide and team-based socials.

HQ

CMSPI Manchester, England Office

Manchester, United Kingdom

CMSPI Manchester, England Office

61 Oxford Street, Oxford Place, Manchester, United Kingdom, M1 6EQ

Similar Jobs

6 Days Ago
Hybrid
Senior level
Senior level
Digital Media • Gaming • Software • Esports • Automation
Lead the modernization of regulatory data systems by designing scalable BigQuery and Dataform pipelines on GCP. Build and support ETL/ELT workflows, reporting systems, data-quality controls, monitoring, and operational safeguards. Drive technical designs, delivery planning, architecture simplification, CI/CD, testing, and documentation while mentoring engineers and using AI-assisted development tools to improve engineering quality.
Top Skills: Ci/CdClaude CodeCloud ComposerCloud FunctionsCloud StorageDataformEltETLGoogle BigqueryGoogle Cloud PlatformPub/SubSQLSQL Server
6 Days Ago
Hybrid
Manchester, Greater Manchester, England, GBR
Senior level
Senior level
Digital Media • Gaming • Software • Esports • Automation
Lead the modernization of legacy SQL Server reporting systems into scalable Google Cloud architectures. Design and maintain BigQuery and Dataform pipelines, implement data-quality and reconciliation controls, improve observability and engineering standards, and support regulatory reporting. The role includes technical design leadership, delivery planning, mentoring engineers, reducing technical debt, and using AI-assisted development tools to improve quality and efficiency.
Top Skills: Ci/CdClaude CodeCloud ComposerCloud FunctionsCloud StorageDataformEltETLGoogle BigqueryGoogle Cloud PlatformPub/SubSQLSQL Server
12 Days Ago
In-Office
Entry level
Entry level
Digital Media • Gaming • Software • Esports • Automation
Develop and maintain regulatory data reporting systems across SQL Server and GCP BigQuery. Build ETL/ELT pipelines, migrate legacy solutions to cloud-native platforms, and implement data modeling, validation, monitoring, alerting, QA, and documentation. The role requires advanced SQL, BigQuery, GCP services, orchestration, Terraform, CI/CD, and version control experience, while supporting accurate, traceable, and performant regulatory submissions.
Top Skills: Ci/CdClaude CodeCloud ComposerCloud FunctionsCloud StorageEltETLGitGitlabGoogle BigqueryGoogle Cloud PlatformPub/SubSQLSQL ServerTerraform

What you need to know about the Manchester Tech Scene

Home to a £5 billion digital ecosystem, including MediaCity, which consists of major players like the BBC, ITV and Ericsson, Manchester is one of the U.K.'s top digital tech hubs, at the forefront of advancements in film, television and emerging sectors like as e-sports, while also fostering a community of professionals dedicated to pushing creative and technological boundaries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account