Experian Logo

Experian

Senior Data Platform Engineer AWS, Spark

Posted 7 Days Ago
Be an Early Applicant
Hybrid
Nottingham, Nottinghamshire, England
Senior level
Hybrid
Nottingham, Nottinghamshire, England
Senior level
Design, build, and maintain AWS-based data pipelines and platform capabilities for fraud-related data. Develop ingestion, transformation, integrations, automation, and infrastructure using Spark, Terraform, CI/CD, and cloud-native tooling. Collaborate with platform, security, compliance, and data stakeholders to deliver secure, governed, scalable solutions. Provide technical leadership, documentation, design input, operational support, and mentorship to junior engineers.
The summary above was generated by AI
Company Description

Experian is a global data and technology company, powering opportunities for people and businesses around the world. We operate across a range of markets, from financial services to healthcare, automotive, agribusiness, insurance, and many more. Experian invests in people and new advanced technologies to unlock the power of data. We have an amazing team of 25,200 people in 32 countries.

Internal Grade D/EB8

Job Description

Experian Credit Services & Verifications are looking for a Senior Data Platform Engineer to provide hands-on technical leadership for a new fraud data capability that will connect fraud-related data assets into Experian's Data Analytics Platform.

You will work closely with the central Data Analytics Platform team, data owners, security, compliance, platform and delivery stakeholders to agree practical implementation approaches, align with established platform patterns, and ensure the team delivers secure, scalable and supportable solutions.

This is a hands-on engineering role suited to someone who can combine strong data engineering depth with cloud platform experience, engineering discipline and team leadership. You will apply effective DevSecOps practices and contribute to technical roadmap discussions where you will make effective use of CI/CD, Infrastructure as Code and cloud-native tooling, and help drive automation and continuous improvement across the engineering lifecycle.

This is a Hybrid, Nottingham based role (40% in the office) reporting to the Director of Engineering.

Key responsibilities

  • Design, build, test and maintain AWS-based data pipelines for fraud-related data assets.
  • Support ingestion and transformation of data from source platforms such as Snowflake and internal product/data systems.
  • Develop new data flows, integrations and automation as additional data assets are onboarded.
  • Work with platform, security and data stakeholders to ensure solutions follow agreed security, governance and compliance patterns.
  • Contribute to technical design discussions, review proposals, evaluate options, provide estimates and recommend practical solutions.
  • Use Infrastructure as Code and Configuration as Code tooling, such as Terraform, Git and CI/CD pipelines, to deliver repeatable solutions.
  • Produce clear documentation covering pipelines, data flows, operational procedures and support processes.
  • Support junior engineers where appropriate and contribute to a collaborative, quality-focused engineering culture.
  • Use modern engineering practices, including automation and AI-assisted development where appropriate, to improve delivery speed, quality and repeatability.

Qualifications

  • Strong experience building data pipelines, data lake solutions or data platform capabilities.
  • Strong experience with AWS cloud services relevant to data engineering and platform delivery, including services such as AWS Glue, S3, Step Functions, IAM, Lake Formation, EC2, Lambda, EventBridge and SQS.
  • Strong experience with DevOps and Infrastructure as Code tooling, including Terraform, CI/CD pipelines, Git and Jenkins.
  • Strong experience developing on Apache Spark or Hadoop.
  • Significant programming experience using Scala or Python.
  • Strong understanding of cloud security, data privacy, access control and governance principles in data platform environments

Desired skills

  • AWS Developer Certification or other relevant AWS certification.
  • Strong expertise in Terraform or CloudFormation.
  • Experience with OpenShift or Kubernetes.
  • Experience with automated testing tools such as pytest or Scalatest.
  • Knowledge of RESTful APIs and microservice architectures.
  • Experience working with sensitive, governed or regulated data environments.
  • Familiarity with data catalogue, metadata management, data marketplace or federated data mesh concepts.

Additional Information

  • Great compensation package and discretionary bonus plan
  • Core benefits include pension, bupa healthcare, sharesave scheme and more
  • 25 days annual leave with 8 bank holidays and 3 volunteering days. You can purchase additional annual leave.

Recruitment Fraud Awareness - Experian's recruitment process is conducted only through authorised channels. Recruitment communications will only be sent from an @experian.com email address. Experian will never ask candidates to make any payment as part of an application, interview, assessment, onboarding, or recruitment process. To apply for roles or verify opportunities, please visit experian.com/careers.

Our uniqueness is that we celebrate yours. Experian's people first, inclusive and purpose driven culture is multi award-winning; World's Best Workplaces™ 2025 (Fortune Global Top 25), Great Place To Work™ in 26 countries to name a few. Check out Experian Life on social or explore our Careers Site to understand why. Experian is also proud to be an Equal Opportunity and Affirmative Action employer. If you have a disability or special need that requires accommodation, please let us know at the earliest opportunity.

Experian Careers - Creating a better tomorrow together

Find out what its like to work for Experian by clicking here

Similar Jobs

Entry level
Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
Leads global sales enablement for Rubrik’s specialist sales organization. Translates product roadmaps and technical concepts into training, demos, labs, battlecards, learning paths, and validation programs for account executives and sales engineers. Delivers onboarding and continuous education, teaches value-based selling and MEDDPICC, measures readiness and retention, manages multiple enablement workstreams, and partners with Product, Engineering, Marketing, and Sales leadership.
Top Skills: Active DirectoryAi ToolsCloud InfrastructureLearning PlatformsMicrosoft Entra IdSaaS
Yesterday
In-Office
Senior level
Senior level
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Owns and evolves Ericsson’s AI-based managed services portfolio, creating scalable value-pack offerings that monetize autonomous network operations and related capabilities. Develops value propositions and commercial models, ensures offerings are standardized and sellable across markets, and coordinates technical, security, delivery, sales, and marketing stakeholders. The role translates network and AI technologies into commercially viable services while supporting sales enablement, industry events, and customer-facing engagements.
Top Skills: AnalyticsArtificial IntelligenceAutomationAutonomous Network OperationsCloud ComputingNetwork Managed ServicesTelecom Networks
Senior level
Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
Lead customer-facing lifecycle assessment projects for global clients, delivering ISO-compliant LCAs, EPDs, PCFs, and regulatory documentation. Analyze complex environmental datasets, perform decarbonization, sensitivity, and uncertainty assessments, manage third-party reviews, and communicate results to stakeholders. Support PCR development, sustainability strategy, software capabilities, industry working groups, and evolving frameworks including EU Battery Regulation, CBAM, EPR, PACT, and Catena-X.
Top Skills: Catena-XCbamDppEcoinventEn 15804EpdEprEu Battery RegulationExcelGabiGreetIso 14025Iso 14040Iso 14044Iso 14067Iso 15804Iso 21930LcaOpenlcaPactPcfPythonSimaproTraci

What you need to know about the Manchester Tech Scene

Home to a £5 billion digital ecosystem, including MediaCity, which consists of major players like the BBC, ITV and Ericsson, Manchester is one of the U.K.'s top digital tech hubs, at the forefront of advancements in film, television and emerging sectors like as e-sports, while also fostering a community of professionals dedicated to pushing creative and technological boundaries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account