Elsevier Logo

Elsevier

Senior Data Engineer I-Search and AI Platform

Reposted Yesterday
Be an Early Applicant
In-Office
London, Greater London, England
Senior level
In-Office
London, Greater London, England
Senior level
Design, build, and maintain scalable data pipelines and services for large-scale search and analytics. Develop batch and ELT/ETL workflows, use Spark, Airflow, Python/Java, and AWS, apply engineering best practices, and collaborate with product and data science teams.
The summary above was generated by AI

Senior Data Engineer – Search and AI Platform

About the role:

The Search and AI Platform supports core products such as Scopus, ScienceDirect, and AI‑driven research solutions. As a Senior Data Engineer, you will help design, build, and run reliable data pipelines and services that support large‑scale search and analytics use cases. You will work hands‑on while also supporting and guiding other engineers.

About the team: 

The Search and AI Platform is Elsevier’s agentic data platform, which powers products such as Scopus, ScienceDirect, and our next-generation LLM-powered research systems. The platform utilises agentic services to interrogate our rich knowledge graphs, search and recommendation systems, and our unparalleled collection of research data, delivering insights to the scientific community that enable them to collaborate more effectively, work smarter, and produce high-quality research more efficiently.

Responsibilities:

  • Design, build, and maintain scalable data pipelines and services
  • Develop batch and ELT/ETL data workflows for ingesting and processing large datasets
  • Work with technologies such as Python, Java, Spark, SQL, and Airflow
  • Apply good software engineering practices, including testing, documentation, and CI/CD
  • Contribute to cloud‑based systems (AWS), focusing on reliability, monitoring, and automation
  • Collaborate with product, platform, and data science partners to deliver meaningful outcomes
  • Support team learning through code reviews and knowledge sharing

Requirements:

  • Experience working as a data or software engineer on production systems
  • Strong skills in Python and experience with at least one backend language (such as Java)
  • Understanding of data engineering concepts such as data lakes, batch processing, and distributed systems
  • Experience building or operating data pipelines using tools like Spark and Airflow
  • Familiarity with cloud platforms (AWS preferred) and production monitoring
  • Clear communication skills and a collaborative approach to problem‑solving

Why join us? 

Join our team and contribute to a culture of innovation, collaboration, and excellence. If you are ready to advance your career and make a significant impact, we encourage you to apply. 

Work in a way that works for you 
 

We promote a healthy work/life balance across the organization. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals. 

  • Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive. 

Working for you 

We know that your well-being and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer: 

  • Comprehensive Pension Plan 
  • Home, office, or commuting allowance. 
  • Generous vacation entitlement and option for sabbatical leave 
  • Maternity, Paternity, Adoption and Family Care leave 
  • Flexible working hours 
  • Personal Choice budget 
  • Internal communities and networks 
  • Various employee discounts 
  • Recruitment introduction reward 
  • Employee Assistance Program (global) 

 
About the business

A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education, and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world’s grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.

We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location.

We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120.

Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here.

Please read our Candidate Privacy Policy.

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.

USA Job Seekers:

EEO Know Your Rights.

Top Skills

Apache Airflow
Spark
AWS
Ci/Cd
Elt
ETL
Java
Python
SQL

Similar Jobs

37 Minutes Ago
Hybrid
London, England, GBR
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Senior .NET Developer will design and build enterprise-grade .NET solutions for financial services, focusing on cloud-based applications and scalable systems.
Top Skills: .NetAWSC#ElasticacheGraphQLNoSQLRedisRestSQL Server
38 Minutes Ago
Hybrid
London, England, GBR
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
As a Principal .NET Developer, you will architect and deliver enterprise-scale platforms for capital markets, leveraging cloud technologies and mentoring engineering teams.
Top Skills: .NetAuroraAWSC#CloudfrontDocumentdbEc2EksElasticacheGraphQLRedisRestRoute 53S3SQL Server
40 Minutes Ago
Hybrid
London, Greater London, England, GBR
Senior level
Senior level
Fintech • Information Technology • Financial Services
The Senior Associate, Client Services will provide specialized support for RFQ-Hub, assist clients in trading issues, enhance product knowledge, and improve client training and configuration support.
Top Skills: Fix MessagesSalesforce

What you need to know about the Manchester Tech Scene

Home to a £5 billion digital ecosystem, including MediaCity, which consists of major players like the BBC, ITV and Ericsson, Manchester is one of the U.K.'s top digital tech hubs, at the forefront of advancements in film, television and emerging sectors like as e-sports, while also fostering a community of professionals dedicated to pushing creative and technological boundaries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account