Elsevier Logo

Elsevier

Senior Data Engineer I-Search and AI Platform

Reposted 23 Days Ago
Be an Early Applicant
In-Office
London, Greater London, England
Senior level
In-Office
London, Greater London, England
Senior level
Design, build, and maintain scalable data pipelines and services for large-scale search and analytics. Develop batch and ELT/ETL workflows, use Spark, Airflow, Python/Java, and AWS, apply engineering best practices, and collaborate with product and data science teams.
The summary above was generated by AI

Senior Data Engineer – Search and AI Platform

About the role:

The Search and AI Platform supports core products such as Scopus, ScienceDirect, and AI‑driven research solutions. As a Senior Data Engineer, you will help design, build, and run reliable data pipelines and services that support large‑scale search and analytics use cases. You will work hands‑on while also supporting and guiding other engineers.

About the team: 

The Search and AI Platform is Elsevier’s agentic data platform, which powers products such as Scopus, ScienceDirect, and our next-generation LLM-powered research systems. The platform utilises agentic services to interrogate our rich knowledge graphs, search and recommendation systems, and our unparalleled collection of research data, delivering insights to the scientific community that enable them to collaborate more effectively, work smarter, and produce high-quality research more efficiently.

Responsibilities:

  • Design, build, and maintain scalable data pipelines and services
  • Develop batch and ELT/ETL data workflows for ingesting and processing large datasets
  • Work with technologies such as Python, Java, Spark, SQL, and Airflow
  • Apply good software engineering practices, including testing, documentation, and CI/CD
  • Contribute to cloud‑based systems (AWS), focusing on reliability, monitoring, and automation
  • Collaborate with product, platform, and data science partners to deliver meaningful outcomes
  • Support team learning through code reviews and knowledge sharing

Requirements:

  • Experience working as a data or software engineer on production systems
  • Strong skills in Python and experience with at least one backend language (such as Java)
  • Understanding of data engineering concepts such as data lakes, batch processing, and distributed systems
  • Experience building or operating data pipelines using tools like Spark and Airflow
  • Familiarity with cloud platforms (AWS preferred) and production monitoring
  • Clear communication skills and a collaborative approach to problem‑solving

Why join us? 

Join our team and contribute to a culture of innovation, collaboration, and excellence. If you are ready to advance your career and make a significant impact, we encourage you to apply. 

Work in a way that works for you 
 

We promote a healthy work/life balance across the organization. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals. 

  • Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive. 

Working for you 

We know that your well-being and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer: 

  • Comprehensive Pension Plan 
  • Home, office, or commuting allowance. 
  • Generous vacation entitlement and option for sabbatical leave 
  • Maternity, Paternity, Adoption and Family Care leave 
  • Flexible working hours 
  • Personal Choice budget 
  • Internal communities and networks 
  • Various employee discounts 
  • Recruitment introduction reward 
  • Employee Assistance Program (global) 

 
About the business

A global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education, and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world’s grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.

We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location.

We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120.

Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here.

Please read our Candidate Privacy Policy.

We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.

USA Job Seekers:

EEO Know Your Rights.

Similar Jobs

19 Days Ago
Hybrid
Senior level
Senior level
Artificial Intelligence • HR Tech • Productivity • Software
As Lead Data Engineer, you'll architect data systems for an AI product, building scalable pipelines and ML infrastructure while establishing engineering standards and mentoring future team members.
Top Skills: AirflowKafkaMilvusNoSQLPostgresPythonQdrantSpark
An Hour Ago
Easy Apply
Hybrid
Easy Apply
Mid level
Mid level
Fintech • Information Technology • Payments • Productivity • Software • Travel • Automation
As an Account Manager, you will drive adoption and revenue from mid-market accounts, ensuring clients maximize value, building strong relationships, and collaborating cross-functionally to address customer needs and drive program success.
Top Skills: Data AnalysisNavan Platform
Internship
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As a Cybersecurity Intern at CrowdStrike, you will learn about the Falcon platform, assist in incident response, triage security alerts, and perform basic malware analysis while gaining exposure to meaningful projects in a collaborative environment.
Top Skills: Incident HandlingInformation SecurityNetwork Communications

What you need to know about the Manchester Tech Scene

Home to a £5 billion digital ecosystem, including MediaCity, which consists of major players like the BBC, ITV and Ericsson, Manchester is one of the U.K.'s top digital tech hubs, at the forefront of advancements in film, television and emerging sectors like as e-sports, while also fostering a community of professionals dedicated to pushing creative and technological boundaries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account