As a Lead Data Engineer, you will shape the future of online car markets, leading complex data projects, organizing teams, and designing new data solutions while working closely with engineers and management in a collaborative environment.
About the project:
Our customer is the European online car market with over 30 million monthly users, with a market presence in 18 countries. The company is now merging with a similar company in Canada and needs support on this way. As a Lead Data Engineer, you will play a pivotal role in shaping the future of online car markets and enhancing the user experience for millions of car buyers and sellers.
Requirements:
- 8+ years of experience in software engineering
- English - Upper-Intermediate+
- Proven experience leading complex data projects, organizing teams, and architecting and designing new solutions
- Extensive expertise in AWS services, especially Glue, Athena
- Proficiency in Python, PySpark, GCP
- SQL, Airflow, data streaming frameworks (Kafka or Firehose)
- Experience in building and maintaining data pipelines
- Experience in building data platforms, not just using them
- Proficiency in data modeling techniques and best practices
Responsibilities:
- Simplify existing tools, make them more modular, work with technical debt
- Propose improvements, be actively involved in team discussions and decision-making, drive initiatives
- Work closely with a team of Senior Engineers, Product Manager and Engineering Manager
We offer:
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
Top Skills
Pyspark
Python
SQL
Similar Jobs
The Data Engineer will architect and lead the transition from on-premises batch architecture to a cloud-based streaming data platform, focusing on data warehousing, ETL pipelines, and data governance. The role involves collaboration with cross-functional teams and fostering a culture of technical excellence.
The Data Engineer will develop databases and data pipelines, create end-to-end data solutions, and maintain scalable data solutions while collaborating with various stakeholders to ensure data security and project success.
Be an Early Applicant
As a Middle Data Engineer, you will enhance online car markets by developing and maintaining data pipelines, working with AWS services and SQL, and collaborating with a senior engineering team to improve tools and drive initiatives.
What you need to know about the Manchester Tech Scene
Home to a £5 billion digital ecosystem, including MediaCity, which consists of major players like the BBC, ITV and Ericsson, Manchester is one of the U.K.'s top digital tech hubs, at the forefront of advancements in film, television and emerging sectors like as e-sports, while also fostering a community of professionals dedicated to pushing creative and technological boundaries.
