Senior Lead Data Engineer
Remote/Reading/Exeter
Hiring Manager: Tamara Carpintero-Perez
Closing Date 7th January 2025
The Opportunity
Are you ready to make a significant impact on the future of data and engineering? We have an exciting Senior Lead position in our Data Engineering team, perfect for experienced, hands-on professionals in leading and innovating. As a 100% data-driven company, we pride ourselves on employing the best engineering practices across our products and solutions.
As direct report to the Head of Data Engineering, you will play a crucial role in driving the team’s vision and objectives to completion. You will be expected to provide technical leadership, own the solution, ensure the reliability of data products, and collaborate closely with your team and other teams to optimise data solutions.
This is an exciting opportunity for highly skilled and motivated Senior Lead Data Engineers with strong expertise in data architecture, ETL pipelines, cloud technologies and big data solutions who are looking to keep crafting their technical leadership responsibilities and shape the future of data engineering within our organisation.
In this role, you will:
- Technical Leadership: Assist the Head of Data Engineering in overseeing the design, development, and optimisation of data software, data infrastructure and pipelines.
- Team Technical Leadership: Guide a team of talented data engineers to deliver cutting-edge solutions, mentor and coach them, ensuring that best practices in data engineering and software development are followed. Lead by example. Be hands-on.
- Lead by Example: We value leaders with exceptional technical expertise and hands-on coding skills. As a Senior Lead, you’ll set the standard by being directly involved and actively contributing to technical challenges. Be ready to roll up your sleeves when necessary and engage in real, impactful work alongside the team.
- Data Strategy & Solutions: Own the technical roadmap, aligning engineering efforts with broader business goals and ensuring timely delivery, quality control, and that architectural decisions are forward-thinking and scalable. Inspire the team by providing a clear vision for technical excellence and innovation in the data engineering strategy.
- Cloud: Optimise cloud-based data solutions, storage and processing systems, with hands-on experience in AWS or Azure.
- Technical Excellence: Lead the pursuit of technical excellence by championing best practices in coding, architecture, and performance. Foster a team culture focused on continuous improvement, where learning is encouraged.
- Leverage Big Data Technologies: Utilise tools such as Hadoop, Spark, and Kafka to design and manage large-scale on-prem data processing systems.
- Collaboration: Collaborate with cross-functional teams and stakeholders to deliver high-impact solutions that align with business objectives.
- Assemble Large, Complex Data Sets: Craft and manage data sets that meet both functional and non-functional business requirements.
- Monitoring & Troubleshooting: Ensure data quality, integrity, and availability by developing systems and solutions to monitor performance, quality and troubleshoot issues as they arise.
- Build Advanced Data Solutions: Develop the software and infrastructure for optimal data extraction, transformation, and loading using leading cloud technologies like Azure and AWS or Big Data ones.
- Ensure Cost Efficiency: Keep the Data Lakes and Data solutions within agreed cost models and budgets.
- Data Engineering Empowerment: Empower a high-performing engineering team to deliver innovative software while fostering a collaborative environment where ideas are valued. Act as a mentor, helping team members overcome technical challenges and grow in their roles.
About You
The Senior Lead Data Engineer will be a passionate leader with hands-on seniority in engineer with the ability to inspire, mentor, and bring a team along on the journey. The ideal candidate will possess:
- Depth of Expertise: seasoned hands-on experience in data engineering, with extensive experience in a leadership or mentoring role. Demonstrated track record of leading complex data engineering initiatives at scale. Extensive experience in designing, implementing, and optimizing data solutions, supported by a history of successfully managing technical teams and projects.
- Exceptional coding skills.
- Degree in Computer Science, Software Engineering, or similar (applied to Data. Data Specialisation).
- Extensive experience in data engineering, in both Cloud & On-prem Big Data and Data Lake environments
- Expert knowledge in data technologies, data transformation tools, data governance techniques.
- Strong analytical and problem-solving abilities.
- Good understanding of Quality and Information Security principles.
- Effective communication, ability to explain technical concepts to a range of audiences
- Able to provide coaching and training to less experienced members of the team
- Essential skills:
- Programming Languages such as Spark, Java, Python, PySpark, Scala, etc (minimum 2)
- Extensive Big Data hands-on experience (coding/configuration/automation/monitoring/security/etc) is a must
- Significant AWS or Azure hands-on experience (coding/configuration/automation/monitoring/security)
- ETL Tools such as Azure Data Fabric (ADF) and Databricks or similar ones
- Data Lakes: Azure Data, Delta Lake, Data Lake or Databricks Lakehouse
- Certifications AWS, Azure, or Cloudera certifications are a plus.
- Nice to have skills:
- Geospatial data experience
- Advanced Database and SQL skills
- SQL or Data warehousing design patterns and implementation
Join us and lead the charge in transforming the data landscape at Landmark, while advancing your career in a dynamic and forward-thinking environment.
