As a Senior Data Engineer, you will design and implement a cloud-based Consumer Data Lake, transforming consumer data into actionable insights through hands-on technical execution and collaboration. You will build and optimize data pipelines, ensure data quality, and work with global teams to meet business needs while adhering to privacy regulations.
Join an exciting journey to create a greenfield, cutting-edge Consumer Data Lake for a leading global organization based in Europe. This platform will unify, process, and leverage consumer data from various systems, unlocking advanced analytics, insights, and personalization opportunities. As a Senior Data Engineer, you will play a pivotal role in shaping and implementing the platform's architecture, focusing on hands-on technical execution and collaboration with cross-functional teams.
Your work will transform consumer data into actionable insights and personalization on a global scale. Using advanced tools to tackle complex challenges, you’ll innovate within a collaborative environment alongside skilled architects, engineers, and leaders.
Key Responsibilities:
- Hands-On Development: Build, maintain, and optimize data pipelines for ingestion, transformation, and activation.
- Create and implement scalable solutions to handle diverse data sources and high volumes of information
- Data Modeling & Warehousing: Design and maintain efficient data models and schemas for a cloud-based data platform.
- Develop pipelines to ensure data accuracy, integrity, and accessibility for downstream analytics.
- Collaboration: Partner with Solution Architects to translate high-level designs into detailed implementation plans.
- Work closely with Technical Product Owners to align data solutions with business needs.
- Collaborate with global teams to integrate data from diverse platforms, ensuring scalability, security, and accuracy.
- Platform Development: Enable data readiness for advanced analytics, reporting, and segmentation.
- Implement robust frameworks to monitor data quality, accuracy, and performance.
- Testing & Quality Assurance: Implement robust security measures to protect sensitive consumer data at every stage of the pipeline
- Ensure compliance with data privacy regulations (e.g., GDPR, CCPA ..) and internal policies.
- Monitor and address potential vulnerabilities, ensuring the platform adheres to security best practices.
Requirements:
- Over 4+ years of experience showcasing technical expertise and critical thinking in data engineering.
- Hands-on experience with DBT and strong Python programming skills.
- Proficiency in Snowflake and expertise in data modeling are essential.
- Demonstrated experience in building consumer data lakes and developing consumer analytics capabilities is required.
- In-depth understanding of privacy and security engineering within Snowflake, including concepts like RBAC, dynamic/tag-based data masking, row-level security/access policies, and secure views.
- Ability to design, implement, and promote advanced solution patterns and standards for solving complex challenges.
- Familiarity with multiple cloud platforms (Azure or GCP preferred, with a focus on Azure).
- Practical experience with Big Data batch and streaming tools.
- Competence in SQL, NoSQL, relational database design (SAP HANA experience is a bonus), and efficient methods for data retrieval and preparation at scale.
- Proven ability to collect and process raw data at scale, including scripting, web scraping, API integration, and SQL querying.
- Experience working in global environments and collaborating with virtual teams.
- A Bachelor’s or Master’s degree in Data Science, Computer Science, Economics, or a related discipline.
We offer:
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
Top Skills
Python
Similar Jobs
Be an Early Applicant
As a Data Platform Engineer, you will support the ML Platform Team in developing a high-scale compute and data platform, provision and expose data for researchers, implement workflow orchestrators, and ensure ML engineering best practices are followed.
The Data Engineer will develop databases and data pipelines, create end-to-end data solutions, and maintain scalable data solutions while collaborating with various stakeholders to ensure data security and project success.
As a Strong Middle Data Engineer, you will design and maintain data platforms and pipelines for an online car market. Collaborate with senior engineers to simplify tools and enhance user experience while actively participating in decision-making and improvements.
What you need to know about the Manchester Tech Scene
Home to a £5 billion digital ecosystem, including MediaCity, which consists of major players like the BBC, ITV and Ericsson, Manchester is one of the U.K.'s top digital tech hubs, at the forefront of advancements in film, television and emerging sectors like as e-sports, while also fostering a community of professionals dedicated to pushing creative and technological boundaries.
