Prolific Logo

Prolific

Data Engineer

Reposted 3 Days Ago
Remote
Hiring Remotely in UK
Senior level
Remote
Hiring Remotely in UK
Senior level
Design, build, and maintain scalable data pipelines and platform services to support analytics, ML, and product teams. Implement infrastructure-as-code (Terraform) and Kubernetes-based deployments, develop data services/APIs, and ensure data quality, observability, security, and compliance. Partner with cross-functional teams, document systems, and continuously improve performance and reliability.
The summary above was generated by AI
Data Engineer      

 

Prolific

Prolific is not just another player in the AI space—we are the architects of the human data infrastructure that's reshaping the landscape of AI development. In a world where foundational AI technologies are increasingly commoditized, it's the quality and diversity of human-generated data that truly differentiates products and models.

 

The role

We're looking for a Data Engineer to help build scalable data solutions that serve teams across the business—from data scientists and analysts to AI engineers and product teams. You'll contribute to both the underlying platform and the way data is used in our products, working in a modern, cloud-native environment where privacy, security, and good data practices are part of how we build.

 

What you’ll bring to the role

  • Technical Expertise: 3+ years building and shipping production-grade data systems, with strong SQL skills and proficiency in Python or another object-oriented language (Java, Scala etc.)
  • Familiarity with cloud-native infrastructure—ideally some exposure to Terraform, Kubernetes, or similar IaC and container orchestration tools. We don't expect deep expertise in all of these, but comfort working in this kind of environment matters.
  • Experience designing data APIs or services that expose data to applications, or a strong interest in working across the analytical/operational boundary.
  • A thoughtful approach to data quality, privacy, and security—you understand that how data is used is as important as how it's moved.
  • Strong collaboration skills and comfort working across teams with different priorities—engineers, data scientists, AI engineers, and product.
  • A pragmatic, curious mindset—you enjoy keeping up with the field and know when to reach for a new tool versus when to stick with what works.
  • Pipeline Management: Hands-on experience with data pipeline tools (Airflow, dbt) and strong ability to optimize for performance and reliability.
  • Quality Focus: Commitment to continuously improving product quality, security, and performance through rigorous testing and code reviews.
  • Documentation: Meticulous approach to creating and maintaining architecture and systems documentation.
  • Problem-Solving: Exceptional analytical skills to troubleshoot complex data issues and implement effective solutions.
  • Independence: Capability to ship medium features independently while contributing to the team's overall objectives.

 

What you’ll be doing in the role 

  • Build and maintain data pipelines that power analytics, ML workloads, and product-facing applications—from internal databases, SaaS sources, and streaming systems through to the teams and services that consume them.
  • Evolve our data platform alongside cloud platform engineers, using infrastructure-as-code (Terraform) and Kubernetes-based deployments (Argo) to keep the platform scalable, reliable, and self-serve.
  • System Architecture: Design and implement scalable data infrastructure that accommodates our growing data volume and complexity.
  • Develop data services and APIs that expose trusted data to product applications, bridging analytical and operational systems.
  • Own data quality and observability, putting monitoring, testing, and alerting in place so issues are caught early and trust in the data stays high.
  • Partner with AI engineers, data scientists, analysts, and product teams to understand their data needs and design the right solutions—not just the quickest ones.
  • Uphold strong data privacy, security, and compliance practices in everything you build, particularly where data flows into product-facing contexts.
  • Technical Documentation: Create and maintain comprehensive documentation of data flows, models, and systems for knowledge sharing.
  • Security and Compliance: Ensure all data systems adhere to security best practices and compliance requirements.

 

Why Prolific is a great place to work

We've built a unique platform that connects researchers and companies with a global pool of participants, enabling the collection of high-quality, ethically sourced human behavioral data and feedback. This data is the cornerstone of developing more accurate, nuanced, and aligned AI systems.

We believe that the next leap in AI capabilities won't come solely from scaling existing models but from integrating diverse human perspectives and behaviors into AI development. By providing this crucial human data infrastructure, Prolific is positioning itself at the forefront of the next wave of AI innovation—one that reflects the breath and the best of humanity.

Working for us will place you at the forefront of AI innovation, providing access to our unique human data platform and opportunities for groundbreaking research. Join us to enjoy a competitive salary, benefits, and remote working within our impactful, mission-driven culture.

 

Links to more information on Prolific

Benefits 

External Handbook 

Website 

YouTube 

 

Privacy Statement

By submitting your application, you agree that Prolific may collect your personal data for recruiting and global organization planning. Prolific's Candidate Privacy Notice explains what personal information Prolific may process, where Prolific may process your personal information, its purposes for processing your personal information, and the rights you can exercise over Prolific use of your personal information.

Similar Jobs

7 Days Ago
Remote or Hybrid
United Kingdom
Senior level
Senior level
Enterprise Web • HR Tech • Information Technology • Software • Cybersecurity
Develop and maintain customer-facing analytical reporting, data pipelines, and data models. Build Python applications, ensure data quality and consistency, collaborate with analytics engineers, and enable business teams to access actionable data. The role also involves cloud data warehouse optimization, infrastructure as code, software engineering best practices, and cross-functional product collaboration within an agile SaaS environment.
Top Skills: AWSAzureBigQueryCloudFormationContinuous IntegrationDbtFlaskGCPGitLookerPlotlyPower BIPythonRedshiftSnowflakeSQLSqlalchemyTerraform
Yesterday
Remote or Hybrid
United Kingdom
Mid level
Mid level
Big Data • Cloud • Logistics • Machine Learning • Retail
Designs and optimizes scalable data pipelines and architectures supporting analytics and operational needs. The role develops ETL, streaming, data quality, governance, and cloud-based workflows using modern big data technologies. Responsibilities include translating business requirements into technical solutions, monitoring data systems, improving reliability and performance, and providing technical guidance on data modeling, storage, and metadata management.
Top Skills: Apache HiveApache KafkaSparkCi/CdData ModelingData WarehousingETLGCPMetadata ManagementPython
6 Days Ago
Remote
GBR
Junior
Junior
Information Technology • Analytics • Business Intelligence • Big Data Analytics
Build and maintain reliable data pipelines using Python and SQL. Integrate REST APIs, databases, files, cloud storage, and third-party platforms; process and load data into warehouses for analytics and BI. Implement incremental and fault-tolerant loading, logging, monitoring, retries, error handling, and data quality checks. Work with ETL/ELT, Git, and potentially dbt, Spark, orchestration tools, cloud platforms, Docker, dimensional modeling, and BI datasets.
Top Skills: AirflowAWSAws S3AzureAzure Blob StorageBigQueryCi/CdDagsterDbtDockerDomoGCPGitGoogle Cloud StorageLookerMs SqlPostgresPower BIPrefectPysparkPythonQuicksightRedshiftRest ApisSnowflakeSparkSQLTableau

What you need to know about the Manchester Tech Scene

Home to a £5 billion digital ecosystem, including MediaCity, which consists of major players like the BBC, ITV and Ericsson, Manchester is one of the U.K.'s top digital tech hubs, at the forefront of advancements in film, television and emerging sectors like as e-sports, while also fostering a community of professionals dedicated to pushing creative and technological boundaries.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account