Designs and maintains Python and SQL-based automation for ETL and data pipeline validation. Tests source-to-target mappings, transformations, schemas, data quality, incremental loads, and business rules across GCP platforms including BigQuery, Dataflow, Pub/Sub, and Cloud Composer. Develops reusable, metadata-driven test components for high-volume structured and semi-structured data, integrates suites with CI/CD, investigates defects, and supports API validation using tools such as Pytest, Requests, Postman, or REST Assured.
Job Description: Quality Assurance Engineer III– ETL & Data Test Automation
Role Overview
Role Overview
We are looking for a hands-on Quality Engineering Engineer with strong expertise in ETL/Data Testing Automation and working knowledge of API Automation. The primary responsibility is to build scalable automated validation solutions for data pipelines, data transformations, and cloud-based data platforms.
Key Responsibilities- Design, develop, and maintain Python and SQL-based ETL/Data Testing Automation frameworks.
- Automate source-to-target validation across complex ETL/ELT data pipelines.
- Validate data across Bronze/Raw, Silver/Curated, and Gold/Consumption layers.
- ETL & Data Validation: Validate source-to-target data, transformations, schema, record counts, nulls, duplicates, and business rules using BigQuery and SQL.
- Automation: Develop Python/dbt-based automation for ETL validation, data-quality checks, regression testing, and automated test reporting.
- GCP: Validate end-to-end data pipelines across BigQuery, GCS, Dataflow, Pub/Sub, and Cloud Composer, including full and incremental data loads.
- Build reusable automation for:
- Source-to-target reconciliation
- Row-count and aggregate validation
- Schema and data-type validation
- Null, duplicate, and mandatory-field checks
- Data completeness and integrity checks
- Transformation and business-rule validation
- Incremental, delta, and historical load validation
- Data freshness and pipeline validation
- Develop solutions for validating high-volume datasets using Python, SQL, Pandas, and cloud data platforms.
- Perform complex SQL validation and troubleshoot data discrepancies across source and target systems.
- Validate structured and semi-structured data, including JSON and nested datasets.
- Develop reusable, configuration-driven or metadata-driven automation components to reduce manual testing.
- Integrate automated ETL/data-quality test suites with CI/CD pipelines such as Jenkins, GitHub Actions, or Azure DevOps.
- Perform defect investigation and root-cause analysis by collaborating with developers, data engineers, and business teams.
- Maintain automation code using Git/GitHub, including appropriate branching and pull-request practices.
- Support API validation as a secondary responsibility, including REST API request/response, status code, JSON payload, authentication, schema, and basic integration validation.
- Develop and maintain basic API automation using Python Requests/Pytest, Postman/Newman, or REST Assured when required.
- Contribute to test strategy, regression coverage, release readiness, and overall quality engineering practices.
Pearson Manchester, England Office
The Lighthouse, 14 The Quays, Manchester, United Kingdom, M50 3BF
Similar Jobs
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Leads integrated buy-side and sell-side network strategy for Pfizer’s external CMO and CentreOne supply networks. Develops strategic roadmaps, evaluates network footprint, capacity, capabilities, resilience, sourcing, and exits, and identifies cross-network synergies. Governs network strategy processes, operating models, data tools, and reporting while partnering with procurement, operations, quality, finance, supply chain, business development, and leadership. Uses analytics and AI tools to translate network intelligence into strategic decisions and supports growth initiatives in a global regulated pharmaceutical environment.
Top Skills:
Artificial IntelligenceExcelMicrosoft 365Microsoft CopilotNetwork Intelligence ToolsPower BIPowerPoint
Cloud • Fintech • Food • Information Technology • Software • Hospitality
Build and evolve scalable backend products and APIs using Java or Kotlin. Lead projects from discovery through rollout, make architectural decisions, improve system performance and reliability, collaborate cross-functionally, mentor engineers, and apply testing, code review, CI/CD, and distributed-systems best practices. Use AI-assisted development tools daily and help deliver AI-powered product capabilities.
Top Skills:
AIAWSCi/CdClaude CodeCursorDevinDockerJavaKotlinKubernetesMicroservicesNoSQLRestful ApisSQL
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Manage strategic projects from initiation through delivery, defining scope, timelines, deliverables, and success metrics. Track progress, risks, and reporting while facilitating governance meetings and senior leadership updates. Prepare executive presentations and synthesize business performance, project updates, KPIs, and transformation milestones into data-driven narratives. Partner with senior stakeholders across business, finance, operations, risk, technology, analytics, and BI teams, using dashboards and reports to support decision-making.
Top Skills:
Power BISap Businessobjects
What you need to know about the Manchester Tech Scene
Home to a £5 billion digital ecosystem, including MediaCity, which consists of major players like the BBC, ITV and Ericsson, Manchester is one of the U.K.'s top digital tech hubs, at the forefront of advancements in film, television and emerging sectors like as e-sports, while also fostering a community of professionals dedicated to pushing creative and technological boundaries.



