Kainos Logo

Kainos

Senior Data Engineer

Job Posted 21 Days Ago Posted 21 Days Ago
Be an Early Applicant
3 Locations
Senior level
3 Locations
Senior level
As a Senior Data Engineer, you will design and develop large-scale data processing software, collaborate within agile teams, and ensure high code quality in production environments.
The summary above was generated by AI

When you join Kainos, you get to think beyond limitations to make an immediate and positive impact – like transforming digital services for millions of citizens or helping Fortune 500 companies get live and thrive on Workday.You’ll be part of a people-first culture that is growing around the world. We’re a creative, committed, and diverse group of individuals who succeed as a team.At Kainos your ideas are heard and valued and you’ll leave a legacy that you can feel proud of.  Join us and discover how our people write our story.

MAIN PURPOSE OF THE ROLE & RESPONSIBILITIES IN THE BUSINESS:

As a Senior Data Engineer (Senior Associate) at Kainos, you will be responsible or designing and developing data processing and data persistence software components for solutions which handle data at scale. Working in agile teams, Senior Data Engineers provide strong development leadership and take responsibility for significant technical components of data systems . You will work within a multi-skilled agile team to design and develop large-scale data processing software to meet user needs in demanding production environments.

Your responsibilities will include:

  • Working to develop data processing software primarily for deployment in Big Data technologies. The role encompasses the full software lifecycle including design, code, test and defect resolution.

  • Working with Architects and Lead Engineers to ensure the software supports non-functional needs.

  • Collaborating with colleagues to resolve implementation challenges and ensure code quality and maintainability remains high. Leads by example in code quality.

  • Working with operations teams to ensure operational readiness

  • Advising customers and managers on the estimated effort and technical implications of user stories and user journeys.

  • Coaching and mentoring team members.

MINIMUM (ESSENTIAL) REQUIREMENTS:

  • Strong software development experience in one of Java, Scala, or Python

  • Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, Databricks.

  • Experience of developing substantial components for large-scale data processing solutions and deploying into a production environment 

  • Proficient in SQL and SQL extensions for analytical queries

  • Solid understanding of ETL/ELT data processing pipelines and design patterns

  • Aware of key features and pitfalls of distributed data processing frameworks, data stores and data serialisation formats

  • Able to write quality, testable code and has experience of automated testing

  • Experience with Continuous Integration and Continuous Deployment techniques

  • A Keen interest in AI Technologies

DESIRABLE REQUIREMENTS:

  • Experience of performance tuning

  • Experience of data visualisation and complex data transformations

  • Experience with steaming and event-processing architectures including technologies such as Kafka and change-data-capture (CDC) products

  • Expertise in continuous improvement and sharing input on data best practice

  • Practical experience with AI technologies, tools, processes and delivery

 

So what are you waiting for? Let’s write the next incredible chapter of our story together. 

Embracing our differences  

At Kainos, we believe in the power of diversity, equity and inclusion. We are committed to building a team that is as diverse as the world we live in, where everyone is valued, respected, and given an equal chance to thrive.   We actively seek out talented people from all backgrounds, regardless of age, race, ethnicity, gender, sexual orientation, religion, disability, or any other characteristic that makes them who they are.   We also believe every candidate deserves a level playing field. Our friendly talent acquisition team is here to support you every step of the way, so if you require any accommodations or adjustments, we encourage you to reach out. We understand that everyone's journey is different, and by having a private conversation we can ensure that our recruitment process is tailored to your needs.

 

Top Skills

AWS
Azure
Databricks
GCP
Java
Kafka
Python
Scala
SQL

Similar Jobs

23 Hours Ago
Remote
Hybrid
United Kingdom
Senior level
Senior level
Enterprise Web • HR Tech • Information Technology • Software • Cybersecurity
The Senior Data Engineer will collaborate with teams to develop and maintain customer-facing analytical reporting and data pipelines, applying domain knowledge and software engineering practices.
Top Skills: AWSAzureBigQueryCloudFormationDbtFlaskGCPLookerPlotlyPower BIPythonRedshiftSnowflakeSQLSqlalchemyTerraform
5 Days Ago
Hybrid
Manchester, Greater Manchester, England, GBR
Senior level
Senior level
Artificial Intelligence • Big Data • Information Technology • Software
The Senior Data Engineer will design and develop analytics dashboards, optimize ETL pipelines, implement streaming processes, and maintain big data services while collaborating with various teams.
Top Skills: Amazon RedshiftApache AirflowArgo CdAWSCi/CdClickhouseDockerDynamo DbGithub ActionsJavaJavaScriptJenkinsKafkaKubernetesMongo DbNqlPostgresPower BIPythonRedisS3Typescript
2 Days Ago
London, Greater London, England, GBR
Senior level
Senior level
Fintech • Mobile • Payments • Software • Financial Services
As a Senior Backend Software Engineer in the Data Governance team at Wise, you will develop backend services and tools for data management, focusing on automation and user-centric design while collaborating with various stakeholders to shape data governance practices.
Top Skills: DockerFlinkIcebergJavaKafkaRest ApisS3Snowflake

What you need to know about the Manchester Tech Scene

Home to a £5 billion digital ecosystem, including MediaCity, which consists of major players like the BBC, ITV and Ericsson, Manchester is one of the U.K.'s top digital tech hubs, at the forefront of advancements in film, television and emerging sectors like as e-sports, while also fostering a community of professionals dedicated to pushing creative and technological boundaries.
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account