Job Ref: 214195109

Date: 2021-07-14 11:00:19

Apply Now

Lead Data Engineer

Telford or Milton Keynes

£65,000 – £750,000 depending on experience + 20% discretionary bonus scheme, PHI, Pension

Our market-leading client is looking to secure the services of a hands-on Lead Data Engineer. The Lead DataOps Engineer is a key member of the DataOps team responsible for leading a team of DataOps Engineers to deliver data-analytics pipelines to move data from business systems into the data-lake. You’ll be biased towards reuse and automation of the process to minimise manual steps, as well as writing tests to monitor data as it moves along the pipeline to ensure its quality.

Working within an agile/Kanban framework, a clear drive for delivery is required as well as strong organisation and problem-solving skills. You will provide technical leadership to the squad as well as within the development department on how best to create an agile DataOps architecture.

Key requirements for the Lead Data Engineer role:

* Lead a team of developers to implement a DataOps strategy to deliver automated data pipelines across business systems to the data-lake.

* Ensuring that data pipelines are reusable and as automated as possible.

* Subject matter expert within the development department on DataOps

* Support other development squads in how best to incorporate DataOps pipelines with their systems

Skills & experience of a Lead Data Engineer role:

* Significant experience in DataOps, ingesting data into data pipelines, and testing of data quality within the pipeline

* Experience of creating automated and reusable DataOps pipelines

* Experience with Apache Kafka within an Event Driven Architecture

* Experience with data operations/ETL

* Experience with AWS services

* Experience with CI/CD pipelines

* Strong desire to constantly deliver value to the business

* Ability to absorb new ideas and concepts quickly

* Ability to present ideas clearly and concisely

Our client is built on diversity. Their ambition is to build an inclusive culture where diversity is embraced, and everyone feels safe, respected, valued and able to thrive as part of a winning, engaged team.

As part of our recruitment process, you will be required to provide evidence of your right to work in the UK. Documentary evidence will be requested at the interview stage

Apply Now