Job Ref: 214287799

Date: 2021-07-26 17:20:29

Apply Now

Our market leading client is looking to secure the services of a Lead DataOps Engineer to join their team on a permanent basis.

As the Lead DataOps Engineer, you will responsible for leading a team of DataOps Engineers to deliver data-analytics pipelines to move data from business systems into the Client’s data-lake. You’ll be biased towards reuse and automation of the process to minimise manual steps, as well as writing tests to monitor data as it moves along the pipeline to ensure its quality.

Working within an agile/Kanban framework, a clear drive for delivery is required as well as strong organisation and problem-solving skills. You will provide technical leadership to the team as well as within the development department on how best to create an agile DataOps architecture.

Duties of a Lead DataOps Engineer:

* Lead a team of developers to implement a DataOps strategy to deliver automated data pipelines across business systems to the Client’s data-lake

* Ensuring that data pipelines are reusable and as automated as possible

* Subject matter expert within the development department on DataOps

* Support other development teams in how best to incorporate DataOps pipelines with their systems

Required knowledge, skills & experience of a Lead DataOps Engineer:

* Significant industry experience in DataOps, ingesting data into data pipelines, and testing of data quality within the pipeline

* Experience of creating automated and reusable DataOps pipelines

* Experience with Apache Kafka within an Event

* Driven Architecture

* Experience with data operations/ETL

* Experience with AWS services

* Experience with CI/CD pipelines

* Strong desire to constantly deliver value to the business

* Ability to absorb new ideas and concepts quickly

* Ability to present ideas clearly and concisely

Our client is built on diversity. Their ambition is to build an inclusive culture where diversity is embraced, and everyone feels safe, respected, valued and able to thrive as part of a winning, engaged team

Apply Now