Job Ref: 212979466

Date: 2021-01-07 11:43:19

Apply Now

Security Cleared Data Engineer

My client is currently looking for a Data Engineer to work as part of a team of data scientists, analysts and visualisation professionals.

Tools/Technology Experience

SQL coding skills
Python coding skills
Knowledge of Azure data services (ADF, Azure Data Lake Storage, SQL DWH)
Familiarity with distributed systems (Hadoop, MapReduce, Hive, U-SQL, Spark, Data bricks etc)
Familiarity with unstructured data and No-SQL technologiesData Analysis and Acquisition Experience

Capturing data requirements from both customer and technical teams
Understanding and identifying data sources to support data requirements
Setting up interfaces to source systems and/or working with system owners to facilitate it
Setting up data acquisition pipelines to move data from source to target systemsData and Engineering Processing

Setting up data processing jobs to clean and transform data
Applying business logic and feature engineering techniques to generate data sets
Troubleshooting and performance tuning data pipelines
Supporting data science teams in their data acquisitionFor more details, please contact me on (phone number removed)

Apply Now