Data Engineering Lead

  • McGregor Boyall
  • North West Midlands Mail Centre, Sun Street, Wolverhampton, UK
  • 12/07/2022
Full time Data Science Data Engineering Data Analytics Big Data Data Management Statistics

Job Description

Lead Data Engineer

£65,000 - £80,000

Hybrid (Manchester or London)

Permanent – Full Time

Job Summary:

As part of expanding our analytics platform we have an exciting Data Engineering Lead opportunity, critical to helping us make more data quickly available and into meaningful management information and insight.

As Data Engineering Lead you will responsible for the end-to-end creation and maintenance of our cloud analytics infrastructure and MI outputs servicing all internal customers including the data science and e-commerce teams to warehouse operations and financial performance.

This would suit someone looking for a role that is fluid and flexible and will provide some autonomy and accountability.

Experienced GCP data cloud data engineers preferred, but we invite any traditional BI developer with solid ETL/Data Warehouse experience to apply.

Tasks, duties & responsibilities:

  • Report into and work alongside the Head of Data Management to build upon the existing GCP/BigQuery cloud based data platform.
  • Develop highly scalable, robust data pipelines transforming raw data into the enterprise-wide Data Lake and Data Warehouse.
  • Design ETL processes to manage batch and real time based ingestion, data integration, cleansing and validation.
  • Work closely with business stakeholders gathering requirements and delivering a solution from source data to production MI.
  • Work with the Insight team to help expedite and prepare data for ML/AI insight & analysis.

Requirements:

  • Relevant experience in a data engineering or data warehousing senior role
  • Solid SQL & Python skills working with large and complex datasets
  • GCP experience preferred (Big Query, Dataform (similar to DBT), batch and streaming pipeline technologies)
  • Some exposure of MSSQL, MySQL, AWS platform (S3, Athena, Redshift)
  • Some experience of dimensional modelling & delivering front end MI data
  • DataOps experience i.e. CI / CD and continuous deployment
  • Some line management experience a bonus
  • Highly organised and process driven
  • Self-motivated and enthusiastic approach to work
  • Ambitious, driven individual who excels in challenging environments
  • Relationship Builder, able to work with multiple business functions to achieve objectives

McGregor Boyall is acting as an Employment Agency in relation to this vacancy.

Lead Data Engineer

£65,000 - £80,000

Hybrid (Manchester or London)

Permanent – Full Time

Job Summary:

As part of expanding our analytics platform we have an exciting Data Engineering Lead opportunity, critical to helping us make more data quickly available and into meaningful management information and insight.

As Data Engineering Lead you will responsible for the end-to-end creation and maintenance of our cloud analytics infrastructure and MI outputs servicing all internal customers including the data science and e-commerce teams to warehouse operations and financial performance.

This would suit someone looking for a role that is fluid and flexible and will provide some autonomy and accountability.

Experienced GCP data cloud data engineers preferred, but we invite any traditional BI developer with solid ETL/Data Warehouse experience to apply.

Tasks, duties & responsibilities:

  • Report into and work alongside the Head of Data Management to build upon the existing GCP/BigQuery cloud based data platform.
  • Develop highly scalable, robust data pipelines transforming raw data into the enterprise-wide Data Lake and Data Warehouse.
  • Design ETL processes to manage batch and real time based ingestion, data integration, cleansing and validation.
  • Work closely with business stakeholders gathering requirements and delivering a solution from source data to production MI.
  • Work with the Insight team to help expedite and prepare data for ML/AI insight & analysis.

Requirements:

  • Relevant experience in a data engineering or data warehousing senior role
  • Solid SQL & Python skills working with large and complex datasets
  • GCP experience preferred (Big Query, Dataform (similar to DBT), batch and streaming pipeline technologies)
  • Some exposure of MSSQL, MySQL, AWS platform (S3, Athena, Redshift)
  • Some experience of dimensional modelling & delivering front end MI data
  • DataOps experience i.e. CI / CD and continuous deployment
  • Some line management experience a bonus
  • Highly organised and process driven
  • Self-motivated and enthusiastic approach to work
  • Ambitious, driven individual who excels in challenging environments
  • Relationship Builder, able to work with multiple business functions to achieve objectives

McGregor Boyall is acting as an Employment Agency in relation to this vacancy.

", "image": "https://www.mcgregor-boyall.com/uploads/mcgr_logo.png", "employmentType": "Permanent", "industry": "", "hiringOrganization" : { "@type":"Organization", "name":"McGregor Boyall-Delivering Talent", "url":"https://www.mcgregor-boyall.com/", "logo":"https://www.mcgregor-boyall.com/uploads/mcgr_logo.png" }, "jobLocation": { "@type": "Place", "address": { "@type": "PostalAddress", "addressLocality": "North West, London", "addressRegion": "North West, London", "postalCode": "North West, London", "streetAddress": "North West, London" } }, "baseSalary" : { "@type": "MonetaryAmount", "currency": "GBP", "value": { "@type": "QuantitativeValue", "value": "80000.00", "unitText": "YEAR" } }, "url": "https://www.mcgregor-boyall.com/jobs/north-west/london/data-and-analytics/data-engineering-lead/26081" }