Big Data Developer

  • Barclays
  • Northampton NN4 7SG, UK
  • 30/07/2021
Full time Data Science Data Analytics Big Data Data Management Statistics

Job Description

As a Barclays Big Data Developer, you will be part of Risk Finance Treasury Technology – Enterprise Data Platforms which is a Technology section within Barclays providing technical data services, infrastructure, guidance and support to the Barclays Payments business area. In this role you will form part of a world class Big Data engineering team responsible for optimising data usage, sharing best practises and developing and connecting engineering teams across Barclays.

Barclays is one of the world's largest and most respected financial institutions, with 329 years of success, quality and innovation behind us. We offer careers that provide endless opportunity – helping millions of individuals and businesses thrive, and creating financial and digital solutions that the world now takes for granted.

This opportunity is open to flexible working arrangements. Such as working from home, flexible or compressed hours, and part-time options. If you have a need for flexibility, please apply and discuss this with us during the hiring process.

What will you be doing?
• Building distributed and highly performant Big Data applications which process massive amounts of data (both structured and unstructured data) in batch and streaming

  • Building solutions to migrate data from upstream sources into Hadoop, both one-off historic data loads and set up regular scheduled updates including Change Data Capture
  • Leveraging the Big Data Ecosystem to enrich and transform corporate data to enable searching, data visualisation and advanced analytics
  • Automating repeatable processes with solutions that are robust, configurable and scalable
  • Working closely with analysts and business stakeholders to gather requirements and build data marts
  • Continuous delivery through Agile Methodologies on Big Data Platforms
  • Working closely with release engineers and Product Management to deliver software in a continuous delivery environment
  • Producing design documentation and provide knowledge transfers to the Live System Support teams

What we’re looking for:
• Extensive experience in Hadoop/Spark development in large scale enterprise environments

  • Hands on knowledge of Hive/Impala, Spark, Sqoop, HBase and YARN
  • Expert level experience in one of Java, Scala, Shell or Python
  • Expert level SQL and Data Warehousing knowledge and understanding of Hadoop Security controls: AD, Kerberos, Sentry

Skills that will help you in the role:
• Excellent communication skills and experience of distributed global teams with Solid grounding in Financial Service

  • Familiar with Agile methodologies including Scrum or Kanban
  • Experience of implementing data security capabilities such as tokenization, encryption etc.
  • Experience with Spark Streaming and Kafka and understanding of Cloud infrastructure/technologies

Where will you be working?
Northampton was the birthplace of Barclaycard in 1966 and we've been based in Pavilion Drive since the building opened in 1997. This state-of-the art energy efficient building holds up to 2,500 staff. The office location is perfect for travel from the midlands and London alike as we are based just off the A45, it is easily accessible by both car and bus routes.