Data Engineer

  • Linux Recruit
  • Greater London, UK
  • 16/01/2019
Full time Data Science Data Engineering Data Analytics Data Management Statistics Software Engineering

Job Description

Work directly on a successful app with over 100 million users at the core of the product, joining a successful data team.

You will be working on delivering a new self-service data platform, that will be built with Scala, Spark, Python, CI/CD and Infrastructure as code, alongside an experienced technical team.

You are a data engineer with experience working on large scale projects in real-time stream processing of data. Your experience is solid in Spark and Scala or Python (both would be great!) with a heavy TDD approach to your code. You will also work heavily with cloud technologies and distributed systems

Ideally, you are someone who has solid experience in systems and software design as you will be building and designing datasets from scratch within a highly scalable environment. advancing the existing data infrastructure.

You will work with the following technologies, however, you don't need experience in all;

  • Scala
  • Spark
  • Python
  • AWS
  • Lambda
  • Kinesis
  • Hive
  • Jenkins
  • Packer
  • Docker
  • Kubernetes

With the technologies above, you will be crucial to the significant impact on the success and reliability of the product joining an exciting team within a growing business.

You will be joining a team of continuous learners and will always face new challenges within this team. We're looking for you to bring on your expertise, whilst also taking each day as a new learning opportunity.

As well as working within an ever-growing industry where technology is key, you will work in a social, modern environment centred around ownership and trust.