Big Data Analytics Developer

  • IHS Markit
  • Ropemaker Street, London, UK
  • 12/01/2019
Full time Data Science Data Engineering Data Analytics Big Data Data Management Statistics Software Engineering

Job Description

IHS Markit is currently investing in their technology and data platform to develop a number of new revenue generating products, leveraging open source and big data technologies. These include new data integration, advanced analytics, visualisation, aggregation and smart data initiatives that address new customer needs and are highly visible and strategic within the organisation.

These initiatives are using best of breed technologies, such as Hadoop, Spark, HDFS, Kafka, SOLR, Cassandra and AWS along with in-house developed technologies, and the successful candidate will be working in a fast paced, dynamic team environment, building commercial products which are at the heart of the business.

Duties and Accountabilities

  • Design and implement “Big Data” infrastructure for batch and real-time analytics.
  • Ensure highly interactive response times. Avoid allowing performance bottlenecks to creep into the system.
  • Interpret and analyse business use-cases and feature requests into technical designs and development tasks.
  • Be an active player in system architecture and design discussions.
  • Take ownership of development tasks, participate in regular design and code review meetings.
  • Be proud of the high quality of your own work.
  • Work with a number of teams (in multiple worldwide locations).
  • Always follow quality standards (unit tests, integration tests and documented code).
  • Be delivery focused, have a passion for technology and will enjoy offering new ideas and approaches.

Education and Expertise

  • Bachelor’s degree in Computer Science, Applied Mathematics, Engineering, or a related discipline, or equivalent experience.
  • Computer Science and Software Engineering : Strong software development experience: Ability to build production software in Scala or Python
  • Distributed file systems/databases/systems
  • Be able to demonstrate commercial experience on big data/advanced analytics projects
  • Linux/Unix.
  • Knowledge of algorithms, data structures, computational complexity.
  • Functional programming
  • Git
  • Hadoop, HDFS, YARN, Spark, Hive, NoSQL databases, SOLR, Kafka, Druid
  • AWS: EC2, EMR, S3
  • Akka
  • SQL

Skills and Experience Required

  • You can effectively provide technical direction, and estimates to fulfill a set of requirements.
  • You can effectively manage timelines and cross team coordination.
  • You can follow relevant technology trends, actively evaluate new technologies, and use this information to improve the product
  • You get a lot of satisfaction from on-time delivery.
  • Happy clients are really important to you
  • You take pride in your work.

It is the policy of IHS Markit to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, IHS Markit will provide reasonable accommodations for qualified individuals with disabilities. We maintain a drug-free workplace. For candidates in the US, we are a participant in E-Verify (see link below).

EEO is the Law
EEO is the Law Supplement
Right to Work
Pay Transparency Policy
E-Verify

Current Colleagues

If you are currently a colleague with IHS Markit please apply internally via Workday.