Data Engineer

As a Data Engineer you will play a crucial role in designing, building, and maintaining the data infrastructure that powers our investment strategies. You will work closely multiple stakeholders to ensure seamless data flows, robust pipelines, and efficient data management processes.

Principal Responsibilities

• Design, develop, and optimise scalable data pipelines to support real-time and batch data processing.
• Integrate various data sources into our data ecosystem, ensuring high data quality and consistency.
• Collaborate with the analytics team to implement and maintain data models using tools such as Snowflake and dbt (Data Build Tool).
• Automate data workflows and orchestrate complex ETL processes using orchestration tools such as Dagster, Luigi, and Airflow.
• Monitor and troubleshoot data pipelines, ensuring reliability and performance.
• Implement best practices in data governance, security, and compliance.
• Collaborate with cross-functional teams to understand data needs and deliver solutions that drive business value.

Competencies

• Proficiency in Python: Strong experience in writing efficient, clean, and maintainable Python code for data processing
• Expertise in SQL: Deep knowledge of SQL for querying, transforming, and managing data in relational databases
• Experience with Snowflake: Hands-on experience with Snowflake for building and managing cloud data warehouses is highly preferred
• Experience with dbt: Proven experience in using dbt for data transformation, testing, and documentation
• Familiarity with Orchestration Tools: Experience with orchestration tools such as Dagster, Luigi, Airflow, or similar
• Strong Problem-Solving Skills: Ability to analyse complex problems, design scalable solutions, and implement them effectively
• Attention to Detail: Meticulous attention to detail, especially when working with financial data and ensuring data integrity
• Collaboration: Excellent communication and teamwork skills, with the ability to work closely with various stakeholders
• Understanding of Finance: Experience working in the financial services industry, particularly within hedge funds or asset management