106 data engineer jobs found

Join us as Senior AWS Data Engineer working on our Market Data Store (MDS); We are embarking on an exciting initiative to revolutionize the way market data is accessed and utilized. The successful candidate will have the chance to make a significant impact in designing the platform and working on cutting-edge technologies like Databricks and Snowflake. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge faced by all banks, working closely with various businesses and gaining an overview of many different sectors. To be successful as a Senior AWS data Engineer, you should have: Extensive hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools. Previous experience in implementing best practices for data engineering, including data governance, data quality, and data security. Proficiency in data processing...

  You will play a pivotal role in leading and delivering complex data engineering solutions with a focus on data analysis, data modeling, and designing ETL processes. As a Principal Data Engineer, you will work with a variety of advanced tools, platforms, and techniques to ensure high-quality data solutions that support the business and its goals. Key Responsibilities: Data Engineering & Architecture : Design and implement scalable data models and ETL processes to support the company's analytics and reporting needs. Work with Data Mesh architecture principles and Data Products to ensure effective data sharing and governance across the organization. Lead the development of end-to-end data solutions using Azure Synapse, Azure SQL Database, SSAS, Power Query/DAX, Microsoft Fabric, and Power BI. Develop data solutions in Azure, leveraging Data Lakes, Data Warehouses, and Azure Data Factory to deliver robust data pipelines....

Contract type:  Permanent Hours:  37.5 Salary:  Circa £60,000, depending on experience Location:  Leeds City Centre WFH policy:  Employees are required to attend the office 2 days/week Travel:  You will be required to travel to the London office once a month (this is expensed by the business) Flexible working : Variety of flexible work patterns subject to line manager discretion e.g. Compressed 9-day fortnight. Reports to:  Data Engineer Manager Deadline Note:  We reserve the right to close the advert before the advertised deadline if there are a high volume of applications.   Role Summary: As the Data Engineer, you will own LCCC’s data ecosystems and will work with developers, solution architects, technical BAs, analysts, data scientists, and other SMEs to define the optimum data platform for the business. You will build the required ETL/ELT pipelines for the ingesting, processing and...

Location:  Remote role with occasional onsite meetings as required Salary:  £40 - £45k depending on experience Contract:  Permanent Future Shapers. Experience Makers. About the Role: ArvatoConnect are hiring for an Azure Data Engineer & Data Modeller to join our dynamic Data & Analytics team. You’ll be at the forefront of designing and maintaining robust, metadata-driven data pipelines within the Azure ecosystem, leveraging tools like Synapse Pipelines and Synapse Notebooks. Your expertise in the Kimball methodology, Medallion architecture and Delta Lake best practices will be crucial in creating high-performing data models that drive strategic decision-making. You’ll work closely with BI Analysts, Data Scientists and business stakeholders to identify data requirements and build scalable solutions. Your role will involve optimising data reliability, performance and governance, ensuring data integrity and...

We are looking for a self-motivated individual with an innovative mind, a passion for technology, and a good understanding of Data Modeling. Our client is a digital-first technology services firm specializing in accelerating business transformation and delivering human-centric digital experiences. We have been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation. They bring together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation is built on a comprehensive suite of engineering services, a dedication to solving clients’ toughest technology problems, and a commitment to continuous improvement. The Python Data Engineer will focus on designing and...

We are looking for a self-motivated individual with an innovative mind, a passion for technology, and a good understanding of Data Modeling. Our client is a digital-first technology services firm specializing in accelerating business transformation and delivering human-centric digital experiences. We have been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation. They bring together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited opportunities digital offers. Our reputation is built on a comprehensive suite of engineering services, a dedication to solving clients’ toughest technology problems, and a commitment to continuous improvement. The Python Data Engineer will focus on designing and...

Applications from Bournemouth and London will be accepted Overview The Data Engineer will play a critical role in designing, developing, and implementing enterprise-wide data solutions. The position focuses on building scalable and reliable data pipelines, data integrations, and models to meet both internal and external customer needs. A strong mix of technical expertise, problem-solving skills, and business acumen is essential. Key Accountabilities and main responsibilities Strategic Focus Contribute to the development of advanced data engineering capabilities. Apply software engineering principles and database design to create scalable data pipelines, integrations, and models. Transform raw data into accurate, reusable datasets with a combination of technical expertise and business insight. Actively participate in driving a data-driven decision-making culture across the organisation. Operational Management Design, develop, and...

Ecosurety are looking for a talented Data Engineer to join our Technology Team. We create digital products and tools which support our customers to comply with data heavy packaging regulations. The Data Engineering team play a fundamental role in delivering the data solutions to support our external customers and internal teams. You’ll be joining a team of 3 Data Engineers in total, as part of a wider Technology Team including Product, BI & Data Specialists, Cloud Architects, and the IT function. Reporting into the Head of Products & Services, the role requires a broad set of skills, including designing, implementing, and maintaining data pipelines, developing data solutions, configuring cloud environments, establishing new processes and adhering to strong Governance amongst the team. We presently work in Azure but are moving more to the Snowflake platform. Ecosurety is an industry leading company of 90+ people, based in the heart of Bristol’s vibrant city...

EXPERIENCE Internships LOCATION London FOCUS Long/Short Investing | Data Engineering BUSINESS Point72 A Career in Long/Short Equities at Point72 Long/Short Equity is Point72’s core investment strategy, and its success depends upon our sector-based investing teams comprised of portfolio managers and research analysts. As an ever-increasing amount of data is applied to the fundamental equity strategies, we are seeking a dedicated data engineer intern to help design and build solutions that enable investment professionals to extract insights from large, complex, Compliance-approved structured and unstructured data sets. Over your 10-week internship in our London office, you will gain exposure to a variety of activities, which may include: Developing and supporting data processing pipelines including but not limited to ingestion, transformation, and end-customer delivery Working closely with...

We are seeking a highly skilled Data Engineer to join our team and play a pivotal role in designing, implementing, and managing new data technology infrastructure. You will be responsible for building and maintaining a scalable and robust cloud-based platform that consolidates existing legacy data services. The platform will enable efficient data management, automation of processes, and provide high-quality data services to our users and tooling. The role is 100% remote. Key Responsibilities Design, develop, and implement data pipelines and ETL processes to ingest, transform, and load data into the data platform. Collaborate with the Lead Architect and Cloud Engineer to ensure the seamless integration of data services within the cloud infrastructure. Develop data models and schemas to support efficient data storage and retrieval. Implement data quality and validation processes to ensure the accuracy and consistency of data. Optimize data processes and...

Title  - Data Engineer Location  - London, EC1A 1AA (Hybrid) Royal Mail delivers more than our competitors put together. Yet we have ambitious plans to grow market share both at home and globally, whilst transforming our UK operation to increase efficiency and profit. Our strategy clearly sets out these plans – data and technology is pivotal to its success. This Data Engineer position will play a pivotal role in driving Royal Mail's data strategy, collaborating closely with our Data Analytics and Data Science teams. As a Data Engineer you will; Drive simple, standardised and innovative ways to ingest, process, store, analyse various data sources Design, implementation and monitoring of our cloud data platform (GCP) Work with the Data Science team to deploy machine learning user cases to production Drive automation in the continuous integration pipelines, infrastructure management...

Join a digital first bank that’s powered by people. Our technology team builds innovative digital solutions rapidly and at scale to deliver the next generation of banking services for our customers around the world. In our cybersecurity team you’ll be helping to safeguard the financial system on which millions of people depend. You’ll be making banking more secure by designing, implementing, and operating controls to manage cybersecurity risk. You’ll help define HSBC Group cyber security standards, deliver Global Security Operations ad Threat management services, provide round-the-clock monitoring and security incident response services, and oversee Network/Application/Infrastructure Security. The work you do will provid3e assurance of the adequacy and effectiveness of security controls to Business Risk Owners. The Principal Cybersecurity Analytics Data Engineer, is a key technical role within the Platform & Data Engineering Team,...

Who are we? Howden is a collective – a group of talented and passionate people all around the world. Together, we have pushed the boundaries of insurance. We are united by a shared passion and no-limits mindset, and our strength lies in our ability to collaborate as a powerful international team comprised of 18,000 employees spanning over 100 countries. People join Howden for many different reasons, but they stay for the same one: our culture. It’s what sets us apart, and the reason our employees have been turning down headhunters for years. Whatever your priorities – work / life balance, career progression, sustainability, volunteering – you’ll find like-minded people driving change at Howden.   Lead Data Engineer Senior Data Engineer to lead and drive forward complex and high-impact data initiatives.   Summary of the Role Howden Group Services is expanding its internal data engineering capability and is looking...

Kindred Group is a digital entertainment pioneer bringing together nine successful online gambling brands, forming one of the largest online gambling groups in the world. Our purpose is to transform gambling by being a trusted source of entertainment that contributes positively to society. Our goal is that 0% revenue is derived from harmful gambling. Our global team of more than 2000 people represents 70+ nationalities. When you join Kindred, you'll be part of a collaborative, diverse and inclusive team that has your best interest at heart. We are a trusting company that knows the value of a healthy work-life balance. We offer a wide range of benefits, along with annual bonus, which is tied to both company and your individual performance. The role We are looking for a Lead Data Engineer to modernise our Corporate – Player Sustainability, Finance, Legal, and Regulatory data infrastructure, focusing on cloud technologies, next-generation data warehousing and...

Could it be you? We’re on the hunt for a Data Engineer in a brand new role to join our mission to find the door and help our people walk through it. We’re looking for a flexible, adaptable, and knowlegable Data Engineer to support our new Data Architect to deliver our Data Strategy. This role is being uploaded so we can recruit special talent working at the cutting edge of helping us improve what we do and how we do it. You’ll support with the delivery of the groups data strategy working collaboratively with stakeholders, extracting, transforming and loading data from a wide variety of sources. A few key points from our role profile: Collaborate with stakeholders to identify and map the data assets that will form the Data Asset Register (DAR) across all relevant systems. Establish processes to extract relevant identification details for the data assets within the DAR, e.g. storage, data type, format. Design and implement processes to extract, transform and...

  As a result of rapid growth, we need an MidLevel Data Engineer to join our Data and Engineering team. Founded in 2016 as an Amazon agency, Optimizon is one of the UK’s most exciting and fast-growing marketplace agencies, dedicated to building and protecting brands on marketplaces such as Amazon, eBay, Wayfair, Onbuy, Mano Mano, DIY.com and many more all over the world. Based in London and Swindon, with a hybrid office/WFH policy, we have a multi-team approach led by our account managers, supported by our Creative, Advertising, Data Analysis and Technical teams. Key role responsibilities: Implement data pipelines and systems to connect and process data for analytics and BI systems. Document systems and source-to-target mappings. Re-engineer manual data flows to enable scaling and repeatable use. Follow best practice guidelines and help to improve those guidelines. Write clean,...

About Kindred Kindred Group is a digital entertainment pioneer bringing together nine successful online gambling brands, forming one of the largest online gambling groups in the world. Our purpose is to transform gambling by being a trusted source of entertainment that contributes positively to society. Our goal is that 0% revenue is derived from harmful gambling. Our global team of more than 2000 people represents 70+ nationalities. When you join Kindred, you'll be part of a collaborative, diverse and inclusive team that has your best interest at heart. We are a trusting company that knows the value of a healthy work-life balance. We offer a wide range of benefits, along with annual bonus, which is tied to both company and your individual performance. #LI-LB1 The role As a Senior Data Engineer, you will play a pivotal role in designing, implementing, and optimising robust data solutions to support business-critical analytics and decision-making processes....

We are seeking a talented   Big Data Engineer   to join our data engineering team. In this role, you will be responsible for designing, developing, and optimising scalable big data pipelines and architectures. You will work closely with data scientists, data analysts, and business stakeholders to ensure that high-volume data is processed, stored, and made accessible for analytical and operational use Key Responsibilities: Architect and maintain scalable data pipelines using AWS services like S3, Redshift, Glue, Kinesis, and EMR. Integrate data from various sources, ensuring accessibility and consistency for analytics. Build real-time streaming solutions using Kinesis, Kafka, or Flink. Develop ETL workflows with tools like AWS Glue or Apache Spark. Ensure efficient storage, query optimization, and cost management for large datasets. Work closely with data scientists and analysts to enable data-driven insights and machine learning. Implement monitoring and...

twentyAI is partnering with a leading global insurance company, recognised for its innovative risk solutions across sectors such as marine, professional liability, and trade credit. They are seeking a talented Data Engineer to join their dynamic technology team in Leeds. The company operates across multiple international markets, leveraging cutting-edge technology to provide top-tier insurance products and services. This Data Engineer will pay a key role in supporting the new Master Data Management services they are rolling out. This will be a global facing role giving you the chance to work with business and technical users across the world. Key Responsibilities : Design, develop, and test new system features and applications using Azure Cloud technologies. Support the roll out of the new Master Data Management Services as well as the development of the code from the engineering team. Advise on approach to Data Governance and Management, making use of...

Job Advert About Us At Everflow, we’re redefining the utility industry. We're an award-winning, fast-growing company, delivering   exceptional   and environmentally friendly water and waste services to businesses across the UK. Our mission is to simplify utilities, saving our customers time, money, and energy so they can focus on what matters most: achieving their business goals. Everflow isn’t like other companies. Sure, we have perks like free coffee, break rooms, and ping pong tables, but what truly sets us apart is our values. We encourage our people to be their authentic selves and embrace the freedom to innovate. At Everflow, it’s not just about delivering exceptional results for our customers; it’s about cultivating a fulfilling, balanced work environment where great things happen. What you’ll be doing: The Lead Data role assists in defining and executing the organisation’s data strategy, ensuring efficient operations and delivering actionable insights....