£45,000 - £50,000 yearly
Scrumconnect Consultancy
London E14, UK
Scrumconnect Consulting is looking for a Software Engineer to work on a Strategic Data Platform with expertise in Azure Data Factory (ADF), Python, PySpark, Java, Terraform, and Azure DevOps. The ideal candidate will have experience in cloud-based data engineering, automation, and infrastructure provisioning while working in an Azure environment.
You will be responsible for developing scalable data pipelines, integrating cloud services, automating deployments, and supporting DevOps workflows.
Key Responsibilities:
1. Software Engineer
Develop, test, and deploy scalable data pipelines using Azure Data Factory (ADF), Python, PySpark, and Java.
Implement data transformation, ETL/ELT workflows, and data integration solutions.
Optimize data flow and performance for cloud-based data processing.
2. Cloud & Infrastructure Automation
Use Terraform to provision and manage Azure resources.
Implement...