Cloud Bridge
Dean Street, Marlow SL7 3AA, UK
We are seeking a talented Big Data Engineer to join our data engineering team. In this role, you will be responsible for designing, developing, and optimising scalable big data pipelines and architectures. You will work closely with data scientists, data analysts, and business stakeholders to ensure that high-volume data is processed, stored, and made accessible for analytical and operational use
Key Responsibilities:
Architect and maintain scalable data pipelines using AWS services like S3, Redshift, Glue, Kinesis, and EMR.
Integrate data from various sources, ensuring accessibility and consistency for analytics.
Build real-time streaming solutions using Kinesis, Kafka, or Flink.
Develop ETL workflows with tools like AWS Glue or Apache Spark.
Ensure efficient storage, query optimization, and cost management for large datasets.
Work closely with data scientists and analysts to enable data-driven insights and machine learning.
Implement monitoring and...