London
Data Engineer (Inside IR35) £425 Per day SC Cleared London o support the formation of a new Data Team, there is a critical need to establish robust, scalable, and secure data infrastructure. Currently, data is dispersed across multiple systems with inconsistent formats and limited automation. A Data Engineer will play a key role in designing and implementing the pipelines, architecture, and tooling required to enable reliable data ingestion, transformation, and delivery. Key Responsibilities * Design, build, and maintain scalable data pipelines to ingest, transform, and store data from multiple sources. * Develop and manage data models, schemas, and metadata to support analytics and reporting needs. * Collaborate with Data Analysts, Data Scientists, and Business Analysts to ensure data availability, accessibility, and usability. * Implement data quality checks, validation routines, and monitoring to ensure data integrity and reliability. * Optimise data workflows for performance, cost efficiency, and maintainability using modern data-engineering tools and platforms (e.g., Azure Data Factory, AWS Data Pipeline, Databricks, Apache Spark). * Support the integration of data into visualisation platforms and analytical environments (e.g., Powe...