Liverpool
Lead Data Platform Engineer Remote (UK-based) SC Clearance Required (British Citizen) Permanent - Up to £110,000 + Benefits We are looking for a hands-on Lead Data Platform Engineer to join a high-impact programme delivering scalable, real-time data solutions. This role offers the opportunity to work on complex, mission-critical systems using modern technologies across streaming, cloud, and distributed data platforms. The Role As a Lead Data Platform Engineer, you will design and deliver batch and real-time data pipelines that are highly available, low latency, and scalable. You will collaborate with cross-functional teams to shape solutions, influence architecture, and ensure data is transformed into reliable, consumable outputs. Key Responsibilities • Design, build, and deploy data pipelines and backend services, • Work with real-time streaming technologies and event-driven architectures, • Champion engineering best practices including TDD, CI/CD, and clean code, • Collaborate with architects, analysts, and testers in Agile/BDD environments, • Take ownership of services in production, ensuring performance and reliability, • Drive continuous improvement across data platform capabilities, • Contribute to solution design, estimation, and delivery planning Required Experience • Strong production Java experience, • Experience with Kafka, Kinesis, or similar streaming technologies, • Hands-on experience with Spark, Flink, Kafka Streams, or similar, • Experience with Spring Boot and/or Python, • Strong experience with AWS (including Lambda and S3), • Experience integrating with PostgreSQL, Redis, or similar, • Solid understanding of data pipelines and data modelling, • Passion for clean, testable, and maintainable code, • Experience working in Agile and/or DevOps environments Desirable Skills • Experience with Elasticsearch, OpenSearch, or Solr, • Familiarity with Terraform, Ansible, or Packer, • Experience with CI/CD tools such as Jenkins or Drone If you are interested, please apply or get in touch to discuss further.