Etl jobs in BirminghamCreate job alerts

Systems Integration Developer (XML / SQL / VB.NET) Outside IR35 | Day Rate | Fully Remote | Immediate Start Seeking a hands-on Systems Integration Developer to integrate externally produced data back into live systems, ensuring it behaves as native system output. Strong focus on XML, SQL, and VB.NET, with light ETL-style data handling. Key Skills • XML (structured outputs, schemas, validation), • XSLT transformations, • VB.NET system posting / integration logic, • SQL (data loads, reconciliation, fixes), • Experience integrating external data into existing platformsRole Highlights, • Design and load XML aligned to existing system formats, • Build XSLT for system and user-facing views, • Develop VB.NET logic to validate and post data, • Use SQL to support data movement and integrity, • Ensure existing workflows and outputs continue uninterrupted

Data Engineer - Microsoft Fabric & Power BIBirmingham City Centre based £65K - £75K We're partnering with a growing, data-driven organisation looking to hire a Data Engineer to take ownership of their end-to-end data platform. This is a hands-on role focused on building a modern data stack within Microsoft Fabric. You'll design and develop pipelines, structure data models, and deliver reporting through Power BI that supports decision-making across marketing, sales, finance, and operations. There is a clear progression path into leadership as the data function grows, but the initial focus is on building a scalable, high-quality data platform from the ground up. The Role • Design and build scalable ETL/ELT pipelines in Microsoft Fabric using PySpark and SQL, • Develop transformation logic within Fabric Lakehouses using Delta Lake and medallion architecture principles, • Integrate data from ecommerce, ticketing, and marketing platforms into a central data layer, • Connect sources such as GA4, Google Ads, Meta Ads, and affiliate platforms via APIs and native connectors, • Own data quality, monitoring, and governance across the platform, • Design and implement dimensional data models (fact/dimension tables, star schema), • Build and maintain Power BI semantic models with DAX, KPIs, and row-level security, • Deliver dashboards and reporting across commercial, marketing, and operational performance, • Support analytics use cases including attribution modelling, cohort analysis, and customer segmentation, • Translate business requirements into data solutions and present insights to stakeholders, • Promote best practices in data engineering, documentation, and version controlRequirements, • Strong hands-on experience with Microsoft Fabric (Lakehouse, Warehouse, pipelines), • Advanced SQL and strong PySpark experience, • Proficiency in Python for data processing and API integration, • Experience building Power BI models and dashboards for business reporting, • Strong understanding of ETL/ELT design and data modelling principles, • Experience integrating third-party data via REST APIs, • Knowledge of data quality, monitoring, and governance practices, • Experience using Git or similar version control tools At Gleeson Recruitment Group, we embrace inclusivity and welcome applicants of all backgrounds, experiences, and abilities. We are proud to be a disability confident employer.By applying you will be registered as a candidate with Gleeson Recruitment Limited. Our Privacy Policy is available on our website and explains how we will use your data.

We are currently working with a leading Leisure & Hospitality client based in Birmingham who are recruiting for a Junior Data Engineer on a permanent basis. This is a great opportunity for someone early in their data career who wants hands-on experience with data pipelines, ETL/ELT processes, and analytics platforms - essentially you will help build modern, cloud-based data solutions using Microsoft Fabric and Azure. The role will require you to: • Support the development and maintenance of data pipelines, • Help ingest, transform, and load data from multiple systems, • Monitor and troubleshoot data workflows, • Work with senior engineers to design and document solutions, • Collaborate with analysts and stakeholders on data needs You should have a good understanding of data engineering concepts, familiarity with SQL and cloud based platforms. Any experience with Microsoft Fabric, ADF, Synapse, Python or Power BI would be desirable. Please note the client is not providing sponsorship and you should have full right to work in the UK.

Data Engineer - Celonis • Location: United Kingdom (Fully remote - must live and be able to work in the UK), • Job Type: Full-time This company is renowned for delivering data, analytics, and automation solutions to large, complex businesses, particularly in finance, operations, supply chain, and customer functions. As part of their UK delivery team, you will play a crucial role in supporting major transformation programmes through practical, hands-on data engineering. Day-to-day of the role: • Design, develop, and maintain scalable data pipelines to feed Celonis from various source systems., • Build, integrate, and optimise SQL Server-based data warehouse pipelines., • Support migration initiatives towards a modern Microsoft Fabric architecture., • Develop and maintain Celonis data models using Celonis Data Integration., • Translate business and reporting requirements into technical data specifications., • Write and optimise SQL and Celonis PQL queries to support dashboards and analysis., • Develop Python scripts for data cleansing, transformation, and automation., • Implement data quality checks and reconciliation processes across systems., • Provide technical support to analysts and business users working with Celonis., • Ensure adherence to data governance, security, and access control standards. Required Skills & Qualifications: • Proven commercial hands-on experience with Celonis in a delivery environment., • Strong experience with Celonis Data Integration and analysis development., • Solid SQL skills (data transformation, optimisation, and performance tuning)., • Proficiency in Python for data engineering and automation tasks., • Good understanding of ETL / ELT processes and data modelling., • Experience working within Agile delivery teams., • Strong analytical skills and meticulous attention to detail., • Celonis Data Engineer certification., • Experience with SQL Server and Microsoft Fabric., • Experience integrating data from enterprise platforms (ERP, CRM, finance systems, etc.)., • Experience in a consulting or client-facing delivery role., • Opportunity to work in a dynamic, international environment., • Competitive salary+ bonus and benefits package., • Professional development and career advancement opportunities.

Layke is working with a new client on a contract requirement for a Senior Data Engineer to support the next stage of a major data platform build. This is a hands-on engineering role focused on building out a modern cloud data environment using Azure, Databricks and Lakehouse architecture. The successful contractor will help shape scalable data pipelines, improve data quality controls, and support analytics/reporting capability across the business. You’ll suit this role if you are comfortable taking ownership in a growing data function, working directly with stakeholders, and turning business requirements into reliable, production-grade data solutions. You’ll be involved in designing and developing data pipelines and data structures across an Azure/Databricks environment, supporting a wider data and analytics platform build. Typical work will include: • Building and optimising data pipelines using Azure Data Factory, Python, SQL and Databricks, • Working with Lakehouse / medallion-style architecture, • Developing robust data models and data flows for reporting and analytics, • Working with Azure SQL / MS SQL environments, • Helping improve CI/CD and deployment practices for data engineering workflows, • Supporting dashboarding and analytical outputs, including PowerBI-facing datasets What we’re looking for • Strong commercial experience as a Data Engineer / Senior Data Engineer, • A relevant and current Databricks certification, • Hands-on experience with Databricks and Azure-based data platforms, • Strong SQL skills, ideally across MS SQL / Azure SQL, • Python experience for data engineering, automation and ETL/ELT workflows, • Experience building scalable data platforms, ideally using lakehouse patterns, • Good understanding of data modelling, data quality and governance principles, • Experience with Git and CI/CD ways of working, • Experience in financial services, wealth management, insurance, banking or another regulated environment would be highly beneficial Contract details • Role: Senior Data Engineer, • Contract: Initial contract engagement, • Location: UK remote with occasional Midlands presence possible, • Rate: £550-600 per day, • Start: within 4 weeks

BI Developer Trustmarque | Remote (UK) | Full-time Are you passionate about turning data into meaningful insights that drive real business decisions? At Trustmarque, we’re looking for a talented BI Developer to join our growing data team and play a pivotal role in shaping how data is transformed, modelled, and consumed across the organisation. This is a fully remote role where you’ll sit at the intersection of data engineering and business intelligence, acting as the vital link between technical data pipelines and impactful business reporting. About the Role As a BI Developer, you’ll work closely with Data Engineers and Data Analysts to transform raw data into clean, structured, and analytics-ready datasets. You’ll design and maintain transformation pipelines, build robust semantic models, and deliver high-quality Power BI dashboards and reports that empower stakeholders to make confident, data-driven decisions. What You’ll Be Doing • Act as the key bridge between Data Engineering and Data Analyst teams, ensuring data is structured, documented, and ready for reporting, • Design and build scalable transformation pipelines within Microsoft Fabric, • Develop reusable, well-documented semantic data models optimised for Power BI, • Create and maintain engaging, interactive Power BI reports and dashboards, • Apply advanced techniques including DAX, Power Query, and row-level security, • Support and optimise data pipelines, transforming manual processes into automated, scalable solutions, • Collaborate with stakeholders to translate business requirements into data-driven solutions, • Implement data quality checks, validation rules, and monitoring processes, • Uphold data governance best practices across the BI layer, • Optimise performance of datasets and pipelines (e.g. incremental refresh, query folding, aggregations), • Conduct data audits to improve quality, security, and governance, • Maintain clear documentation of data flows, lineage, and transformations, • Strong hands-on experience with Microsoft Fabric (Pipelines, Dataflows Gen2, Lakehouse, OneLake), • Advanced Power BI skills (report design, DAX, Power Query, dataset management, governance), • Solid understanding of data modelling principles, including star schema design, • Strong SQL skills with a focus on performance optimisation, • Experience with ETL/ELT processes and data transformation workflows, • Knowledge of data warehousing concepts and architectures, • Understanding of data governance, including quality, security, and compliance, • Excellent problem-solving skills with the ability to analyse complex datasets, • High attention to detail and commitment to data accuracy, • Strong communication skills with the ability to work across technical and non-technical teams At Trustmarque, you’ll be part of a collaborative and forward-thinking environment where data is at the heart of decision-making. You’ll have the opportunity to work with modern technologies, influence data strategy, and deliver solutions that make a real impact.

At Tata Technologies we make product development dreams a reality by designing, engineering and validating the products of tomorrow for the world’s leading manufacturers. Due to our continued growth we are now recruiting for a SAP QM Consultant. to be based at our office/ our customer’s site in Solihull. Our Digital Enterprise Solutions (DES) Department leverages extensive manufacturing know-how for enlightened enterprise systems. Our deep industry experience allows us to drastically reduce process time and effectively streamline business flows for any organization. Our world-class consultants enable organizations to realize the power of the integrated enterprise by providing superior consulting and implementation services. The Role: Will be responsible for Functional and process delivery across the assigned Value Streams at the customers manufacturing plants and other locations. Area of Responsibility • SAP S/4 hana consulting with expertise in Quality Management., • Design, development, delivery and support complex SAP solution bases upon the guideline established by clients., • Quality experience in all aspects of project work: Design, Configuration, unit testing, Integration testing , Documentation, Migration/conversion , Cutover, hyper care and support., • Conducted training programs in SAP QM., • modules knowledge of the key integration points between the other SAP modules (MM and PP experience is an asset)., • Custom designed solutions for large international clients, • Strong knowledge of data mapping, creating QM master data, • Preparing BPD's and updates of ARIS Flows/BPML/ L0 to L4 Processes., • Experience of running design, fit to standard and validation workshops., • Works upstream with Product Managers to understand the product backlog and proposals in the pipeline., • Ensure that business stakeholders are managed., • Skills and experience to complete the configuration in the S4 HANA environments and support master data/transactional data creation., • Document Configurations., • Work in Scrum teams of developers to deliver an agreed scope in accordance with the governance model and maintaining close contact with all stakeholders., • Work in Scrum teams in taking product backlog features and delivering incremental business value., • Proactively plans and manages resources in line with business priorities., • Works with Business Change and Service Transition Managers to ensure engagement occurs at appropriate points throughout the lifecycle, business readiness is secured and that the effective handover to operational (Dev Ops) support is managed effectively., • Ensure timely adherence to Operational Acceptance processes., • Ensure that the Value Stream is managed to realise business outcomes., • Ensure that stakeholders are informed and managed at all times. Knowledge / Experience • SAP QM Functional Consultancy Experience, • S/4 HANA Functional Consultants experienced in working in functional and technical Scrum Teams to deliver the Vehicle Management & Warranty Value Stream., • Leading, organising, developing and executing customer facing Fit To Standard and Solution Validation Workshops., • Track record of successful technology design, build, test and deployment., • Develop extensive and comprehensive knowledge of current state business process, solution design and challenges., • Present future state industry standard processes. Secure business global process owner buy-in to operate in an industry standard way., • Develop and present solutions for business scenarios that cannot be satisfied by industry standard S4 HANA., • Experience of Scaled Agile Scrum S4 HANA and BTP delivery with Developers and Teams distributed across multiple geographies., • Manages the delivery execution of an agreed scope of work., • Develop and secure approval for an agreed solution to be configured and or developed and or integrated in S4 HANA and or BTP and or SAP Cloud modules., • Develop a definition of the project's data requirements, data strategy and ETL documents.Validate data readiness in all SAP environments to support all testing, dry runs, cutover, go live and BAU operation., • Develop a definition of the project's integration requirements., • Maintain delivery to schedule and communicate to all stakeholders., • Report status as periodically and ad hoc as agreed and defined in the Agile governance model., • Attend key Agile Scrum events., • Monitor progress and acts to proactively resolve emerging concerns., • Manage logging interdependencies, resolution of issues and mitigation of risks. Escalate as risk and issues appropriate., • Act on escalations received. If you are passionate about bringing innovation to the projects you work on and want to join a global company, then this is the place for you. Tata Technologies: Engineering a better world.

Senior Data Engineer £80,000 - £100,000 Remote (UK-Based) An opportunity for a highly technical Senior Data Engineer looking to join a fast-growing online gambling and sports betting platform that focuses on its first-in-class mobile app. THE COMPANY This future-ready online gambling and sports betting platform offers customers the best mobile app experience in the industry. THE ROLE As a Senior Data Engineer, you will sit within a high calibre data engineering team, owning and evolving core ETL pipelines that underpin the entire data platform. The focus is on building reliable, well-modelled data assets that can scale with the business. Specifically, you can expect to be involved in the following: • ETL pipelines for data ingestion and data modelling, • Using AWS to store and process data, with Snowflake as the data warehouse, • Use of Python and SQL The successful Senior Data Engineer will have the following skills and experience: • Strong Python and SQL skills, • AWS or GCP (NOT Azure), • Orchestration, ideally with Airflow or Dagsta but open to others, • Data warehousing - Snowflake, Redshift, BigQuery (NOT Databricks) The successful Senior Data Engineer will receive the following benefits: Please register your interest by sending your resume to Majid Latif via the Apply link on this page.

A leading Financial Services organisation, currently investing heavily in its enterprise data platform, is looking to hire an experienced Data Quality Manager on a permanent basis. The role offers a salary of circa £100,000, with potential flexibility, alongside an excellent benefits package and very flexible working. This role will suit a technically strong Data Quality professional with a passion for improving the accuracy, consistency and reliability of data across a modern cloud environment. You will work closely with Data Engineering & Platform teams to embed practical data quality controls into day-to-day delivery and help drive a more engineering-led approach to governance across the business. This is a hands-on leadership role, combining governance oversight with practical technical input across a Snowflake, Databricks and Azure data platform. You will work closely with engineers, analysts and operational stakeholders to improve data quality standards and best practices across the wider data estate. Role responsibilities • Drive the ongoing development of the organisation’s Data Quality and Governance capability, • Define and implement data quality standards, controls, monitoring frameworks and best practices, • Work closely with Data Engineering teams to embed quality controls into pipelines, transformations and workflows, • Support governance and quality initiatives across Snowflake and Databricks based data platforms, • Guide metadata management, lineage, reconciliation and data modelling best practices, • Help drive a more consistent and trusted approach to data management across the wider business Experience required • Strong background across Data Quality, Data Governance and Data Management within modern cloud data environments, • Hands-on experience with Snowflake, Databricks, Azure, SQL and Python, • Experience embedding data quality controls across ETL and ELT pipelines, • Strong understanding of modern data architectures and engineering best practices, • Experience with data profiling, lineage, reconciliation and metadata management tools, • Ability to work closely with engineering teams and influence technical stakeholders, • Previous experience operating within large-scale data transformation programmes would be beneficial If you are an experienced Data Quality Manager looking for a hands-on role within a large-scale data transformation programme, please apply with an up-to-date CV for review.

GCP Data Engineer - Dataflow 6 Month Contract Inside IR35 Up to £650 per day Remote We’re hiring a Senior Data Engineer to design, build, and optimise scalable data pipelines on Google Cloud Platform. This is a hands-on role for someone with a self-starter mindset who enjoys working with modern data architectures and open-source frameworks. What you’ll be doing: • Designing and building ETL/ELT pipelines, • Developing scalable data workflows on GCP, with a strong focus on Google Cloud Dataflow, • Implementing robust data ingestion frameworks using batch and streaming approaches, • Working with structured and semi-structured data, • Collaborating with Data Modelling & Analytics teams, • Driving data reliability, monitoring, and observability, • Automating deployments and workflows, • Contributing to tooling and framework decisions What we’re looking for: • Strong ETL/ELT pipeline experience, • Proven GCP data services expertise, including hands-on experience with Google Cloud Dataflow (essential), • Strong SQL and data transformation skills, • Experience with orchestration and pipeline automation, • Background in modern data architectures (lakehouse/warehouse), • Proactive, ownership-driven mindset Nice to have: • Data Vault 2.0 exposure, • BigQuery optimisation experience, • Open-source data framework experience, • CI/CD for data pipelines

🚀 We’re Hiring: Data & DevOps Engineer (Biotech) Help shape the future of immune therapies. A fast-growing biotech company is on a mission to tackle immune dysfunction — a root cause of many cancers, autoimmune conditions, and infectious diseases. By developing first-in-class antigen modulation technologies, the team is pioneering a new approach to controlling how the immune system recognises and targets cells. As the company enters its next phase of growth, we’re looking for a Data & DevOps Engineer to join the IT function and play a key role in building scalable, secure, and reproducible data systems that support cutting-edge science. 🔍 The Role This position sits at the intersection of IT, data, and scientific teams (including Bioinformatics). You’ll lead on designing and delivering modern data infrastructure and DevOps practices that enable high-quality, reproducible research and analytics. 🛠 What You’ll Be Doing • Design and maintain secure, scalable cloud infrastructure (AWS), • Build and optimise CI/CD pipelines for scientific workflows (e.g. Nextflow), • Implement containerisation (Docker) for reproducibility and traceability, • Develop infrastructure-as-code (e.g. CloudFormation), • Architect data pipelines and platforms for structured and unstructured data, • Integrate analytics tools (e.g. Power BI, Spotfire, Microsoft Fabric), • Enhance data governance, lineage, and auditability, • Collaborate closely with scientists and bioinformaticians, • Produce clear technical documentation, • Manage external vendors supporting cloud infrastructure, • Continuously improve systems and processes ✅ What We’re Looking For • Experience in DevOps, Platform Engineering, or similar within biotech, pharma, or life sciences, • Strong expertise in AWS, Docker, and CloudFormation, • Hands-on experience with Linux systems and CI/CD pipelines, • Experience designing data pipelines and ETL processes, • Understanding of data modelling and master data management, • Ability to collaborate effectively with scientific stakeholders ⭐ Nice to Have • Experience in regulated or research-driven environments (data governance, reproducibility), • Exposure to Microsoft Fabric, Azure data services, or modern BI tools, • Experience with AI services (e.g. Amazon Bedrock), • DevOps/security certifications, • API integration experience 🌱 Why Join? • Be part of a company driving a fundamental shift in disease treatment, • Work at the cutting edge of science, data, and engineering, • Collaborate with world-class researchers and technologists

About Quantiphi Quantiphi is an award-winning, AI-First digital engineering and consulting company focused on delivering high-impact Services and Solutions that help organizations solve what truly matters. We partner with enterprises to reimagine their businesses through intelligent, scalable, and transformative AI driving measurable outcomes at the very core of their operations. Since our founding in 2013, Quantiphi has tackled some of the world’s most complex business challenges by combining deep industry expertise, disciplined cloud and data engineering practices, and cutting-edge applied AI research. Our work is rooted in delivering accelerated, quantifiable business value, not just technology for technology’s sake. Headquartered in Boston, Quantiphi is a global organization with 4,000+ professionals serving clients across key industry verticals, including BFSI, Healthcare & Life Sciences, CPG, MFG, TME etc. As an Elite and Premier partner to leading cloud and AI platforms such as NVIDIA, Google Cloud, AWS, and Snowflake, we build and deliver enterprise-grade AI services and solutions that create real-world impact. We’ve been recognized with • 17x Google Cloud Partner of the Year awards in the last 8 years., • 3x AWS AI/ML award wins., • 3x NVIDIA Partner of the Year titles., • 2x Snowflake Partner of the Year awards., • We have also garnered top analyst recognitions from Gartner, ISG, and Everest Group., • We offer first-in-class industry solutions across Healthcare, Financial Services, Consumer Goods, Manufacturing, and more, powered by cutting-edge Generative AI and Agentic AI accelerators., • We have been certified as a Great Place to Work for the third year in a row- 2021, 2022, 2023. Be part of a trailblazing team that’s shaping the future of AI, ML, and cloud innovation. Your next big opportunity starts here! For more details, visit:______ or___. Role: Cloud Data Architect Experience Level: 8-10+ years Work Location: United Kingdom (Remote) Job Overview: We are seeking a highly skilled AWS Data Migration & Data Engineering Consultant to lead end-to-end data migration initiatives across on-prem, cloud, and multi-cloud environments into AWS. This role focuses on defining and executing data migration strategies, including assessment, wave planning, migration execution, and post-migration stabilization, while ensuring data integrity, minimal downtime, and alignment with business SLAs. The ideal candidate brings strong experience in cross-platform database migrations (Oracle, SQL Server, MySQL, or cloud-native systems) combined with deep expertise in AWS data engineering services and modern data pipeline development. Key Responsibilities: • Lead end to end database migrations to AWS from diverse sources, including on-premises systems (e.g., Oracle, SQL Server, MySQL) and other cloud platforms (e.g., GCP, Azure)., • Lead end-to-end data migration strategy and execution, including assessment, dependency mapping, and wave planning, • Design and implement migration frameworks using AWS DMS, SCT, Glue, and Redshift, • Define and execute data validation, reconciliation, and cutover strategies ensuring zero/low data loss, • Enable CDC-based replication and minimal downtime migrations across heterogeneous systems, • Design and optimize ETL/data pipelines using AWS Glue, PySpark, or EMR, • Architect and implement scalable, secure, and highly available data platforms on AWS, • Drive schema conversion and modernization strategies (heterogeneous migrations where applicable), • Optimize performance of source and target systems pre- and post-migration, • Manage and govern S3-based data lakes and metadata using Glue Data Catalog, • Collaborate with application, infrastructure, and analytics teams for seamless migration and stabilization, • Implement monitoring, rollback, and failure recovery mechanisms, • Ensure adherence to security, governance, and compliance standards Required Skills: • 8+ years of experience in database migration and data engineering, • Proven experience in cross-platform data migrations (on-prem to cloud or cloud to cloud), • Strong hands-on expertise with: AWS DMS (Database Migration Service), AWS SCT (Schema Conversion Tool), AWS Glue (ETL & data integration), Amazon Redshift (data warehousing), • Experience designing and implementing data validation and reconciliation frameworks, • Strong experience in ETL/data pipeline development (Glue, PySpark, EMR, or equivalent), • Deep proficiency in SQL and data modeling concepts, • Experience working with S3-based data lakes and Glue Data Catalog, • Strong understanding of CDC, transaction consistency, and migration cutover strategies, • Hands-on experience with performance tuning, schema design, and query optimization, • Proficiency in Python/PySpark and scripting (Shell/Python), • Experience with Oracle, SQL Server, MySQL, PostgreSQL, or cloud-native databases Nice to Have: • Exposure to real-time replication tools (e.g., GoldenGate or equivalent), • Database Administration (DBA) expertise, including backup & recovery strategies, HA/DR design, database patching and upgrades, lifecycle management, capacity planning, performance monitoring, and security hardening., • Experience with Lake Formation and data governance frameworks, • Familiarity with Data Mesh and cross-account data sharing architectures, • Experience with CI/CD for data pipelines (CodePipeline, Jenkins, etc.), • Knowledge of Infrastructure as Code (Terraform / CloudFormation), • AWS Certifications (Solutions Architect / Data Engineer), • Experience in mentoring teams and leading large-scale migration programs. What’s in it for YOU at Quantiphi: • Make an impact at one of the world’s fastest-growing AI-first digital engineering companies., • Upskill and discover your potential as you solve complex challenges in cutting-edge areas of technology alongside passionate, talented colleagues., • Work where innovation happens - work with disruptive innovators in a research-focused organization with 60+ patents filed across various disciplines., • Stay ahead of the curve—immerse yourself in breakthrough AI, ML, data, and cloud technologies and gain exposure working with Fortune 500 companies.

Data Engineers — Contract Multiple roles · Mid-level & Senior · Hybrid (UK) 📌 Rate: £450–£600 per day (Inside IR35, dependent on experience) 📌 Duration: 6-month SOW initially; longer-term programme (2–3 years overall) 📌 Location: Remote (UK-based) — occasional travel to the Midlands (up to 2 days/month) 📌 Clearance: SC eligible required (UK residency) Hanover are building two data engineering teams to support a large-scale, long-running programme within Central Government. This role centres around designing and building data pipelines in a modern cloud environment, embedded within multi-disciplinary Agile teams. There are both mid-level, senior and lead positions available, so we're open to a range of experience levels. What you'll be doing – Designing, building and maintaining scalable ETL/ELT data pipelines – Working with structured data sources to support analytics and downstream services – Collaborating within Agile delivery teams alongside engineers of mixed seniority – Improving data quality, performance and reliability – Contributing to knowledge sharing and good engineering practice across teams What we're looking for – Strong background as a Data Engineer in complex, delivery-led environments – Solid ETL/ELT experience — Talend is highly desirable – Experience with one or more of: AWS, Oracle, PL/SQL, PostgreSQL – Strong SQL and data modelling fundamentals – Comfortable working in Agile teams with real delivery pressure Nice to have – Central or wider public sector experience – Exposure to large-scale or regulated data environments

About the Role: We are looking for an experienced Data Engineer with strong Talend and Unix expertise to join our team and help deliver secure, high‑performance database and ETL solutions within a large, regulated environment. This role suits someone who enjoys building robust data pipelines, working closely with stakeholders, and supporting critical data services end‑to‑end. What You’ll Do: • Design and implement secure, scalable, and performant data integration solutions, • Build, operate, and continuously improve ETL/data pipelines (ingestion, transformation, curation), • Ensure operational excellence through monitoring, alerting, SLAs, and incident management, • Collaborate with product teams and client stakeholders to refine requirements and align solutions with non‑functional requirements (performance, cost, security), • Support incident resolution and ensure service continuity, • Produce high‑level and low‑level designs, • Share knowledge and mentor colleagues, • Actively contribute to Agile ceremonies and cross‑functional delivery teams Essential Skills & Experience • Strong hands‑on experience with Talend, • Solid Unix/Linux experience (scripting, automation, troubleshooting), • Oracle SQL, • Experience working in Agile environments, • Tools: Jira & Confluence, • Experience supporting production data pipelines Desirable Skills (Nice to Have): • Oracle PL/SQL, • AWS, • GitLab, Artifactory, • Vault, • Berlin JobScheduler, • Test Automation Frameworks, • Data Modelling, • Denodo, • Development lifecycle frameworks (e.g. D4D) Working Arrangement: • Hybrid role, • Occasional on‑site attendance for workshops (typically 2 days per month), • Locations: Telford or Worthing Security Clearance (Mandatory): • Active UK SC Clearance, • Clearance must be transferable to HMRC, • Unfortunately, candidates without active SC clearance cannot be considered Why Join Us? • Work on high‑impact, mission‑critical data platforms, • Collaborative environment with strong engineering standards, • Opportunity to influence design decisions and mentor others, • Stable, long‑term programme within a secure environment

Job Title:Snowflake/Dataops Data Engineer Technical Lead Department:Delivery Reporting to:Professional Services Manager About the role We are looking for a Client Technical Lead to join our delivery team ensure the technical standards and project approach are implemented in the best possible way. You will be providing daily supervision and mentoring of one or more the technical project team(s). This includes reviewing, maintaining or creating a System Architecture and maintaining close relationships with the Project Manager and Business Development and Account Manager. You will be contributing to Agile User-Story and Task grooming, estimations and sprint planning, technical delivery and retrospective reviews both commonly with and without direct Customer involvement. You will be drawing upon and contributing to Datalytyx General and Technology specific Delivery Guides to ensure that best practices approaches are maintained and common project dangers are avoided. You will be working within the 2-week sprints to get the best work from yourself and the technical team members and be committed to completing shared multi-client sprint deliverables. You will be proactively working to know your client’s business and technical needs and be looking for potential additional scope and opportunities that can become future opportunities to make Datalytyx and our Customers successful in our shared relationship. You spot potential engagement issues or blockers early on in planning and sprint execution and help our Project Manager(s) define mitigation steps to ensure joint delivery success. You’ll pro-actively work to build up knowledge of the business, including how our commercial and production teams work. Of course to get to know your colleagues and customers well, you’ll occasionally travel between our two offices and to customer sites. Who are we looking for We are looking for someone who is keen to join the team and learn about what we do. Someone comfortable working with technical staff and customer staff and be confident gathering and representing technical requirements and our resulting deliverables. You will be someone who thrives on working as part of a team to continuously improve quality, demonstrate an eye for detail and be a completer-finisher. We are looking for someone who the technical team can rely upon, demonstrates a positive can-do attitude. You might be a technical consultant who can grow within the role on simple client projects and learn demonstrate the above attributes on a daily basis. You will have a keen eye for the technology used and shape of a client engagement. You will be able to spot potential “broken windows” early on in client technical engagements. You enjoy making a difference to the products and integrations our customers are using. You will have a solid grounding in Computer Science, either from a formal education background or through experience in your career. You will have experience of Big Data Cloud technology, cloud and project/issue tracking systems (we use Jira). What you’ll be doing • Working with DataOps.live and Snowflake to deliver amazing analytic data solutions, • Work on agile projects, looking to deliver business value fast, • Reviewing, maintaining or creating a System Architecture, • Evangelise and contribute to Snowflake, Dataops, DBT best practice, • Daily supervision and mentoring of one or more the technical project team(s), • Contribute and participate in 4-eyes code promotion reviews of GIT Merge Requests, • Identifying and tracking Tasks to manage and resolve technical debt in the solution, • Maintaining close relationships with the Project Manager and Business Development and Account Manager, • Contributing to Agile User-Story and Task backlog grooming, • Participate and lead Team estimations, • Sprint planning, • Creating project from templates and implementing 4-layer modern data architecture ELT data solutions, • Deliver CI/CD data pipelines, implementing a layered ELT data architecture, • Ingesting data from external sources such as Relational Databases, files, Kafka and other sources, • Writing data processing routines with languages such as python, • Collaborate with data source Subject Matter Experts (SME) to discover and understand the data, • Model and transform data using SQL and DBT, • Collaborate with colleagues in peer code reviews and pair programming sessions, • Creating example dashboards using visualisation/BI tools to enable customers to enhance and self-serve further visualisations, • Support and enable Data Science team(s), • Review and resolve data pipeline failures and data test failures, • Optimise and improve data pipelines, • Utilise Snowflake best practices and features to optimise credit usage and performance, • Work with Data Consumers to optimise queries and improve consumption of data Technical skills • A background in SQL and principles of data warehousing, • Snowflake design and engineering experience or certification in Snowpro Core, • Experience in data modelling and ELT, • Analytical and Structured approach to work, • A team player able to perform peer code reviews and provide constructive mentoring, • 5 years’ experience within Data & Analytics and DBT, • Desirable, • Experience of ETL design and dev, including Test-Driven development, • Deep understanding of relational as well as NoSQL data stores, methods and approaches (star and snowflake, dimensional modelling), • Experience of programming languages including Object-Oriented language (.Net. Java, C, Python), • GIT experience, • Good knowledge of DevOps / DataOps principles with working knowledge of Docker and Linux, • Hands on experience with DBT, • Expertise in Snowflake advanced concepts like setting up resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, • Expertise in deploying Snowflake features such as data sharing, • Experience with data security and data access controls and design, • Experience with AWS or Azure data storage and management technologies such as S3 and ADLS, • A track record of achievement and recognition within the IT industry as evidenced by significant promotion since leaving University, • A strong academic track record including the achievement of a good honours degree or equivalent, • Certification in Snowpro Advanced Architect or Snowpro Advanced Data Engineer

Palantir Data Consultant – Defence & Security Bristol, London or Manchester DV Clearance Eligible Required The Opportunity An exciting opportunity to join a growing Technology & Transformation capability supporting high-impact Defence & Security programmes. This role sits at the intersection of data engineering, architecture, and business transformation, delivering mission-critical solutions using the Palantir platform. Key Responsibilities • Design, build, and optimise data pipelines and ETL workflows within Palantir Foundry, • Develop scalable data models and architect robust Foundry solutions, • Transform complex, multi-source data into structured, high-quality assets, • Implement data governance, lineage, and quality frameworks, • Develop applications within the Palantir ecosystem (low-code and pro-code), • Collaborate with cross-functional teams using agile methodologies, • Translate business requirements into technical solutions that deliver measurable outcomes Required Experience & Skills • Hands-on experience with Palantir Foundry and/or Gotham, • Strong background in data engineering, including ETL and pipeline development, • Experience working with batch, streaming, and unstructured data, • Proficiency in Python and/or TypeScript, • Understanding of data modelling, system design, and scalable architectures, • Knowledge of data governance, metadata management, and security principles, • Strong communication skills with the ability to engage technical and non-technical stakeholders, • Familiarity with SDLC, version control, and CI/CD practices Security Requirements Candidates must have an active UK Developed Vetting (DV) clearance.

Key Responsibilities Design and deliver scalable Azure-based data pipelines and ETL workflows Build and optimise data models supporting analytics and reporting Support and enhance Azure Synapse and Azure Data Lake environments Contribute to the migration and adoption of Microsoft Fabric Integrate ma

A leading UK law firm is seeking a Data Engineer specializing in Microsoft Fabric. The ideal candidate will have experience in data engineering, proficient in SQL and Python, and possess knowledge of ETL processes.

A leading recruitment firm is seeking a Junior Data Engineer for a permanent position in Birmingham. Ideal candidates will have a good understanding of data engineering concepts and familiarity with SQL. This role offers hands-on experience in developing data pipelines and working with ETL/ELT proce

A leading technology firm in Birmingham seeks a Data Engineer to design and build data pipelines, optimize ETL processes, and create AI/ML models.The role involves working with Azure, ensuring data governance, and collaborating with cross-functional teams.Candidates should have a degree or equivalen

Systems Integration Developer (XML / SQL / VB.NET) Outside IR35 | Day Rate | Fully Remote | Immediate Start Seeking a hands‑on Systems Integration Developer to integrate externally produced data back into live systems, ensuring it behaves as native system output. Strong focus on XML, SQL, and VB.NET, with light ETL-style data handling. Key Skills XML (structured outputs, schemas, validation) XSLT transformations VB.NET system posting / integration logic SQL (data loads, reconciliation, fixes) Experience integrating external data into existing platforms Role Highlights Design and load XML aligned to existing system formats Build XSLT for system and user-facing views Develop VB.NET logic to validate and post data Use SQL to support data movement and integrity Ensure existing workflows and outputs continue uninterrupted Repeatable delivery across multiple data loadsContract: Outside IR35 Location: Fully Remote Start: Immediate / short notice

This role supports healthcare data migration and archiving projects, providing a great opportunity for early career professionals to build experience in data migration, ETL, SQL, and healthcare technology.

Your responsibilities include establishing data integrations, conducting ETL activities, and collaborating with SMEs to validate data models.

Ensure adherence to data governance quality standards and compliance throughout the ETL lifecycle Maintain comprehensive documentation of ETL processes mappings and workflows for transparency and reproducibility. Identify process gaps and recommend improvements to optimize ETL operations and data qu

In this role, you will design, build, and maintain ETL and ELT pipelines, ensuring data quality and performance.

We are looking for an ETL Engineer with a strong analytics engineering focus to work within our FlightDeck infrastructure, ensuring data is arriving reliably, well‑modelled, and analysis‑ready for planners, strategists and clients. You will be responsible for maintaining and configuring data pip

Mitie Cleaning & Hygiene Services is seeking a Data Engineer to design and develop ETL/ELT pipelines in a hybrid work environment.

Candidates should possess a degree in a related field and experience in SQL, REST APIs, JavaScript, and ETL.

Key responsibilities include collaborating with technology teams, developing Python ETL pipelines, and building reporting solutions using Tableau.

The successful candidate will design, build, and maintain data pipelines, execute ETL processes, and create data models.

This permanent position involves designing and maintaining ETL and data pipelines on Google Cloud Platform (GCP). The ideal candidate should possess strong experience in data engineering, ETL development, and have a background in the banking or financial services domain.

Mercor is seeking a Data Engineering Expert to develop ETL pipelines and ensure data quality.

Key responsibilities include designing SQL data solutions, developing ETL pipelines, and ensuring data quality.

A growing deep-tech consultancy in Greater London is seeking an experienced Software Engineer for a permanent hybrid role.The position involves delivering strategic advisory and engineering services to clients, designing data models, and implementing AI solutions.Candidates must have strong skills i

The role requires deep experience in ETL testing, Python, SQL, and cloud services like AWS and Azure.

The role focuses on enhancing the data platform, developing ETL/ELT pipelines, and improving data quality and reporting.

Key responsibilities include designing automated tests for ETL processes, data validation, and supporting cloud solutions like AWS and Azure.

A digital transformation specialist in Greater London is looking for an Informatica Senior Data Engineer.The role requires strong expertise in Informatica and a background in data engineering, particularly within Azure environments.The position offers a rate of £400‑£475 per day and requires SC

This role requires creating ETL pipelines and working in an Agile environment.

A tech consulting firm in the UK is seeking an experienced Senior Data Engineer with a focus on ETL design and development. Responsibilities include designing scalable ETL processes, performing data quality validation, and mentoring junior team members.

You will be responsible for maintaining and configuring data pipelines in our ETL tool, owning transformations, data models and metric definitions, and ensuring data can be confidently used across the agency. We are looking for an ETL Engineer with a strong analytics engineering focus to work within

Gravitas Recruitment Group (Global) Ltd is seeking a Data Engineer for a crucial technology transformation project with a Lancashire-based Social Housing provider.The successful candidate will bridge the gap between complex code and business strategy, utilizing core technical skills in SQL, Python,

Wonderfield Group in Greater London is seeking a Junior Data Engineer.In this role, you'll support the design and maintenance of data pipelines, aiding data-driven decision-making across their operations.Ideal candidates are detail-oriented, proactive, and eager to learn in a hybrid working environm

Mercor is seeking a Data Engineering Expert to build and develop ETL/ELT pipelines, dbt models, and Airflow/Dagster DAGs.

A leading media agency in Greater London is seeking an experienced ETL Engineer to enhance their FlightDeck infrastructure. Ideal candidates have at least 3 years of experience in ETL and SQL Server management.

This role involves designing and delivering Power BI dashboards, building reliable ETL pipelines using SSIS, and ensuring data quality.

The role involves using SQL to perform the full Extract, Transform, Validate, and Import (ETL) processes, ensuring smooth data transitions.

The successful candidate will execute the ETL process while managing technical transitions and troubleshooting data issues.