Etl jobs in Newcastle Upon TyneCreate job alerts

About The Role FDM is a global business and technology consultancy seeking a Software Developer to work for our client within the public sector. This is initially a 6-month contract with very good prospects to extend, and will be a hybrid role that will be based in Newcastle. An active SC status is required for this role. Our client are seeking a Software Developer to contribute to the ongoing operation and evolution of a large-scale data platform supporting complex analytical use cases. The platform consolidates event data from a wide range of user-facing systems, processing and publishing it through shared internal analytics services. This role involves building and maintaining dependable data ingestion and delivery pipelines, with a strong focus on reliability, performance, and long-term maintainability. Responsibilities: • Drive delivery of groups of related user stories within iterative, agile development cycles., • Develop and maintain a deep understanding of the platform and actively share knowledge across the team and with non-technical stakeholders., • Work closely with Product, Analysis, and Engineering colleagues to refine requirements and implement high-quality technical solutions., • Support the operation, monitoring, and enhancement of live data pipelines and downstream publishing services., • Proactively identify opportunities to improve system efficiency, scalability, robustness, and security posture., • Provide technical guidance, code review, and mentoring to junior developers, promoting strong engineering standards and best practices.About You, • 3+ years of experience in Software Development, • Active SC is required for this role, • Strong experience using Python for data processing, transformation, and ETL workloads., • Practical experience working with AWS cloud services, including compute, storage, and security tooling., • Infrastructure-as-code experience using Terraform., • Distributed data processing using Apache Spark., • Workflow scheduling and orchestration with Apache Airflow., • Containerisation and environment management using Docker., • CI/CD pipeline implementation and maintenance using GitLab., • Awareness of and experience with security scanning and vulnerability tooling (e.g. Trivy, Trend Micro, Wiz or similar)., • Career coaching, mentoring and access to upskilling throughout your entire FDM career, • Initial upskilling pre-assignment that has been accredited by TechSkills, • Assignments with global companies and opportunities to work abroad FDM is an award-winning global leader in tech and business talent solutions, backed by more than 35 years of industry experience. We have centres across Europe, North America, and Asia-Pacific, and a global workforce of over 2500 employees. FDM has shown exponential growth throughout the years, firmly establishing itself as an award-winning employer, currently listed on the FTSE4Good Index and as a 2026 Financial Times UK ‘Best Employer’. Diversity and Inclusion FDM Group is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, national origin, age, disability, veteran status or any other status protected by federal, provincial or local laws.

Senior Data Engineer Location: 100% Remote (UK-based) Employment Type: Permanent Salary: Up to £75,000 Positions Available: 2 The Opportunity We are looking for experienced Senior Data Engineers to play a key role in the evolution of a modern enterprise data platform built on Databricks and AWS. This is an opportunity for highly autonomous engineers who enjoy ownership, solving complex data challenges, and contributing to scalable, high-quality data solutions in a cloud-first environment. You’ll work across the full data engineering lifecycle, helping to design, build, optimise, and govern data products within a Databricks Lakehouse architecture. Key Responsibilities • Design, develop, and optimise scalable ETL/ELT pipelines using Databricks, Python, SQL, and Delta Live Tables (DLT)., • Build and maintain performant Delta Lake solutions, including partitioning and optimisation strategies., • Contribute to Lakehouse architecture design and scalable ingestion frameworks., • Develop governed, reusable, and maintainable data products., • Implement data quality, observability, monitoring, and automated testing frameworks., • Ensure alignment with governance, lineage, and security standards using Unity Catalog., • Optimise Databricks cluster usage, orchestration, and cloud cost efficiency., • Work collaboratively with architects, analysts, and stakeholders to translate business requirements into technical solutions., • Mentor and support other engineers while contributing to engineering best practices and standards., • Strong commercial experience as a Data Engineer or Senior Data Engineer., • Deep hands-on expertise with Databricks on AWS (essential)., • Strong understanding of Spark, Delta Lake, and Lakehouse architectures., • Proven experience designing scalable and maintainable modern data platforms., • Strong knowledge of the end-to-end data engineering lifecycle., • Experience with AWS cloud services in data engineering environments., • Experience with Data Asset Bundles is highly desirable., • Strong SQL and Python development skills., • Understanding of data governance, metadata management, and quality frameworks., • Ability to work autonomously and thrive in a self-directed environment. The ideal candidate will be: • A self-starter who enjoys autonomy and ownership., • Comfortable operating in fast-moving engineering environments., • Passionate about engineering quality, scalability, and continuous improvement., • Confident influencing technical direction and best practice adoption., • Delivery-focused with a pragmatic approach to solving problems.

Data Engineer Location: Newcastle Upon Tyne (Cobalt Business Park) Function: Data Engineering / Advanced Technology Industry: Consulting / Public & Private Sector About the Role Our client is a global professional services organisation delivering large scale technology and transformation programmes across both public and private sector clients. They are continuing to invest heavily in their data capability, with their Advanced Technology Centre acting as a key delivery hub for complex, high impact data solutions. This role sits within a growing data engineering team focused on building modern, scalable data platforms that power analytics, AI, and operational decision making. You will be working on real world, production grade systems rather than proof of concepts, with clear ownership and visibility across the full data lifecycle. What You’ll Be Doing You will be hands-on in designing, building, and scaling data solutions in a cloud-first environment. • Build and optimise scalable data pipelines using Java as the primary language, with exposure to Python where needed, • Develop real-time streaming solutions using technologies such as Kafka and Flink, • Integrate data from multiple sources including APIs, batch systems, and streaming platforms using AWS services like Kinesis, MSK, Lambda, and Glue, • Contribute to modern data architecture patterns including medallion architecture and event-driven design, • Ensure strong data governance, quality, lineage, and security across all pipelines, • Deploy data applications using CI/CD pipelines (Azure DevOps, GitHub Actions, Jenkins), • Manage infrastructure using Infrastructure as Code tools such as Terraform or CloudFormation, • Work with containerised environments using Docker and Kubernetes, • Collaborate closely with analytics, product, and AI teams to deliver clean, usable datasets, • Support code reviews, best practices, and knowledge sharing across the team, • Provide guidance and mentorship to junior engineers where appropriate Ideal Background • Third-level education in a relevant field such as Computer Science, Data Science, Artificial Intelligence, or similar, • Minimum 2 years’ experience in data engineering or large-scale data platforms, • Strong programming skills in Java (preferred) or Python, • Hands-on experience with Kafka, Flink, or Spark, with a preference for streaming technologies, • Solid understanding of real-time data processing concepts such as event time, state handling, and backpressure, • Experience building ETL/ELT or streaming data pipelines, • Good understanding of distributed systems and microservices architecture, • Experience working with cloud platforms, ideally AWS (Azure or GCP also considered), • Exposure to CI/CD pipelines and DevOps practices, • Experience with Terraform or similar Infrastructure as Code tools, • Familiarity with Docker and Kubernetes, • Comfortable working in Agile delivery environments, • Strong communication skills with the ability to work across technical and non-technical stakeholders What You’ll Receive • Salary between £40,000 – £65,000 depending on experience, • Hybrid working model (3 days per week onsite in Newcastle), • Exposure to large-scale, enterprise-level data projects across multiple industries, • Clear progression pathways within a structured global organisation, • Access to modern cloud and data technologies, • Ongoing training and development within a highly collaborative environment Who Should Apply • Data Engineers looking to move into more complex, large-scale streaming and cloud-based environments, • Engineers with strong Java or Python backgrounds wanting to deepen expertise in real-time data processing, • Candidates from consulting or product environments who are comfortable working across multiple stakeholders, • Individuals interested in building production-grade data platforms rather than siloed or legacy systems Please note: This role requires eligibility for BPSS and SC clearance, including 5 years continuous UK residency and appropriate right to work status. If you want to work on high-impact data systems with modern tooling and clear progression, this is a strong move.

Data Engineer - SC Cleared / SC Eligible Location: Newcastle upon Tyne About the Role We are working with a leading organisation who are building a brand-new engineering and data function in Newcastle. They are looking to hire multiple Data Engineers across Junior, Mid-level, and Senior levels. Due to the nature of the projects, candidates must hold active SC Clearance or be eligible to obtain SC Clearance. This is an exciting opportunity to work on complex, high-impact data platforms, helping to design, build, and maintain scalable data pipelines and cloud-based data solutions. Key Responsibilities • Design, build, and maintain scalable data pipelines and ETL processes., • Develop and optimise data models for analytics and reporting., • Work closely with software engineers, analysts, and stakeholders., • Ensure data quality, reliability, and performance., • Implement best practices in data engineering, governance, and security., • Build and maintain cloud-based data platforms., • Support deployment, monitoring, and troubleshooting of data systems., • Mentor junior engineers (for mid and senior level roles). Required Skills & Experience We are open to candidates from a wide range of technical backgrounds. The technology stack is flexible, but experience in some of the following are nice to have: Data Engineering & Programming: • Python, • SQL, • Spark / PySpark, • Scala, • Data modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda), • Other cloud platforms (Azure / GCP considered), • Data lake and data warehouse architectures General: • Strong problem-solving skills, • Experience working in agile environments, • Good communication and stakeholder engagement, • Understanding of secure data handling practices Security Clearance • Active SC Clearance OR eligibility to obtain SC Clearance is mandatory., • Must have lived and worked in the UK for the past 5 years. Experience Levels Junior: • 0–2 years commercial experience, • Strong fundamentals and eagerness to learn Mid-Level: • 2–5 years commercial experience, • Ability to work independently and contribute to design Senior: • 5+ years commercial experience, • Strong technical leadership and mentoring capability Benefits • Competitive salary (dependent on experience), • Hybrid working model, • Excellent career development and training opportunities, • Modern cloud-based data platforms, • Greenfield projects and long-term programmes, • Supportive, collaborative culture If you are a Data Engineer looking for your next challenge and hold (or are eligible for) SC Clearance, we would love to hear from you.

GCP Data Engineer - Dataflow 6 Month Contract Inside IR35 Up to £650 per day Remote We’re hiring a Senior Data Engineer to design, build, and optimise scalable data pipelines on Google Cloud Platform. This is a hands-on role for someone with a self-starter mindset who enjoys working with modern data architectures and open-source frameworks. What you’ll be doing: • Designing and building ETL/ELT pipelines, • Developing scalable data workflows on GCP, with a strong focus on Google Cloud Dataflow, • Implementing robust data ingestion frameworks using batch and streaming approaches, • Working with structured and semi-structured data, • Collaborating with Data Modelling & Analytics teams, • Driving data reliability, monitoring, and observability, • Automating deployments and workflows, • Contributing to tooling and framework decisions What we’re looking for: • Strong ETL/ELT pipeline experience, • Proven GCP data services expertise, including hands-on experience with Google Cloud Dataflow (essential), • Strong SQL and data transformation skills, • Experience with orchestration and pipeline automation, • Background in modern data architectures (lakehouse/warehouse), • Proactive, ownership-driven mindset Nice to have: • Data Vault 2.0 exposure, • BigQuery optimisation experience, • Open-source data framework experience, • CI/CD for data pipelines

This is TDS We are a global software consultancy specialising in providing highly skilled experts to meet our clients' business needs. At Test Driven Solutions, we excel in driving both from the ground up development as well system modernisation projects, leveraging the latest cutting-edge technologies to deliver outstanding results. We operate across both private and public sectors. We are serving industries such as financial services, government, healthcare, gaming, education, broadcasting, and renewable energy organisations. We are continually growing as a business, securing new client wins and advancing ongoing internal projects. What's it like working here At TDS we uphold clear and unwavering values, fostering a community-oriented ethos that encourages close collaboration across our diverse disciplines. We hold regular team meet-ups, both online and in person, and monthly company wide social events. In addition, we organise company away weekends, which have previously taken us to cities like Amsterdam, Dusseldorf, Riga and Dublin. These trips offer the team a chance to unwind and strengthen connections outside of the office. It is important to us to create an environment where strong connections are built and camaraderie is nurtured within our team. Offering full hybrid working patterns to align with today’s flexible work environment, our team is spread across the UK, with members based in and around Newcastle, Edinburgh, Glasgow, Perth, Inverness and the Birmingham region. We are proud to have our modern UK headquarters on the Quayside in Newcastle’s city centre, with stunning views of the Glass House. This office serves as a central base of work for everyone, providing a collaborative space for our team when they come together. In January, we opened our second UK office, based in Haymarket, Edinburgh to give our Scottish team a hub that is more local. Additionally, we have teams located in our international office regions in Wrocław, Poland, and Calgary, Canada, creating a truly global workforce. This distributed team structure fosters strong connections and collaboration, regardless of location. What you will be involved in • Working with clients to deliver high quality data solutions for varied industries, • Building and Improving complex data pipelines, data transformations and data models, • Investigating and fixing data issues and improving performance and reliability, • Supporting junior engineers and taking ownership of defined technical tasks, • Working with architects and analysts to turn designs into working data solutions, • Collaborating with the internal Cloud & Data team to share best practices and ideas Technical Requirements • Talend ETL (or similar), • SQL/Python, • Database DDL, • Git/Gitlab/Gitlab CI, • JSON schema analysis, • TAD, • Test Automation, • PL/SQL Packages and procedures, • Denodo integration Nice to have • AWS/Azure, • Ansible, • Amazon S3, • Artifactory, • Zephyr, • Berlin JobScheduler, • Vault Benefits • 25 days holiday + Bank holidays, • Hybrid/Remote work and flexible working hours, • Contributory pension scheme (Salary sacrifice available), • Progression opportunities/Paid certificates, • Discretionary Bonus Scheme, • BUPA Health/Dental care, • Perkbox benefits/discount scheme, • City centre office location, • Macbook Pro/Windows Machine provided, • Monthly company socials, • Cycle to Work scheme, • Company away weekend, • TDS Merchandise

BI Developer Trustmarque | Remote (UK) | Full-time Are you passionate about turning data into meaningful insights that drive real business decisions? At Trustmarque, we’re looking for a talented BI Developer to join our growing data team and play a pivotal role in shaping how data is transformed, modelled, and consumed across the organisation. This is a fully remote role where you’ll sit at the intersection of data engineering and business intelligence, acting as the vital link between technical data pipelines and impactful business reporting. About the Role As a BI Developer, you’ll work closely with Data Engineers and Data Analysts to transform raw data into clean, structured, and analytics-ready datasets. You’ll design and maintain transformation pipelines, build robust semantic models, and deliver high-quality Power BI dashboards and reports that empower stakeholders to make confident, data-driven decisions. What You’ll Be Doing • Act as the key bridge between Data Engineering and Data Analyst teams, ensuring data is structured, documented, and ready for reporting, • Design and build scalable transformation pipelines within Microsoft Fabric, • Develop reusable, well-documented semantic data models optimised for Power BI, • Create and maintain engaging, interactive Power BI reports and dashboards, • Apply advanced techniques including DAX, Power Query, and row-level security, • Support and optimise data pipelines, transforming manual processes into automated, scalable solutions, • Collaborate with stakeholders to translate business requirements into data-driven solutions, • Implement data quality checks, validation rules, and monitoring processes, • Uphold data governance best practices across the BI layer, • Optimise performance of datasets and pipelines (e.g. incremental refresh, query folding, aggregations), • Conduct data audits to improve quality, security, and governance, • Maintain clear documentation of data flows, lineage, and transformations, • Strong hands-on experience with Microsoft Fabric (Pipelines, Dataflows Gen2, Lakehouse, OneLake), • Advanced Power BI skills (report design, DAX, Power Query, dataset management, governance), • Solid understanding of data modelling principles, including star schema design, • Strong SQL skills with a focus on performance optimisation, • Experience with ETL/ELT processes and data transformation workflows, • Knowledge of data warehousing concepts and architectures, • Understanding of data governance, including quality, security, and compliance, • Excellent problem-solving skills with the ability to analyse complex datasets, • High attention to detail and commitment to data accuracy, • Strong communication skills with the ability to work across technical and non-technical teams At Trustmarque, you’ll be part of a collaborative and forward-thinking environment where data is at the heart of decision-making. You’ll have the opportunity to work with modern technologies, influence data strategy, and deliver solutions that make a real impact.

🚀 We’re Hiring: Data & DevOps Engineer (Biotech) Help shape the future of immune therapies. A fast-growing biotech company is on a mission to tackle immune dysfunction — a root cause of many cancers, autoimmune conditions, and infectious diseases. By developing first-in-class antigen modulation technologies, the team is pioneering a new approach to controlling how the immune system recognises and targets cells. As the company enters its next phase of growth, we’re looking for a Data & DevOps Engineer to join the IT function and play a key role in building scalable, secure, and reproducible data systems that support cutting-edge science. 🔍 The Role This position sits at the intersection of IT, data, and scientific teams (including Bioinformatics). You’ll lead on designing and delivering modern data infrastructure and DevOps practices that enable high-quality, reproducible research and analytics. 🛠 What You’ll Be Doing • Design and maintain secure, scalable cloud infrastructure (AWS), • Build and optimise CI/CD pipelines for scientific workflows (e.g. Nextflow), • Implement containerisation (Docker) for reproducibility and traceability, • Develop infrastructure-as-code (e.g. CloudFormation), • Architect data pipelines and platforms for structured and unstructured data, • Integrate analytics tools (e.g. Power BI, Spotfire, Microsoft Fabric), • Enhance data governance, lineage, and auditability, • Collaborate closely with scientists and bioinformaticians, • Produce clear technical documentation, • Manage external vendors supporting cloud infrastructure, • Continuously improve systems and processes ✅ What We’re Looking For • Experience in DevOps, Platform Engineering, or similar within biotech, pharma, or life sciences, • Strong expertise in AWS, Docker, and CloudFormation, • Hands-on experience with Linux systems and CI/CD pipelines, • Experience designing data pipelines and ETL processes, • Understanding of data modelling and master data management, • Ability to collaborate effectively with scientific stakeholders ⭐ Nice to Have • Experience in regulated or research-driven environments (data governance, reproducibility), • Exposure to Microsoft Fabric, Azure data services, or modern BI tools, • Experience with AI services (e.g. Amazon Bedrock), • DevOps/security certifications, • API integration experience 🌱 Why Join? • Be part of a company driving a fundamental shift in disease treatment, • Work at the cutting edge of science, data, and engineering, • Collaborate with world-class researchers and technologists

Job Title:Snowflake/Dataops Data Engineer Technical Lead Department:Delivery Reporting to:Professional Services Manager About the role We are looking for a Client Technical Lead to join our delivery team ensure the technical standards and project approach are implemented in the best possible way. You will be providing daily supervision and mentoring of one or more the technical project team(s). This includes reviewing, maintaining or creating a System Architecture and maintaining close relationships with the Project Manager and Business Development and Account Manager. You will be contributing to Agile User-Story and Task grooming, estimations and sprint planning, technical delivery and retrospective reviews both commonly with and without direct Customer involvement. You will be drawing upon and contributing to Datalytyx General and Technology specific Delivery Guides to ensure that best practices approaches are maintained and common project dangers are avoided. You will be working within the 2-week sprints to get the best work from yourself and the technical team members and be committed to completing shared multi-client sprint deliverables. You will be proactively working to know your client’s business and technical needs and be looking for potential additional scope and opportunities that can become future opportunities to make Datalytyx and our Customers successful in our shared relationship. You spot potential engagement issues or blockers early on in planning and sprint execution and help our Project Manager(s) define mitigation steps to ensure joint delivery success. You’ll pro-actively work to build up knowledge of the business, including how our commercial and production teams work. Of course to get to know your colleagues and customers well, you’ll occasionally travel between our two offices and to customer sites. Who are we looking for We are looking for someone who is keen to join the team and learn about what we do. Someone comfortable working with technical staff and customer staff and be confident gathering and representing technical requirements and our resulting deliverables. You will be someone who thrives on working as part of a team to continuously improve quality, demonstrate an eye for detail and be a completer-finisher. We are looking for someone who the technical team can rely upon, demonstrates a positive can-do attitude. You might be a technical consultant who can grow within the role on simple client projects and learn demonstrate the above attributes on a daily basis. You will have a keen eye for the technology used and shape of a client engagement. You will be able to spot potential “broken windows” early on in client technical engagements. You enjoy making a difference to the products and integrations our customers are using. You will have a solid grounding in Computer Science, either from a formal education background or through experience in your career. You will have experience of Big Data Cloud technology, cloud and project/issue tracking systems (we use Jira). What you’ll be doing • Working with DataOps.live and Snowflake to deliver amazing analytic data solutions, • Work on agile projects, looking to deliver business value fast, • Reviewing, maintaining or creating a System Architecture, • Evangelise and contribute to Snowflake, Dataops, DBT best practice, • Daily supervision and mentoring of one or more the technical project team(s), • Contribute and participate in 4-eyes code promotion reviews of GIT Merge Requests, • Identifying and tracking Tasks to manage and resolve technical debt in the solution, • Maintaining close relationships with the Project Manager and Business Development and Account Manager, • Contributing to Agile User-Story and Task backlog grooming, • Participate and lead Team estimations, • Sprint planning, • Creating project from templates and implementing 4-layer modern data architecture ELT data solutions, • Deliver CI/CD data pipelines, implementing a layered ELT data architecture, • Ingesting data from external sources such as Relational Databases, files, Kafka and other sources, • Writing data processing routines with languages such as python, • Collaborate with data source Subject Matter Experts (SME) to discover and understand the data, • Model and transform data using SQL and DBT, • Collaborate with colleagues in peer code reviews and pair programming sessions, • Creating example dashboards using visualisation/BI tools to enable customers to enhance and self-serve further visualisations, • Support and enable Data Science team(s), • Review and resolve data pipeline failures and data test failures, • Optimise and improve data pipelines, • Utilise Snowflake best practices and features to optimise credit usage and performance, • Work with Data Consumers to optimise queries and improve consumption of data Technical skills • A background in SQL and principles of data warehousing, • Snowflake design and engineering experience or certification in Snowpro Core, • Experience in data modelling and ELT, • Analytical and Structured approach to work, • A team player able to perform peer code reviews and provide constructive mentoring, • 5 years’ experience within Data & Analytics and DBT, • Desirable, • Experience of ETL design and dev, including Test-Driven development, • Deep understanding of relational as well as NoSQL data stores, methods and approaches (star and snowflake, dimensional modelling), • Experience of programming languages including Object-Oriented language (.Net. Java, C, Python), • GIT experience, • Good knowledge of DevOps / DataOps principles with working knowledge of Docker and Linux, • Hands on experience with DBT, • Expertise in Snowflake advanced concepts like setting up resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, • Expertise in deploying Snowflake features such as data sharing, • Experience with data security and data access controls and design, • Experience with AWS or Azure data storage and management technologies such as S3 and ADLS, • A track record of achievement and recognition within the IT industry as evidenced by significant promotion since leaving University, • A strong academic track record including the achievement of a good honours degree or equivalent, • Certification in Snowpro Advanced Architect or Snowpro Advanced Data Engineer

About Quantiphi Quantiphi is an award-winning, AI-First digital engineering and consulting company focused on delivering high-impact Services and Solutions that help organizations solve what truly matters. We partner with enterprises to reimagine their businesses through intelligent, scalable, and transformative AI driving measurable outcomes at the very core of their operations. Since our founding in 2013, Quantiphi has tackled some of the world’s most complex business challenges by combining deep industry expertise, disciplined cloud and data engineering practices, and cutting-edge applied AI research. Our work is rooted in delivering accelerated, quantifiable business value, not just technology for technology’s sake. Headquartered in Boston, Quantiphi is a global organization with 4,000+ professionals serving clients across key industry verticals, including BFSI, Healthcare & Life Sciences, CPG, MFG, TME etc. As an Elite and Premier partner to leading cloud and AI platforms such as NVIDIA, Google Cloud, AWS, and Snowflake, we build and deliver enterprise-grade AI services and solutions that create real-world impact. We’ve been recognized with • 17x Google Cloud Partner of the Year awards in the last 8 years., • 3x AWS AI/ML award wins., • 3x NVIDIA Partner of the Year titles., • 2x Snowflake Partner of the Year awards., • We have also garnered top analyst recognitions from Gartner, ISG, and Everest Group., • We offer first-in-class industry solutions across Healthcare, Financial Services, Consumer Goods, Manufacturing, and more, powered by cutting-edge Generative AI and Agentic AI accelerators., • We have been certified as a Great Place to Work for the third year in a row- 2021, 2022, 2023. Be part of a trailblazing team that’s shaping the future of AI, ML, and cloud innovation. Your next big opportunity starts here! For more details, visit:______ or___. Role: Cloud Data Architect Experience Level: 8-10+ years Work Location: United Kingdom (Remote) Job Overview: We are seeking a highly skilled AWS Data Migration & Data Engineering Consultant to lead end-to-end data migration initiatives across on-prem, cloud, and multi-cloud environments into AWS. This role focuses on defining and executing data migration strategies, including assessment, wave planning, migration execution, and post-migration stabilization, while ensuring data integrity, minimal downtime, and alignment with business SLAs. The ideal candidate brings strong experience in cross-platform database migrations (Oracle, SQL Server, MySQL, or cloud-native systems) combined with deep expertise in AWS data engineering services and modern data pipeline development. Key Responsibilities: • Lead end to end database migrations to AWS from diverse sources, including on-premises systems (e.g., Oracle, SQL Server, MySQL) and other cloud platforms (e.g., GCP, Azure)., • Lead end-to-end data migration strategy and execution, including assessment, dependency mapping, and wave planning, • Design and implement migration frameworks using AWS DMS, SCT, Glue, and Redshift, • Define and execute data validation, reconciliation, and cutover strategies ensuring zero/low data loss, • Enable CDC-based replication and minimal downtime migrations across heterogeneous systems, • Design and optimize ETL/data pipelines using AWS Glue, PySpark, or EMR, • Architect and implement scalable, secure, and highly available data platforms on AWS, • Drive schema conversion and modernization strategies (heterogeneous migrations where applicable), • Optimize performance of source and target systems pre- and post-migration, • Manage and govern S3-based data lakes and metadata using Glue Data Catalog, • Collaborate with application, infrastructure, and analytics teams for seamless migration and stabilization, • Implement monitoring, rollback, and failure recovery mechanisms, • Ensure adherence to security, governance, and compliance standards Required Skills: • 8+ years of experience in database migration and data engineering, • Proven experience in cross-platform data migrations (on-prem to cloud or cloud to cloud), • Strong hands-on expertise with: AWS DMS (Database Migration Service), AWS SCT (Schema Conversion Tool), AWS Glue (ETL & data integration), Amazon Redshift (data warehousing), • Experience designing and implementing data validation and reconciliation frameworks, • Strong experience in ETL/data pipeline development (Glue, PySpark, EMR, or equivalent), • Deep proficiency in SQL and data modeling concepts, • Experience working with S3-based data lakes and Glue Data Catalog, • Strong understanding of CDC, transaction consistency, and migration cutover strategies, • Hands-on experience with performance tuning, schema design, and query optimization, • Proficiency in Python/PySpark and scripting (Shell/Python), • Experience with Oracle, SQL Server, MySQL, PostgreSQL, or cloud-native databases Nice to Have: • Exposure to real-time replication tools (e.g., GoldenGate or equivalent), • Database Administration (DBA) expertise, including backup & recovery strategies, HA/DR design, database patching and upgrades, lifecycle management, capacity planning, performance monitoring, and security hardening., • Experience with Lake Formation and data governance frameworks, • Familiarity with Data Mesh and cross-account data sharing architectures, • Experience with CI/CD for data pipelines (CodePipeline, Jenkins, etc.), • Knowledge of Infrastructure as Code (Terraform / CloudFormation), • AWS Certifications (Solutions Architect / Data Engineer), • Experience in mentoring teams and leading large-scale migration programs. What’s in it for YOU at Quantiphi: • Make an impact at one of the world’s fastest-growing AI-first digital engineering companies., • Upskill and discover your potential as you solve complex challenges in cutting-edge areas of technology alongside passionate, talented colleagues., • Work where innovation happens - work with disruptive innovators in a research-focused organization with 60+ patents filed across various disciplines., • Stay ahead of the curve—immerse yourself in breakthrough AI, ML, data, and cloud technologies and gain exposure working with Fortune 500 companies.

Data Engineers — Contract Multiple roles · Mid-level & Senior · Hybrid (UK) 📌 Rate: £450–£600 per day (Inside IR35, dependent on experience) 📌 Duration: 6-month SOW initially; longer-term programme (2–3 years overall) 📌 Location: Remote (UK-based) — occasional travel to the Midlands (up to 2 days/month) 📌 Clearance: SC eligible required (UK residency) Hanover are building two data engineering teams to support a large-scale, long-running programme within Central Government. This role centres around designing and building data pipelines in a modern cloud environment, embedded within multi-disciplinary Agile teams. There are both mid-level, senior and lead positions available, so we're open to a range of experience levels. What you'll be doing – Designing, building and maintaining scalable ETL/ELT data pipelines – Working with structured data sources to support analytics and downstream services – Collaborating within Agile delivery teams alongside engineers of mixed seniority – Improving data quality, performance and reliability – Contributing to knowledge sharing and good engineering practice across teams What we're looking for – Strong background as a Data Engineer in complex, delivery-led environments – Solid ETL/ELT experience — Talend is highly desirable – Experience with one or more of: AWS, Oracle, PL/SQL, PostgreSQL – Strong SQL and data modelling fundamentals – Comfortable working in Agile teams with real delivery pressure Nice to have – Central or wider public sector experience – Exposure to large-scale or regulated data environments

Lead SAS Developer - Government Programme £800 per day | Hybrid (2-3 days onsite in Newcastle) | SC Clearance Required Sanderson Government & Defence is proud to be supporting a key government client in the search for a highly experienced Lead SAS Developer to join a major transformation programme within a central UK public sector organisation. The Opportunity As a Lead SAS Developer, you will take ownership of designing and delivering complex data integration and software solutions within a large-scale, multi-team environment. Acting as a subject matter expert, you will lead from the front-guiding technical decisions, mentoring engineers, and ensuring best practice across the development lifecycle. Key Responsibilities Design, develop, and enhance SAS-based software solutions across enterprise systems Lead the implementation of robust ETL pipelines and data integration processes Collaborate with cross-functional teams to ensure seamless system integration Take ownership of technical decision-making and contribute to programme-wide strategy Conduct testing, debugging, and optimisation to maintain high-quality deliverables Mentor junior team members and foster a culture of continuous improvement Stay current with emerging technologies and industry best practices Skills & Experience Required Advanced expertise in SAS Data Integration Studio Strong experience in custom application development and software engineering principles Proven capability with SAS DataFlux ETL tools Experience with SAS Event Stream Processing (highly desirable) Demonstrated leadership experience within complex delivery environments Strong stakeholder engagement and communication skills Essential Requirements Active SC (Security Clearance) , or eligibility to obtain clearance Ability to work onsite in Newcastle 2-3 days per week Why Apply? Competitive day rate of £800 per day Opportunity to contribute to a high-impact government transformation programme Work within a collaborative, forward-thinking engineering environment Long-term contract potential within a secure and stable sector If you are a seasoned SAS professional ready to take on a leadership role within a high-profile government programme, we would love to hear from you. Apply now or contact Sanderson Government & Defence for more information. Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built, and we welcome applications from people of all backgrounds and perspectives. Our success is driven by our people, united by the spirit of partnership to deliver the best resourcing solutions for our clients. If you need any help or adjustments during the recruitment process for any reason , please let us know when you apply or talk to the recruiters directly so we can support you.

What You’ll Be DoingLead and mentor a team of Data Engineers in an Agile delivery environmentOwn technical planning, roadmap alignment, sprint execution, and delivery trackingBuild and maintain scalable ETL/ELT pipel

A government contracting firm is seeking a Lead SAS Developer in Newcastle upon Tyne for a high-impact transformation programme.

Konnecto Tech Stack & Data Pipelines – experience with MongoDB, Snowflake, clickdata streams, S3 ingestion and Airflow ETL.

A leading media agency in Greater London is seeking an experienced ETL Engineer to enhance their FlightDeck infrastructure. Ideal candidates have at least 3 years of experience in ETL and SQL Server management.

This role involves designing and delivering Power BI dashboards, building reliable ETL pipelines using SSIS, and ensuring data quality.

The role involves using SQL to perform the full Extract, Transform, Validate, and Import (ETL) processes, ensuring smooth data transitions.

You will collaborate in an agile team, designing high-performance data solutions, developing robust ETL services, and leveraging AI tools to enhance workflows.

Responsibilities include processing and exploiting Publicly Available and Commercially Available Information, building scalable ETL pipelines, and ensuring compliance with regulatory requirements.

The ideal candidate will have strong experience with Safe FME and FME Flow for ETL pipelines, as well as proficiency in geospatial web mapping tools like ArcGIS and QGIS.

Responsibilities include building and maintaining Data Lakes and Data Warehouses on Amazon Redshift, developing Power BI datasets, and optimising ELT/ETL pipelines.

The successful candidate will execute the ETL process while managing technical transitions and troubleshooting data issues.

Ideal candidates will have expertise in SQL, Python, and data visualization tools such as Tableau or Quicksight, along with experience building ETL pipelines.

Data Analyst to design and build interactive Power BI dashboards, develop data models, and deliver ETL processes.

This role supports healthcare data migration and archiving projects, providing a great opportunity for early career professionals to build experience in data migration, ETL, SQL, and healthcare technology.

Candidates should possess a degree in a related field and experience in SQL, REST APIs, JavaScript, and ETL.

In this role, you will design, build, and maintain ETL and ELT pipelines, ensuring data quality and performance.

Identify process gaps and recommend improvements to optimize ETL operations and data quality Communicate effectively with stakeholders to report progress challenges and solutions related to ETL projects. Ensure adherence to data governance quality standards and compliance throughout the ETL lifecycl

We are looking for an ETL Engineer with a strong analytics engineering focus to work within our FlightDeck infrastructure, ensuring data is arriving reliably, well‑modelled, and analysis‑ready for planners, strategists and clients. You will be responsible for maintaining and configuring data pip

Mitie Cleaning & Hygiene Services is seeking a Data Engineer to design and develop ETL/ELT pipelines in a hybrid work environment.

Your responsibilities include establishing data integrations, conducting ETL activities, and collaborating with SMEs to validate data models.

Wonderfield Group in Greater London is seeking a Junior Data Engineer.In this role, you'll support the design and maintenance of data pipelines, aiding data-driven decision-making across their operations.Ideal candidates are detail-oriented, proactive, and eager to learn in a hybrid working environm

Key responsibilities include designing automated tests for ETL processes, data validation, and supporting cloud solutions like AWS and Azure.

Mercor is seeking a Data Engineering Expert to build and develop ETL/ELT pipelines, dbt models, and Airflow/Dagster DAGs.

This role requires creating ETL pipelines and working in an Agile environment.

A digital transformation specialist in Greater London is looking for an Informatica Senior Data Engineer.The role requires strong expertise in Informatica and a background in data engineering, particularly within Azure environments.The position offers a rate of £400‑£475 per day and requires SC

Gravitas Recruitment Group (Global) Ltd is seeking a Data Engineer for a crucial technology transformation project with a Lancashire-based Social Housing provider.The successful candidate will bridge the gap between complex code and business strategy, utilizing core technical skills in SQL, Python,

A tech consulting firm in the UK is seeking an experienced Senior Data Engineer with a focus on ETL design and development. Responsibilities include designing scalable ETL processes, performing data quality validation, and mentoring junior team members.

We are looking for an ETL Engineer with a strong analytics engineering focus to work within our FlightDeck infrastructure, ensuring data is arriving reliably, well‑modelled, and analysis‑ready for planners, strategists and clients. You will be responsible for maintaining and configuring data pip

Data Engineer Python ETL SaaS (PR/100686) London, England. Data Engineer (Python ETL AWS SaaS) Remote UK to £95k. You have experience of building ETL data pipelines.

Football Radar in Greater London is seeking a Data Engineer to support its innovative data science efforts.You'll take ownership of data pipelines, ensuring that data is accurate and accessible.Responsibilities include automating data updates, building datasets, and deploying models to the cloud.Ide

Perch Group is hiring a Data Engineer to provide technical solutions and lead ETL/ELT processes using Azure Data Factory.

This role involves owning and evolving ETL pipelines while focusing on building scalable data assets.

Responsibilities include building ETL/ELT pipelines, developing workflows, and collaborating with teams for effective system integration.

The successful candidate should have strong MS SQL and ETL skills, and will work in a hybrid model, enjoying perks like a company bonus scheme, staff discounts, extensive holiday allowances, and access to training and development.

This role involves designing, building, and maintaining ETL pipelines while supporting data migration from legacy systems to cloud environments.

The successful candidate will design, build, and maintain scalable data pipelines and manage ETL processes across Azure data platforms.