Orchestration jobs in Newcastle Upon TyneCreate job alerts

Data Engineer – FinTech – Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle and are looking for a talented Data Engineer to join their team. This role will focus on building and optimising systems that make complex datasets accessible, reliable, and valuable for the business. As a Data Engineer, you will take responsibility for the development of high-quality pipelines that process and manage large volumes of data from a range of external and internal sources. You’ll play a key role in enhancing and maintaining their central data platform, ensuring the smooth delivery of information that supports investment decision-making. Working closely with stakeholders across the business, you’ll help shape how data is accessed, tested, and leveraged to maximise value. The successful candidate will bring: • 3–6 years of relevant experience working as a Data Engineer (or in a closely related role)., • A 2:1 or above in Computer Science (or related field), ideally from a Russell Group university., • Direct experience in the hedge fund sector (essential)., • Strong ability to design and build data pipelines that integrate multiple data sources., • Proficiency in SQL and Python, with solid exposure to AWS or other cloud-based data tools., • Familiarity with version control systems such as Git and workflow/orchestration tools such as Airflow., • Proven ability to test and troubleshoot data systems, with a track record of improving reliability and accuracy., • Excellent communication skills, with the ability to collaborate effectively in a team environment., • A detail-oriented, proactive mindset, with a willingness to learn and apply new technologies. This is an exciting opportunity to join a forward-thinking organisation where data is at the core of their success. You’ll be part of a collaborative environment where your work will directly support world-class FinTech solutions. Location: Newcastle, UK (Fully Office Based) Salary: £45,000 - £80,000 + Bonus + Benefits Applicants must be based in the UK and have the right to work in the UK. Noir continues to be the leading Microsoft recruitment agency; we can help you make the right career decisions! NOIRUKTECHREC NOIRUKREC

DevOps Engineer – Defence & Security Newcastle Requires SC Clearance or Eligible for SC Clearance The Opportunity Join a high-performing engineering team delivering secure, scalable infrastructure and platforms for mission-critical Defence & Security programmes. This role is ideal for DevOps engineers who thrive in complex environments and want to work with modern cloud, automation, and container technologies. What You’ll Do • Build, automate, and maintain CI/CD pipelines, • Develop infrastructure using Infrastructure as Code (Terraform, Ansible, Packer), • Manage containerised applications using Docker and Kubernetes, • Implement monitoring, logging, and observability solutions (ELK, Grafana), • Support cloud environments across AWS, Azure, or GCP, • Ensure secure, reliable deployments with strong DevSecOps practices, • Work across Windows & Linux environments, including virtualisation (VMware), • Manage artefacts, code quality, and release processes What You’ll Need • Experience with scripting or development (Python, PowerShell, C#, Java, or C++), • Strong CI/CD experience (Jenkins, GitHub Actions, TeamCity or similar), • Knowledge of containerisation and orchestration tools, • Experience with cloud platforms (AWS, Azure, or GCP), • Understanding of monitoring, logging, and system performance, • Familiarity with databases (e.g. SQL Server) and job scheduling tools, • Experience with Atlassian tools (e.g. Jira, Confluence) Bonus Skills • Experience with Artifactory, SonarQube, • VMware (vSphere), SAN environments, • Security best practices (secrets management, vulnerability scanning) Security Requirement SC clearance (or willingness/eligibility to obtain) is required.

Front End Developer – FinTech – Newcastle (Tech stack: Front End Developer, React, TypeScript, Websockets, SignalR, Containers, Orchestration, UX, Usability, Programmer, Developer, Architect, Front End Developer) Our client is a cutting-edge FinTech company with a reputation for innovation and excellence. They design and build advanced trading and analytics platforms used globally by some of the world’s leading financial institutions. With ambitious plans for growth and new product launches, they are now seeking a talented Front End Developer to join their team in Newcastle. As a Front End Developer, you will take ownership of building intuitive, performant, and scalable user interfaces. You will work closely with developers across the stack, as well as directly with end-users, to shape requirements and deliver best-in-class digital experiences. This is an opportunity to work in a highly collaborative, innovation-driven environment where your ideas and expertise will directly shape the future of their products. The successful candidate will bring: • A 2:1 or higher degree in Computer Science (essential)., • Strong recent experience with modern front-end frameworks, particularly React, alongside TypeScript., • Background working with real-time communication tools such as Websockets or SignalR., • Familiarity with containerisation and orchestration platforms., • A genuine enthusiasm for creating clean, usable, and engaging interfaces., • The confidence to collaborate across different teams and engage directly with users to refine solutions., • A proactive, problem-solving mindset with a drive for innovation and ownership., • Curiosity to understand the wider business domain and translate this knowledge into technical solutions. Prior exposure to financial services will be viewed positively but is not essential. This is a fantastic opportunity to join a forward-thinking company where you will be empowered to innovate, solve challenging problems, and build products that make a real impact. Location: Newcastle, UK (Fully Office Based) Salary: £45,000 - £80,000 + Bonus + Benefits Applicants must be based in the UK and have the right to work in the UK. Noir continues to be the leading Microsoft recruitment agency; we can help you make the right career decisions! NOIRUKTECHREC NOIRUKREC

DevOps Engineer - FinTech - Newcastle (Tech stack: DevOps Engineer, PowerShell, C#, Java, Python, Ansible, Terraform, Docker, Kubernetes, Docker Swarm, ELK, Grafana, CI/CD, TeamCity, SQL Server, Windows, Linux, Programmer, Developer, Architect, DevOps Engineer) Our client is a cutting-edge FinTech company with a reputation for innovation and excellence. They design and build advanced trading and analytics platforms used globally by some of the world's leading financial institutions. With ambitious plans for growth and new product launches, they are now seeking a talented DevOps Engineer to join their team in Newcastle. As a DevOps Engineer, you will be responsible for creating, maintaining, and optimising the infrastructure and pipelines that support highly complex financial software platforms. You'll work closely with developers and stakeholders, ensuring deployments are seamless, environments are robust, and systems are both secure and scalable. This is a fantastic opportunity to apply your technical expertise in a collaborative, fast-paced environment where innovation is actively encouraged. The successful candidate will bring: • A 2:1 degree or above in Computer Science (or related), ideally from a top university., • Strong ability in scripting with PowerShell or a similar language., • Hands-on coding skills in at least one of C#, Java, or Python., • Practical knowledge of automation tools such as Terraform or Ansible., • Background in container platforms (e.g., Docker) with orchestration using Kubernetes or Swarm., • Familiarity with system monitoring solutions (e.g., ELK, Grafana, or similar)., • Proven track record in building and maintaining CI/CD pipelines, preferably with TeamCity., • Experience working with SQL databases, particularly Microsoft SQL Server., • Comfort managing both Windows and Linux environments., • The ability to communicate clearly with colleagues and clients to resolve challenges and deliver solutions. Desirable (but not essential): • Working knowledge of Atlassian products such as JIRA or Bitbucket., • Exposure to artifact management tools like Artifactory., • Deployment automation experience with Octopus Deploy., • Awareness of code quality and analysis tools (e.g., SonarQube)., • Background with job scheduling platforms such as Control-M., • Experience with major cloud providers (Azure, AWS, GCP)., • Familiarity with VMware (vSphere) and storage area networks. Previous experience in financial services would be advantageous, though not a requirement. This is an exceptional opportunity to join a forward-thinking organisation where your contributions will directly shape the delivery of world-class FinTech products. Location: Newcastle, UK (Fully Office Based) Salary: £50,000 - £90,000 + Bonus + Benefits Applicants must be based in the UK and have the right to work in the UK. Noir continues to be the leading Microsoft recruitment agency; we can help you make the right career decisions! NOIRUKTECHREC NOIRUKREC

Tech stack: Front End Developer, React, TypeScript, Websockets, SignalR, Containers, Orchestration, UX, Usability, Programmer, Developer, Architect, Front End Developer). Front End Developer - FinTech - Newcastle. With ambitious plans for growth and new product launches, they are now seeking a talen

Python Software Developer (SC Cleared)Location: Manchester, Leeds, Newcastle, Birmingham, London Contract :6 MonthsSecurity RequirementActive SC Clearance requiredOverviewWe are seeking experienced Python Software Developers to support the delivery of large-scale analytics and data-driven solutions within a secure enterprise environment. The successful candidates will work on cloud-based platforms, data processing pipelines, and secure integrations while collaborating with cross-functional engineering and platform teams.This role is ideal for professionals with strong Python development expertise, cloud engineering experience, and exposure to modern DevOps and data engineering practices.Must Have:AWS services; Terraform; Apache Spark; Python; Apache Airflow; Docker; GitLab; Security scanning agent; Jupyter; Notebooks; Key Responsibilities • Design, develop, and maintain scalable Python applications and services, • Build and optimize cloud-native data processing pipelines, • Develop and manage workflows using orchestration tools such as Airflow, • Work with large-scale data processing frameworks including Apache Spark, • Deploy and maintain containerized applications using Docker, • Implement infrastructure automation using Terraform, • Integrate solutions with enterprise data and secure file transfer systems, • Collaborate with DevOps, security, and infrastructure teams to ensure secure and reliable deployments, • Contribute to CI/CD pipelines and source control management using GitLab, • Support vulnerability management and security scanning processes, • Create technical documentation and provide knowledge-sharing support where required, • Participate in Agile ceremonies and collaborative engineering activitiesRequired Skills & Experience, • Strong hands-on experience with Python development, • Experience working with AWS cloud services, • Proven experience with Terraform and Infrastructure as Code (IaC), • Strong knowledge of Apache Spark, • Experience with Apache Airflow or similar orchestration tools, • Hands-on experience with Docker and containerized environments, • Experience using GitLab for version control and CI/CD pipelines, • Understanding of security scanning and vulnerability management tools such as Trivy, Trend Micro, Wiz, or similar, • Experience working with Jupyter Notebooks, • Familiarity with secure enterprise integrations and data transfer solutions, • Strong problem-solving and debugging skills, • Excellent communication and stakeholder collaboration skillsPreferred Experience, • Experience working within secure or regulated environments, • Exposure to large-scale analytics or data platform projects, • Previous experience in public sector or enterprise-scale environments, • Understanding of cloud security best practicesWorking ArrangementHybrid working modelApproximately 60% onsite presence required in NewcastleRemaining days remote, depending on project requirementsClearance RequirementCandidates must hold active SC Clearance or be eligible to obtain clearance.

📍 Remote 💷 £400/day Outside IR35 ⏳ 3+ Month Contract Currently supporting a B2B healthcare SaaS company who are looking for a strong AI-focused .NET Engineer to support a major migration from Azure OpenAI “On Your Data” into a custom RAG orchestration layer. You’ll be working directly with the CTO on production AI systems used by thousands of end users, with a strong focus on performance, grounded responses and AI safety. Key experience: • C# / .NET Core, • Azure OpenAI, • Azure AI Search, • RAG pipelines, • Azure DevOps / CI/CD, • Production AI systems, • Cloud-native / microservices environments Interesting role for someone who enjoys solving real engineering problems around AI at production scale. If you're interested, please apply!

Senior Data Engineer Location: 100% Remote (UK-based) Employment Type: Permanent Salary: Up to £75,000 Positions Available: 2 The Opportunity We’re looking for two experienced Senior Data Engineers to join a growing data platform team delivering modern cloud-native data solutions at scale. This role is ideal for self-starters who enjoy autonomy, ownership, and solving complex engineering challenges within a highly collaborative environment. The core technology stack is Databricks on AWS, and candidates must have strong hands-on experience specifically with Databricks deployed in AWS environments. Experience with Databricks on other cloud platforms alone will not be sufficient, as the implementation approach and tooling differ significantly. You’ll play a key role in designing and building scalable, governed, and high-performing data solutions across the full data engineering lifecycle. Key Responsibilities • Design and develop scalable ETL/ELT pipelines using Databricks, Python, SQL, and Spark, • Build and optimise Delta Lake architectures and data pipelines on AWS, • Implement ingestion frameworks using Databricks Autoloader, • Develop transformation workflows using Lakeflow / Delta Live Tables, • Work with Data Asset Bundles for deployment and environment management, • Support CI/CD and infrastructure automation across the data platform, • Ensure data quality, governance, lineage, and observability best practices, • Optimise cluster performance, orchestration, and cost efficiency, • Collaborate with architects, analysts, and wider engineering teams, • Contribute to platform standards, reusable frameworks, and engineering best practices Essential Skills & Experience • Strong commercial experience as a Senior Data Engineer, • Proven expertise with Databricks on AWS (essential), • Strong understanding of Spark, Delta Lake, and Lakehouse architecture, • Hands-on experience with Databricks Autoloader and Lakeflow / DLT, • Experience using Data Asset Bundles within Databricks environments, • Strong AWS experience across modern cloud-native data platforms, • Good understanding of the full data engineering lifecycle, • Experience building scalable, maintainable, and production-grade data solutions, • Strong communication and stakeholder engagement skills, • Comfortable working independently with high levels of ownership and autonomy Nice to Have • CI/CD and Infrastructure as Code experience, • Experience with governance and metadata tooling, • Exposure to data observability and monitoring frameworks, • Previous experience working in fast-paced agile delivery environments This is an excellent opportunity to join a modern engineering environment where you’ll have genuine influence over platform direction, architecture, and engineering standards.

Test Engineer (Data & Automation) Overview We are seeking an experienced Test Engineer to support the delivery of high-quality data and application solutions. This role focuses on automation, data validation, and production analysis within a modern cloud-based environment. You will play a key role in ensuring system reliability, improving testing frameworks, and driving best practices across engineering teams. This is a collaborative position requiring strong technical expertise, analytical thinking, and the ability to mentor others while working across complex data platforms. Key Responsibilities Design, develop, and maintain automated test frameworks to improve testing efficiency and coverage Analyse and interpret test results, identifying risks, issues, and areas for improvement Produce clear reports on testing activities, outcomes, and associated risks Automate data validation and application testing processes across distributed systems Investigate production issues using data analysis to identify root causes Work with orchestration tools (e.g., Apache Airflow) to monitor workflows and troubleshoot failures Validate data using tools such as Jupyter Notebooks and Amazon Athena Analyse data across multiple formats to ensure integrity and correctness of new functionality Support CI/CD practices using Git-based workflows and pipeline automation Participate in infrastructure and deployment activities, including containerisation and In...

Software Developer Permanent | Hybrid (willing to travel to Newcastle) | Python | Apache | Data | SC cleared Hybrid work arrangement. Office attendance is up to 60%. Location is flexible: London, Leeds, Newcastle, Sheffield, Blackpool, Manchester and Birmingham. You must be willing to travel to Newcastle when required. The Role: We are looking for Software Developers with strong Python and data processing with Apache Spark responsible to lead the design, development, and operation of data‑driven applications and pipelines in a collaborative Dev and DevOps environment. The role focuses on writing and improving application code while working closely with DevOps engineers to support automated deployments, infrastructure management, system monitoring, reliability, and scaling. The post holder collaborates with Product Owners, Business Analysts, and users to translate business needs into robust technical solutions, operates and improves production services, analyses data and system issues to identify root causes, and champions engineering best practices. They also provide technical leadership through coaching and mentoring junior colleagues and contributing to continuous improvement across development, delivery, and operational processes. Responsibilities: Engineers will contribute to research, development and delivery across: æ Design, build, and operation of data ingest and publishing pipelines æ Workflow orchestration and task scheduling using managed services æ Collaboration with Product Owners, Business Analysts, and users to shape technical solutions æ Production support, monitoring, and continuous improvement of system resilience, stability, and performance æ Data analysis and investigation to identify root causes of defects and operational issues æ DevOps collaboration, including supporting automated deployments, infrastructure management, monitoring, and scaling æ Coaching and mentoring junior engineers and promoting engineering best practices Skills & Experience: æ Understanding of data processing using Apache Spark æ Use of Python, SQL, and familiarity with PySpark æ Experience using Apache Airflow for task orchestration æ Understanding of EMR and reviewing output logs æ Use of Jupyter notebooks and/or Amazon Athena to query and validate data æ Data analysis to identify root cause of issues æ Understanding of dimensional data models and slowly changing dimensions/historic data capture æ Use of AWS console and services such as, but not limited to; CloudWatch, IAM, S3, Glue, ECR, EC2, EMR, Dynamo DB, LakeFormation æ Familiarity with Amazon Textract and Comprehend æ Understanding of both server-side and client-side encryption æ Use of GitLab for source code management pipelines for CI/CD æ Use of GitLab Tags for component versioning in shared repositories æ Understanding of Docker and containerization of solutions æ IaC using Terraform æ Experience of understanding how customer expectations transition to applied functionality æ Familiarity with, and implementation of Engineering best practices æ Use of gitlab for release tagging and deployments æ Familiarity with basic data structures for constructing a solution æ Active BPSS, SC clearance or eligible for clearance Desirable skills: æ Experience supporting AI or data driven platforms æ Knowledge of cyber security or fraud prevention domains æ Experience working within government or critical national infrastructure environments Find out more: or check out our LinkedIn page

Job Description Role: DevOps Engineer Location: Manchester, Leeds, Newcastle, Birmingham. (60% per week to onsite on either location) Clearance: Active SC Clearance required Work Type: Contract (3-6 Months) Overview We are seeking experienced DevOps Engineers to join a high-profile programmed within a secure government environment. This role focuses on building, automating, and maintaining scalable cloud infrastructure while supporting data-driven platforms and integrations. Key Responsibilities Design, build, and maintain cloud-based infrastructure using AWS Develop and manage Infrastructure as Code using Terraform Support and optimise data processing pipelines using Apache Spark and Airflow Collaborate with cross-functional teams to deliver secure and scalable solutions Implement CI/CD pipelines using GitLab Containerise applications and services using Docker Conduct and implement security scanning and vulnerability management Work with Jupyter Notebooks for data exploration and developmentKey Skills & Experience Strong experience with AWS services Expertise in Terraform (Infrastructure as Code) Hands-on experience with: Apache Spark Python Apache Airflow Docker GitLab CI/CD Experience with security scanning tools such as: Trivy Trend Micro Wiz (or similar) Knowledge of data engineering and pipeline orchestration Familiarity with Jupyter Notebooks Experience working in secure/public sector environmentsWorking Arrangement Manchester, Leeds, Newcastle, Birmingham. (60% per week to onsite on either location) Occasional travel to Newcastle required for team workshops, planning, and collaboration sessions

Test Engineer – SC cleared Permanent | Hybrid | AWS | Terraform | SC Cleared We are seeking an SC cleared Test Engineer will support a large public sector organisation in the delivery and operation of a secure, analytics platform. The platform brings together human interaction, claim processing and support events across multiple channels, including telephony, face to face and digital services. Data is extracted from multiple sources, transformed into a trusted format, and loaded into a central analytics asset used by data and insight teams. This role focuses on ensuring the quality, reliability and robustness of complex data pipelines and services. You will provide technical leadership in testing and automation, while supporting system stability and mentoring other team members. Responsibilities: • Plan and lead testing activities across sets of related user stories, • Design, implement and maintain automated test frameworks for data pipelines and applications, • Identify and escalate risks and quality issues identified through automated testing, • Analyse and report on test activity, results, issues and risks, • Support live services through production data analysis and root cause investigation, • Operate and support ingest and publishing pipelines and services, identifying opportunities to improve resilience and stability, • Work closely with Product Owners, Business Analysts, developers and data users to understand requirements, • Take ownership of understanding the end to end system and support knowledge sharing, • Coach and mentor junior engineers and testers in testing best practice, • Ensure delivered functionality meets user and customer expectationSkills & Experience:, • Active SC clearance, • Strong experience as a Senior Test Engineer working on data intensive or platform-based systems, • Proven ability to design, implement and maintain automated testing for data pipelines and applications, • Strong coding skills in Python and SQL, with working knowledge of Java and scripting languages such as Bash, • Experience analysing and validating complex datasets in multiple formats, • Solid understanding of CI/CD pipelines, source control and integrating automated testing into delivery workflows, • Experience working with cloud-based data platforms and services, including orchestration, monitoring and logging, • Working knowledge of data processing and analytics tools, including notebook-based analysis and query services, • Understanding of infrastructure as code, containerised solutions and secure data handling, including encryption concepts, • Basic understanding of dimensional data models, historical data capture and data lifecycle management, • Ability to identify, assess and communicate technical and delivery risks clearly, • Experience supporting live production systems and contributing to stability and resilience improvements, • Proven experience mentoring and supporting team members in testing best practice Desirable skills: • Experience supporting large scale, secure public sector platforms, • Experience operating and supporting live production data services, • Understanding of user journeys and translating expectations into testable outcomes About Peregrine We build workforces that deliver tech and change programmes at leading UK organisations. By combining data science from Peregrine Intelligence, our industry-accredited Peregrine Academy, and market-leading attraction and diversity initiatives, we bridge capability gaps at all levels in public and private sector organisations. We work closely with our clients to understand their challenges and deliver flexible, long-term solutions that make a real difference. When you join Peregrine, you become part of a team that’s focused on growth, both yours, our clients’, and the sectors we support. You’ll also get access to a full range of benefits alongside your salary. How Specialist Talent Works As a permanent employee at Peregrine, you’ll be part of our Specialist Talent team. That means you’ll work on-site or remotely with our clients, supporting them on complex, high-impact projects in Data, Digital and Business Transformation. You’ll get the variety and challenge of consultancy work, with the stability and support of a permanent role. You’re not a contractor - you’re a valued member of our team, with access to all the same benefits, learning opportunities, and community. Find out more: peregrine.global or check out our LinkedIn page: peregrine-resourcing

Software Developer - SC cleared Permanent | Hybrid (willing to travel to Newcastle) | Python | AI | SC and BPSS We are looking for Software Developers with strong Python and AI experience responsible to lead the design, development, and operation of data‑driven applications and pipelines in a collaborative Dev and DevOps environment. The role focuses on writing and improving application code while working closely with DevOps engineers to support automated deployments, infrastructure management, system monitoring, reliability, and scaling. The post holder collaborates with Product Owners, Business Analysts, and users to translate business needs into robust technical solutions, operates and improves production services, analyses data and system issues to identify root causes, and champions engineering best practices. They also provide technical leadership through coaching and mentoring junior colleagues and contributing to continuous improvement across development, delivery, and operational processes. Responsibilities: Engineers will contribute to research, development and delivery across: Design, build, and operation of data ingest and publishing pipelines Workflow orchestration and task scheduling using managed services Collaboration with Product Owners, Business Analysts, and users to shape technical solutions Production support, monitoring, and continuous improvement of system resilience, stability, and performance Data analysis and investigation to identify root causes of defects and operational issues DevOps collaboration, including supporting automated deployments, infrastructure management, monitoring, and scaling Coaching and mentoring junior engineers and promoting engineering best practices Skills & Experience: Strong experience with Python and SQL Experience with distributed data processing and analytics platforms Experience applying AI or machine learning in practical solutions Focus on automation and system integration Workflow orchestration experience (e.g. pipeline or job scheduling frameworks) Comfortable working in early stage, fast evolving environments (Alpha project experience) AWS Services Active BPSS, SC clearance or eligible for clearance Desirable skills: Experience supporting AI or data driven platforms Knowledge of cyber security or fraud prevention domains Experience working within government or critical national infrastructure environments About Peregrine We build workforces that deliver tech and change programmes at leading UK organisations. By combining data science from Peregrine Intelligence, our industry-accredited Peregrine Academy, and market-leading attraction and diversity initiatives, we bridge capability gaps at all levels in public and private sector organisations. We work closely with our clients to understand their challenges and deliver flexible, long-term solutions that make a real difference. When you join Peregrine, you become part of a team that’s focused on growth, both yours, our clients’, and the sectors we support. You’ll also get access to a full range of benefits alongside your salary. Find out more: peregrine.global or check out our LinkedIn page: peregrine-resourcing

What is Citizen Event Analytics? Citizen Event Analytics (CEA) is a cross-benefit, cross-channel event history compiled from citizens' interaction, (telephony, face to face and digital), claim processing and support events. CEA uses a pipeline that: Extracts event data from different sources Transforms the data into a usable and trusted resource Loads that data into the data asset that is accessible to Data users through the Uplifted Analytical Service (UAS). Support DWP in the maintenance of the longitudinal event history data asset and associated data pipelines that forms Citizen Event Analytics. As directed by DWP, activities may include: The resources will be expected to support: plan and lead development on sets of related stories have an understanding of the whole CEA system and take responsibility for teaching this to others(specific technical skills listed below in the ‘Technical skill requirements’ section work with other users, Product Owner and Business Analyst to understand what needs to be built coach and mentor more junior colleagues operate the ingest and publishing production pipelines/services, that are build and find ways to improve system robustness, resilience and stability Key skills required: Understanding of data processing using Apache Spark Use of Python, SQL, and familiarity with PySpark Experience using Apache Airflow for task orchestration Understanding of EMR and reviewing output logs Use of Jupyter notebooks and/or Amazon Athena to query and validate data Data analysis to identify root cause of issues Understanding of dimensional data models and slowly changing dimensions/historic data capture Use of AWS console and services such as, but not limited to; CloudWatch, IAM, S3, Glue, ECR, EC2, EMR, Dynamo DB, LakeFormation Familiarity with Amazon Textract and Comprehend Understanding of both server-side and client-side encryption Use of GitLab for source code management pipelines for CI/CD Use of GitLab Tags for component versioning in shared repositories Understanding of Docker and containerization of solutions IaC using Terraform Experience of understanding how customer expectations transition to applied functionality Familiarity with, and implementation of, DWP Engineering best practices Use of gitlab for release tagging and deployments Familiarity with basic data structures for constructing a solution

Python Software Developer (SC Cleared) Location: Manchester, Leeds, Newcastle, Birmingham, London Contract :6 Months Security Requirement Active SC Clearance required Overview We are seeking experienced Python Software Developers to support the delivery of large-scale analytics and data-driven solutions within a secure enterprise environment. The successful candidates will work on cloud-based platforms, data processing pipelines, and secure integrations while collaborating with cross-functional engineering and platform teams. This role is ideal for professionals with strong Python development expertise, cloud engineering experience, and exposure to modern DevOps and data engineering practices. Must Have: AWS services; Terraform; Apache Spark; Python; Apache Airflow; Docker; GitLab; Security scanning agent; Jupyter; Notebooks; Key Responsibilities Design, develop, and maintain scalable Python applications and services Build and optimize cloud-native data processing pipelines Develop and manage workflows using orchestration tools such as Airflow Work with large-scale data processing frameworks including Apache Spark Deploy and maintain containerized applications using Docker Implement infrastructure automation using Terraform Integrate solutions with enterprise data and secure file transfer systems Collaborate with DevOps, security, and infrastructure teams to ensure secure and reliable deployments Contribute to CI/CD pipelines and source control management using GitLab Support vulnerability management and security scanning processes Create technical documentation and provide knowledge-sharing support where required Participate in Agile ceremonies and collaborative engineering activities Required Skills & Experience Strong hands-on experience with Python development Experience working with AWS cloud services Proven experience with Terraform and Infrastructure as Code (IaC) Strong knowledge of Apache Spark Experience with Apache Airflow or similar orchestration tools Hands-on experience with Docker and containerized environments Experience using GitLab for version control and CI/CD pipelines Understanding of security scanning and vulnerability management tools such as Trivy, Trend Micro, Wiz, or similar Experience working with Jupyter Notebooks Familiarity with secure enterprise integrations and data transfer solutions Strong problem-solving and debugging skills Excellent communication and stakeholder collaboration skills Preferred Experience Experience working within secure or regulated environments Exposure to large-scale analytics or data platform projects Previous experience in public sector or enterprise-scale environments Understanding of cloud security best practices Working Arrangement Hybrid working model Approximately 60% onsite presence required in Newcastle Remaining days remote, depending on project requirements Clearance Requirement Candidates must hold active SC Clearance or be eligible to obtain clearance

Software Developer - SC cleared Permanent | Hybrid (willing to travel to Newcastle) | Python | AI | BPSS We are looking for Software Developers with strong Python and AI experience to work at an early stage alongside enterprise architects and senior engineers. You will help research, design and prototype the foundations of a new service, with particular emphasis on automation, integration and intelligent workflows. You will join Peregrine who are supporting a large public sector organisation, starting an ambitious transformation programme focused on modernising how financial support services are delivered. The aim is to explore whether multiple existing approaches can be consolidated into a single, streamlined service. This work is at Alpha stage, with a strong focus on research, prototyping and proving technical and architectural options. This is a hands-on role suited to engineers who enjoy shaping solutions from first principles and working in exploratory delivery phases. The role is primarily remote, however travel to Newcastle may be required for sprint ceremonies and key workshops. Responsibilities: Engineers will contribute to research and development across: Workflow orchestration and process design Web portal options and user interaction patterns Data models and schema design Automation and AI, including AI assisted software development approaches Skills & Experience: Strong experience with Python Experience applying AI or machine learning in practical solutions Focus on automation and system integration Comfortable working in early stage, fast evolving environments (Alpha project experience) AWS Services Active BPSS, SC clearance or eligible for clearance Desirable skills: Experience supporting AI or data driven platforms Knowledge of cyber security or fraud prevention domains Experience working within government or critical national infrastructure environments About Peregrine We build workforces that deliver tech and change programmes at leading UK organisations. By combining data science from Peregrine Intelligence, our industry-accredited Peregrine Academy, and market-leading attraction and diversity initiatives, we bridge capability gaps at all levels in public and private sector organisations. We work closely with our clients to understand their challenges and deliver flexible, long-term solutions that make a real difference. When you join Peregrine, you become part of a team that’s focused on growth, both yours, our clients’, and the sectors we support. You’ll also get access to a full range of benefits alongside your salary. How Specialist Talent Works As a permanent employee at Peregrine, you’ll be part of our Specialist Talent team. That means you’ll work on-site or remotely with our clients, supporting them on complex, high-impact projects in Data, Digital and Business Transformation. You’ll get the variety and challenge of consultancy work, with the stability and support of a permanent role. You’re not a contractor - you’re a valued member of our team, with access to all the same benefits, learning opportunities, and community. Find out more: peregrine.global or check out our LinkedIn page: peregrine-resourcing

Ledger Bennett is seeking a New Business Account Director to oversee pitch management for RFIs and RFPs.The role involves orchestrating internal teams to create cohesive, impactful responses while ensuring smooth project management.The ideal candidate will have extensive experience in pitch processe

Design intelligent orchestration models. You help customers see what intelligent orchestration can unlock. Design AI‑Powered Orchestration.

Publicis Groupe ANZ is looking for a Regional Account Director to lead the orchestration of client projects and ensure seamless marketing integration.

Wise is seeking a strategic leader for our Cards Pay-in Orchestration team in Greater London.

Well-funded AI data orchestration platform. As a Frontend Engineer, you will build the intuitive interface for an AI-native data and workflow orchestration platform.

A growing tech startup in Greater London is seeking a Full Stack Developer to contribute to building and improving their AI-driven HR platform.You will engage in defining product features, writing TypeScript code, and integrating with third-party services.The ideal candidate has multi-year experienc

A seed-stage AI startup is seeking a Staff AI Engineer to lead its technical direction.You will orchestrate specialized agents to solve complex challenges in financial services, ensuring accuracy and compliance.The role requires extensive production-grade AI systems experience, particularly in NLP a

A leading software company in Greater London is seeking a Senior Solutions Consultant to engage with strategic enterprise accounts.This role involves understanding customer business challenges and demonstrating the value of digital solutions.Ideal candidates will have a robust technical and marketin

Jack and Jill AI is seeking a Senior Backend Engineer to design an orchestration layer for deploying autonomous technology in heavy industries.

The role involves designing and implementing Operations Orchestration workflows to automate lifecycle operations.

Burberry is seeking a Senior Manager, CRM Orchestration to enhance customer transformation. This pivotal role involves leading the orchestration strategy across marketing and retail touchpoints, driving a shift from channel-led execution to customer-centric experiences.

Jack & Jill, a $28M fintech startup, is seeking an AI Engineer to lead AI transformation in alternative asset management.As the first dedicated AI hire, you will design and implement sophisticated AI workflows and document intelligence features.Join a founding team with backgrounds from KKR and Gold

This key role within the Professional Services team will have you designing and integrating automation orchestrations for clients, which includes working with APIs and existing automation assets.

Software Developer - Java - Messaging Orchestration for Apple iCloud, Apple Music. We are seeking an accomplished senior software engineer to architect and build the software for our customer engagement platform, powering message orchestration across Apple Services at global scale.

This role involves building scalable and resilient process orchestration solutions while collaborating with teams to integrate workflow automation into microservices.

Drive ecosystem development across technology partners, vendors, and internal teams to accelerate delivery of scalable, interoperable Autonomous Network and service orchestration solutions, while providing vendor selection frameworks and strategic options to solution teams to ensure alignment with a

A forward-thinking AI company in the United Kingdom is seeking a Gen-AI Prompt & Context Engineer to design and operate LLM workflows.The role involves optimizing prompts, developing multi-agent systems, and ensuring compliance and performance through Python automation and various AI frameworks.Stro

A leading identity verification company seeks a Marketing Leader to spearhead their growth strategy.The role involves building a high-velocity pipeline, establishing brand authority, and leading product marketing.Ideal candidates will have experience in B2B SaaS or Fintech marketing, possess domain

A leading digital experience platform is looking for a driven Senior Platform Engineer to join their Core Data Team in Greater London.In this role, you will lead the design, development, and deployment of scalable software solutions while collaborating with cross-functional teams.The ideal candidate

You will create advanced AI applications that address complex problems through robust workflows and multi-agent orchestration.

As Senior Manager, CRM Orchestration, you will lead the evolution of our orchestration strategy across One‑to‑Many and One‑to‑One communications. The next chapter is about evolving from channel‑led execution to true customer orchestration, delivering connected, relevant and seamless experi

Jack & Jill is seeking a Senior Backend Engineer to join their innovative team, aimed at building a orchestration platform for autonomous technology deployment.

Technology Specialist to orchestrate patch coordination across complex platforms in Greater London.This role involves defining patch scopes, coordinating with various teams, and managing third-party providers to ensure effective delivery.The ideal candidate will have strong skills in patch managemen

Burberry is seeking a Senior Manager, CRM Orchestration to spearhead customer communication strategies. The role focuses on leading orchestration for One-to-Many and One-to-One communications, designing customer journeys, and leveraging data to enhance engagement.

You will manage diverse stakeholders and drive innovative orchestration solutions in line with strategic architecture. Key qualifications include excellent leadership skills, proficiency in orchestration tools like Cisco NSO, and strong analytical capabilities.

A cutting-edge technology firm in Greater London seeks an experienced Project Manager to lead the execution of customer projects in the AI space.In this role, you will manage multiple projects, ensuring delivery aligns with customer needs and company standards.You will bridge technical teams and cus

This is managed by the Cards Pay-in Authentication team, the sister team to Orchestration. The Cards Pay-in Orchestration team decides which acquirer a payment should be routed to for maximum chance of being accepted. In this role you’ll be responsible for the product vision, strategy and roadmap

Grafana Labs is seeking an engineer to join the AppCore team in the UK.The role involves designing and operating critical systems for Grafana Cloud, enhancing service lifecycle reliability, and contributing to projects from inception through delivery.Ideal candidates should have strong skills in Gol

Callosum believes that orders of magnitude improvements in AI systems will come through application-aware orchestration across heterogeneous hardware. Current orchestration stacks were built for the homogeneous world - naive to the strengths of new chips and blind to the demands of modern multi-agen

Grapevine in Greater London is seeking a hands-on engineer to develop and enhance the core data and orchestration layers of their platform.

Jaide Health is seeking a software developer to join Neo4j Aura, a Kubernetes-based project delivering Neo4j as a service.This role involves building production systems on Kubernetes within a collaborative and distributed team across Europe.Key qualifications include Go programming, agile developmen

A leading telecommunications company is seeking a Senior Manager for Autonomous Networks, AI, and Orchestration Enablement.