Scala jobs in DerbyCreate job alerts

Job Title: Data Engineer Location: UK Job Type: Full-time Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services in the past two years alone. This work has not only reached over 50 million citizens but also achieved considerable savings for the taxpayer, amounting to over £25 million. At Scrumconnect, we foster a community of talented consultants who thrive on collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. We are looking to fill the position of Data Engineer to help develop and maintain data products. Data Engineering teams are responsible for the delivery and operational stability of the data products built and provide ongoing support for those products. Data Engineers work within, and contribute to, the overall data development lifecycle process as part of multi-functional Agile delivery teams focused on one or more products. Role: Design, build, and operate simple, repeatable ETL data pipelines within distributed processing environments and cloud platforms, as well as localized single-node processing environments. Develop and produce prototyped then productionized code that can be deployed across a range of ETL, data validation, and other data production processes. Develop understanding of the native tooling of one or more of: GCP, Azure, AWS. An intermediate or better level coding in one or more mainstream coding languages (i.e., Python, SQL, Java, Scala, and R), and critically review the code of other data engineers. Develop code for a range of data products including data matching, rule development, scans, operational outputs. Participate in development and maintenance of in-house code libraries. Undertake unit testing to support common code development. Review business requirements to ensure they are clear and robust, and transform requirements into reusable production-ready code and/or effective data models. Understand the key principles of database design and be able to resolve technical problems in databases, data processes, data products, and services as they occur. Initiate actions, monitor services, and identify trends to resolve problems. Apply correct techniques in normalizing data and building robust relational structures in database products. Undertake basic data analysis, for example, for data profiling, QA, or problem resolution. Support queries from end users on data quality issues affecting data production; communicate issues and blockers to develop solutions. Undertake source system analysis and data profiling to confirm data quality and ensure accurate metadata. Understand relevant data sources, tools, and systems. Work with experts to develop validation frameworks for both simple and complex data sources. Communicate with customers, for example, to update on progress or confirm requirements. Using a working knowledge of cloud data engineering tools in assisting with the development of data pipelines, products, and automation processes. Work with other team members in development of tool performance logging and monitoring. Work with other team members in applying engineering team and community best practice in data products and pipelines. Experience predicting and advising on technology changes in the engineering toolset(s) and platform(s) you work on. Work with the team in implementing the transition to modern data platforms including Data Warehouse, Lakehouse, across the data products, pipelines, and processes you are responsible for. Engage with other professional communities (Data Science, Architecture, etc.) to identify emerging and cross-community issues affecting your role and escalate as necessary. Describe technical, data, pipeline, and production issues to colleagues of different specialisms. Communicate within the team and across teams to monitor expectations around delivery of data engineering, products, and pipelines, blockers, priorities, and issues. Escalate issues and blockers in delivery proactively. Familiar with developing data pipelines and products for very large volume 'big data' series using a range of native engineering tools and practices and coding approaches. A working knowledge of engineering standards across a platform and native toolset. Experience implementing these standards in the day-to-day role and keeping outputs up-to-date with these. Typical Data Engineering Experience required (5+ yrs): Knowledge and experience of Azure/AWS Cloud data solution provision. Proficient in SQL. Ability to develop and deliver complex visualisation, reporting and dashboard solutions using tools like Power BI. Enterprise-scale experience with ETL tools (Informatica and or similar). Experience of data modelling and transforming raw data into datasets and extracts. Experience of working in a large project /scale complex organisation and knowledge of migrating legacy capabilities. Experience in Agile. Ability to analyse and collect information and evidence, identify problems and opportunities, and ensure recommendations fit with strategic business objectives. Experience of building team capability through role modelling, mentoring, and coaching. Ability to manage relationships with non-technical colleagues and can work in a collaborative, inclusive way. Ability to design, write, and operate ETL pipelines, in the context of distributed processing, applying coding, data, and documentation standards, in the language required by the business area. Understanding of the principles of data processing in a distributed and or cloud platform, and ability to use this understanding to ensure robust coding in a distributed or cloud environment. Able to write clean, efficient and well documented code for data processing tasks to a specification. Able to use Git for code version control to pull and push and review merge requests for team and own code. Ability to undertake simple data and code analysis for effective quality assurance and to resolve processing issues. Ability to undertake simple data and code analysis for effective quality assurance and to resolve processing issues. Experience of one or more programming/coding languages listed: Python/PySpark, SQL, Proc SQL, NoSQL, MySQL, SQLite, Spark SQL, Hive SQL, PostgreSQL, SAS, SAS E-guide, Scala, RegEx, Java, R Investigate problems in systems, processes and services, with an understanding of the level of a problem, for example, strategic, tactical or operational. Undertake data profiling and source system analysis for data evaluation, issue resolution or data standardisation. Use metadata repositories to complete complex tasks such as data and systems integration impact analysis. Good knowledge of database structures, practices, principles of database integrity etc. Basic knowledge of applying database principles and SQL coding across a range of platform database and data querying tools (i.e. SQL Server, Cloud SQL, Big Query, Hive, Athena etc.) Show an awareness of opportunities for innovation with new tools and uses of data. Experience in more than one of the following tools is required for Engineers engaging in BI development: Plotly, R Shiny, Tableau, QlikView/Qlik sense, Power BI, SAP, Business Objects, MicroStrategy Experience of several of the following tools: NiFi, Hbase, Bash, Assist, Putty, Neo4J, Spark , Kafka, HDFS, Oozie, Git Hub, Unix, Hadoop, Impala, DoJo, Flume, Elastic, Logstash, Kibana, Airflow, Glue, Big Query, Athena, CML, Hive, Informatica, CuteFTP Ability to explain and communicate technical concepts in non-technical language. Explain the types of communication that can be used with internal and external stakeholders, and their impact. Design, build and test data products based on feeds from multiple systems, using a range of different storage technologies, access methods or both. Able to explain and implement the concepts and principles of data modelling. Ability to create and run simple unit tests. Desired Qualifications Certifications in AWS, Azure, Databricks, or related technologies. Example _ Experience with public sector data initiatives and compliance requirements. Knowledge of machine learning and artificial intelligence concepts. Your working time at Scrumconnect will be split between multiple locations, including from our HQ and hub locations, client site or home. Travel requirements vary in frequency and take into account requirements of your work, our clients and the team. We welcome candidates from all identities, attributes and backgrounds to thrive with us. The diversity of our people should be reflected in the impact we deliver. Join us at Scrumconnect, where your highly demonstrable skills and expertise will drive the future of user-centred design in public services.

Role – Confluent Consulting Engineer Technology – Apache Kafka, Confluent Platform, Stream Processing Location –(Remote) UK Job Description Your role: As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: · 5+ years of hands-on experience with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) · Strong proficiency in Java, Python, or Scala · Solid understanding of event-driven architecture and data streaming patterns · Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure · Familiarity with Docker, Kubernetes, and CI/CD pipelines · Excellent problem-solving and communication abilities Preferred: Candidates with experience in Confluent Kafka and its ecosystem will be given preference: · Experience with Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center · Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink · Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC · Confluent certifications (Developer, Administrator, or Flink Developer) · Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes · Knowledge of data mesh architectures, KRaft migration, and modern event streaming patterns · Exposure to monitoring tools (Prometheus, Grafana, Splunk) · Experience with data lakes, data warehouses, or big data ecosystems Personal Besides the professional qualifications of the candidates we place great importance in addition to various forms personality profile. These include: · High analytical skills · A high degree of initiative and flexibility · High customer orientation · High quality awareness · Excellent verbal and written communication skills

Strong experience with Scala in a Front End or full-stack context.

Job Title: Scala Developer (Immediate Joiner Outside IR35) Location: Remote (UK Based) Description: We are looking for an experienced Scala Developer to join our Government client

Write well-structured, idiomatic Scala and use functional programming patterns where appropriate. Solid understanding of functional programming concepts and idiomatic Scala (e. Scalaz familiarity advantageous).

Ensure that technical decisions support our goals of quality, performance, scalability, reliability, availability, and security. Experienced in developing high‑performance, scalable and available web services, and applications. Experience with PHP and Scala is preferred.

You'll engage in both Frontend and Backend projects, contributing to our product vision with technologies like Typescript, React, and Scala.

We are looking for multiple Scala Software Engineer's (ranging from Mid to Senior to Tech Lead) to join a dynamic team building solutions for a public sector client, building critical digital services from end-to-end working on a variety of projects featuring high-performance cloud platforms using J

Commerce is looking for a Software Engineer to join the Payment integrations team, responsible for building payment gateway integrations on the BigCommerce platform.The ideal candidate will have over 3 years of backend development experience with a strong focus on Ruby on Rails, and a solid understa

On the backend we use Scala and.

Permutive is looking for a Senior Scala Engineer to join us on the journey of revolutionising the way businesses leverage their data. You will also own our core data pipelines and underlying infrastructure, ensuring everything is scalable and reliable while mentoring engineers and championing techni

Senior software engineer, backend (Scala) (UK).

Obsidian is seeking expert software engineers with experience in Scala, Kotlin, and/or OCaml to evaluate advanced AI systems in engineering domains.

Permutive is looking for a Senior Scala Engineer to help revolutionize data usage in businesses. Candidates should have extensive experience with Scala and functional programming concepts.

Backend Development: Scala, API-first design (OpenAPI). Functional & Async Programming: Cats Effect and functional Scala patterns. Develop and maintain a Scala-based API backend supporting manufacturing frontline teams.

BairesDev is seeking a Staff Software Engineer specializing in Scala to lead the design and development of distributed data systems.

Signify Technology, based in Greater London, is looking for an experienced backend developer with expertise in Scala.

A leading technology consultancy in Greater London is seeking a highly experienced Data Engineer with expertise in Hadoop, Spark, Scala, and Python.

This system was built from the ground up starting in 2013 and is written entirely in Scala. The London team is an experienced group of Java and Scala developers, with a deep understanding of UI and UX design. Scala or Java developer to join the FlexONE London team.

Commercial experience building backend systems with Scala, including experience with modern Scala tooling and libraries. API integrations within a modern functional Scala environment. Building backend services and platform functionality using Scala.

London is seeking a Software Engineer II specializing in backend development, particularly with Ruby on Rails, to enhance payment integrations and support scalable, high-performance solutions.

Rise Technical Recruitment Limited seeks a Scala Developer located in London for a hybrid role requiring at least weekly office attendance. Strong Scala programming and functional programming principles understanding are essential for this role.

The Scala plugin for IntelliJ IDEA helps developers work with Scala every day. We’re looking for a Technical Product Manager to help improve IntelliJ IDEA’s Scala support. You will work closely with engineers, experiment with modern Scala projects and tooling, analyze user feedback, investigate

Experience with Scala programming (or another Functional Programming Language). Familiarity with functional Scala libraries, e. Permutive is looking for two Scala Software Engineers to join us on the journey of revolutionising the way businesses leverage their data.

The role requires expertise in Java or Scala, with experience in multiple technologies and strong adherence to GDS standards.

JetBrains is seeking a Technical Product Manager to enhance the Scala support in IntelliJ IDEA. In this hands-on role, you will bridge the gap between user needs and product improvements by working closely with engineers, experimenting with Scala projects, and analyzing user feedback. The successful

Qualifications include experience with JVM languages like Java, Scala, or Kotlin, and familiarity with AWS, GCP, or Azure.

WorksHub is looking for a Graduate Software Engineer located in London, United Kingdom.This full-time role offers a competitive compensation package.Candidates should have a degree in Computer Science or Information Technology, proficiency in programming languages like Python and Java, and a solid u

An international software house in the UK is looking for a Scala Developer to build scalable greenfield solutions. The successful candidate will have at least three years of commercial Scala programming experience, and skills in PostgreSQL, RESTful API design, and TDD/BDD environments.

A global software provider is seeking a Senior Scala Engineer for a full-time position based in the United Kingdom. The ideal candidate will have over 5 years of experience as a Backend Engineer and hands-on experience with Scala in production environments. Responsibilities include developing a Scal

We are seeking a highly experienced Data Engineer ( Hadoop / Spark / Scala / Python) to join our Financial Services Data Practice. You will have deep hands‑on expertise in Hadoop, Spark, Scala, Python. Write scalable ETL processes using tools like Hive Pig and Spark.

What technical skills you will require* Proficiency in Scala and Python.

Candidates should possess strong programming skills in Scala and Python, experience with REST APIs, and a background in computer science or engineering.

Proficiency in Scala and an interest in Python are essential, alongside experience with PostgreSQL and Docker.

Ideal candidates will have strong Scala experience, understanding of microservices architecture, and comfort with distributed systems. Space Executive is seeking a Senior Scala Software Engineer to join a hybrid working environment in Greater London. The role involves building scalable backend servi

Experience with one of the following Java Virtual Machine (JVM) languages: Java, Scala, or Kotlin. Familiarity with the Scala programming language and popular frameworks such as: Cats, Cats Effect, ZIO, and http4s.

BigCommerce Pty is seeking a Software Engineer II - Backend to work on payment integrations, enhancing the BigCommerce platform's functionality.The ideal candidate will have 3+ years of experience in backend development, particularly with Ruby on Rails, and will design, implement, and maintain criti

The ideal candidate will have 3-5 years of experience and a strong technical background in Scala, Python, and Java, among other technologies.

The ideal candidate will have a Bachelor's degree in Computer Science, expertise in Scala and Python, and a passion for solving engineering challenges.

Stealth iT Consulting is seeking multiple Scala Software Engineers at various levels (Mid, Senior, Tech Lead) to contribute to building critical digital services for a public sector client. Ideal candidates will have strong experience in Scala, designing REST APIs, and working with databases.

Auxo Talent is seeking a Scala Developer to join their dynamic team in the United Kingdom for an initial 6-month contract. The ideal candidate will have a minimum of 5 years of software development experience and strong expertise in Scala, alongside familiarity with various technologies such as Akka

Proficiency in Scala and Python.

In this role, you will be responsible for building features and services on their innovative product platform while utilizing functional Scala and working with distributed systems.

This Scala Developer would be joining the innovation arm of the business tasked with building complex, highly scalable greenfield solutions utilised worldwide to deliver critical infrastructure. This Scala Developer will be joining a collaborative, continuous improvement focussed environment working

This full-time role requires a BS degree in Computer Science or related field with coding knowledge in Java and Scala.

Morson Human Resources Limited is recruiting for a Head of Software Engineering in Manchester.This role involves leading a team of engineers to deliver high-quality AI solutions, defining engineering strategies, and promoting best practices.Ideal candidates will have significant leadership experienc