Databricks jobs in WatfordCreate job alerts

We are looking for a Technology Partner Sales Manager to own Fivetran co-selling alongside Snowflake and Databricks. Work with global Technology Partner Managers to understand co-sell processes specific to each partner. Manage the relationships across Snowflake & Databricks to ensure 3rd line, 2nd l

Senior Data Engineer| AWS/Databricks/PySpark | London/Glasgow (Hybrid) | August Start.This is a hybrid engagement represented by 2 days/week onsite, either in Central London or Glasgow.Must be able to start mid-August.Our partner is looking for a Senior Data Engineer to join a high-impact engineerin

About ProvectusAt Provectus, we architect enterprise-grade AI and data solutions that transform how organizations leverage their most valuable asset – data. We combine deep technical expertise with strategic product thinking to deliver scalable, production-ready AI systems and modern data platforms.Who We're Looking ForWe're seeking a Senior Technical Product Manager with strong engineering acumen and product leadership experience to drive sophisticated AI and data platform initiatives. You bring the technical depth to engage in architecture discussions, evaluate trade-offs, and make informed decisions about complex system designs – while maintaining focus on business value and user outcomes.You're a technical translator who bridges the gap between possibility and practicality, helping clients navigate the rapidly evolving AI landscape with confidence. Your background allows you to assess technical feasibility, identify risks early, and guide engineering teams toward optimal solutions. • Architect Product Strategy for Technical Platforms:, • Define product strategy for AI platforms, data infrastructure, and enterprise-scale data migration initiatives., • Lead technical product discovery – evaluating emerging technologies (GenAI, Agentic AI, vector databases, streaming architectures) and assessing fit for client use cases., • Design solution architectures in collaboration with data architects and engineers, making build-vs-buy decisions and technology stack selections., • Develop technical roadmaps balancing innovation, scalability, security, and time-to-value. Drive AI/ML Product Development: • Own end-to-end product lifecycle for GenAI applications leveraging LLMs, RAG architectures, Agentic frameworks, and multi-modal AI systems., • Translate business requirements into technical specifications, API contracts, data schemas, and system integration patterns., • Guide model selection, evaluation criteria, and deployment strategies for ML models in production environments., • Champion MLOps practices including model versioning, monitoring, performance tracking, and continuous improvement loops. Manage Complex Data Platform Initiatives: • Lead product planning for data lake/lakehouse implementations, warehouse modernizations, and cloud data platform migrations., • Define data product requirements including ingestion pipelines, transformation logic, data quality rules, governance policies, and access patterns., • Oversee integration of multiple data domains, ensuring interoperability, data lineage, and metadata management., • Partner with data engineering teams on performance optimization, cost management, and scalability planning. Execute Through Agile Delivery: • Facilitate Agile ceremonies and maintain well-groomed backlogs with properly sized, technically detailed Features and epic-level stories., • Work closely with engineering teams to decompose complex features into incremental releases with clear technical dependencies., • Define sprint goals aligned with quarterly objectives and long-term product vision., • Balance technical debt management with feature delivery, advocating for enablers and architectural improvements. Enable Technical Decision-Making: • Conduct technical due diligence, proofs-of-concept, and spike solutions to validate approaches before full investment., • Analyze trade-offs between competing technical solutions, considering performance, cost, maintainability, and developer experience., • Document technical decisions, architectural decision records (ADRs), and design patterns for knowledge sharing., • Communicate technical strategies and recommendations to executive stakeholders with clarity and conviction., • Required Qualifications:, • Bachelor's degree in Technology or Business related field (Master's preferred)., • 5-7+ years of experience in technical product management, solutions architecture, or software engineering., • 5+ years in product management roles with demonstrated end-to-end product ownership., • 3-5+ years of experience with AI/ML products, Generative AI, or data platform development., • 3-5+ years working in Agile/Scrum environments with strong command of Agile methodologies and ceremonies., • Deep understanding of cloud architectures (AWS, Azure, GCP) and modern data stack technologies. Technical Expertise: • AI/GenAI: LLM integration, prompt engineering, RAG architectures, fine-tuning, Agentic AI frameworks (LangChain, LlamaIndex, AutoGen)., • Data Engineering: ETL/ELT patterns, data modeling, Snowflake, Databricks, dbt, Airflow, Kafka/streaming architectures., • Cloud Platforms: AWS (SageMaker, Bedrock, Glue), Azure (OpenAI Service, Synapse), GCP (Vertex AI, BigQuery)., • MLOps: Model deployment, monitoring, versioning, CI/CD for ML, feature stores, experiment tracking., • Data Migration: Assessment methodologies, migration patterns, data validation, cutover strategies., • Development Practices: API design, microservices, containerization (Docker, Kubernetes), CI/CD pipelines. Core Competencies: • Solution design and technical architecture capabilities., • Requirements translation from business needs to technical specifications., • Strong analytical thinking and problem-solving in complex technical domains., • Exceptional stakeholder management across technical and non-technical audiences., • Clear technical communication—documenting complex systems and presenting architectural decisions., • Risk identification, dependency mapping, and mitigation planning. Preferred Qualifications: • Prior software development or data engineering experience (3+ years)., • Background in consulting or professional services, delivering client solutions., • Certifications: AWS Solutions Architect, Azure Data Engineer, GCP Professional Data Engineer, Certified Scrum Product Owner. Personal Attributes: • Insatiable curiosity about emerging technologies and a hands-on experimentation mindset., • Close attention to detail with quality focus and commitment to technical excellence., • Collaborative team player who thrives in cross-functional environments., • Adaptable and comfortable navigating ambiguity in fast-paced consulting contexts., • Passion for mentoring engineers and elevating technical practices., • Lead top-tier engineering teams and cutting-edge agentic AI systems, enterprise AI platforms., • Shape how enterprises adopt AI — from strategy to architecture to delivery., • Grow within a team building modern AI-delivery practices, tools, and frameworks., • Remote-friendly culture with strong engineering, data, and consulting partnerships.We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Required Core Skills: Databricks, AWS, Python, Pyspark, data modelling Minimum years of experience: 7 years Job Description: Must have hands-on experience in designing, developing, and maintaining data pipelines and data streams. Must have a strong working knowledge of moving/transforming data across layers (Bronze, Silver, Gold) using ADF, Python, and PySpark. Must have hands on experience to PySpark, Python,AWS,data modelling Must have experience in ETL processes Must have hands on experience in Databricks development Good to have experience in developing and maintaining data integrity and accuracy, data governance, and data security policies and procedures. Must have hands on experience in SQL development Excellent Communication skills & Logical thinking

Job Title: Data Engineer Location: UK Job Type: Full-time Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services in the past two years alone. This work has not only reached over 50 million citizens but also achieved considerable savings for the taxpayer, amounting to over £25 million. At Scrumconnect, we foster a community of talented consultants who thrive on collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. We are looking to fill the position of Data Engineer to help develop and maintain data products. Data Engineering teams are responsible for the delivery and operational stability of the data products built and provide ongoing support for those products. Data Engineers work within, and contribute to, the overall data development lifecycle process as part of multi-functional Agile delivery teams focused on one or more products. Role: Design, build, and operate simple, repeatable ETL data pipelines within distributed processing environments and cloud platforms, as well as localized single-node processing environments. Develop and produce prototyped then productionized code that can be deployed across a range of ETL, data validation, and other data production processes. Develop understanding of the native tooling of one or more of: GCP, Azure, AWS. An intermediate or better level coding in one or more mainstream coding languages (i.e., Python, SQL, Java, Scala, and R), and critically review the code of other data engineers. Develop code for a range of data products including data matching, rule development, scans, operational outputs. Participate in development and maintenance of in-house code libraries. Undertake unit testing to support common code development. Review business requirements to ensure they are clear and robust, and transform requirements into reusable production-ready code and/or effective data models. Understand the key principles of database design and be able to resolve technical problems in databases, data processes, data products, and services as they occur. Initiate actions, monitor services, and identify trends to resolve problems. Apply correct techniques in normalizing data and building robust relational structures in database products. Undertake basic data analysis, for example, for data profiling, QA, or problem resolution. Support queries from end users on data quality issues affecting data production; communicate issues and blockers to develop solutions. Undertake source system analysis and data profiling to confirm data quality and ensure accurate metadata. Understand relevant data sources, tools, and systems. Work with experts to develop validation frameworks for both simple and complex data sources. Communicate with customers, for example, to update on progress or confirm requirements. Using a working knowledge of cloud data engineering tools in assisting with the development of data pipelines, products, and automation processes. Work with other team members in development of tool performance logging and monitoring. Work with other team members in applying engineering team and community best practice in data products and pipelines. Experience predicting and advising on technology changes in the engineering toolset(s) and platform(s) you work on. Work with the team in implementing the transition to modern data platforms including Data Warehouse, Lakehouse, across the data products, pipelines, and processes you are responsible for. Engage with other professional communities (Data Science, Architecture, etc.) to identify emerging and cross-community issues affecting your role and escalate as necessary. Describe technical, data, pipeline, and production issues to colleagues of different specialisms. Communicate within the team and across teams to monitor expectations around delivery of data engineering, products, and pipelines, blockers, priorities, and issues. Escalate issues and blockers in delivery proactively. Familiar with developing data pipelines and products for very large volume 'big data' series using a range of native engineering tools and practices and coding approaches. A working knowledge of engineering standards across a platform and native toolset. Experience implementing these standards in the day-to-day role and keeping outputs up-to-date with these. Typical Data Engineering Experience required (5+ yrs): Knowledge and experience of Azure/AWS Cloud data solution provision. Proficient in SQL. Ability to develop and deliver complex visualisation, reporting and dashboard solutions using tools like Power BI. Enterprise-scale experience with ETL tools (Informatica and or similar). Experience of data modelling and transforming raw data into datasets and extracts. Experience of working in a large project /scale complex organisation and knowledge of migrating legacy capabilities. Experience in Agile. Ability to analyse and collect information and evidence, identify problems and opportunities, and ensure recommendations fit with strategic business objectives. Experience of building team capability through role modelling, mentoring, and coaching. Ability to manage relationships with non-technical colleagues and can work in a collaborative, inclusive way. Ability to design, write, and operate ETL pipelines, in the context of distributed processing, applying coding, data, and documentation standards, in the language required by the business area. Understanding of the principles of data processing in a distributed and or cloud platform, and ability to use this understanding to ensure robust coding in a distributed or cloud environment. Able to write clean, efficient and well documented code for data processing tasks to a specification. Able to use Git for code version control to pull and push and review merge requests for team and own code. Ability to undertake simple data and code analysis for effective quality assurance and to resolve processing issues. Ability to undertake simple data and code analysis for effective quality assurance and to resolve processing issues. Experience of one or more programming/coding languages listed: Python/PySpark, SQL, Proc SQL, NoSQL, MySQL, SQLite, Spark SQL, Hive SQL, PostgreSQL, SAS, SAS E-guide, Scala, RegEx, Java, R Investigate problems in systems, processes and services, with an understanding of the level of a problem, for example, strategic, tactical or operational. Undertake data profiling and source system analysis for data evaluation, issue resolution or data standardisation. Use metadata repositories to complete complex tasks such as data and systems integration impact analysis. Good knowledge of database structures, practices, principles of database integrity etc. Basic knowledge of applying database principles and SQL coding across a range of platform database and data querying tools (i.e. SQL Server, Cloud SQL, Big Query, Hive, Athena etc.) Show an awareness of opportunities for innovation with new tools and uses of data. Experience in more than one of the following tools is required for Engineers engaging in BI development: Plotly, R Shiny, Tableau, QlikView/Qlik sense, Power BI, SAP, Business Objects, MicroStrategy Experience of several of the following tools: NiFi, Hbase, Bash, Assist, Putty, Neo4J, Spark , Kafka, HDFS, Oozie, Git Hub, Unix, Hadoop, Impala, DoJo, Flume, Elastic, Logstash, Kibana, Airflow, Glue, Big Query, Athena, CML, Hive, Informatica, CuteFTP Ability to explain and communicate technical concepts in non-technical language. Explain the types of communication that can be used with internal and external stakeholders, and their impact. Design, build and test data products based on feeds from multiple systems, using a range of different storage technologies, access methods or both. Able to explain and implement the concepts and principles of data modelling. Ability to create and run simple unit tests. Desired Qualifications Certifications in AWS, Azure, Databricks, or related technologies. Example _ Experience with public sector data initiatives and compliance requirements. Knowledge of machine learning and artificial intelligence concepts. Your working time at Scrumconnect will be split between multiple locations, including from our HQ and hub locations, client site or home. Travel requirements vary in frequency and take into account requirements of your work, our clients and the team. We welcome candidates from all identities, attributes and backgrounds to thrive with us. The diversity of our people should be reflected in the impact we deliver. Join us at Scrumconnect, where your highly demonstrable skills and expertise will drive the future of user-centred design in public services.

Ensure end-to-end data quality, from raw ingested data to business-ready datasets. Our data platform is built using Databricks, with data pipelines written in PySpark and orchestrated using Airflow. By applying for this role, you consent to us processing your personal data in accordance with the UK

Qliksense Developer Certain Advantage are hiring for a Qliksense Developer based in London. This role is on an initial contract till the end of the year basis and is office based The company: We’re working with a business that’s on a strong growth trajectory, backed by ambitious plans. With a commitment to innovation and excellence, they are poised to make a significant impact in the industry. The role As a Senior Analytics engineer you are a subject matter expert, who designs & builds analytics solutions and mentors junior engineers. You are also the key person to convert the Vison and Data and Analytics Strategies into IT solutions and deliver them. • Design, build and implement POCs, prototypes and full-fledged UX solutions and strategies, • Communicate with key stakeholders to drive clarification of requirements and to promote UX designs and solutions, • Expert knowledge in QlikSense & Qlik Cloud Analytics to deliver complex, fast moving datasets to high value trading teams., • Support the design, e.g., by analysing user journeys and drive towards simplification and automation, • Enable high quality & compelling story telling through creation of strong, simple to understand data visualizations, • Document technical solution design and strategy documentation, • Run quality assessments of counterparts’ design, • Adhere to the organisations Release and Change process The individual: • Expert knowledge of authoring/troubleshooting SQL/Azure/Databricks queries, • Expert knowledge and application of general and tool specific connectivity, data modeling, source data procurement strategies (Database, import/cached), security configuration, performance tuning, usage of right visuals, layout optimization, mobility, scripting and integrating advanced analytics, • Knowledge of upcoming trends in tools and technology, • Gas/Power Trading knowledge - Short-term trading, physical assets trading (CCGT, Wind, Solar, Battery), • Risk - Modelling & understanding of risk & risk management., • Commodity Modelling - Energy (power, gas, environmental products) and meteorology., • Skilled at one of the following secondary visualization tools - (at least one of the following – (1) Power BI and Azure Analysis Services (AAS), (2) Spotfire, (3) SAP Analytics Cloud) Does this sound like your next career move? Apply today. Working with Certain Advantage We go the extra mile to find the best people for the job. If you’re hunting for a role where you can make an impact and grow your career, we’ll work with you to find it. We work with businesses across the UK to find the best people in Finance, Marketing, IT and Engineering. If this job isn’t for you, head to certainadvantage.co.uk and register for job alerts and career guidance tips.

Technical Data Analyst - Databricks Migration. Leading Insurance business is looking for an experienced Technical Data Analyst to join a major data transformation programme, supporting the migration of data platforms to Databricks within an Azure environment. Strong Databricks experience, ideally wi

The Solutions Architect (Lakebase) team executes on Databricks’ strategic Product Operating Model that provides enhanced focus on earlier stage, highly prioritised product lines in order to establish product market fit, and set the course for rapid revenue growth. At Databricks, we strive to provi

Job Title: Technical Delivery Lead - Data Engineering Lead (Hands-on Python / Databricks). Extensive experience with Databricks, including Workflows, Notebooks, and Delta Lake. Design and build scalable data pipelines using Databricks and Azure.

Engineering Manager for Lakebase Storage to enhance its data and AI infrastructure platform.The role involves driving development for mission-critical services and facilitating a high-performing engineering team in London.Successful candidates will have experience in building storage systems, team l

The ideal candidate has significant experience with Databricks and consultancy skills, capable of leading engineering teams and delivering high-quality solutions in a remote setting.

Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio‑eco

Cyber Security training courses seeks a Databricks Data Architect to enhance their pre-sales and practice growth efforts. You will own solution architecture for Databricks Lakehouse platforms while guiding clients through their data and AI strategies. The ideal candidate should possess significant p

A leading financial services organisation is seeking a Data Integration Lead to enhance its data platform, focusing on scalable integrations between Databricks and Salesforce. The ideal candidate must demonstrate strong experience in data engineering, with hands-on expertise in Databricks and Salesf

Architect and implement Databricks Lakehouse solutions end‑to‑end. Optimise Databricks performance, security, and cost efficiency. Databricks certifications highly desirable.

Databricks is seeking a strategic alliance leader to own and scale our partnership with Accenture across EMEA, while orchestrating our relationship with Avanade. This pivotal role is crucial to enhancing the influence of Databricks in the Data & AI ecosystem.

This transformative role requires expertise in Databricks and AI engineering, focusing on comprehensive architecture leadership and stakeholder collaboration.

Limited is hiring a Data Solution Architect specializing in Databricks, to join their team in the UK. The ideal candidate will bring 7+ years of experience in data architecture and possess strong expertise in Databricks and Apache Spark.

Databricks is seeking a Strategic Account Executive in Greater London to manage large enterprise accounts and drive revenue growth through strategic relationships.

Cyber Security training courses is seeking a Senior Data Engineering Manager in Greater London to lead three separate Data Engineering teams.This role emphasizes strategy, people management, and technical judgement, while advocating for a healthy work-life balance.The position offers a salary up to

Individuals looking for employment at Databricks are considered without regard to age, color, disability, ethnicity, family or marital status, gender identity or expression, language, national origin, physical and mental ability, political affiliation, race, religion, sexual orientation, socio‑eco

Key responsibilities include deploying Azure Databricks, implementing security measures, and providing governance across data platforms. Essential skills include Azure Databricks experience and knowledge of Azure networking and security assurance. Synapri is seeking a professional to design and impl

The role involves designing robust architectural patterns, guiding delivery teams, and ensuring consistency across the platform, particularly focusing on Databricks.

A leading data and AI company is seeking a Strategic Alliance Leader to manage and grow the alliance with Accenture across EMEA.This pivotal role demands over 12 years of experience in enterprise software, with a proven track record of executing joint go-to-market strategies that drive measurable re

Experience working for Databricks or a Databricks Partner (highly desirable). The client is investing heavily in its Databricks practice and is hiring a senior, commercially-minded Databricks Architect to help take it to the next level. You will be trusted to lead from the front: owning solution des

Ability to attract, hire, and coach engineers who meet the Databricks hiring standards – can up‑level existing team via hiring top‑notch senior talent, growing leaders and helping struggling members; can gain trust of the team and guide their careers. At Databricks, we strive to provide compre

This role demands proven leadership in data engineering with strong skills in Python and Databricks.

Databricks is seeking a Lakewatch Sales Specialist to help security teams modernise their SIEM with an open, agentic platform that unifies security, IT, and business data for AI-driven detection and response. At Databricks, we are committed to fostering a diverse and inclusive culture where everyone

Develop and execute a strategic account plan aligned to customer business objectives, industry dynamics, and Databricks' growth goals. Do you want to help solve the world’s toughest problems with big data and AI? This is what we do every day at Databricks. You will work closely with their key stak

Lead tri-party collaboration between Databricks, Accenture/Avanade, and Microsoft to maximise Azure-aligned investments and market impact. Incubate and scale differentiated joint industry solutions, accelerators, and managed services built on the Databricks Platform. Databricks is seeking a strategi

Databricks is looking for a sales leader in Greater London to lead their Enterprise Named and Strategic Account Executive team.

Aimpoint Digital is seeking a fully remote Databricks Solution Architect to engage with clients and help shape the future of AI on Databricks. The ideal candidate possesses extensive consulting experience, strong communication skills, and deep expertise in Databricks.

Join Databricks to help shape its crucial UKI business segment.

At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. You will be the face of Databricks at relevant events, building strategic relations

Databricks fosters an inclusive environment and offers comprehensive benefits to its employees.

Own and scale the Databricks–Accenture alliance across EMEA, aligning regional execution with global strategy and driving measurable consumption growth. Incubate and scale differentiated joint industry solutions, accelerators, and managed services built on the Databricks Platform. Databricks is th

Databricks is the data and AI company, and more than 10,000 organizations worldwide — including over 50% of the Fortune 500 — rely on the Databricks Data Intelligence Platform to unify and democratize data, analytics, and AI. Represent Databricks as a thoughtful, credible sales leader in the Dig

Alvarium Talent is seeking a Databricks Architect to lead the design of scalable data architectures using the Databricks Lakehouse platform. The role offers the opportunity to influence enterprise data strategies and requires proven experience with Databricks architectures, Spark, and data governanc

This role will see you designing and delivering modern data platforms, working closely with clients and technical teams to build scalable, secure and high-performing solutions using Databricks, Apache Spark and cloud technologies. You’ll also play a key role in pre-sales activities, solution desig

Go-to-Market Leader for EMEA Financial Services to drive strategic growth.This role involves managing executive relationships and developing comprehensive sales plans for the Banking, Capital Markets, and Insurance sectors.The ideal candidate will have over 10 years of executive experience in Bankin

Become trusted advisor to multiple stakeholders within Databricks from product, sales, pre‑sales, marketing, to partner teams. Keynote marquee industry events and plan and execute Databricks events in Financial Services. Ensure Databricks has security messaging and positioning for Financial Servic

Maxwell Bond is looking for an experienced Data Architect to shape and deliver Databricks-based platforms.

Solutions Architect to join their Lakebase team.This role focuses on enhancing product market fit and driving revenue growth while collaborating with account teams on strategic engagements.Candidates should have over 10 years of OLTP expertise and be proficient in SQL and Python, with experience in

A leading data and AI company based in London is seeking a Technical Advisor to engage with senior stakeholders in the startup ecosystem.This role involves building relationships with CTOs and VPs of Engineering while driving awareness of the company's offerings.The ideal candidate has over 10 years

The ideal candidate will have experience with team leadership, Databricks or Snowflake, and modern cloud platforms like AWS, Azure, or GCP.

At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. Individuals looking for employment at Databricks are considered without regard to a

Gravitas Recruitment Group (Global) Ltd is seeking an experienced Data Architect to design and implement modern data platforms using Databricks. A key requirement is at least 5 years of experience in Data Architecture and 3 years with Databricks.