Databricks jobs in BlackburnCreate job alerts

AI Engineer Job Tenure: Full-time, permanentSalary: CompetitiveCompany Description Ready to join a team thats leading the way in reshaping the future of insurance? Here at esure Group, we are on a mission to revolutionise insurance for good! We’ve been providing Home and Motor Insurance since 2000, with over 2 million customers trusting us to keep them covered through our esure and Sheilas’ Wheels brands. With a bold dedication for digital innovation, were transforming the way the industry operates and putting customers at the heart of everything we do. Having completed our recent multi-year digital transformation, we’re now leveraging advanced technology and data-driven insights alongside exceptional service, to deliver personalised experiences that meet our customers ever-changing needs today and in the future. Job Description We currently have a phenomenal opportunity for an AI Engineer to join our us as we enhance our customer experience by harnessing the power of NLP, large language models, and flawless integration with third-party GenAI services. In this dynamic role, youll be involved in every stage of the AI lifecycle, from brainstorming ideas and crafting prompts to fine-tuning models and deploying them into production. Success in this role is measured through rigorous A/B testing, ensuring our solutions deliver real value. Youll have the opportunity to work on a variety of impactful projects across the entire enterprise. We are seeking an innovative individual who shares our vision to fix insurance for good. What you’ll do: Collaborate with business partners to identify use-cases where GenAI can provide measurable benefits. Support the data science and AI team in deploying scalable AI applications across the enterprise. Work with a multi-functional team (DevOps, data engineers, developers, testers, Infosec) to productionize AI services on AWS. Enhance our tech stack, including MLOps, CI/CD pipelines, UI, and AI Python libraries. Develop prompts, fine-tune models, and track results. Evaluate third-party GenAI and LLM technologies for cost-benefit analysis. Deliver projects from scoping and R&D to production deployment and benefit measurement. Follow and contribute to standards for code quality, R&D, and model development. Engineer data for optimal AI application performance. Advise peers and senior management on business and customer impact. Write production-grade Python code, leveraging CI/CD, Databricks, and ensuring appropriate test coverage; proficiency in SQL. Liaise with third-party partners and stay updated on field advancements and regulations. Collaborate with data governance and data management teams on data requirements. Qualifications What we’d love you to bring: You are a self-starter with experience in delivering research + models to production to drive tangible commercial benefits and improved customer experiences. You thrive in working autonomously and collaboratively to drive impact in a fast-paced multi-functional business. PhD or MSc experience in a numerate subject: Machine Learning, Computer Science, Statistics, or equivalent, Demonstrable experience of applying, researching, and developing sophisticated NLP models, prompt engineering + fine-tuning LLMs to drive value in a commercial setting, Able to work independently and efficiently to deliver projects on time, taking project briefs and refining them to strong results. Experienced in engaging with non-technical stakeholders to scope, design and build an appropriate ML solution. Proficient with Python data science stack, e.g., pandas, scikit-learn, Jupyter etc., and version control, e.g., Git. Exposure to LLMOps, model monitoring principles, CI/CD and associated tech, e.g., Docker, MLflow, k8s, FastAPI etc. Knowledge of Langchain, huggingface and LLM offerings by 3rd party vendors. Knowledge of OO programming and software design, i.e., SOLID principles. Knowledge and working experience of AGILE methodologies. Familiarity with Databricks, and RAG application architecture a plus Experience with latency optimisation and quantisation preferred Additional Information What’s in it for you?: Competitive salary that reflects your skills, experience and potential. Discretionary bonus scheme that recognises your hard work and contributions to esure’s success. 25 days annual leave, plus 8 flexible days and the ability to buy and sell further holiday. Our flexible benefits platform is loaded with perks to choose from, so you can build a personal toolkit to support your health, wellbeing, lifestyle, and finances. Company funded private medical insurance for qualifying colleagues. Fantastic discounts on our insurance products! 50% off for yourself and spouse/partner and 10% off for direct family members. We’ll elevate your career with hands-on training, mentoring, access to our exclusive academies, regular career conversations, and expert partner resources. Driving good in the world couldn’t be more important to us. Our colleagues can use 2 volunteering days per year to support their local communities. Join our internal networks and communities to connect, learn, and share ideas with likeminded colleagues. We’re a proud supporter of the ABI’s ‘Make Flexible Work’ campaign and welcome you to ask about the flexibility you need. Our hybrid working approach also puts you in the driving seat of how and where you do your best work. And much more; See a full overview of our benefits here Reward and benefits | Esure Group PLC We are committed to creating an inclusive and diverse workplace where everyone feels valued, respected, and empowered. We celebrate individuality and create spaces where unique backgrounds and experiences can come together. We believe that diverse perspectives drive innovation, in turn enabling us to better serve our customers, community and build a stronger organisation. Our commitment to inclusion extends to every part of our business, from hiring practices to professional growth opportunities, ensuring equal access and support for all.

Senior Data Engineer- Spark & Databricks Optimisation- Up to £55K. Databricks (but AWS, Azure or GCP.

A next-generation technology partner is seeking a Senior Manager Databricks Engineer to lead the delivery of high-quality data and ML solutions. The ideal candidate will have strong experience with Databricks, cloud platforms like AWS, Azure, or GCP, and a proven ability to lead and mentor teams.

The ideal candidate will have over 10 years of expertise in building SAS workflows and a strong track record in legacy SAS modernization projects, particularly involving Databricks and Spark.

The role demands expertise in data analytics and engineering, with hands-on experience using Databricks and Power BI.

A leading data and AI company in the United Kingdom is seeking a Tech Recruiter to drive recruitment in the EMEA region.The ideal candidate will have 2-3 years of in-house recruiting experience within the SaaS, Data, or AI sectors.You will develop unique recruitment strategies, build engaged talent

This hybrid role requires deep expertise in Data Engineering with a focus on Azure Databricks, Python, and Spark.

Azure data platform – Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage; infrastructure as code for data workloads (Terraform or Bicep). Databricks – Delta Lake, Unity Catalog, job cluster vs interactive cluster trade‑offs, cost‑aware compute management,

You will facilitate onboarding, lead technical strategies, and manage complex customer accounts, ensuring success and value extraction from Databricks' offerings.

A prominent technology recruitment firm in Central London is seeking a Databricks Lead Engineer to drive a major data platform re-engineering programme. Strong experience with Databricks, Unity Catalog, and AWS is required.

A leading data and AI company is looking for a Staff People Partner to act as a strategic advisor.This role focuses on building high-performance cultures, managing talent, and driving organisational excellence amidst rapid growth and AI-driven changes.The ideal candidate will have proven HR experien

At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. Individuals looking for employment at Databricks are considered without regard to a

A leading tech solutions provider is seeking a Technology Architect specializing in Databricks to join their team in London.

Candidates should have proven experience in data architecture or lead data engineering, deep expertise in Databricks, and advanced SQL performance tuning skills.

The Forward Deployed Engineering (FDE) team is a highly specialized, customer-facing software engineering team at Databricks. Lead architecture and design decisions, ensuring solutions are secure, scalable, and aligned with both customer needs and Databricks best practices. Design and develop applic

The ideal candidate will have strong skills in Databricks, Azure Data Factory, and Python, helping to design and deliver quality data solutions within the firm's data office.

Senior Azure Databricks Data Engineer | Commodities & Energy Trading | Greenfield Next-Gen Lakehouse | Up to £110K + Bonus + Benefits. Architect and build scalable data solutions using Snowflake, Databricks, Synapse/Fabric, and PySpark.

A leading technology consultancy in the United Kingdom seeks an experienced SC Cleared Databricks Engineer to join their team. This role focuses on designing and delivering advanced Databricks solutions within the AWS ecosystem.

This role requires extensive experience in data engineering, specifically with AWS services and Databricks.

Ideal candidates will have over 3 years of experience, strong skills in Python, Databricks, and AWS, and be advanced in SQL.

Experience with Databricks, along with proficiency in Python and R, is essential for success in this role, which offers opportunities for mentoring and collaborative projects.

Databricks EMEA Emerging Business Partner of the Year. Our projects are fast-paced, typically 2 to 4 months long, and primarily use Apache Spark/Databricks on AWS/Azure. Proven experience with Databricks.

Databricks Engineer – Fully remote – 6‑month contract – £550‑£650 per day – Outside IR35. Building and optimising Databricks pipelines. Strong Databricks and PySpark experience.

A global financial services firm in Greater London seeks a Lead Data Engineer to design and deliver data solutions.You will develop, test, and maintain essential data pipelines while ensuring data security and stability.The ideal candidate has strong experience with AWS, Python, and SQL, and will wo

The role focuses on modernising data platforms with Azure and Databricks, building scalable pipelines, and optimising analytics solutions. Candidates should excel in Databricks and possess experience in multi-client delivery.

Databricks is headquartered in San Francisco, with offices around the globe and was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake and MLflow. At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. Individuals looking for em

A leading financial services firm in Greater London is looking for a skilled Data Engineer to design and optimize data pipelines using Databricks and AWS. The ideal candidate will possess proficiency in Databricks along with strong problem-solving capabilities.

A leading data and AI company in Greater London seeks an experienced Engineering Manager to lead and support a talented engineering team.The role requires at least 5 years of engineering experience and a minimum of 2 years in engineering management.Responsibilities include hiring, career development

Candidates should have extensive experience in data engineering and a solid track record with Databricks projects. A leading technology firm is seeking an experienced Solutions Architect specializing in Databricks to work on fully remote contracts.

The position involves designing and implementing scalable data platforms with a strong focus on Databricks and Azure Data Factory.

A data consultancy in Greater London is looking for a Data Engineer to build data solutions using Databricks in a hybrid role. The ideal candidate will have solid experience in Databricks, SQL, and Spark, as well as a good understanding of data modelling and pipelines.

Databricks is seeking a Genie + AI/BI Sales Specialist to help enterprise customers transform how business users interact with data. This high-impact role sits within the AI Go-To-Market team and partners closely with Enterprise Account Executives to drive adoption of Databricks AI/BI and Genie. Mor

You will demonstrate a passion for the job and lead by example by putting Databricks and our customers first to achieve the sales and delivery mission.

A leading data and AI company in London is seeking a Senior Solutions Architect to oversee technical engagements in the Energy sector.This role requires engagement with a globally distributed customer base and coaching of junior staff.Ideal candidates will have a strong background in Data Science an

At Databricks, we strive to provide comprehensive benefits and perks that meet the needs of all of our employees. At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. Individuals looking for employment at Databricks are considered without regard to a

A strong background in Databricks, data modeling, and cloud environments like Azure is essential. An innovative consultancy in London is seeking a Data Architect to lead the design and implementation of Databricks Lakehouse solutions.

Enable transformational initiatives: Guide strategic customers through their end‑to‑end big data journeys—migrating from legacy platforms and deploying industry‑leading data and AI applications on the Databricks platform. At Databricks, we are committed to fostering a diverse and inclusive c

A global information and analytics company seeks a Software Engineer III to develop Java-based backend services and implement Scala/Spark pipelines for metric computations.This role emphasizes collaboration within a cross-functional team and requires experience with RESTful APIs.Flexible working hou

You will lead your team, customer and partners to identify impactful big data and AI use cases whilst proving out their value on the Databricks Data Intelligence Platform. More than 10,000 organizations worldwide — including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500 — rely

You will develop 'technical champions’ within our top Partners, providing enablement on technical matters related to the Databricks product. Working with our partners, you will help our customers achieve tangible, data-driven outcomes through our Databricks Data Intelligence Platform, enabling dat

At Databricks, we are committed to fostering a diverse and inclusive culture where everyone can excel. As a Big Data Solutions Architect (Internal Title – Resident Solutions Architect) in our Professional Services team you will work with clients on short to medium‑term customer engagements on th

Do you want to help solve the world's toughest problems with big data and AI? This is what we do everyday at Databricks. Reporting to the Director, Sales, as an Enterprise Account Executive at Databricks you will come with an informed and compelling point of view on the Big Data, Advanced Analytics

A leading technology firm in Greater London is seeking an Engineering Manager to build and lead teams focused on mission-critical Lakebase services.The role involves driving continuous delivery, managing storage system development, and ensuring operational excellence.Candidates should have at least

A leading data and AI company is seeking a Public Sector Account Executive to drive adoption and engagement within enterprise organizations.The role requires expertise in sales to public sector accounts, a proven track record in business development, and the ability to create strategic partnerships.

This role is critical to a major data transformation and involves leading technical decisions around Azure and Databricks. Ideal candidates will possess strong Azure and SQL skills, with experience in Databricks and PySpark.

A European consultancy is seeking a Databricks-focused Machine Learning Engineer for a contract role in the United Kingdom. The ideal candidate will have strong expertise in Databricks, DevOps practices, and excellent communication skills.

A track record of delivering large Databricks data transformations & appropriate Databricks industry certifications. We are currently looking for an exceptional Senior Manager to lead on developing our Data Engineering Capability with an initial focus on Databricks. Lead the design and implementatio