Principal Data Architect
4 days ago
Nottingham
Principal Data Architect Location: Nottingham or Londo nWorking Model: Hybrid — 3 days per week in offic eAbout the Rol e UST is seeking a Principal Data Architect to define and drive the architectural direction of a large-scale, complex data transformation programme. This is a senior, influence-led role, not a hands-on engineering position, for a recognised technical authority who shapes strategy, builds consensus, and raises the architectural bar across a multi-disciplinary data organisatio n.You will own the end-to-end data architecture across the full data lifecycle: from real-time ingestion and high-quality data capture, through large-scale distributed processing, structured storage and Data LakeHouse design, to curated consumption by Data Scientists, Analysts, Engineers and AI/ML platforms. Spark and distributed data processing sit at the heart of this architecture; deep fluency in these domains is essentia l. What You’ll Do:Architectural Leaders • hipDefine and evolve the enterprise data architecture strategy, with a primary focus on Cloud-scale Distributed Data Processing using Apache Spark and PySpark at the core of the platf, • ormEstablish and maintain architectural artefacts, reference architectures, Architecture Decision Records (ADRs), technical standards, and architecture roadmaps, for the distributed data processing and storage dom, • ainLead architectural governance across the Data LakeHouse, streaming pipelines, and Data Products, ensuring scalability, performance, and engineering excellence are embedded by des, • ignDrive simplification and standardisation across the architecture, promoting reuse of proven patterns, appropriate SaaS solutions, and Enterprise platform capabilit ies Stakeholder Influence & Collabora • tionInfluence and align senior stakeholders, internal customers, and Enterprise partners on key technology decisions and the architectural direction of the data ecosy, • stemPartner with Product Management, Engineering, Cyber, and the broader Architecture community to solve complex data challenges and unlock business v, • alueServe as a passionate advocate for the data platform, driving awareness, adoption, and usage aligned to Enterprise architecture standards and patt, • ernsEngage actively with UK and Enterprise Architecture groups, contributing to cross-domain standards and architectural thin king Architecture Excellence & Cu • ltureNurture architectural excellence within the Data team by leading technical design reviews, setting best practices, and coaching Engineers, Data Scientists, and Analysts on sound architecture princ, • iplesFoster a culture of innovation within the data platform, identifying opportunities to leverage emerging technologies, including Generative and Agentic AI, within the architecture and development life, • cycleChampion data-driven thinking across the wider organisation, supporting the evolution of a scalable, data-led cu lture What You’ll Bring:Essential Experience & Exp • ertiseDemonstrable track record as a Principal, Lead, or Senior Data Architect in a large, complex, data-led organisation, operating at an influence and strategy level rather than hands-on de, • liveryExpert-level understanding of Apache Spark and PySpark as the foundation of distributed data processing architectures, including tuning, optimisation, and enterprise-scale deployment pa, • tternsDeep expertise in designing and evolving Data LakeHouse architectures, covering ELT pipeline design, structured/semi-structured data processing, partitioning strategies, and Data Product de, • liveryStrong command of workflow orchestration at scale using Apache Airflow or equivalent, integrated with Spark-based processing pip, • elinesProven expertise in Streaming Data and Event-Driven Architecture design, enabling real-time data flows at enterprise, • scaleHands-on architectural experience with AWS data services, including AWS Glue (Spark-based ETL), Serverless compute, DynamoDB, S3-based Lake architectures, and associated security and governance t, • oolingWorking knowledge of ML and Generative AI platform architecture, including the design of Agentic AI systems within the data and software development lif ecycle Leadership & Commun • icationExceptional communication skills, able to articulate complex technical architecture to senior business stakeholders and translate business strategy into actionable data architecture de, • cisionsA natural collaborator and influencer, able to build consensus across technical, product, and executive communities without direct au, • thorityExperience embedding and scaling architectural thinking within large Enterprise settings, elevating the capability of multi-disciplinary dat, • a teamsProficiency in software engineering principles, CI/CD practices, and DevOps culture as they apply to data platform d elivery