Lead Data Engineer
20 days ago
Nottingham
We are looking for a Lead Engineer to join our Ascend Cloud Foundation Platform team. We unlock the power of data to create opportunities for consumers businesses and society. At lifes big moments from buying a home or car to sending a child to university to growing a business exponentially by connecting it with new customers we empower consumers and our clients to manage their data with confidence so they can maximize every opportunity. Reporting into our Senior Client Delivery Manager you will to join an established agile team with a passion and lead a technical team that supports innovation learning and collaboration. Ensure that the team follows the highest technical standards. Support Agile methods to deliver high value outcomes. Main responsibilities: • Lead an outstanding Agile technical team, • Build data pipelines and data lake, • Deliver quality software, • Collaborate with the risk security and compliance teams to ensure adherence to regulatory requirements (e.g. GDPR PCI DSS) and industry standards related to data privacy and security, • Understand where there are overlapping technical requirements in your team and other teams and help build out technology roadmaps, • Codebase ownership, • Technical Application ownership Qualifications : • Strong experience with DevOps & IaC tooling - Terraform CI/CD pipelines Git Jenkins, • Strong experience of developing on Apache Spark/Hadoop, • Strong experience with AWS cloud services including (but not limited to) AWS Glue S3 Step, • Strong experience building data pipelines and data lake, • Experience of the full development lifecycle/application Lifecycle Management Tools - BitBucket & Jira, • Significant experience of programming using Scala or Python. Configuration as code principles and API integration, • Ability to explain solutions to technical and non-technical audiences, • Write clean scalable and re-usable code that implements SOLID principles common design patterns where applicable and adheres to published coding standards, • Ability to analyse investigate and compare large data sets when required, • Functions Lambdas EventBridge SQS and Lake formation, • Experience with automated testing methodologies Additional Information : Benefits package includes: • Hybrid working, • Great compensation package and discretionary bonus, • Core benefits include pension bupa healthcare sharesave scheme and more Experian is proud to be an Equal Opportunity and Affirmative Action employer. Innovation is an important part of Experians DNA and practices and our diverse workforce drives our success. Everyone can succeed at Experian and bring their whole self to work irrespective of their gender ethnicity religion colour sexuality physical ability or age. If you have a disability or special need that requires accommodation please let us know at the earliest opportunity. Experian Careers - Creating a better tomorrow together Find out what its like to work for Experian by clicking here Remote Work : No Employment Type : Full-time Key Skills Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala Department / Functional Area: Product Development Experience: years Vacancy: 1