(SC cleared) Data Engineer
21 days ago
Bristol
Description Methods Analytics (MA) is recruiting for a Data Engineer to join our team a permanent basis. This role will be mainly remote but require flexibility to travel to Bristol. What Youll Be Doing as a Data Engineer: • Design and architect modern data solutions that align with business objectives and technical requirements, • Design and implement advanced ETL/ELT pipelines using Python SQL and Apache Airflow, • Build highly scalable and performant data solutions leveraging cloud platforms and technologies, • Develop complex data models to handle enterprise-level analytical needs, • Make critical technical decisions on tools frameworks and approaches for complex data challenges, • Optimise large-scale data processing systems for performance and cost-efficiency, • Implement robust data quality frameworks and monitoring solutions, • Evaluate new technologies to enhance our data engineering capabilities, • Collaborate with stakeholders to translate business requirements into technical specifications, • Present technical solutions to leadership and non-technical stakeholders, • Contribute to the development of the Methods Analytics Engineering Practice by participating in our internal community of practice Your Impact: • Enable business leaders to make informed decisions with confidence through timely accurate data insights, • Drive adoption of modern data architectures and platforms, • Deliver seamless data solutions that enhance user experience, • Elevate the technical capabilities of the entire data engineering team, • Help cultivate a data-driven culture within the organisation, • Establish technical standards and patterns that ensure quality and maintainability Requirements • Experience in SQL Server Integration Services (SSIS), • Good experience with ETL - SSIS SSRS T-SQL (On-prem/Cloud), • Strong proficiency in SQL and Python for handling complex data problems, • Hands-on experience with Apache Spark (PySpark or Spark SQL), • Experience with the Azure data stack, • Knowledge of workflow orchestration tools like Apache Airflow, • Experience with containerisation technologies like Docker, • Proficiency in dimensional modelling techniques, • Experience with CI/CD pipelines for data solutions, • Experience implementing and advocating for test-driven development methodologies in data pipeline workflows including unit testing integration testing and data quality validation frameworks, • Strong communication skills for translating complex technical concepts, • Track record of successful project delivery in a technical leadership capacity, • Experience designing and implementing data mesh or data fabric architectures, • Knowledge of cost optimisation strategies for cloud data platforms, • Experience with data quality frameworks and implementation, • Understanding of data lineage and metadata management, • Experience with technical project management, • Experience with data visualisation tools like Power BI or Apache Superset, • Experience with other cloud data platforms like AWS GCP or Oracle, • Experience with modern unified data platforms like Databricks or Microsoft Fabric, • Experience with Kubernetes for container orchestration, • Understanding of streaming technologies (Apache Kafka event-based architectures), • Software engineering background with SOLID principles understanding, • Experience with high-performance large-scale data systems, • Knowledge of recent innovations in AI/ML and GenAI, • Defence or Public Sector experience At Methods Analytics we believe in a transparent hiring process. Heres what you can expect: 1. Internal Application Review, 2. Initial Phone Screen, 3. Technical Interview, 4. Pair Programming Exercise, 5. Final Interview, 6. Offer Benefits Methods Analytics (MA) exists to improve society by helping people make better decisions with data. Combining passionate people sector-specific insight and technical excellence to provide our customers an end-to-end data service. We use a collaborative creative and user centric approach to data to do good and solve difficult problems. Ensuring that our outputs are transparent robust and transformative. We value discussion and debate as part of our approach. We will question assumptions ambition and process but do so with respect and humility. We relish difficult problems and overcome them with innovation creativity and technical freedom to help us design optimum solutions. Ethics privacy and quality are at the heart of our work and we will not sacrifice these for outcomes. We treat data with respect and use it only for the right purpose. Our people are positive dedicated and relentless. Data is a vast topic but we strive for interactions that are engaging informative and fun in equal measure. But maintain a steely focus on outcomes and delivering quality products for our customers. We are passionate about our people; we want out colleagues to develop the things they are good at and enjoy. • Autonomy to develop and grow your skills and experience, • Be part of exciting project work that is making a difference in society, • Strong inspiring and thought-provoking leadership, • A supportive and collaborative environment, • Developmentaccess to Pluralsight and LinkedIn Learning, • Wellness24/7 Confidential employee assistance programme, • Social -office parties pizza Friday and commitment to charitable causes, • Time off- 25 days of annual leave a year plus bank holidays with the option to buy 5 extra days each year, • Volunteering - 2 paid days per year to volunteer in our local communities or within a charity organisation, • PensionSalary Exchange Scheme with 4% employer contribution and 5% employee contribution, • Discretionary Company Bonusbased on company and individual performance, • Life Assuranceof 4 times base salary, • Private Medical Insurancewhich is non-contributory(spouse and dependants included)