Data DevOps Engineer
7 days ago
Watford
Data DevOps Engineer Are you passionate about building scalable, reliable data infrastructure in the cloud? Join our innovative team as a Data DevOps Engineer and play a pivotal role in transforming how data powers decision-making and operational excellence. This is your chance to work at the forefront of cloud-native data architecture, ensuring seamless deployment, management, and optimization of large-scale analytics solutions that drive impactful insights and business growth. Compensation: £85,000 p/a Work Model: 3 days on site per week in Watford What You'll Do: • Design, implement, and maintain AWS-based data infrastructure leveraging Redshift, S3, EMR, and other cloud services., • Develop and oversee CI/CD pipelines for ETL processes and Power BI deployments, ensuring rapid, error-free code releases., • Automate environment provisioning and data workflows using Terraform, Docker, Kubernetes, Python, and other automation tools., • Manage data provisioning workflows, environment freshness, and synchronization across development, testing, and production stages., • Optimize data pipelines for performance, resource utilization, and cost efficiency while ensuring high reliability and scalability., • Establish observability frameworks with CloudWatch, Grafana, or Datadog for proactive monitoring and troubleshooting., • Collaborate with cross-functional teams to enhance deployment strategies, resolve technical issues, and implement best practices in security, compliance, and governance., • Extensive experience with AWS cloud services (Redshift, S3, Lambda, EMR, CloudFormation/Terraform)., • Proficiency in CI/CD tools such as Jenkins, GitHub Actions, or similar., • Strong scripting skills in Python for automation, logging, and observability integrations., • Expertise in SQL, especially Redshift, and in managing large-scale data processing frameworks like Spark and EMR., • Hands-on experience with containerization (Docker, Kubernetes)., • Professional certifications such as AWS Certified Solutions Architect and AWS Certified DevOps Engineer are highly desirable., • Deep understanding of environment management, code promotion, deployment pipelines, and release management., • Experience with Power BI, DAX, and data modeling for optimized reporting., • Knowledge of big data orchestration tools like Apache Airflow., • Previous exposure to regulated environments such as finance, healthcare, or gaming., • Bachelor’s or Master’s degree in Computer Science, Data Analytics, or related field., • Ability to work within an agile team, managing multiple deliverables simultaneously., • Strong troubleshooting skills and the ability to diagnose complex cloud-based issues.