Data Engineer (Azure)
22 hours ago
Barcelona
Take your career to the next level with Amaris Consulting as a Data Engineer (Azure & Databricks). Become part of an international team, thrive in a global group with €800M turnover and 1,000+ clients worldwide, and an agile environment by planning the kickoff and follow up on projects. Join Amaris Consulting, where you can develop your potential and make a difference within the company. ✍️ WHAT WOULD YOU NEED? • Experience & background, • At least 4 years of experience as a Data Engineer, • Proven experience designing, developing, deploying, and maintaining ETL/ELT pipelines in a cloud environment, ideally with Azure + Databricks, • Hands-on experience with Microsoft Azure, especially: Azure Data Lake Storage, Azure Data Factory, • Solid knowledge of Databricks, including:Apache Spark (job & cluster optimization), • Databricks Workflows and Jobs Delta Lake, • Strong data modeling skills and proven experience anonymizing data, • Programming in Python (including PySpark) and Excellent SQL skills, • Solid understanding of development best practices, version control (e.g. Git) and CI/CD processes, • Good level of English (spoken and written), • Technical skills – nice to have, • Knowledge of Scala programming, • Experience with other clouds such as GCP or AWS, • Experience building ETLs for third‑party APIs, • Familiarity with data governance concepts and tools, • Experience working within a Lakehouse / medallion architecture is a strong plus 👉 WHAT WILL YOU DO? 👈 As a Senior Data Engineer, you will be responsible for designing and implementing robust, scalable, and secure data solutions on our client’s corporate data platform: • Design & build anonymized data marts, • Design and develop anonymized data marts across multiple source applications on the corporate data platform, • Implement medallion / Lakehouse architectures leveraging Azure and Databricks, • Ensure data marts are fully functional, performant, and secure, • Develop and maintain data pipelines, • Build and maintain ETL/ELT pipelines using Azure Data Factory, Databricks, Spark, and Delta Lake, • Optimize Spark jobs and clusters for performance and cost efficiency, • Integrate data from various sources, including APIs (when applicable), • Data anonymization & governance, • Define and implement anonymization methodologies and protocols across data marts, • Ensure compliance with data privacy and security standards, • Contribute to data governance practices and guidelines, • Documentation & quality assurance, • Produce comprehensive documentation of:Data mart structures, • Anonymization methodologies, • Data management guidelines and standards, • Prepare an Implementation Report with evidence demonstrating the proper functionality of anonymization processes, • Validate all implementations with supporting evidence and documentation to guarantee quality and compliance, • Work closely with data engineers, data architects, analysts, and business stakeholders to understand requirements and translate them into technical solutions, • Provide technical guidance and best practices within the data team, • Contribute to continuous improvement of development standards, CI/CD pipelines, and code quality 🚀 WHY US? 🚀 Join our dynamic team of talented individuals and experience a world of growth and opportunities. Here's what we offer: • Accelerated career growth, • Grow rapidly with a tailored career path and regular salary evaluations, • 70% of our senior leaders started at entry level, • Continuous learning & development, • Enhance your skills through our Tech Academy catalog, Udemy E-learning Platform, language sessions, webinars, and workshops, • Take charge of your development with an annual personal training budget and company-paid certifications, • Flexibility & benefits, • Enjoy flexible policies and remote work options (depending on project), • Benefit from attractive social advantages such as:Transit and restaurant tickets, • Kindergarten support, • Private health insurance, • Wellbeing & support, • Benefit from our WeCare program, supporting employees in critical situations, • Unleash your full potential, both professionally and personally Amaris Consulting is proud to be an equal-opportunity workplace. We are committed to promoting diversity within the workforce and creating an inclusive working environment. For this purpose, we welcome applications from all qualified candidates regardless of gender, sexual orientation, race, ethnicity, beliefs, age, marital status, disability, or other characteristics.