Senior Data Engineer - vitoria gasteiz
8 days ago
Vitoria-Gasteiz
Overview In this role you will help build the global data product foundation that powers PepsiCo’s international growth in digital commerce. You’ll work with a cross-functional team to design, implement, and scale data pipelines and platforms that enable data-driven decisions. You will contribute to engineering best practices and collaborate with product, QA, and IT teams to improve data quality and delivery. This is a chance to shape data infrastructure for a global business and accelerate transformative initiatives in a startup-minded, enterprise environment. Responsabilidades • Own end-to-end data pipeline development, including modeling, testing, scalability, and operability, • Contribute to engineering best practices within the team, • Collaborate with product and technology platforms to implement data solutions, • Participate in architecture discussions and decisions to expand platforms, • Deliver high quality pipelines through analysis, reviews, test automation, and QA collaboration, • Introduce new tools and practices to improve data and code quality, researching or sourcing third-party tools and building in-house tools, • Support pipelines with robust exception handling, monitoring, and debugging production issues, • Manage multiple data sources, analyze data quality, and coordinate with client IT/data teams to resolve issues Requisitos principales, • 5+ years designing and building scalable data systems, • Proficiency in Python, PySpark, SQL, Airflow, DBT, Hadoop (Hive/Impala), AWS, Azure, Snowflake, • Strong interpersonal skills to understand Enterprise Information Management requirements and translate to solutions, • Experience in Retail, E-commerce, or Financial Services preferred, • Strong analytical abilities for complex customer problems and data-driven decisions, • Hands-on experience with large data sets using Python/PySpark/SQL/Hive/Impala, • Proven track record of achievement, entrepreneurial hands-on approach, and strong communication skills, • Deep understanding of database design and engineering, • strong communication, • collaboration, • analytical mindset, • Python, • PySpark, • SQL
Pilar R.Active 3 years ago