Senior Data Engineer
Barcelona, SPAIN IT development
Job description
Overview
About D+A in PepsiCo
PepsiCo operates in an environment undergoing immense and rapid change. Big-data and digital technologies are driving business transformation that is unlocking new capabilities and business innovations in areas like eCommerce, mobile experiences and IoT. The key to winning in these areas is being able to leverage enterprise data foundations built on PepsiCo’s global business scale to enable business insights, advanced analytics and new product development. PepsiCo’s Enterprise Data Operations (EDO) team is tasked with the responsibility of developing quality data collection processes, maintaining the integrity of our data foundations and enabling business leaders and data scientists across the company to have rapid access to the data they need for decision-making and innovation.
What PepsiCo Enterprise Data Operations (EDO) does:
· Maintain a predictable, transparent, global operating rhythm that ensures always-on access to high-quality data for stakeholders across the company
· Responsible for day-to-day data collection, transportation, maintenance/curation and access to the PepsiCo corporate data asset
· Work cross-functionally across the enterprise to centralize data and standardize it for use by business, data science or other stakeholders
· Increase awareness about available data and democratize access to it across the company
As a member of the data engineering team, you will be the key technical expert developing and overseeing PepsiCo's data product build & operations and drive a strong vision for how data engineering can proactively create a positive impact on the business. You'll be an empowered member of a team of data engineers who build data pipelines into various source systems, rest data on the PepsiCo Data Lake, and enable exploration and access for analytics, visualization, machine learning, and product development efforts across the company. As a member of the data engineering team, you will help lead the development of very large and complex data applications into public cloud environments directly impacting the design, architecture, and implementation of PepsiCo's flagship data products around topics like revenue management, supply chain, manufacturing, and logistics. You will work closely with process owners, product owners and business users. You'll be working in a hybrid environment with in-house, on-premise data sources as well as cloud and remote systems.
Responsibilities
Responsibilities
· Active contributor to code development in projects and services.
· Manage and scale data pipelines from internal and external data sources to support new product launches and drive data quality across data products.
· Build and own the automation and monitoring frameworks that captures metrics and operational KPIs for data pipeline quality and performance.
· Responsible for implementing best practices around systems integration, security, performance and data management.
· Empower the business by creating value through the increased adoption of data, data science and business intelligence landscape.
· Collaborate with internal clients (data science and product teams) to drive solutioning and POC discussions.
· Develop and optimize procedures to “productionalize” data science models.
· Define and manage SLA’s for data products and processes running in production.
· Support large-scale experimentation done by data scientists.
· Prototype new approaches and build solutions at scale.
· Research in state-of-the-art methodologies.
· Create documentation for learnings and knowledge transfer.
· Create and audit reusable packages or libraries.
Qualifications
Qualifications
· 4+ years of overall technology experience that includes at least 3+ years of hands-on software development, data engineering, and systems architecture.
· 3+ years of experience with Data Lake Infrastructure, Data Warehousing, and Data Analytics tools.
· 3+ years of experience in SQL optimization and performance tuning, and development experience in programming languages like Python, PySpark, Scala etc.).
· 2+ years in cloud data engineering experience in Azure.
· Experience with integration of multi cloud services with on-premises technologies.
· Experience with data profiling and data quality tools like Apache Griffin, Deequ, and Great Expectations.
· Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets.
· Experience with at least one MPP database technology such as Redshift, Synapse or SnowFlake.
· Experience with running and scaling applications on the cloud infrastructure and containerized services like Kubernetes.
· Experience with version control systems like Github and deployment & CI tools.
Education
BA/BS in Computer Science, Math, Physics, or other technical fields.
Skills, Abilities, Knowledge
· Excellent communication skills, both verbal and written, along with the ability to influence and demonstrate confidence in communications with senior level management.
· Strong change manager. Comfortable with change, especially that which arises through company growth. Able to lead a team effectively through times of change.
· Ability to understand and translate business requirements into data and technical requirements.
· High degree of organization and ability to manage multiple, competing projects and priorities simultaneously.
· Positive and flexible attitude to enable adjusting to different needs in an ever-changing environment.
· Foster a team culture of accountability, communication, and self-management.
· Consistently attain/exceed individual and team goals
Competencies
· Highly influential and having the ability to educate challenging stakeholders on the role of data and its purpose in the business.
· Understands both the engineering and business side of the Data Products released.
· Places the user in the center of decision making.
· Teams up and collaborates for speed, agility, and innovation.
· Experience with and embraces agile methodologies.
· Strong negotiation and decision-making skill.
· Experience managing and working with globally distributed teams.
What makes us different?
· Hybrid work model: combination of remote and collaborative office experience to enable innovation
· Entrepreneurial environment in leading international company
· Professional growth possibilities & learning opportunities
· Variety of benefits to support your physical, emotional and financial wellbeing
· Volunteering opportunities to help external communities
· Diverse team with more than 30% of female representation & over 30 nationalities
· Have a stake in D&I strategy and bring your whole self to work
About PepsiCo
We believe that culture should be at the cornerstone of everything we do at PepsiCo. We are agile, innovative and not afraid of failure. We want our team to come to work every day excited to explore new ways to bring enjoyment, refreshment and fun to the world.
PepsiCo Positive (pep+) is the future of our organization – a strategic end-to-end transformation, with sustainability at the center of how we will create growth and value by operating within planetary boundaries and inspiring positive change for the planet and people.
So, if you’re ready to be a part of a playground for those who think big, we’d love to chat.
*We encourage the diversity of applicants across gender, age, ethnicity, nationality, sexual orientation, social background, religion or belief and disability
#Location: Barcelona, Spain