Senior Data Engineer

Job description

Job Type

IT

Location

London - Pimlico

Partnership Level

6

Closing Date

24/11/2024

Vacancy Type

Permanent

Salary

£57,600.00 - £92,400.00 Annual

Salary Frequency

Annual

Hours of Work

35

Share

Share job or send it to yourself for later
share

Apply Now

We want all of our Partners to have a good work-life balance and we support flexible working. This might mean flexible or compressed hours, job sharing or shorter hour contracts, where it is possible to do so. Please discuss this further with the hiring manager during your interview.

Our Purpose

Working in Partnership for a happier world – our shared Purpose that guides us in everything we do and inspires 3 important principles; happier people, happier business, happier world. The John Lewis Partnership is a truly unique business, one that seeks to make a positive difference to the lives of everyone.

What’s the role about?

As the UK’s most effective omni-channel retailer, E-Commerce is a key part of Our Business - we run two of the busiest websites in the UK, driving a significant proportion of our sales. Our Engineering practice includes 60+ teams, working on everything from Cloud Platforms to Mobile Apps, from E-Commerce functionality to Machine Learning.

Our Engineers work collaboratively and share knowledge, and learning is extremely important to us. We support our Engineers to continuously improve their skills and keep abreast of the latest technologies.

Find out more about being a Data Engineer in the Partnership, and the technology we use.

What you’ll be doing?

This is an opportunity to join our John Lewis Partnership Data Platform (PDP) team working as a Senior Data Engineer. 

You will be using your extensive Data Engineering skills and experience in designing, implementing and supporting secure cloud-based data platforms, ensuring high-quality delivery outcomes across our data landscape.

The vision for PDP is to embed data-driven decision-making and analytics at scale, across the Partnership. We recognise the importance of data and are backing a significant investment in developing the platform.

We are transforming our in-house Data Engineering capability, which has been at the heart of a move to a cloud-native data platform, to become Product delivery focused. Recent successes have been the PDP underpinning customer experience and loyalty outcomes such as my JL Rewards and the relaunch of my Waitrose.

As a Senior Data Engineer, you will participate in the shaping and delivery of data solutions to meet the needs of a wide variety of stakeholders from across the Partnership. You will be able to propose and build, run and own high quality data products.

You will have a passion for using technology to deliver innovative and innovative software and data solutions and will have a proven history of working in teams delivering complex, performant, high-quality software. We want you to work well in a fast-paced environment and have a focus on quality, ensuring the delivery aligns with the needs of the business, whilst also being supportable and maintainable and with clear ownership. You will be a mentor for exceptional data DevSecOps for our Partners and customers. 

Internally this role is called Product Engineer (PL6)

What you’ll already have:

Expert skills in building cloud-based data pipelines using data orchestration and workflow platforms. We use Airflow/Cloud Composer with Python but you may have experience with different orchestration/workflow tools or programming languages.

·  Experienced running/coaching teams - responsible for designing solutions and aiding the team implement these solutions.
·  Advanced SQL skills, with a deep understanding of how to write performant SQL and debug problems
·  Experience with a cloud-based relational Data Warehousing product
·  Data transformation tools, preferably DBT
·  Cloud-Based data platforms, preferably Snowflake or Big Query
·  Designing secure data pipelines and fixing security/performance issues
·  Identification of data quality issues
·  Deploying to at least one major Cloud Platform such as AWS, GCP or Azure
·  Experience in platform as a code , particularly Terraform
·  Continuous Integration/Continuous Delivery
·  TDD, pair programming, preferably Python
·  Agile development methods such as Scrum or Kanban.

What else you could bring:

·  Containerisation, Kubernetes
·  Built and/or championed observability platforms
·  Event-driven design
·  Gitlab CI, Jenkins, Circle CI, Jira
·  Data orchestration and workflow technologies such as Airflow
·  Visualisation & reporting tools such as Tableau or Looker
·  ETL tools such as Apache Beam or AbInitio
·  Knowledge or experience of DataVault (DV2)
·  Data Visualisation
·  Understanding of Data Management Concepts.

Where will you be working?:

We have opportunities at  both our John Lewis Head Office in London, Pimlico and Waitrose Head Office in Bracknell, Berkshire.

We have a blended hybrid approach of working from our offices and a home/remote UK location. You are contracted to a Partnership office location. If you choose to work remotely you should be aware that from time to time, you will need to come into the office. This decision is made within your team.

At the John Lewis Partnership, we embrace our differences. We want you to be you. Because, well, we know you're at your best when you're free to be yourself. Being a truly inclusive employer to us means creating an environment which celebrates your contribution, regardless of age, gender, race, ethnicity, disability, sexual orientation, social background, religion or belief. It's why we've set our own aim to become the UK’s most inclusive business - for our Partners (employees) and our customers. We firmly believe that our future success lies in diversity of thought from all Partners and it's integral in our mission to build a happier world. We welcome applications from everyone interested in working for us. And, once you're a Partner, your differences will make all the difference. Find out more about D&I in the Partnership here - https://www.jlpjobs.com/about/diversityandinclusion/