Data Engineer II
UNITED KINGDOM IT development
Job description
Nombre del sítio: London The Stanley Building, San Francisco, USA - Washington - Seattle
Fecha de publicación: Feb 6 2024
The Onyx Research Data Platform organization represents a major investment by GSK R&D and Digital & Tech, designed to deliver a step- change in our ability to leverage data, knowledge, and prediction to find new medicines. We are a full-stack shop consisting of product and portfolio leadership, data engineering, infrastructure ,and DevOps, data / metadata / knowledge platforms, and AI/ML and analysis platforms, all geared toward:
·
Building a next-generation data experience for GSK’s scientists, engineers, and decision-makers, increasing productivity and reducing
·
time spent on “data mechanics”
·
Providing best-in-class AI/ML and data analysis environments to accelerate our predictive capabilities and attract top-tier talent
·
Aggressively engineering our data at scale to unlock the value of our combined data assets and predictions in real-time
Data Engineering is responsible for the design, delivery, support, and maintenance of industrialized automated end-to-end data services and pipelines. They apply standardized data models and mapping to ensure data is accessible for end users in end-to-end user tools through the use of APIs. They define and embed best practices and ensure compliance with Quality Management practices and alignment to automated data governance. They also acquire and process internal and external, structured and unstructured data in line with Product requirements.
A Data Engineer II is a technical contributor who can take a well-defined specification for a function, pipeline, service, or other sort of component, devise a technical solution, and deliver it at a high level. They have a strong focus on the operability of their tools and services, and develop, measure, and monitor key metrics for their work to seek opportunities to improve those metrics. They are aware of, and adhere to, best practices for software development in general (and data engineering in particular), including code quality, documentation, DevOps practices, and testing. They ensure the robustness of our services and serve as an escalation point in the operation of existing services, pipelines, and workflows.
A Data Engineer II should be deeply familiar with the most common tools (languages, libraries, etc) in the data space, such as Spark, Kafka, Storm, etc., and aware of the open-source communities that revolve around these tools. They should be constantly seeking feedback and guidance to further develop their technical skills and expertise and should take feedback well from all sources in the name of development.
Key responsibilities for the Senior Data Engineer include:
·
Builds modular code / libraries / services / etc using modern data engineering tools (Python/Spark, Kafka, Storm, …) and orchestration tools (e.g. Google Workflow, Airflow Composer)
·
Produces well-engineered software, including appropriate automated test suites and technical documentation
·
Develop, measure, and monitor key metrics for all tools and services and consistently seek to iterate on and improve them
·
Ensure consistent application of platform abstractions to ensure quality and consistency with respect to logging and lineage
·
Fully versed in coding best practices and ways of working, and participates in code reviews and partnering to improve the team’s standards
·
Adhere to QMS framework and CI/CD best practices
·
Provide L3 support to existing tools / pipelines / services
Why you?
Basic Qualifications:
We are looking for professionals with these required skills to achieve our goals:
·
4+ years of data engineering experience with a Bachelors degree.
·
2+ years of data engineering experience with a PhD or a Masters degree.
·
Cloud experience (e.g., AWS, Google Cloud, Azure, Kubernetes)
·
Experience in automated testing and design
·
Experience with DevOps-forward ways of working
Preferred Qualifications:
If you have the following characteristics, it would be a plus:
·
Software engineering experience
·
Demonstrable experience overcoming high volume, high compute challenges
·
Familiarity with orchestrating tooling
·
Knowledge and use of at least one common programming language: e.g., Python (preferred), Scala, Java, including toolchains for documentation, testing, and operations / observability
·
Strong experience with modern software development tools / ways of working (e.g. git/GitHub, DevOps tools, metrics / monitoring, …)
·
Cloud experience (e.g., AWS, Google Cloud, Azure, Kubernetes)
·
Application experience of CI/CD implementations using git and a common CI/CD stack (e.g. Jenkins, CircleCI, GitLab, Azure DevOps)
·
Experience with agile software development environments using Jira and Confluence
·
Demonstrated experience with common tools and techniques for data engineering (e.g. Spark, Kafka, Storm, …)
·
Knowledge of data modeling, database concepts, and SQL
Closing Date for Applications: Monday 26th February 2023 (COB)
Please take a copy of the Job Description, as this will not be available post closure of the advert.
When applying for this role, please use the ‘cover letter’ of the online application or your CV to describe how you meet the competencies for this role, as outlined in the job requirements above. The information that you have provided in your cover letter and CV will be used to assess your application.
During the course of your application, you will be requested to complete voluntary information which will be used in monitoring the effectiveness of our equality and diversity policies. Your information will be treated as confidential and will not be used in any part of the selection process. If you require a reasonable adjustment to the application / selection process to enable you to demonstrate your ability to perform the job requirements, please contact 0808 234 4391. This will help us to understand any modifications we may need to make to support you throughout our selection process.
#GSKOnyx
Como empresa impulsada por nuestros valores de enfoque al paciente, transparencia, respeto e integridad, sabemos que la inclusión y la diversidad son esenciales para que podamos tener éxito. Queremos que todos nuestros colegas prosperen en GSK, brindando sus experiencias únicas, asegurándonos de que se sientan bien y que sigan creciendo en sus carreras. Como candidato para un papel, queremos que usted se sienta de la misma manera.
Creemos en una cultura de trabajo ágil para todos nuestros roles. Si la flexibilidad es importante para usted, lo alentamos a explorar con nuestro equipo de contratación cuáles son las oportunidades.
No dude en ponerse en contacto con nosotros si desea analizar cualquier ajuste a nuestro proceso que pueda ayudarlo a demostrar sus fortalezas y capacidades. Puede llamarnos al 0808 234 4391 o enviar un correo electrónico Ukdiversity.recruitment@gsk.com .
A medida que lo solicite, le pediremos que comparta alguna información personal que sea voluntaria. Esto se utilizará para ayudarnos a comprender qué tan bien estamos haciendo frente a nuestras ambiciones de inclusión y diversidad. Realmente lo agradeceríamos si pudiera tomarse unos momentos para completarlo. Tenga la seguridad de que los gerentes de contratación no tienen acceso a esta información, no se utiliza en ninguna parte del proceso de selección y trataremos su información de forma confidencial y la utilizaremos de forma anónima.