Data Engineering
Azcapotzalco (Azcapotzalco)
Job description
Job description
If you’re looking for a career where you can make a real impression, join Global Service Center (GSC) HSBC and discover how valued you’ll be. HSBC is one of the largest banking and financial services organizations the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realis their ambitions.
We are currently seeking an experienced professional to join our team in the role of Data Engineering
The GCDR application (hosted on Hadoop platform) is primarily concerned with entity resolution (matching internal and external party data together to form single view of the customer). It covers all four lines of business across 57+ markets. It also supports other services such as UI, reporting, network generation, APIs etc.
This role has two elements, the priority is ensuring the health, communication and root cause analysis of the daily production runs as part of a follow the sun support model/team and secondly to act as a Spark Developer for change (continuous improvement) and automation.
The developer aspect includes development, programming, and maintenance of applications using the Apache Spark open-source framework. They work with different aspects of the Spark ecosystem, including Spark SQL, Datasets, and streaming. A Spark Developer must have strong programming skills in Unix, Scala, or Python. They should also be familiar with big data processing tools and techniques.
· Monitor daily production batches including weekend support on a rota basis, eg once a month.
· Take necessary action in case of failures, undertake root cause analysis and request (or perform) remedial action, eg fix code, fix configuration
· Develop, program, and maintain applications using the Apache Spark open-source framework
· Work with different aspects of the Spark ecosystem, including Spark SQL, Datasets, and streaming
Become familiar with the multiple applications and use cases that are supported on this platform
Requirements
Skills
· Strong programming skills in Java, Scala, or Python, ideally also Spark and Unix, or a programming language associated with data engineering.
· Background in hands-on technical development
· Familiar with big data processing tools and techniques
· Good understanding of distributed systems
· Excellent analytical and problem-solving skills
· Excellent English, written and verbal
· Team player but with ability to work independently and proactively
· A strong technical communication ability with demonstrable experience of working in rapidly changing client environments.
Enthusiam to learn and expand their technical and non technical skills/knowledge
· Experience in devops
· Expertise building and deploying production level data processing batch systems maintained by application support teams.
· Experience with a variety of modern development tooling (e.g. Git, Gradle, Nexus) and technologies supporting automation and DevOps (e.g. Jenkins, Docker)
· Knowledge of testing libraries of common programming languages (such as ScalaTest or equivalent). Knows the difference between different test types (unit test, integration test) and can cite specific examples of what they have written themselves.
· Experience working in an Agile environment
· Experience working with Quantexa software
· Quantexa Data Engineering Certification
· Industry knowledge of the current state of data management trends & regulation
· Experience of working within a large, complex and geographically dispersed organization (including matrix management structure and across time zones).
· Experience in managed services AWS EKS, Azure EKS
· Experience in Angular
· Microservices (OCP, Kubernetes)
Due to the urgent hiring need, candidates with immediate right to work locally and no relocation need will be prioritised.
At HSBC we offer our colleagues a greater number of leave days so that they can fully enjoy their wedding, take care of the new member of the family, or grieve the loss of a family member. Our paid leave package is at the forefront in Mexico, now you have one more reason to be HSBC and proudly live a culture of well-being, balance and care.
HSBC is an equal opportunity employer committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and, opportunities to grow within an inclusive and diverse environment. We encourage applications from all suitably qualified personsirrespective of, but not limited to, their gender or genetic information, sexual orientation, ethnicity, religion, social status, medical care leave requirements, political affiliation, people with disabilities, color, national origin, veteran status, etc., We consider all applications based on merit and suitability to the role.
Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.
***Issued By HSBC Electronic Data Process Mexico Private LTD***