Google cloud platform Data Engineer /Senior Lead Consultant Specialist
Pune (Pune Division) IT development
Job description
Job description
Some careers shine brighter than others.
If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.
HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.
We are currently seeking an experienced professional to join our team in the role of Data Engineer /Senior Lead Consultant Specialist
In this role, you will:
· Desing, build and maintain scalable and efficient data pipeline using Apache Beam.
· Strong understanding of Google cloud platform and its core services.
· Strong understanding of data modelling, data pipelines and distributed systems
· Proven experience in managing large scale data systems.
· Leverage GCP services such as Dataflow, Bigquery, Pub/Sub,GCS and Cloud composer etc. for data processing and orchestration
· Hands on experience with tools and technologies such as sql, java, Kakfa etc.
· Experience in writing optimized sql.
· Optimize data pipelines for performance, scalability and cost efficiency.
· Hands-on experience in REST API
· Working knowledge of different microservice design pattern and implementation
· Strong analytical and trouble shooting skills.
· Strong interpersonal skills and ability to work in a team and in global environments.
· Should be proactive, have learning attitude & adjust to work in dynamic work environments.
Requirements
To be successful in this role, you should meet the following requirements:
· Lead , mentor and grow a team of high performing data engineers
· Define and implement data engineering roadmap in alignment with business goals
· Oversee the design and development of data pipelines, ETL process and scalable data infrastructure
· Implement best practices in data governance, security and compliance
· Responsible for development of data pipeline/ database /microservice/ dataflow job with focus on high quality code.
· Evaluate, select and implement data engineering tools framework and technologies
· Ensure high availability, scalability and performance of data platform
· Manage multiple data engineering projects ,ensuring timely delivery and alignment with priorities
· Collaborate with architecture and data governance team to implement data quality, security and compliance framework
· Ensure adherence to regulations
· Define and implement data retention and archival policies
You’ll achieve more when you join HSBC.
www.hsbc.com/careers
HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.
Issued by – HSBC Software Development India