GCP Data Engineer/ Consultant Specialist
Pune (Pune Division) IT development
Job description
Job description
Some careers shine brighter than others.
If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.
HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.
We are currently seeking an experienced professional to join our team in the role of Consultant Specialist
In this role, you will:
· Co-ordinations with stakeholders to ensure timely deliverables.
· Provide solution architecture support to projects where required ensuring that solution defined meets business needs, is aligned to functional and target architecture with any deviations approved.
· Analyze and propose plan to demise legacy systems.
· Lead a team of data engineers and assume responsibilities as Technical Lead for the assigned projects.
· Ensure full ownership and efficient management of the GDT IT services and products.
· Ensure that any new technology products are taken through the technology design governance process.
· Mentor and coach less experienced members of staff and promotes an understanding of the value of architecture and of use of technologies and standards in their domain across IT.
· Periodical monitor of team progress.
· Delivering optimum solution that meets client requirements.
· Inputs provided for Estimations, Monitoring & Co-ordinate team related activities.
· Involved in Designing, Development & Unit testing, Performance Testing the application
Requirements
To be successful in this role, you should meet the following requirements:
· Have Extensive Experience in IT data analytics projects, Hands on experience in migrating on
· premise ETLs to Google Cloud Platform (GCP) using cloud native tools such as BIG query, Cloud Data,Proc, Google Cloud Storage, Composer.
· SQL concepts, Presto SQL, Hive SQL, Python (Pandas, Numpy, SciPy, Matplotlib) and Pyspark to cope up with the increasing volume of data.
· Design and implement scalable data pipelines using Google Cloud Dataflow.
· Develop and optimize BigQuery datasets for efficient data analysis and reporting.
· Collaborate with cross-functional teams to integrate data solutions with business processes.
· Automate data workflows using Cloud Composer and Apache Airflow.
· Ensure data security and compliance with GCP Identity and Access Management.
· Mentor junior engineers in best practices for cloud-based data engineering.
· Implement real-time data processing with Google Cloud Pub/Sub and Dataflow.
· Continuously evaluate and adopt new GCP tools and technologies.
You’ll achieve more when you join HSBC.
www.hsbc.com/careers
HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.
Issued by – HSDI