Data Engineering/Consultant Specialist
Pune (Pune Division)
Job description
Job description
Some careers shine brighter than others.
If you’re looking for a career that will help you stand out, join HSBC, and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.
HSBC is one of the largest banking and financial services organizations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realize their ambitions.
We are currently seeking an experienced professional to join our team in the role of Consultant Specialist
In this role you will:
A set of technically experienced, knowledgeable and skilled Data Engineers that can develop data technology solutions. As Data Engineers, they will play a crucial role in designing, building, and maintaining our data infrastructure and system. They should not be averse to adopting the latest technologies and work in parallel with Cross-functional teams like Data Architects and Analytical Engineers. Skills can include developing code using various algorithms and languages (e.g. Python, R, Scala), deep knowledge in data lifecycle management (e.g. data sourcing, ingestion, data warehouse, data refinery, big data, migration, API development and Code review), the associated groups strategic tools (e.g. Collibra, Qlik, Quentexa, Teradata, Cloudera), problem-solving skills, and a deep understanding of data engineering principles.
Key Responsibilities:
· Design and Develop Data Infrastructure: Architect, build, and optimize scalable data infrastructure, including data warehouses, data lakes, ETL/ELT processes, big data systems which maintain enterprise data and allow queries to be run against it
· Data Integration: Implement efficient and reliable data integration pipelines, ensuring the smooth flow of data from various sources to target systems. Also experience in APIs, feature engineering etc.
· Data Modeling and Schema Design: Design and implement data models and schemas that support business requirements and optimize data retrieval and analysis.
· Data Quality and Governance: Develop and implement data quality checks, data validation processes, and data governance practices to maintain data integrity and accuracy.
· Performance Optimization: Identify performance bottlenecks, optimize data processing and storage systems, and improve overall data pipeline efficiency.
· Data Security: Ensure data privacy and security by implementing appropriate access controls, encryption techniques, and data protection measures.
· Collaboration: Collaborate with cross-functional teams, including data scientists, analysts, and software engineers, to understand their data needs and provide technical support.
· Documentation and Monitoring: Create and maintain technical documentation, data dictionaries, and monitoring systems to track data pipeline performance and identify issues.
· Troubleshooting and Issue Resolution: Investigate and resolve data-related issues, including data quality issues, system failures, and performance degradation.
· Data Architecture and Technology Evaluation: Stay updated with industry trends and emerging technologies in data engineering, and evaluate their potential impact and suitability for the organization.
· Cloud-based Digital Solutions – Understand the latest technologies to build scalable and efficient applications that can run quickly on Internet/Cloud (Any Cloud Platform) .
· Experience in programming skills in Python. Hands on in reading APIs, connecting SQL, and other database pipeline automation tasks using Python.
· Deploying mix of screen scrapping, automation on the glass and/or ICR/OCR offerings – to implement low cost automation solutions in order to improve productivity and efficiency for the BackOffice operations in a rapid application development and delivery model. Knowledge of Python is a must.
· Drive industry leading solutions leveraging DevOps and Agile on Heritage and Niche Technologies to support group strategy
· Open Source development – Monitor servers and determine the use of PUBLIC resources by open source programs. Demonstrate the understanding of the functionality of the open source project. Knowledge of MySQL,MS SQL or similar is must and any other databases will be useful.
· Support in providing technical leadership, evaluation and recommendations for data consumption engines and new technologies that can be used to advance new features and capabilities around analytics and use derived data sets
· Leverage sound judgment and problem solving to tackle most critical problems and connect the dots to broader data solution
· Support build, publish and maintenance of Data Assets for real-time and analytics consumption
Requirements
To be successful in this role you should meet the following requirements:
· Bachelor’s degree
· Exp : 4+ Years
· Knowledge and understanding of financial services will be good.
· Strong proficiency in database management/development and working experience with relational databases, data modeling, and schema design.
· Proficiency in data integration tools, ETL/ELT frameworks, and data pipeline orchestration tools.
· Demonstrated skill as a leader, experience in team management.
· Understanding of data warehousing concepts, dimensional modeling, and data governance practices.
· Knowledge of data security and privacy principles, as well as experience implementing data security measures.
· Takes ownership of personal and professional development, increasing professional knowledge and skills experience
· Practically and theoretically skilled in Python (Access APIs, GCP Connectivity, SQL Connectivity), SQL Skills; Working experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services (e.g., AWS Glue, Azure Data Factory, GCP Dataflow).
· Proven organizational, analytical, problem-solving and verbal & written communication skills.
· Strong communication skills and able to successfully articulate technical concepts to both business and technology audience
· Effective Project management, Time management & prioritization skills with an ability to prioritize competing demands and deliver against stringent deadlines
· Experience of managing migration of processes and exposure to diverse/multi-culture work environments & geographies
· Acts as a team member and shows a positive collaborative attitude, promoting HSBC’s values and behaviours;
· Demonstrates self-awareness of own strengths and weaknesses, seeking feedback, building open and honest relationship with colleagues/managers
· Working experience as a consultant across several domains/firms with an exposure to different technology platforms and architecture models is a huge plus
You’ll achieve more when you join HSBC.
www.hsbc.com/careers
HSBC is committed to building a culture where all employees are valued, respected and opinions count. We take pride in providing a workplace that fosters continuous professional development, flexible working, and opportunities to grow within an inclusive and diverse environment. Personal data held by the Bank relating to employment applications will be used in accordance with our Privacy Statement, which is available on our website.
Issued by – HSBC Software Development India