DRA Data Engineer/Financial Crime Risk IT
Hyderabad (Hyderābād) IT development
Job description
Designation : CS .
Location : Hyd .
Background
Compliance / Financial Crime Risk (FCR) is the Global Function that brings together all areas of financial crime risk management at HSBC.
FCR is dedicated to implementing the most effective global standards to combat financial crime (including anti-money laundering, sanctions and anti-bribery and corruption compliance).
Financial Crime Threat Mitigation (FCTM) is a sub-function of FCR with the responsibility of identifying, analysing and investigating financial crime risk proactively, effectively and efficiently, and ensure proper mitigation of these risks within HSBC. FCTM is a global team comprising investigators, intelligence analysts, data scientists, subject matter experts, liaison specialists and innovation specialists.
FCR IT is responsible for building and supporting the IT systems that are used within FCR/FCTM. The current FCR IT architecture is based on a large on premise Hadoop cluster for data management and analytics.
HSBC IT (including FCR IT) has started a very ambitious programme of work to migrate data & analytics onto Google Cloud Platform (GCP).
This role is needed to support the FCR IT move to GCP in 2019 (and beyond).
Responsibilities
• Help to deliver GCP development projects (including: design, development/coding, testing & deployment into Production) e.g.
• example 1: Build event driven pipeline: a message is published by an HSBC system > Pub/Sub > Dataflow > model prediction > save results in BigQuery.
• example 2: Build batch process: large file is generated in an HSBC Hadoop cluster > batch job transfers file to Google Cloud Storage > data is copied to BigQuery.
• example 3: Write a complex Dataflow/Beam job in Java or Python to merge customer & reference data > update the customer profile in Bigtable > re-calculate customer risk score.
• example 4: Build a secure analytics environment in GCP for Data Scientists (they want to use tools like... Python, R, Jupyter notebook, ML libraries, BigQuery).
• Collaborate with central teams (architecture, security, engineering, networks) who are responsible for delivering HSBC's baseline cloud architecture.
• Collaborate with other development teams that are also working to deliver use cases on GCP (share best practice).
Previous Experience
• Development role on a large IT project (requirements, design, development, testing, data, infrastructure).
• Proven track record of delivery.
• Development role on a large cloud implementation/migration project, preferably GCP (optional).
• Banking and/or Finanicecial Crime Risk experience (optional).
Technical Skills - must-have
• Some knowledge of cloud architecture & services (preferably GCP, but AWS is ok).
• Java.
• Linux, Bash/shell scripting.
• Data (e.g. big data, databases, data pipelines/transformation, metadata, entitlements).
• Databases (SQL, no-SQL).
• Big Data (Hadoop ecosystem, Hortonworks, HDFS, Hive).
• DevOps principles & tools (e.g. CICD, Bamboo/Jenkins, Github/Bitbucket, JIRA, Confluence).
• Agile development principles (e.g. Scrum, Kanban, MVP, Jira, Confluence).
Technical Skills - nice-to-have
• Python.
• Analytics (Jupyter Notebook, R, Machine Learning, Deep Learning)
• GCP or AWS certified.
• Apache Beam and/or Google Dataflow
• Containers (Docker, Kubernetes).
• Experience of streaming data using frameworks/tools (Spark/Flint/Storm etc).
• Spark.
• Automation toolset (Terraform, Ansible or Saltstack).
• Encryption (CMEK, KMS, HSM)
• Security (IAM, roles, service accounts, entitlements).
• Network configuration, VPC, VPN.
Additional Requirements
• Good communication (verbal, written, email). Ability to explain complex ideas.
• Ability to work as part of an agile team (familiarity with agile methodology).
• Ability to work in a team that is located across multiple countries/regions.
• Willingness to adapt and learn new things.
• Takes ownership of tasks.
• GSOH.
Desired profile
Qualifications :
Any graduate