Associate Data Engineer - Graduate Programme (May 2024 Intake)
SINGAPORE IT development
Job description
Introduction
At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so, lets talk.
Your Role and Responsibilities
You analyze and organize the data needed and work closely with data scientists to query data in order to uncover the stories hidden in data and find patterns in the numbers. As an Associate Data Engineer, you’ll help gather and collect data, store data, and perform batch processing and real-time processing.
You’ll work closely with other teams to determine what data management systems are appropriate and which data are needed for analysis. As an Associate Data Engineer, you’ll be able to wrestle with and help solve problems associated with database integration and messy, unstructured data sets.
Work you could do as an Associate Data Engineer:
· Ability to extract required data from data warehouse for analytics use cases
· Create data ingestion pipelines and deploy the same in production for real-time analytics under guidance and supervision from Senior in the team
· Analyzing raw data with minimum supervision
· Ability to work with flat files and excel files to ingest and transform data
· Working to create relevant documentation on the engagement like data mapping, data profiling reports, architecture views, etc
· Developing and maintaining datasets on various platforms
· Conduct simple to complex data analysis and report on results
· Prepare data for prescriptive and predictive modelling as per requirement listed down by the team
· Combine raw information from different sources
· Create data model on which the analytics would be built
· Ask business and industry questions to identify appropriate modeling techniques
· Communicate results to technical and non-technical audiences
Required Technical and Professional Expertise
· Bachelor or higher degree in IT or Computer Science or Master degree in Business Management equivalent
· Knowledge in computer programing is a must
· Strong fundamentals in Mathematics and Computer Science (algorithms)
· Experience & Knowledge using the following software/tools:
· Knowledge of big data tools: Hadoop, Spark etc.
· Knowledge of Oracle databases and Informatica will be an added advantage
· Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
· Must have solid knowledge in terms of working with Excel and advanced functionality
Preferred Technical and Professional Expertise
· Good at solving problems by looking at things differently, debugging, troubleshooting, and designing & implementing solutions to complex technical issues.
· Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
· Experience supporting and working with cross-functional teams in a dynamic environment.
· You have strong technical and analytical abilities, a knack for driving impact and growth, and some experience with programming/scripting in a language such as Java or Python (this will be an added advantage).
· Basic understanding or experience with data modeling architecture and aspect
· You have an interest in, understanding of, or experience with Design Thinking and Agile Development Methodologies
· Good knowledge in terms of communication with focus in English
· You have a basic understanding of Cloud (AWS,Azure, etc)
· Certification in project management/ agile and design thinking will be an added advantage
· You thrive on teamwork and have excellent verbal and written communication skills.