Architect,Azure Data Engineering

Job description

Overview

1. As part of AMESA/APAC Data and Digital Solutions team, the job requires driving the automation, Azure Data Modeling, Azure Data engineering agenda
He or She will also be aware of agile project delivery and Devops/CI-CD automation.
2. Work on Azure data engineering models/pipelines , automation , setting up Bronze->Silver->Golden layer on entire Azure platform.
a.Key skill sets like Azure data engineering, Azure Data bricks, Azure Synapse/SQL.
b.New Business Requirements / Demand Management / Estimations / Work Intake / Project delivery & sustain
c.In-depth technical knowldge of tools like Azure Data factory, Azure data bricks , Azure Synapse , SQL DB, ADLS , azure infra setup etc.
d.Deliver ETL solution including data extraction, transformation, cleansing, data integration and data management. Implement batch & near real time data ingestion pipelines based on reference architecture.
4.Ability to augment with new sources of data including internal/external untapped data.
5. Operationalize analytics models for production usage ,proper security & access control.
6.Nice to have skills Python, Scala, Java & with advance knowledge of SQL

Responsibilities

1. As part of AMESA/APAC Data and Digital Solutions team, the job requires driving the automation, Data Science, Data Modeling, Azure Data engineering agenda
He or She will also be aware of agile project delivery and Devops/CI-CD automation.
2. Work on Azure data engineering models/pipelines , automation , setting up Bronze->Silver->Golden layer on entire Azure platform.
a.Key skill sets like Azure data engineering, Azure Data bricks, Azure Synapse/SQL.
b.New Business Requirements / Demand Management / Estimations / Work Intake / Project delivery & sustain
c.In-depth technical knowldge of tools like Azure Data factory, Azure data bricks , Azure Synapse , SQL DB, ADLS , azure infra setup etc.
d.Deliver ETL solution including data extraction, transformation, cleansing, data integration and data management. Implement batch & near real time data ingestion pipelines based on reference architecture.
4.Ability to augment with new sources of data including internal/external untapped data.
5. Operationalize analytics models for production usage ,proper security & access control.
6.Nice to have skills Python, Scala, Java & with advance knowledge of SQL

Qualifications

• Bachelor’s degree in Computer Science, MIS, Business Management, or related field
• 12-15 years’ experience in Information Technology .
• 2-3 years’ experience in Azure Data engineering(BLOB/DATA bricks/ADF/Synapse/Delta Lake)
• 4-5 years experience in working on Data & Analytics projects.
1. Work on Azure data engineering models/pipelines , automation , setting up Bronze->Silver->Golden layer on entire Azure platform.
a.Key skill sets like Azure data engineering, Azure Data bricks, Azure Synapse/SQL.
b.New Business Requirements / Demand Management / Estimations / Work Intake / Project delivery & sustain
c.In-depth technical knowldge of tools like Azure Data factory, Azure data bricks , Azure Synapse , SQL DB, ADLS , azure infra setup etc.
d.Deliver ETL solution including data extraction, transformation, cleansing, data integration and data management. Implement batch & near real time data ingestion pipelines based on reference architecture.
2.Ability to augment with new sources of data including internal/external untapped data.
3. Operationalize analytics models for production usage ,proper security & access control.

• Must be a strong team player with effective teamwork skills
• Assists in successfully integrating new employees into the department
• Provides training and mentoring to less experienced team members
• Builds others skill sets by coaching them (i.e., coaching, mentoring).
• Leverages cooperative relationships to address complex business data issues.
• Handles day-to-day issues within the work team.
• Ability to adapt to change quickly and handle unforeseen requirements effectively.  
• Assists lower level employees with resolving unforeseen requirements.  Leading and setting team priorities.  
• Fully understand data, systems, and end to end business processes within multiple functional areas. 
• Sees and coaches others on connections between data and process. Understands business needs and the impact of his/her/team activities.
• In-depth understanding of Pepsi Co products, services, business processes and business function directly related to the functional area.
• Understands business direction and assesses business impact when evaluating data solutions.

• Proactively analyze data to increase quality as it relates to accuracy, completeness, consistency, integrity, timeliness, conformity, and validity; Verify accuracy of data in functional area and for integration/project activities.  
• Provide recommendations for correcting issues or problems across both systems and process.  
• Able to conduct root cause analysis.
• Accountability for mass data loads including creation of load format, data preparation, load program design, and testing and result verification in collaboration with the business, or lead the design and development of process flows and business metadata documentation. 
• Understanding importance of metadata and reinforcing benefits and usage to team and business partners
• Able to research, understand, and determine the relevance of information applying to all degrees of complexity in analytical tasks.  Directs research work of more junior colleagues.
• Incorporate the broad picture across business units/functions to foresee all potential impacts of system or project issues taking appropriate action to resolve.
• Able to synthesize separate elements to form a coherent whole using reasoning, logical deduction, and other methods without direction for all complexity levels of analytical/design tasks.
• Able to see connections between data and process across multiple functions and can make suggestions when resolving changes.
• Interacts and has effective partnerships with other team members, business customers and other layers within the business to recommend, design, test, and implement data related system and process improvements.
• Assists in establishing and maintaining a strong partnership with business partners and manage expectations.
• Forms productive networks with external experts to bring solutions to internal customers/partners needs.
• Prepare material and interact with executive level on subject matter expertise.
• Ability to independently prioritize own work and work of team in functional area, applying analytical skills to master data requests.
• Proactively identify and escalate potential issues, offering ideas for solutions.
• Proactively adjusts work assignments and schedule to meet changing team priorities.
• Effectively manage multiple priorities simultaneously.
• Take ownership of critical path tasks and prioritize work of self and others to deliver results within agreed upon deadline.
• Adjust to multiple demands/priorities focusing on the big picture.
• Makes key decisions about data design approach to components of projects. 
• Able to explain to senior leaders how arrived at decision process.