Azure Data Engineer, Senior

Job description

Position Description:

We are currently looking for a Azure senior developer with Databricks and Pyspark skills, having at least 3 or more years of experience and who is willing to work late shift to night shift work schedule.
 

We are looking for a Senior Azure Data Engineer to join the Digitalization & Automation Services Team. You will work alongside our Dev Team and will report to the following: Technical Lead, Service Delivery Manager. Your main tasks will include performing application development with exposure on Azure Databricks and PySpark.

To succeed in this role, you should be able to fit into the technical requirement need and pass the overall technical assessment.

Your future duties and responsibilities:

. Design and implement storage solutions using Azure services such as Azure SQL and Azure Data Lake Storage
. Design and implement ETL using ADF data pipelines to move and transform data from various sources into cloud-based data warehouses
. Implement a business solution using Azure Databricks
. Align with the DevOps strategy to promote code into Production
. Participate in solutioning and delivery optimization (identifying/creating reusable Databricks components)
. Participate in and define steps to transform requirements into an implementation plan

Required qualifications to be successful in this role:

. Must have 3-5 years of relevant experience
. Strong experience in Azure Functions, Azure Data Factory, Azure SQL, and Azure Key Vault
. Strong Experience in Azure Databricks, Azure Databricks Notebooks, Azure Data Lake, Azure Data Lake Storage
. Working experience in migration and modernization projects
. Experience in building data pipelines and analysis tools using Python, PySpark, Scala, SQL
. Proficient in integrating, transforming, and consolidating data from various structured and unstructured data
. Knowledge of Autosys jobs, Batch scripts
. Experience with Agile methodology, Azure DevOps(CI/CD Pipeline)
. Knowledge of streaming platforms (Kafka, Solace queue), Azure App Services, Azure Stream Analytics, Power BI
. Strong communication skills
. Ability to work independently and effectively within a team
. Must be amenable to working onsite 2-3 days a week in McKinley, Taguig, on a late mid-shift to a night-shift schedule

Skills:

·  Detail-oriented
·  DevOps
·  English

What you can expect from us:

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

Come join our team—one of the largest IT and business consulting services firms in the world.