Azure Data Engineer

Job description

Position Description:

Company Profile:
Founded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at cgi.com.
Job Title: Senior Azure Data Engineer
Position: Senior software engineer/ developer
Experience: 5-8 years
Category: Software Development/ Engineering
Shift: Second Shift (Timing:1PM to 10PM)
Work Mode: 5 days’ Work from Office (ODC – Banking Client)
Main location: Bangalore & Chennai
Position ID: J0625-1137

Employment Type: Full Time
Education Qualification: Any graduation or related field or higher with minimum 3 years of relevant experience.
Position Description:
We are seeking a highly skilled Senior Azure Data Engineer to join our growing data team. The role involves designing, developing, and operationalizing large-scale data processing systems on the Azure cloud platform. The ideal candidate will have strong expertise in Azure Databricks, Azure Data Lake, PySpark, and Python, with a proven ability to build efficient, scalable, and reliable data pipelines.

Your future duties and responsibilities:

• Design and maintain scalable data pipelines for ingesting, processing, and transforming structured and unstructured data.
• Develop and optimize Spark jobs using PySpark and Spark SQL within Azure Databricks.
• Implement Azure Data Lake Storage (Gen2) solutions following medallion architecture (Bronze, Silver, Gold layers).
• Collaborate with stakeholders (data architects, analysts, business teams) to translate requirements into technical solutions.
• Ensure data security and compliance with access controls, encryption, and masking.
• Perform data modeling for batch and real-time analytics (star schema, snowflake, data vault).
• Monitor and troubleshoot pipelines for performance and cost optimization.
• Automate deployments using CI/CD pipelines (Azure DevOps/GitHub Actions) and IaC tools (Terraform/Bicep).
• Establish data quality checks and governance standards.
• Mentor junior engineers and promote best practices in data engineering.

Required qualifications to be successful in this role:

• 5+ years of professional experience in data engineering with enterprise-grade solutions.
• 3+ years of hands-on expertise in Microsoft Azure data services, including:
• Azure Databricks: Spark clusters, notebooks, tuning, debugging.
• Medallion Architecture (Bronze, Silver, Gold).
• Experience with Azure Data Factory or Apache Airflow for orchestration.
• Azure Data Lake Storage (Gen2): Directory structure, RBAC/ACLs, performance optimization.
• Strong programming skills in Python (Pandas, APIs, unit testing).
• Expert-level proficiency in PySpark (DataFrame API, Spark SQL, Catalyst Optimizer).
• Advanced SQL development and optimization.
• Solid understanding of data modeling concepts.
• Familiarity with Git and collaborative development practices.

Technical Skills
• Microsoft Azure Data Engineer Associate (DP-203) certification.
• Experience with Delta Lake (ACID transactions, schema enforcement, time travel).
• Real-time data processing with Azure Stream Analytics or Spark Streaming.
• Knowledge of Synapse Analytics, Event Hubs, Azure SQL DB, Cosmos DB, Purview.
• Exposure to DevOps/DataOps principles and tools (CI/CD, Terraform, Azure DevOps).
• Familiarity with Power BI or other visualization tools.

Skills:

·  Azure Data Lake
·  Python

What you can expect from us:

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

Come join our team—one of the largest IT and business consulting services firms in the world.