ETL Test Engineer (Python)

Job description

Position Description:

Company Profile:
Founded in 1976, CGI is among the largest independent IT and business consulting services firms in the world. With 94,000 consultants and professionals across the globe, CGI delivers an end-to-end portfolio of capabilities, from strategic IT and business consulting to systems integration, managed IT and business process services and intellectual property solutions. CGI works with clients through a local relationship model complemented by a global delivery network that helps clients digitally transform their organizations and accelerate results. CGI Fiscal 2024 reported revenue is CA$14.68 billion and CGI shares are listed on the TSX (GIB.A) and the NYSE (GIB). Learn more at cgi.com.
Job Title: ETL Test Engineer
Position: Senior Software Engineer
Experience: 3-9 years
Category: Senior Software Development/ Engineering
Shift: 1PM to 10PM EST Time
Main location: Bangalore/Chennai
Position ID: J1225-0043

Employment Type: Full Time
Education Qualification: Any graduation or related field or higher with minimum 3 years of relevant experience.
Position Description:
We are seeking an experienced ETL/SQL/Python Testing Engineer to design, develop, and execute test cases for data pipelines, ETL processes, and database systems. The ideal candidate will have strong expertise in SQL querying, ETL validation, Python scripting, and test automation to ensure data accuracy, completeness, and optimal performance.

Your future duties and responsibilities:

• Develop and execute ETL test cases to validate data extraction, transformation, and loading processes.
• Perform ETL pipeline testing in Azure Databricks (ADB) environments.
• Write complex SQL queries to verify data integrity, consistency, and correctness across source and target systems.
• Automate ETL testing workflows using Python, PyTest, or similar frameworks.
• Conduct data reconciliation, schema validation, and comprehensive data quality checks.
• Identify and report data anomalies, performance issues, and defects.
• Collaborate with Data Engineers, Analysts, and Business Teams to understand data requirements.
• Design and maintain test datasets for validation activities.
• Implement CI/CD pipelines for automated ETL testing (e.g., Jenkins, GitLab CI).
• Document test results, defects, and detailed validation reports.

Required qualifications to be successful in this role:

• ETL Tools Expertise: Hands-on experience with Informatica, Talend, SSIS, Databricks or similar ETL platforms.
• SQL Mastery: Advanced SQL skills including complex joins, aggregations, subqueries, stored procedures, and performance tuning.
• Python Automation: Strong proficiency in Python with libraries/frameworks such as Pandas, PySpark, PyTest for automation and data validation.
• Database Knowledge: Experience with both RDBMS (Oracle, SQL Server, PostgreSQL) and NoSQL databases (MongoDB, Cassandra).
• CI/CD & DevOps: Familiarity with Jenkins, GitLab CI/CD, Azure DevOps for automated testing pipelines.
• Version Control: Proficient in Git, GitHub/GitLab for collaborative development and code management.
• Big Data Ecosystem (Good to Have): Exposure to Hadoop, Hive, Spark, Kafka for large-scale data testing.
• Testing Tools (Good to Have): Knowledge of Airflow, Great Expectations, Selenium or similar frameworks for workflow orchestration and validation.
• Agile Practices: Experience working in agile environments with sprint-based delivery and in-sprint automation.
• Communication & Leadership: Excellent communication skills to interact with business analysts, line-of-business stakeholders, and ability to lead testing initiatives and drive innovation.

Must-Have Skills:
• ETL Testing: Strong hands-on experience with tools such as Informatica, Talend, SSIS, Databricks.
• SQL Expertise: Advanced SQL skills (joins, aggregations, subqueries, stored procedures).
• Python Automation: Proficiency in Python with libraries/frameworks like Pandas, PySpark, PyTest.
• Databases: Experience with RDBMS (Oracle, SQL Server, PostgreSQL) and NoSQL (MongoDB, Cassandra).
• CI/CD: Practical experience with Jenkins, Azure DevOps, GitLab CI/CD.
• Version Control: Strong knowledge of Git, GitHub/GitLab.

Good-to-Have Skills:
• Big Data Ecosystem: Exposure to Hadoop, Hive, Spark, Kafka.
• Testing Tools: Familiarity with Selenium, Airflow, Great Expectations or similar frameworks.
• Cloud & Data Engineering: Understanding of cloud-based data platforms and orchestration tools.
• Agile Practices: Experience working in agile testing environments with sprint-based delivery.
• Communication & Collaboration: Ability to interact effectively with business analysts and cross-functional teams.

Skills:

·  ETL
·  SQLite

What you can expect from us:

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

Come join our team—one of the largest IT and business consulting services firms in the world.