Databricks Data Quality Developer

Job description

Position Description:

We are seeking a talented Databricks Data Quality (DQ) Developer with a strong background in building data quality frameworks and implementing DQ rules within Databricks and other data platforms. The ideal candidate will be responsible for designing and maintaining robust data quality solutions, analyzing data issues, and working closely with cross-functional teams to ensure data accuracy, consistency, and usability. This hybrid role requires 2 days a week onsite at any CGI Atlantic office: Halifax, NS, Moncton or Fredericton, NB, Stratford, PE, or St. John's, NL.

Your future duties and responsibilities:

• Data Quality Framework Development: Design, develop, and implement scalable data quality frameworks using Databricks, Informatica, and other enterprise-grade tools.
• DQ Rule Configuration: Configure, test, and deploy data quality rules for various data domains in collaboration with business stakeholders and product teams.
• Data Analysis & Profiling: Analyze large and complex datasets to identify data anomalies, trends, and patterns; recommend improvements based on findings.
• Metrics & Reporting: Document and maintain data quality procedures and generate regular reports on DQ metrics and KPIs to track improvements and issues.
• Collaboration & Integration: Work closely with Product, Data Engineering, and Data Governance teams to align DQ rules with business requirements and data architectures.
• Tool Proficiency & Standards Maintenance: Ensure adherence to data quality standards using tools like Databricks, Informatica, SQL, and Python.
• Continuous Improvement: Participate in ongoing efforts to enhance the data quality processes, tools, and frameworks for better performance and scalability.

Required qualifications to be successful in this role:

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field (or equivalent experience)
• 2+ years of experience in developing and implementing Data Quality Frameworks and DQ rules
• Hands-on experience with Databricks and Informatica (DQ components)
• Strong proficiency in SQL and Python for data analysis, validation, and automation
• Experience in documenting data quality procedures and reporting on DQ metrics
• Familiarity with data architecture, data engineering pipelines, and data governance
• Ability to analyze datasets to detect quality issues and propose remediation strategies
• Experience in data profiling and anomaly detection in large-scale data environments
• Familiarity with modern data platforms (e.g., Delta Lake, Spark, Lakehouse architecture)
• Exposure to cloud platforms like AWS, Azure, or GCP
• Background in Agile or DevOps environments
• Certifications in Databricks, Informatica, or related tools are a plus

Skills:

·  Data Quality Management
·  DevOps
·  English
·  Python
·  SQL

What you can expect from us:

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

At CGI, we value the strength that diversity brings and are committed to fostering a workplace where everyone belongs. We collaborate with our clients to build more inclusive communities and empower all CGI partners to thrive. As an equal-opportunity employer, being able to perform your best during the recruitment process is important to us. If you require an accommodation, please inform your recruiter.

To learn more about accessibility at CGI, contact us via email . Please note that this email is strictly for accessibility requests and cannot be used for application status inquiries.

Come join our team—one of the largest IT and business consulting services firms in the world.