Production Support Engineer (Hadoop)

Job description

Position Description:

Role Summary
We are seeking a skilled Production Support Engineer (Hadoop) with strong expertise in Big Data ecosystem support, job monitoring, and troubleshooting. The ideal candidate will have hands on experience with Hadoop services, Linux administration, and Spark based application debugging, along with exposure to scheduling tools and incident management systems.

Experience:  3–5 Years

Location: Hyderabad

Work: 24/7 Rotational shift, 5 days work from office in ODC environment, L1/L2 support, No hybrid access.

Key Responsibilities

. Monitor and manage batch jobs using CA7 scheduler, including tracking job failures and analyzing CA7 logs
. Perform incident management and ticket handling using ServiceNow, ensuring timely resolution and SLA adherence
. Troubleshoot and support Hadoop ecosystem components such as YARN, Hive, and Impala
. Debug and resolve issues in PySpark jobs, including performance tuning and error analysis
. Work with HDFS and HQL (HDFS SQL / Hive queries) for data validation and issue resolution
. Develop and maintain shell scripts for automation and operational tasks
. Analyze system logs and identify root causes of failures across the Big Data platform
. Collaborate with development, infrastructure, and support teams for issue resolution and system improvements

Required Skills & Qualifications

. Strong experience in Linux (RHEL) administration and command line operations
. Hands on experience with Hadoop ecosystem components:
. Proficiency in PySpark, with solid debugging and troubleshooting skills
. Experience with CA7 job scheduling and monitoring
. Knowledge of Shell scripting for automation
. Familiarity with ServiceNow or similar ticketing tools
. Good understanding of data processing workflows and ETL pipelines

Skills:

·  Communication
·  Infrastructure
·  Hadoop Ecosystem (HDFS)
·  Hadoop Hive
·  Linux

What you can expect from us:

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

That same commitment to fairness extends to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the hands of our recruitment professionals.

Come join our team—one of the largest IT and business consulting services firms in the world.