Offers “CGI”

Expires soon CGI

Software Engineer – Hadoop

  • Hyderabad (Medak)
  • Studies / Statistics / Data

Job description

Job Description

Software Engineer – Hadoop

Position Description
Works independently under limited supervision and applies knowledge of subject matter in Applications Development. Possess sufficient knowledge and skills to effectively deal with issues, challenges within field of specialization to develop simple applications solutions. Second level professional with direct impact on results and outcome

Your future duties and responsibilities
• With 2+ years of overall experience in data analysis, data modeling and implementation of enterprise class systems spanning Big Data, Data Integration, Object Oriented programming and Advanced Analytics.
• Excellent understanding of Hadoop Architecture and Daemons such as HDFS, Name Node, Data Node, Job Tracker, Task Tracker.
• Extracted files from Cassandra through Sqoop and placed in HDFS and processed.
• Expertise in Big Data Technologies and Hadoop Ecosystem tools like Flume, Sqoop, Hbase, ZooKeeper, Oozie, MapReduce, Hive, PIG and YARN.
• Extracted and updated the data into MONGOD using MONGO import and export command line utility interface.
• In-depth understanding of Spark Architecture including Spark Core, Spark SQL, Data • Frames, Spark Streaming, Spark MLlib.
• Expertise in developing Real-Time Streaming Solutions using Spark Streaming
• Will be responsible for the development of technical solutions utilizing the big data platform.
• Extracted and updated the data into MONGOD using MONGO import and export command line utility interface.
• Importing and exporting data from RDBMS to HDFS . Hive tables and HBase by using Sqoop.
• Knowledge in handling Kafka cluster and created several topologies to support real-time processing requirements.

Required qualifications to be successful in this role
Primary Skill: Work experience: 2-8 years
Technology Stack: Hadoop Horton works, Hive, Spark,Informatica, Python, Bash (shell scripting), Language R (nice to have), Kafka (nice to have).
Experiences:2-8 yrs

Build your career with us.

It is an extraordinary time to be in business. As digital transformation continues to accelerate, CGI is at the center of this change—supporting our clients’ digital journeys and offering our professionals exciting career opportunities.

At CGI, our success comes from the talent and commitment of our professionals. As one team, we share the challenges and rewards that come from growing our company, which reinforces our culture of ownership. All of our professionals benefit from the value we collectively create.

Be part of building one of the largest independent technology and business services firms in the world.

Learn more about CGI at www.cgi.com.

No unsolicited agency referrals please.

CGI is an equal opportunity employer.

Skills

·  Hadoop Hive
·  ETL
·  SQL/PL SQL
·  Unix
·  Python
·  Scala

Reference

717638

Make every future a success.
  • Job directory
  • Business directory