Hadoop administrator
Pune (Pune)
Job description
· Performance tuning of Hadoop clusters and Hadoop MapReduce routines, screen Hadoop cluster job performances and capacity planning, monitor Hadoop cluster connectivity and security, manage and review Hadoop log files.
· Responsible for File system management and monitoring, HDFS support and maintenance, diligently teaming with the infrastructure, network, database, application and business, Intelligence teams to guarantee high data quality and availability.
· Support in hadoop development and implementation, Loading from disparate data sets,
· Pre-processing using Hive and Pig, Designing, building, installing, configuring and supporting Hadoop
· Translate complex functional and technical requirements into detailed design.
· Perform analysis of vast data stores and uncover insights.
· Maintain security and data privacy.
· Create scalable and high-performance web services for data tracking.
· Managing and deploying HBase
· Load large data volumes in a timely manner
Auto req ID
260254BR
Required Education
Bachelor's Degree
Role ( Job Role )
Delivery Analyst
State / Province
MAHARASHTRA
Primary job category
Technical Specialist
Company
(0063) IBM India Private Limited
Contract type
Regular
Employment Type
Full-Time
ERBP
Yes
Is this role a commissionable/sales incentive based position?
No
Travel Required
Up to 10% or 1 day a week
IBM Business Group
GTS
Preferred Education
Master's Degree
City / Township / Village
PUNE
Being You @ IBM
IBM is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
Required Technical and Professional Expertise
· Minimum 3+ years of experience in Hadoop Administrator
· Proficient in Map-Reduce Abstraction, hadoop cluster configuration, hadoop Administration and Maintenance.
· Strong experience in Job Scheduling, MapReduce Workflows – Oozie, Sqoop and Pig.
· Expertise in monitoring hadoop cluster nodes with ganglia /nagios - Hive, HBase, Flume, Avro, Spark - Mlibrary, SQL, Streaming and Graph ,Big Insights features – UI , Ambari, FS etc
· Hortonworks , Map and Cloudera
Country/Region
India
Preferred Technical and Professional Experience
· Ability to ensure that all the data pertaining to the company and its clients is safeguarded against unauthorized or illegal use by implementing various methodologies against those who violate the security rules and regulations
· Proficient to maintain the availability, integrity, and confidentiality of the information and to maintain its authenticity, control and utility of the relevant data
· Experience in supporting all the necessary procedures related to security approval, accreditation, certification, etc.
· In-depth knowledge to implement a realistic approach during the certification schedule and process
· Hands-on experience to ensure compliance with vulnerability and mitigation procedures and to establish and install security fixes at regular intervals
· Languages: English, Hindi and Local Language TELUGU is preferred.
Secondary Job Category
Technical Services Specialist
Eligibility Requirements
Must have ability to work with a team
Proven communication skills.
Open to work in shifts
Position Type
Early Professional
Early Professional Track
Industry Early Professional
Location Statement
For additional information about location requirements, please discuss with the recruiter following submission of your application.
New Collar Role
No
Introduction
At IBM, work is more than a job - it's a calling: To build. To design. To code. To consult. To think along with clients and sell. To make markets. To invent. To collaborate. Not just to do something better, but to attempt things you've never thought possible. Are you ready to lead in this new era of technology and solve some of the world's most challenging problems? If so, lets talk.
Your Life @ IBM
What matters to you when you're looking for your next career challenge?
Maybe you want to get involved in work that really changes the world? What about somewhere with incredible and diverse career and development opportunities – where you can truly discover your passion? Are you looking for a culture of openness, collaboration and trust – where everyone has a voice? What about all of these? If so, then IBM could be your next career challenge. Join us, not to do something better, but to attempt things you never thought possible.
Impact. Inclusion. Infinite Experiences. Do your best work ever.
About Business Unit
At Global Technology Services (GTS), we help our clients envision the future by offering end-to-end IT and technology support services, supported by an unmatched global delivery network. It's a unique blend of bold new ideas and client-first thinking. If you can restlessly reinvent yourself and solve problems in new ways, work on both technology and business projects, and ask, "What else is possible?" GTS is the place for you!
About IBM
IBM's greatest invention is the IBMer. We believe that progress is made through progressive thinking, progressive leadership, progressive policy and progressive action. IBMers believe that the application of intelligence, reason and science can improve business, society and the human condition. Restlessly reinventing since 1911, we are the largest technology and consulting employer in the world, with more than 380,000 IBMers serving clients in 170 countries.