Hadoop/Spark Administrator
Internship Pune (Pune)
Job description
· Job facts
As OP's, you will be working in a team of self-motivated and self-organized team members, taking responsibility and accountability of administration, installing and maintain environments. He/she will be responsible for meeting 100% availability of the different environment.
A seasoned professional with wide-ranging experience. Deals with diverse and often times complex issues, where analysis may require in-depth evaluation of many factors. Exercises judgment in evaluating methods and may determine criteria for obtaining solutions. May coordinate the activities of other employees. Networks with senior internal and external personnel in area of expertise as well as some key contacts outside area of expertise.
Responsible for maintaining and continuously improving the quality system and achieving quality objectives through daily actions.
KEY ROLES & RESPONSIBILITIES ( required ): describe the key roles and responsibilities of this job.
· Manage and maintain Spark and Hadoop clusters for uninterrupted availability
· Check, back-up, and monitor the entire system, routinely
· Ensure that the connectivity and network are always up and running and plan for capacity upgrading or downsizing as and when the need arises.
· Manage HDFS and ensure that it is working optimally at all times
· Regulate the administration rights depending on the job profile of users
· Add new users over time and discard redundant users smoothly
· Have full knowledge of Spark for efficient Hadoop administration
· Experience in different providers like Cloudrea Hadoop(CDH), Cloudera Manager, Horton works, Apache Ambari or others.
· Experience with public Cloud providers, including Amazon Web Services architecture, tools, and Cloud methodologies.
· Ensuring that teams adhere to the principles, guidelines and best practices.
· Focus on continuous improvements including usage of appropriate tools, techniques and automation.
· Gather and present metrics and activities for the projects to key stakeholders.
· Mentoring and training the new team members.
KNOWLEDGE/ SKILLS/ATTRIBUTES (required): The minimum education, knowledge, experience, skills and attributes required to perform the essential functions of this job.
Required Experience, Skills and Qualifications
· Hands on current profile or job.
· Minimum 3 to 8 years' experience in maintain, upgrading, installing production environments for large-scale applications data and analytical applications.
· Experience in pipelines (ETL) using Big Data tools such as Hadoop, Spark, Hive, Presto, Cassandra, etc.
· Demonstrable track-record of learning and deep-diving as needed into complex existing and new technologies
· Intense sense of ownership, initiative-taking, and a can-do attitude
· Great attention to detail and a data-driven approach to problem solving
· Team-player with a strong collaboration and communication skills, who is able to motivate and mobilize cross-functional teams, and respond positively to feedback
· Proficient in at least one of the SQL languages
· Good understanding of SQL Engine and able to conduct advanced performance tuning
· Comfortable working directly with data analytics and with data engineers
· Strong understanding Agile and working in agile projects
· Strong comprehension, analytical, and problem solving skills
Education
· Bachelor degree in informatics, life sciences or equivalent work experience is required.
Indicate below any additional preferred requirements if applicable (optional):
· Masters of Science (MS) degree in relevant area of study is preferred.
· Experience in testing business intelligence/analytics applications or software for multi-tenant enterprise SaaS applications is a big plus
· Experience in testing business intelligence/analytics applications or software for multi-tenant enterprise SaaS applications is a big plus
· Scripting experience with bash or python or shell scripting. Must feel comfortable writing automation scripts
Roche is an equal opportunity employer.
Information Technology, Information Technology > IT Business Process Management, Consulting and Support
· Who we are
At Roche, 98,000 people across 100 countries are pushing back the frontiers of healthcare. Working together, we've become one of the world's leading research-focused healthcare groups. Our success is built on innovation, curiosity and diversity.
Roche is an equal opportunity employer.