Senior Hadoop Administrator - Only W2 - Central Business Solutions : Job Details

We are seeking a Senior Hadoop Administrator - Associate to design and configure clusters, set up related services and provide maintenance on a regular basis.

Skills Required:

• Expert in setting up Hadoop cluster from scratch and server maintenance.
• Commissioning and decommissioning of the nodes to/from Hadoop cluster.
• Implementing, managing, and administering the overall Hadoop infrastructure.
• Capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster.
• Monitoring the Hadoop cluster connectivity and performance of the cluster for application teams.
• Replicating huge amount data from one Hadoop cluster to another.
• Applying encryption to secure the data in the Hadoop cluster.
• Applying the configuration changes and testing the cluster in collaboration with the application teams and business users.
• Sound knowledge of Hadoop services - HDFS, Hive, HBase, Impala, Hue, Ranger etc.
• Experience with Cloudera CDP Hadoop upgrade.
• Experience with access management and setting up user roles in Hadoop.
• Able to create and debug complex Unix shell scripts.

Nice to have:

• Analyzing and troubleshooting the issues with the clusters.
• Set up and maintain appropriate infrastructure to maintain performance and data integrity.
• Experience with ELK Stack: Elasticsearch, Logstash, Kibana, Apache Hadoop
• Ensuring appropriate monitoring & alerting of Elasticsearch cluster.
• Expert in networking and security settings to support network related pipelines.
• Good to have Ruby and/or Python, Unix and GIT Knowledge.

Soft Skills -

• Good verbal and written communication skills.
• Good analytical and problem-solving skills.
• Good team player.