Hadoop Administrator

• Plan, install, configure, and deploy Hadoop clusters based on business requirements and workload demands.
• Monitor and manage the health of Hadoop clusters, addressing performance issues and ensuring optimal resource utilization.
• Implement and maintain security protocols within the Hadoop ecosystem, including authentication, authorization, and encryption.
• Develop and implement backup and recovery strategies for Hadoop data, ensuring data integrity and availability.
• Perform capacity planning to anticipate future storage and processing needs, and scale the infrastructure accordingly.
• Optimize Hadoop cluster performance by fine-tuning configurations, troubleshooting bottlenecks, and implementing best practices.
• Manage software upgrades, patches, and version updates for Hadoop components to ensure stability and security.
• Implement monitoring tools to track the performance of Hadoop clusters and set up logging mechanisms for analysis and troubleshooting.
• Administer user access and permissions to Hadoop clusters, maintaining a secure and controlled environment.
• Develop and test disaster recovery plans to ensure data availability in case of unexpected events or failures.
• Maintain comprehensive documentation for configurations, procedures, and troubleshooting guides for the Hadoop environment.
• Implement automation scripts for routine tasks, making the administration processes more efficient

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Hadoop Administrator in large-scale environments.
• Proficiency in Hadoop distributions like Apache Hadoop, Cloudera, Hortonworks, etc.
• Strong understanding of Hadoop ecosystem components (HDFS, MapReduce, Hive, HBase, etc.).
• Knowledge of Linux system administration.
• Scripting skills (e.g., Shell, Python) for automation.
• Familiarity with cloud platforms (e.g., AWS, Azure) is a plus.
• Excellent problem-solving and troubleshooting skills.

Unison Consulting