Job Title: Senior Consultant | Hadoop/Cloudera Admin | Others| Operations, Industry & Domain Solutions
Hadoop/Cloudera Administrator: SC & Below
Role Overview:
As a Cloudera Admin, you will be responsible for managing, maintaining, and troubleshooting Cloudera's Hadoop ecosystem components. You will ensure the smooth operation of Cloudera clusters, address performance issues, and support data processing and storage solutions in all Cloudera environments.
Experience:
- 5-9 years of working experience in Cloudera Hadoop components such as HDFS, YARN, Hive, Impala, and Spark.
- Experience with Cloudera Manager for cluster management and monitoring.
Key Responsibilities:
Technical Skills:
- Set up, configure, and manage Cloudera Hadoop clusters, including Hadoop HDFS, YARN, and related services.
- Continuously monitor cluster health and performance, using Cloudera Manager and other monitoring tools.
- Optimize cluster performance, including job execution, resource management, and data processing efficiency.
- Manage capacity and scalability of the Cloudera environment, ensuring adequate resources for growing data needs.
- Diagnose and resolve issues related to Hadoop components, including HDFS, YARN, Hive, Impala, and Spark.
- Respond to and manage production incidents, performing root cause analysis and implementing fixes.
- Support data ingestion, integration, and processing workflows within the Cloudera ecosystem.
- Work closely with data engineers, analysts, and other IT teams to support data processing needs and resolve technical issues.
- Create and maintain documentation for cluster configurations, troubleshooting procedures, and support processes.
- Implement and manage security policies, including access control and data protection within the Cloudera environment.
Soft Skills:
- Strong leadership, communication, and problem-solving abilities.
- Ability to work collaboratively with cross-functional teams.
- Flexibility to meet critical deadlines as needed.
Preferred Qualifications:
- Bachelor’s degree in computer science, Information Systems, or a related field
- Certification in related technologies is desirable.
- Experience/Willingness working in Support Role