CTC - Détails de l'opportunité de carrière

CTC004606 - Hadoop Administrator

Hadoop Administrator

More specifically, the person sought will assume the following responsibilities:

• Participate in the support activities of the big data platform.

• Participate in the administration of Hadoop clusters (setup and tuning).

• Participate in the development of Shell scripts (Linux) for resource and security management of the Hadoop cluster.

• Communicate effectively with technical and non-technical members of the project team.

• Manage multiple tasks and projects simultaneously.

• Work in an agile/iterative context.

Required profile:

• Have at least 5 years experience in Business Intelligence or any other area relevant to data processing.

• Experience in Hadoop clusters administration (mandatory).

• Experience in advanced Linux administration (Redhat 6.x and up).

• Development of bash and Python scripts (Asset)

• Install, config and debug of the Hadoop ecosystem (HDFS, MapReduce, YARN, Zookeeper, Hbase, Hive, Spark, Kafka, Zeppelin).

• Install, config and debug of HDF ecosystem (NiFi, NiFi Registry, Kafka, Schema Registry).

• Install, config and debug of MySQL/MariaDB databases.

• Advanced knowledge of Hadoop administration tools (Cloudera Manager, Ambari).

• Advanced knowledge of Hadoop security (Ranger, Hue, ACL, Knox, Atlas).

• Technologies: LDAP/AD, Kerberos, SSL.

• Have good technical documentation skills.

• Have already worked in an agile project.

• Have good communication skills and popularization of complex concepts.

• Have strong problem-solving skills.

• Be a good team contributor.

• Ensure vigilance to develop and keep up to date.