ECS 3.6.2 Data Access Guide

Deploy the ECS HDFS Client Library

Use this procedure to put the ECS HDFS Client Library JAR on the classpath of each client node in the Hadoop cluster.

1. Log in to a node that has password-less SSH access to all Hadoop nodes.
2. Run the classpath command to get the list of directories in the classpath:
   # hadoop classpath
3. Deploy the client JAR file to all Hadoop nodes by performing the following steps:
   1. Create a text file named masters that contains a list of IP addresses or FQDNs for all Hadoop master nodes, one per line.
   2. Create a text file named workers that contains a list of IP addresses or FQDNs for all Hadoop worker nodes, one per line.
   3. Create the directory /usr/lib/hadoop/lib on all nodes. Use the following command:

      # cat masters workers | xargs -i -n 1 ssh root@{} mkdir -p /usr/lib/hadoop/lib

   4. Copy the ECS client jar to all nodes using the following command:

      cat masters workers | xargs -i -n 1 scp viprfs-client-3.2.0.0-hadoop-2.7.jar root@{}:/usr/lib/hadoop/lib/