Skip to main content
  • Place orders quickly and easily
  • View orders and track your shipping status
  • Enjoy members-only rewards and discounts
  • Create and access a list of your products
  • Manage your Dell EMC sites, products, and product-level contacts using Company Administration.

ECS 3.6.2 Data Access Guide

PDF

Configure ECS client properties

You can use Ambari to set the following configuration properties that are required by the ECS client.

For more information on the core-site.xml parameters, see Hadoop core-site xml properties for ECS HDFS.

Table 1. Hadoop configuration to enable ECS accessThe table lists the Hadoop configuration details to enalble ECS access
Hadoop location Property Value
core-site fs.viprfs.impl com.emc.hadoop.fs.vipr.ViPRFileSystem
fs.AbstractFileSystem.viprfs.impl com.emc.hadoop.fs.vipr.ViPRAbstractFileSystem
fs.viprfs.auth.identity_translation NONE
fs.viprfs.auth.anonymous_translation LOCAL_USER
fs.vipr.installations Can be any name, such as federation1and will be referred to as $FEDERATION. If you have multiple independent ECS federations, enter multiple values separated by commas.
fs.vipr.installation.$FEDERATION.hosts Comma-separated list of FQDN or IP address of each ECS host in the local site
fs.vipr.installation.$FEDERATION.hosts.resolution dynamic
fs.vipr.installation.$FEDERATION.resolution.dynamic.time_to_live_ms 900000
hdfs-site fs.permissions.umask-mode 022
yarn-site yarn.application.classpath Append the following:
/usr/lib/hadoop/lib/* 
				   
				
mapred-site mapreduce.application.classpath Append the following:
/usr/lib/hadoop/lib/* 
				   
				
tez-site tez.cluster.additional.classpath.prefix Append the following:
/usr/lib/hadoop/lib/* 
				   
				
HDFS hadoop-env template Append the following:
export HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/usr/lib/hadoop/lib/* 
				  
Spark spark-env template Append the following:
export SPARK_DIST_CLASSPATH="${SPARK_DIST_CLASSPATH}:/usr/lib/hadoop/lib/*:/usr/hdp/current/hadoop-client/client/guava.jar"

Rate this content

Accurate
Useful
Easy to understand
Was this article helpful?
0/3000 characters
  Please provide ratings (1-5 stars).
  Please provide ratings (1-5 stars).
  Please provide ratings (1-5 stars).
  Please select whether the article was helpful or not.
  Comments cannot contain these special characters: <>()\