PowerScale OneFS HDFS Configuration Guide

HDFS files and directories

You must configure one HDFS root directory in each OneFS access zone that will contain data accessible to Hadoop compute clients. When a Hadoop compute client connects to the cluster, the user can access all files and sub-directories in the specified root directory. The default HDFS directory is /ifs.

Note the following:

• OneFS 9.3.0.0 and later adds support for HDFS ACL.
• Associate each IP address pool on the cluster with an access zone. When Hadoop compute clients connect to the PowerScale cluster through a particular IP address pool, the clients can access only the HDFS data in the associated access zone. This configuration isolates data within access zones and allows you to restrict client access to the data.
• Unlike NFS mounts or SMB shares, clients connecting to the cluster through HDFS cannot be given access to individual folders within the root directory. If you have multiple Hadoop workflows that require separate sets of data, you can create multiple access zones and configure a unique HDFS root directory for each zone.
• Apache Ranger security zones are not supported.
• When you set up directories and files under the root directory, make sure that they have the correct permissions so that Hadoop clients and applications can access them. Directories and permissions will vary by Hadoop distribution, environment, requirements, and security policies.

For more information about access zones, refer to the OneFS CLI Administration Guide or OneFS Web Administration Guide for your version of OneFS.