Article Number: 000052203
Issue |
When attempting to use the Apache Hadoop YARN node label feature, the action fails and OneFS generates an error message. When attempting to use the YARN node label feature with OneFS 7.2.1.x and Apache Hadoop 2.7, the users may receive an -appendToFile: Fatal internal error message. |
Environment |
OneFS 7.2.1.x and Hadoop 2.7 |
OneFS 7.2.1.2
OneFS 7.2.1.1
Implement the following workaround to manually create and use a YARN node label directory that resides on the OneFS cluster rather than the HDFS cluster. Note: If you have ran the isilon_hadoop_tools script on GitHub, you do not need to follow this workaround, as the script automatically creates and permissions the correct directory.
Step 1. Prepare OneFS to store node label information
Perform the following steps on the OneFS cluster.
Note: In the following procedure, HDFS_ROOT_DIR refers to your HDFS root directory on the OneFS cluster.
Isilon
Isilon
20 Nov 2020
2
Solution