If you are upgrading HDP, you need to set the target version in OneFS so that it replies correctly to the upgrade request by Ambari. For the initial release of 2.5, use this command:
isi hdfs settings modify --odp-version=126.96.36.199-1237 --zone=spiral
In the OneFS Admin UI, the setting is in Protocols > Hadoop (HDFS) > Settings.
There are some new services in HDP that need new service users. They are all in the user script. Here is the list, in case you need to add them manually to the hadoop service account group on OneFS:
For each service, you can run the following command:
isi auth users create zeppelin --primary-group=hadoop --zone=spiral
If you choose to configure a different username for Spark2, rather than Spark, be sure to add that as well.
To tie OneFS with Ambari and HDP in a Kerberized environment, you need to be careful about principal names, proxy users, and a few other settings.
The Hive service check now tests whether the HTTP service account can proxy as a user. In a non-Kerberized environment, there is no impact. However, for proper configuration in a kerberized environment, be sure that an HTTP account exists on OneFS (covered in the current user script), and that it has a proxyuser setting to act as ambari-qa (minimum bar for the service check) and the groups that your users are in.
isi auth users create HTTP --primary-group=hadoop --zone=spiral
isi hdfs proxyusers create --proxyuser=HTTP --add-user=ambari-qa --add-group=users --zone=spiral
Also, Spark's component Livy (a REST API for Spark) requires a proxy user configured on OneFS. For example, when using Livy to access Spark from Zeppelin, Livy needs to proxy as the zeppelin user. Modify these to match the group for your hadoop service accounts and any user accounts that need to use Livy.
isi hdfs proxyusers create --proxyuser=livy --add-group=hadoop --zone=spiral
isi hdfs proxyusers modify --proxyuser=livy --add-group=users --zone=spiral
Article ID: SLN319404Last Date Modified: 03/11/2020 08:15 PM