PowerEdge: NVE - Upgrade problem at Adding necessary Apache modules step

Summary: The NVE upgrade failed on step of adding necessary Apache modules step with error: Error occurred when using a2enmod - operation failed.

This article applies to This article does not apply to This article is not tied to any specific product. Not all product versions are identified in this article.
Check out other resources

Symptoms

The NVE upgrade failed on step of adding necessary Apache modules step with error: Error occurred when using a2enmod - operation failed.

Workflow.log:

2022-12-20 13:14:03 (+0100) 47138880920220 NOTICE: Instantiating task UpdateApacheModules
2022-12-20 13:14:03 (+0100) 47138880920220 NOTICE: Perform: action.update-apache-modules
2022-12-20 13:14:03 (+0100) 47138880920220 INFO: ---------- BEGIN UpdateApacheModules::do ----------
2022-12-20 13:14:03 (+0100) 47138880920220 INFO: Configuring module headers
2022-12-20 13:14:03 (+0100) 47138880920220 INFO: >>> [make_temp_script] 111 whoami=root as_user=root, ssh_key_to_load=
2022-12-20 13:14:03 (+0100) 47138880920220 INFO: >>> [make_temp_script] 222 very_current_user=root, as_user=root, ssh command is: ssh-add /root/.ssh/rootid && (a2enmod headers) >/usr/local/avamar/var/run_command-sysout.13786.47138880920220 2>&1
2022-12-20 13:14:03 (+0100) 47138880920220 INFO: - - - - - - - BEGIN(output) - - - - - - -
2022-12-20 13:14:03 (+0100) 47138880920220 INFO: /usr/local/avamar/var/run_command-tmpscript.13786.47138880920220: line 5: a2enmod: command not found
2022-12-20 13:14:03 (+0100) 47138880920220 INFO: - - - - - - - END
2022-12-20 13:14:03 (+0100) 47138880920220 INFO: - - - - - - - BEGIN(outer output) - - - - - - -
2022-12-20 13:14:03 (+0100) 47138880920220 INFO: Identity added: /root/.ssh/rootid (/root/.ssh/rootid)
2022-12-20 13:14:03 (+0100) 47138880920220 INFO: - - - - - - - END
2022-12-20 13:14:03 (+0100) 47138880920220 ERROR: "a2enmod headers", exit status=127 (error)
2022-12-20 13:14:04 (+0100) 47138880920220 INFO: post: "a2enmod headers", exit status=127 (error)
2022-12-20 13:14:04 (+0100) 47138880920220 INFO: >>> [make_temp_script] 222 very_current_user=root, as_user=, ssh command is: (rpm -q dpnserver --last | head -1) >/usr/local/avamar/var/run_command-sysout.13786.47138880920220 2>&1
2022-12-20 13:14:04 (+0100) 47138880920220 INFO: >>> [make_temp_script] 222 very_current_user=root, as_user=admin, ssh command is: (/usr/local/avamar/bin/avhostname -f) >/usr/local/avamar/var/run_command-sysout.13786.47138880920220 2>/usr/local/avamar/var/run_command-syserr.13786.47138880920220
2022-12-20 13:14:04 (+0100) 47138880920220 INFO: - - - - - - - BEGIN(output) - - - - - - -
2022-12-20 13:14:04 (+0100) 47138880920220 INFO: nwserver.customer.com
2022-12-20 13:14:04 (+0100) 47138880920220 INFO: - - - - - - - END
2022-12-20 13:14:04 (+0100) 47138880920220 INFO: "/usr/local/avamar/bin/avhostname -f", exit status=0 (success)
2022-12-20 13:14:04 (+0100) 47138880920220 INFO: Report home message: 2022-12-20 13:14:04 +0100|nwserver.customer.com|unknown|NveUpgrade|19.7.0.123|/space/avamar/repo/temp/NveUpgrade-19.7.0-123.avp_1671529902444/tmp|UpdateApacheModules|Adding necessary Apache modules (25 of 50)|ERROR: UpdateApacheModules::block in add_modules Error occurred when using a2enmod - operation failed
2022-12-20 13:14:04 (+0100) 47138880920220 ERROR: Error occurred when using a2enmod - operation failed
2022-12-20 13:14:04 (+0100) 47138880920220 INFO: post: Error occurred when using a2enmod - operation failed


Avinstaller.log:

INFO: Completing task: Adding necessary Apache modules (25 of 49) id: 100263
Dec 20, 2022 12:14:04 PM com.avamar.avinstaller.process.InstallManager completeTask
INFO: ExitCode: 1
Dec 20, 2022 12:14:04 PM com.avamar.avinstaller.process.InstallManager completeTask
INFO: Stopping task: Adding necessary Apache modules (25 of 49) id: 100263
Dec 20, 2022 12:14:04 PM com.avamar.avinstaller.monitor.PollMessageSender sendMessage
INFO: PollMessageSender sent: <UpdateMessage><TaskName>Adding necessary Apache modules (25 of 49)</TaskName><ProcessKey>nve-upgrade20221019Oct101666201186</ProcessKey><ProcessInstanceId>nve-upgrade20221019Oct101666201186.100007</ProcessInstanceId><TaskId>100263</TaskId><Timestamp>2022/12/20-12:14:04.00568</Timestamp><Content>Adding necessary Apache modules (25 of 49) Failed</Content><Transition behavior="Retry Adding necessary Apache modules (25 of 49)">Retry Current Task</Transition><Transition behavior="Retry Adding necessary Apache modules (25 of 49)">Call EMC Support</Transition></UpdateMessage>
Dec 20, 2022 12:14:04 PM com.avamar.avinstaller.process.TaskTimeManager stopTimer
INFO: startTime: 0
Dec 20, 2022 12:14:04 PM com.avamar.avinstaller.process.InstallManager stop
INFO: Process instance stopped! process key: nve-upgrade20221019Oct101666201186 ,process instance id: nve-upgrade20221019Oct101666201186.100007 at task: Adding necessary Apache modules (25 of 49)

Cause

/tmp directory is holding too many files under it that might be causing the directory to hit the max limit of subdirectories files during upgrade.
Example:

nwserver.customer.com:~ # ls -lad /tmp
drwxrwxrwt 14 root root 4206592 Oct 27 10:19 /tmp

Resolution

  1. Log in to the NVE server as admin
  2. Change to root with su - command
  3. List the contents of the /tmp directory to find out which files/subdirectories are consuming it. It should be caused bu NWUI temporary files.
  4. Stop the nwui service:
    systemctl stop nwui
  5. Clear the tomcat temp files created by nwui from /tmp
  6. Retry the upgrade step.

Affected Products

NetWorker, NetWorker Series, SUSE Linux Enterprise Server 12, PowerEdge XR2, PowerEdge FC640, PowerEdge M640, PowerEdge M640 (for PE VRTX), PowerEdge MX5016s, PowerEdge MX7000, PowerEdge MX740C, PowerEdge MX750c, PowerEdge MX760c, PowerEdge MX840C , PowerEdge R240, PowerEdge R250, PowerEdge R260, PowerEdge R340, PowerEdge R350, PowerEdge R360, PowerEdge R440, PowerEdge R450, PowerEdge R470, PowerEdge R540, PowerEdge R550, PowerEdge R640, PowerEdge R6415, PowerEdge R650, PowerEdge R650xs, PowerEdge R6515, PowerEdge R6525, PowerEdge R660, PowerEdge R660xs, PowerEdge R6615, PowerEdge R6625, PowerEdge R670, PowerEdge R740, PowerEdge R740XD, PowerEdge R740XD2, PowerEdge R7415, PowerEdge R7425, PowerEdge R750, PowerEdge R750XA, PowerEdge R750xs, PowerEdge R7515, PowerEdge R7525, PowerEdge R760, PowerEdge R760XA, PowerEdge R760xd2, PowerEdge R760xs, PowerEdge R7615, PowerEdge R7625, PowerEdge R770, PowerEdge R7715, PowerEdge R7725, PowerEdge R840, PowerEdge R860, PowerEdge R940, PowerEdge R940xa, PowerEdge R960, PowerEdge T350, PowerEdge T360, PowerEdge T440, PowerEdge T550, PowerEdge T560, PowerEdge T640, PowerEdge XR11, PowerEdge XR12, PowerEdge XR4000r, PowerEdge XR4000w, PowerEdge XR4000z, PowerEdge XR4510c, PowerEdge XR4520c, PowerEdge XR5610, PowerEdge XR7620, PowerEdge XR8000r, PowerEdge XR8610t, PowerEdge XR8620t ...
Article Properties
Article Number: 000207370
Article Type: Solution
Last Modified: 11 Mar 2025
Version:  3
Find answers to your questions from other Dell users
Support Services
Check if your device is covered by Support Services.