NetWorker 7.6 - Encryption directive uses up all linux client memory
All,
Running the following config:
Solaris 10 NetWorker Server 7.6.2.2.Build.651 Client Redhat 5 Linux 2.6.18-74.18.1.el5 running NetWorker 7.6.3.2.Build.851
Problem is with the default "Encryption Directive" enabled for the linux client, when the backup runs all memory gets exausted on the client side causing the entire system to hang. Normal backups without the encryption directive run without issues. We have doubled the amount of memory in the client from 8gb to 16gb and the issue persists. It appears that there may be a memory leak with the save process when encryption is enabled.
The client system backs up 1 TB of data.
The problem was also seen on the client when it was running 7.6.2.2, and we since upgraded to the latest 7.6.3.2.Build.851 to see if it would correct the problem.
First of all is that it's not recommended to use a higher version/build of NetWorker in the clients than in the server.
What is the directive you have set for the client, could you please give us some more information about the client configuration and properties? Have you checked what is the process using such amount of memory?
"The aes ASM uses a software encryption algorithm to encrypt file data. aes uses a considerable
amount of CPU resources so its benefit may be limited on low-powered systems."
From this, it looks like CPU is the most important factor in this, so you might want to double-check that you have enough CPU on this system as well as memory.
Thank you Carlos and Bobby for the responses. I'm going to initiate a support ticket against this, as there is more site specific details which will need to be reviewed and not appropriate for a public forum. Just wanted to verify whether there were any known memory leak issues with NetWorker 7.6.x and encryption on Linux clients, which doesn't seem to be the case.
Encryption is resource intensive operation on the NetWorker client and can significantly affect backup performance, Also if backin up with AES encryption on drive with millions of small files will consumes a lot of memory, which will leads to memory leak , Check the backup performance with AES encryption off firstly.
I've initiated EMC Support Ticket 46378182 against this issue. The backups of the same Linux client without the Encryption Directive are successful, and they only use up .1% of RAM during the backup without any fluctuation. There are other details included in the support ticket, so please reference the ticket if you would like further information. Thanks, Mike.
What is the outcome of the support case , is it environmental issue causing the poor performance or there is millions of small files that consumes a lot of memory while encryption is performed ?
Rolling the Linux client NetWorker version back to 7.4.4 resolved the issue. Encrypted backups of the linux client now run as expected. So something obviously changed in the code between the 7.4.4 version and 7.6.x. Still working with EMC support on getting this escalated.
I'm wondering if others which reported that they have encountered this issue were also running at a 7.6 version? And if so, did this previously work under past versions?
I would recommend anyone who is having this issue to open a support ticket with EMC and reference this support thread, as the more reported incidents around this issue will lead to a higher priority.
CarlosRojas
1693 Posts
739
0
Posted February 28th, 2012 21:00
Hi Michael,
First of all is that it's not recommended to use a higher version/build of NetWorker in the clients than in the server.
What is the directive you have set for the client, could you please give us some more information about the client configuration and properties? Have you checked what is the process using such amount of memory?
Thank you.
Carlos.