UNSOLVED

FabianEOC

updated

14 years ago

F

FabianEOC

1 Rookie

•

9 Posts

0

6476

July 16th, 2012 13:00

NetWorker server sizing

Hi,

I am new to NetWorker and currenlty busy with EMC to design our future NetWorker environment (7.6 SP4).

Today we talked about the number of server required and EMC came with the easy rule that says you need one networker server per 1000 clients.

I read a little bit the doc about performance and tuning and indeed the doc says that there is no limit but a maximum of 1000 clients per DataZone is recommended due to the complexity of managing large datazone, and the increased hardware requirements on the NetWorker server.

I found difficult to beleive that this limitation is not somehow limited by the size of data to process and not only the number of client and the backup window duration.

Does anyone have experience with a single NetWorker server managing more than 1000 clients ? If yes, what is the daily amount of data backed up ?

In our production environment we have +/-100 TB to backup (full), spread on 1100 servers (running Windows, AIX, Solaris or Linux).

We plan to spread the full backups during the week, this will give us around 20 TB to backup everyday.

The target device will be a DataDomain DD990 (connected with 4x 10 GE NICs).

The hardware we will use for the NetWorker server will be HP Proliant BL460c g7 (8 x Intel Xeon 2GHz with 32 GB of RAM with disk on SAN with SRDF) replication). The Storage Node will be a HP Proliant DL580G7 (24 Intel Xeon 2 GHz with 64 GB of RAM, 2 x 10 GE NICs)

I will be interested to know more about what you are using, the number of clients per datazone and the problem with the management of a large datazone compared to two smaller ones.

Thank you,

Fabian

  • ble1

    6 Operator

    •

    14354 Posts

    •

    56186 Points

    2795

    0

    Posted July 16th, 2012 14:00

    I have backups spread during the week (well, my DB backups are full each day, but file system backup is full once per random day in a week). I equally spread the load so I end up with 45TB per day for some 800 clients. We use concept of database hotels (power machines hosting 60+ databases) and if it wasn't for that I would have much more clients. I think when it comes to scalability and performance, your biggest issue is not volume, but rather number of sessions.  I have per day 37k sessions. That's not a small number and unless you can spread your backups around the clock instead of using silly backup window paradigm - then you would have problem. At least I would and most likely I would end up with 2 datazones. In my case server is HPUX 11.31 running on VPAR with 8 CPUs assigned and 32GB. I should probably say that this is dedicated server doing only that role and saving its own data and nothing more. Media servers have much more CPUs of course.

  • FabianEOC

    1 Rookie

    •

    9 Posts

    2795

    0

    Posted July 16th, 2012 14:00

    Hi Hrvoje,

    Thank you for your answer.

    I read somewhere that the number of session per client is 4 by default so if we have 1100 physical clients it gives only 4400 sessions, we should add to this the client for virtual cluster resources and other specific client. In our enviroment we should end with 10k sessions per day.Does it seem correct to you ?

    So if NetWorker can handle 37k sessions with one server, can I say that we could have up to 3 to 4 thousand physical clients on a single Neworker server ?

  • ble1

    6 Operator

    •

    14354 Posts

    •

    56186 Points

    2795

    0

    Posted July 16th, 2012 17:00

    4 is number of parallel sessions by default.  Actually, that used to be the case before, then it was increased to 8 and not sure what is the case with current builds.  What you should keep in mind that this is just pure parallelism value - meaning, it says how many parallel session client will run at any time. By default, you will have more sessions of course per client.  Each session is one file system so, top of my head, on UNIX that would be /, /usr, /var, /tmp, /opt plus some other specific to some UNIX distros and any other mnt point you might have.  On Windows is your drives plus some 5 VSS save sets at least... so if you use parallelism of 4, you will see 4 of them run at the same time and as soon as one is done, the queued one will jump in. If you have databases, you will have archive/transaction log backups.  We do them every 1h and have some 300 various databases. That adds to the count considerably as each log may be one session (I do that what SAP for a reason). In my world, I spread backups around the clock and have no issues if they run during working hours since none of my backups last more than an hour (except few fat databases, but they are backed up through proxy using snapshots so no big deal). If you have 1100 clients which will do pure file system backup, I expect you will have some 6k-7k sessions at least per day. That is not much, but it all depends then how big they are and into what time frame you wish to squeeze them. I personally find that ideal limit above which I would switch to second datazone is around 400 clients. After that you will notice impact on backup server. How much depends on horse power and how this load is presented to server itself - there is simple answer there really. Life is far away from ideal, but if I had 1100 clients I would probably split that between two datazones and that way have enough buffer for future growth.