This post is more than 5 years old
85 Posts
0
2501
Large amount of small files takes huge amount of time to backup
Hi Guys,
we have a FS in the TB that takes days to backup.
The FS is made up of millions of small files, I was wondering if there is a way of speeding it up What would you guys reccomend?
Thanks
2dam
we have a FS in the TB that takes days to backup.
The FS is made up of millions of small files, I was wondering if there is a way of speeding it up What would you guys reccomend?
Thanks
2dam
Siobhan1
49 Posts
0
July 12th, 2009 22:00
benzino1
244 Posts
1
July 10th, 2009 03:00
let's say you have to backup "/large" (or E:\large), try to define more than one saveset ie.:
/large/dir1
/large/dir2 etc.
than you can start more than one stream of backup at the time.
2dam
85 Posts
0
July 10th, 2009 03:00
tlemons1
1 Rookie
1 Rookie
•
87 Posts
0
July 10th, 2009 07:00
tl
DavidHampson
1.1K Posts
1
July 10th, 2009 07:00
salvoemc
45 Posts
0
July 10th, 2009 10:00
dugans1
186 Posts
0
July 13th, 2009 00:00
IS tyour file server connected to shared storage "SAN" on an ethernet network or a Fabric solution?
is your storage node the same server as the management server?
I have had a situation where backing up across the network from a client has had poor or slow backup speeds due to offload of data at the storage node.
You might want to check and see what the Network cad is doing on the storage node and if it is offloading to a fabric solution to stream to the tape library this could be your bottle neck.
We had this problem and i put in a 4 port nic and teamed it with load balancing to let it offload to the fabric to then stream to the tape drives.
Another question is are you backing up from one shared storage in one data centre to a tape library in a second data centre? if so i would be looking to shapshot the SAN and present the LUN directly to the storage node at the second DC is the infrastructure is correct you should not hit copper anywhere across the 2 dc's and have a full fabric connection to the tape drives.
Let me know.