Unsolved
This post is more than 5 years old
87 Posts
0
6020
VBA-DD-Cloning
Hi,
we migrated our environment from the VADP method to the new VBA method after upgrading to the latest version of Networker 8.1.1 and upgraded our DD620 to 5.4.0.8.
We used to have a full-inc-inc... setup but with the new method it's always a full. That's not a real problem, backup is very fast to the primary DD and we're getting a high dedup ratio but cloning is taking a real long time now. Looks like it's trying to clone the full backup again and again so going through the whole full backup and comparing the hashes with the remote DD. Is there any way to speed up this process and do the requirements of the line between the two DD's change with this VBA method?
Regards,
John
crazyrov
4 Operator
4 Operator
•
1.3K Posts
0
January 30th, 2014 05:00
Hi DaGrin,
Is the clone based on Clone based replication (CBR) feature of DD or a normal cloning process ?
iimnordic
19 Posts
0
January 30th, 2014 06:00
Hello DaGrin,
Could you please provide more input,
Regarding cloning is this done with a policy in the the "VMware protection policy" within NetWorker ? If not , why ?
You mention it takes "long time" how much longer compaired to VADP?
After upgrading from VADP to VBA you still use 'full every day' schedule? One nice feature in VBA is the Avamar way of thinking "VMware incrementall forever" scedule is included with VBA with best partice to take a fullbackup of the VMware image every 42nd day and INC between. What is the reason to backup 'full every day' other then realy nice de-dup ratios?
I have a test enviroment using the same setup as you (only difference is INC every day not Full every day) as an example we cloned with DDboost to clonepool 156 GB in 4minutes.
Do you have the same infrasturcture between VBA server and Networker/DD as you had in VADP + NetWorker + DD ?
DaGrin
87 Posts
0
January 30th, 2014 06:00
we're using cloning from Networker using DD-BOOST.
VBA=>DD (boost)
DD=>DD (boost)
We had a look and looks like the VBA client is making one big backup file, that it's copying internally on the DD using fastcopy and then Networker is trying to clone this file using DD Boost file replication.
So looks like we end up with one big file that needs to be cloned every day.
DaGrin
87 Posts
0
January 30th, 2014 07:00
I'ts done with the "vmware protection policy" via the VBA. It's only the cloning that's taking up a long time.
We're using the default schedule with this policy so it's using CBT to only get the changed blocks from vmware.
I think the issue is the rebuild of a full by the VBA on the DD. Our cloning used to be only the incremental data and full in the weekend but looks like it's cloneing a full every day now.
Setup is exactly the same, no changes in the setup between the VADP and VBA setup.
Where the red line starts to go straight up, that's where we start to use VBA
kshariprakash
29 Posts
1
February 1st, 2014 22:00
Hi,
Are you using the default Schedule?
This is a known Limitation with VBA / NVP Appliance / DD setup where in during Cloning it doesnt sync the Incremental data which is equivalent to Every day Full data been Cloned from Primary DD to Secondary DD (Only For cloning)
Will Provide / Post more information Soon
HTH
Regards
Hari Prakash.
DaGrin
87 Posts
0
February 2nd, 2014 08:00
Yes, default schedule.
And that's exactly what we see, cloning taking up a long time compared the previous incremental clone.
hhelness
1 Message
1
February 4th, 2014 00:00
We found of selves in the same situation with what seems to be a similar setup. I also found it a bit surprising, and asked advice from EMC support. They replied back that the behaviour was to be expected and as per design.
I did not get a proper explanation, but I came to think of it as the Networker server had to read the data from the DD , acting as a Networker client, before sending it to the DD clone device. (The source DD must recreate all the data, and send it to the Networker server who then use DD boost to ship duped data to the clone DD device. This is not as optimal as when the VBA is reading directly from the source disks (that in addition have change block tracking enable)
Anyhow, due to the bad performance and the urge to be less dependant on one single VBA node, we decided to reconfigure our Networker setup so that we instead of backup+clone (clone to offsite DD) are running two separate backup jobs using two separate VBA nodes that are pointing to two separate DD systems.
VBA1- -> DD1
VBA2 --> DD2
As the backup is so fast (we back up about 17 TB to a DD640 in about 160 minutes) and puts so little strain to the VMware hosts and network, we are now running the backup twice a day instead of only once. In this way we not only have a faster and more robust backup setup than we used to, the last backup is never older than 12 hours, compared to the 24 hours we had previously.
Rgds
Harald
DaGrin
87 Posts
0
February 4th, 2014 02:00
That sounds like a good work-around.
I was in contact with EMC yesterday and looks like there is some special team looking into this EBR/DD "clone" issue.
DaGrin
87 Posts
0
May 23rd, 2014 01:00
Looks like they make some changes in DD OS 5.5:
Synthetic Backup-Aware Replication:
This optimization reduces the time taken to finish replication for backups created by
DD Boost virtual synthesis (Avamar, NetWorker file system backups, NetBackup
Optimized synthetics, etc) or Oracle Incremental Merge using NFS.
Asked the 5.5.0.4 GA code to give it a test run to check if this is really solving this problem.
ble1
2 Intern
2 Intern
•
14.3K Posts
1
May 23rd, 2014 02:00
DDOS 5.5.0.4 is not GA - it is DA as we speak.
ble1
2 Intern
2 Intern
•
14.3K Posts
0
June 3rd, 2014 10:00
See previous comments. There seems to "fix" in DDOS 5.5, but I'm not 100% sure if it applies to this (as I'm not sure if virtual synthesis is the key here). If we assume yes, I guess this comes in DDOS 5.5 and NW 8.2 combo (it might be just DDOS 5.5 actually) so we are talking about GA in start of Q3 for DDOS? (just a guess)
Reich1
4 Posts
0
June 3rd, 2014 10:00
I'm having the exact same issue:
Nightmare.
No fix yet?
GonMur
33 Posts
0
February 23rd, 2015 06:00
This is from the Release Notes of Data Domain DDOS 5.5.1.4
https://support.emc.com/docu56989_Data-Domain-Operating-System-5.5.1.4-Release-Notes---Directed-Availability.pdf?languag…
NetWorker users should note that the optimization done for synthetic backup-aware replication will only be effective for file system backups using virtual synthetics. VMware backups performed by the Virtual Backup Appliance (VBA) will not see any replication performance benefit
sks10241
2 Posts
0
April 27th, 2015 09:00
We are having the exact same issue here. DD 5.5.1.4 NW 8.2.0.6 I am think of setting up 2 different jobs with 2 different VBAs as well. Did anyone ever get resolution tot his?
Stan
pankajpal
9 Posts
0
September 24th, 2015 03:00
Hello,
Is this issue fixed in recent releases? I am facing the same issue cloning jobs for the VBA taking lots of time.
Pankaj