Unsolved
This post is more than 5 years old
12 Posts
0
6136
Exchange 2010 DAG - unable to backup using NMM 9.0.1.0
We are currently unable to backup Exchange 2010 mailbox servers (arranged in a DAG).
Our server & clients are running:
Backup server Windows 2008 R2 9.0.1.5
Client server Windows 2008 R2
NetWorker Client 9.0.1.5
NetWorker Module for Microsoft 9.0.1.0 build 614
Our NetWorker client parameters are set as:
Save set: APPLICATIONS:\Microsoft Exchange 2010
Access
Backup
nsrsnap_vss_save
Application information
NSR_SNAP_TYPE=vss
NSR_VSS_FORCE_SYSTEM_PROVIDER=yes
The backup Group contains
Mailbox client(s)
DAG created client
Error
Cannot run nsrsnap: No such file or director
Please note that NMM Config Checker does not return any errors.
Does the above look ok?
Many thanks
Rich
Raja_Bala
37 Posts
0
January 18th, 2017 00:00
For NMM 9 version backup command is nsrnmmsv.exe. Some application information values are below.
NSR_EXCH_DAG=
NSR_FEDERATED_BACKUP=yes
NSR_FEDERATED_PSOL=
NSR_EXCH _BACKUP or NSR_EXCH2010_BACKUP=
Better configure the client resource using wizard.
Du0b44UK5312468
12 Posts
0
January 18th, 2017 03:00
Hi Raja, thanks for the response. Tried a few variations of the above.
First I tried listing all the Exchange servers for the NSR_FEDERATED_PSOL value and got the following error in the log: 'nsrnmmsv NSR critical 140 Exchange federated .. the client name does not match the DAG name that is required for federated backup. The backup cannot continue.'
I then removed the list of Exchange servers and replaced with the DAG and got the following: 'nsrnmmsv NSR critical 131 NMM .. Exchange2010 Shell interface is unavailable. This may indicate that the EMC powershell library was not properly registered.'
Any further thoughts?
Raja_Bala
37 Posts
0
January 18th, 2017 17:00
Are you running backup by using the DAG name as the client instance? If yes then you need to mention this application information NSR_FEDERATED_PSOL=Exchange_node1, Exchange_node2,Exchange_node3 in the DAG instance client properties.
Did you ran NMM exchange admin config tool in all exchange servers to set permissions?
Du0b44UK5312468
12 Posts
0
February 12th, 2017 12:00
Thanks for your helpful suggestions Raja.
In answer to your last question, yes we are using the DAG name as the client instance. The node names have been added as suggested above.
We have taken the following additional steps:
Re-created DAG client using NMC wizard.
Rebooted all DAG members.
Ran EMC Config Checker against all DAG members - no errors.
Ran NMM Exchange Admin Config tool against all DAG members.
Unfortunately, our backups are still failing. Please note the following NMC and backup server errors.
NMC error:
suppressed 5215 bytes of output.
2/11/2017 12:59:17 PM Group Exchange 2010 waiting for 1 jobs (0 awaiting restart) to complete.
84078 1486818859 2 5 0 25408 24856 0 GW-backupsrv01 savegrp NSR warning 53 command '%s' for client %s exited with return code %d 3 0 489 nsrnmmsv -LL -s GW-backupsrv01 -g
"Exchange 2010/Exchange 2010/backup/Exchange 2010" -a "*policy action jobid=97379" -a "*policy name=Exchange 2010" -a "*policy workflow name=Exchange 2010" -a "*policy
action name=backup" -y "Thu May 11 23:59:59 GMT+0100 2017" -w "Thu May 11 23:59:59 GMT+0100 2017" -m GW-EXCHMB-DAG -z -a DIRECT_ACCESS=Yes -o "\"RENAMED_DIRECTORIES:index_
ookup=on;REQUESTED_LEVEL:level=incr;\"" -l incr -q -W 78 -N pseudo_saveset "APPLICATIONS:\\Microsoft Exchange 2010" 12 13 GW-EXCHMB-DAG 1 1 1
2/11/2017 1:14:19 PM job (97388) host: GW-EXCHMB-DAG savepoint: pseudo_saveset had ERROR indication(s) at completion
2/11/2017 1:14:19 PM GW-EXCHMB-DAG:pseudo_saveset failed.
2/11/2017 1:14:19 PM Exchange 2010 GW-EXCHMB-DAG:pseudo_saveset See the file N:\Program Files\Legato\nsr\logs\policy\Exchange 2010\Exchange 2010\backup_097379_logs
\97388.log for command output
2/11/2017 1:14:24 PM Action backup traditional 'backup' with job id 97379 is exiting with status 'failed', exit code 1
N:\Program Files\Legato\nsr\logs\policy\Exchange 2010\Exchange 2010\backup_097379_logs error:
107092:nsrnmmsv: Version information for C:\Program Files\EMC NetWorker\nsr\bin\nsrnmmsv.exe: Original file name: nsrnmmsv.exe Version: 9.0.1.614 Comments:
Supporting Microsoft Volume Shadow Copy Service127159:nsrnmmsv: Created temp path C:\Program Files\EMC NetWorker\nsr\tmp\nmm\2017-02-11_12-59-17_14716-10956\.nsrnmmsv:
multithreaded save set parallelism==4133296 1486817957 0 0 0 10956 14716 0 GW-exchmb-02.GWENT nsrnmmsv NSR info 26 Starting backup operation. 0145369 1486817958 0 0
0 10956 14716 0 GW-exchmb-02.GWENT nsrnmmsv NSR info 89 Initialization success -- Exchange shell successfully initialized. Required for Exchange. 0149887 1486817958
0 0 0 10956 14716 0 GW-exchmb-02.GWENT nsrnmmsv NSR info 11 DAG IP: %s. 1 0 12 10.61.115.850 1486817958 1 0 0 10956 14716 0 GW-exchmb-02.GWENT nsrnmmsv NSR
notice 84 The Exchange DAG name "%s" was provided by the user. The actual DAG name is "%s". 2 0 13 GW-EXCHMB-DAG 0 26 GW-EXCHMB-DAG.GWENT128719 1486817959 0 0 0
10956 14716 0 GW-exchmb-02.GWENT nsrnmmsv NSR info 102 The federated Exchange backup is set so only databases that are in the active state will be backed up. 0128721
1486817959 0 0 0 10956 14716 0 GW-exchmb-02.GWENT nsrnmmsv NSR info 127 Exchange federated .. No preferred server order list was provided. A list of all servers in
the DAG will be used during backup. 00 1486817959 1 0 0 10956 14716 0 GW-exchmb-02.GWENT nsrnmmsv NSR notice 57 Exchange federated .. Server order checked for
databases: 00 1486817959 1 0 0 10956 14716 0 GW-exchmb-02.GWENT nsrnmmsv NSR notice 7 %s 1 0 25 GW-EXCHMB-07.GWENT0 1486817959 1 0 0 10956 14716 0 GW-
exchmb-02.GWENT nsrnmmsv NSR notice 7 %s 1 0 25 GW-EXCHMB-06.GWENT0 1486817959 1 0 0 10956 14716 0 GW-exchmb-02.GWENT nsrnmmsv NSR notice 7 %s
1 0 25 GW-EXCHMB-04.GWENT0 1486817959 1 0 0 10956 14716 0 GW-exchmb-02.GWENT nsrnmmsv NSR notice 7 %s 1 0 25 GW-EXCHMB-03.GWENT0 1486817959 1 0 0
10956 14716 0 GW-exchmb-02.GWENT nsrnmmsv NSR notice 7 %s 1 0 25 GW-EXCHMB-02.GWENT128686 1486817973 0 0 0 10956 14716 0 GW-exchmb-02.GWENT
nsrnmmsv NSR info 83 Exchange federated .. Databases in DAG have been evaluated for backup..continuing. 0111828 1486817973 0 0 0 10956 14716 0 GW-exchmb-02.GWENT
nsrnmmsv NSR info 45 Starting 'secondary' backup job on host : %s. 1 12 25 GW-EXCHMB-07.GWENT51340 1486817973 0 0 0 10956 14716 0 GW-exchmb-02.GWENT nsrnmmsv
NSR info 45 %s(%d): Created Job ID: %d\n Save command: %s 4 23 10 jobhandler 1 3 306 1 5 97390 0 511 nsrnmmsv.exe -s GW-backupsrv01 -g "Exchange 2010/Exchange
2010/backup/Exchange 2010" -m GW-EXCHMB-DAG -l incr -y "Thu May 11 23:59:59 GMT+0100 2017" -Z GW-EXCHMB-DAG -A *NSR_BACKUP_GENERATIONID=1486817957 -A NSR_EXCH_CHECK=no -A
NSR_EXCH_DAG=GW-EXCHMB-DAG -A NSR_EXCH_INCL_SA=TRUE -A NSR_FEDERATED_BACKUP=yes -A NSR_FED_SECONDARY=yes -A NSR_SINGLE_SNAPSHOT=No -a "*POLICY ACTION JOBID=97379" -a
"*POLICY ACTION NAME=backup" -a "*POLICY NAME=Exchange 2010" -a "*POLICY WORKFLOW NAME=Exchange 2010" -a DIRECT_ACCE116712 1486818078 0 0 0 10956 14716 0 GW-exchmb-
nsrnmmsv NSR info 45 Starting 'secondary' backup job on host : %s. 1 12 25 GW-EXCHMB-06.GWENT51340 1486818079 0 0 0 10956 14716 0 GW-exchmb-02.GWENT nsrnmmsv
NSR info 45 %s(%d): Created Job ID: %d\n Save command: %s 4 23 10 jobhandler 1 3 306 1 5 97391 0 511 nsrnmmsv.exe -s GW-backupsrv01 -g "Exchange 2010/Exchange
2010/backup/Exchange 2010" -m GW-EXCHMB-DAG -l incr -y "Thu May 11 23:59:59 GMT+0100 2017" -Z GW-EXCHMB-DAG -A *NSR_BACKUP_GENERATIONID=1486817957 -A NSR_EXCH_CHECK=no -A
NSR_EXCH_DAG=GW-EXCHMB-DAG -A NSR_EXCH_INCL_SA=TRUE -A NSR_FEDERATED_BACKUP=yes -A NSR_FED_SECONDARY=yes -A NSR_SINGLE_SNAPSHOT=No -a "*POLICY ACTION JOBID=97379" -a
"*POLICY ACTION NAME=backup" -a "*POLICY NAME=Exchange 2010" -a "*POLICY WORKFLOW NAME=Exchange 2010" -a DIRECT_ACCE116712 1486818185 0 0 0 10956 14716 0 GW-exchmb-
nsrnmmsv NSR info 45 Starting 'secondary' backup job on host : %s. 1 12 25 GW-EXCHMB-04.GWENT51340 1486818186 0 0 0 10956 14716 0 GW-exchmb-02.GWENT nsrnmmsv
NSR info 45 %s(%d): Created Job ID: %d\n Save command: %s 4 23 10 jobhandler 1 3 306 1 5 97392 0 511 nsrnmmsv.exe -s GW-backupsrv01 -g "Exchange 2010/Exchange
2010/backup/Exchange 2010" -m GW-EXCHMB-DAG -l incr -y "Thu May 11 23:59:59 GMT+0100 2017" -Z GW-EXCHMB-DAG -A *NSR_BACKUP_GENERATIONID=1486817957 -A NSR_EXCH_CHECK=no -A
NSR_EXCH_DAG=GW-EXCHMB-DAG -A NSR_EXCH_INCL_SA=TRUE -A NSR_FEDERATED_BACKUP=yes -A NSR_FED_SECONDARY=yes -A NSR_SINGLE_SNAPSHOT=No -a "*POLICY ACTION JOBID=97379" -a
"*POLICY ACTION NAME=backup" -a "*POLICY NAME=Exchange 2010" -a "*POLICY WORKFLOW NAME=Exchange 2010" -a DIRECT_ACCE116712 1486818311 0 0 0 10956 14716 0 GW-exchmb-
nsrnmmsv NSR info 45 Starting 'secondary' backup job on host : %s. 1 12 25 GW-EXCHMB-03.GWENT51340 1486818313 0 0 0 10956 14716 0 GW-exchmb-02.GWENT nsrnmmsv
NSR info 45 %s(%d): Created Job ID: %d\n Save command: %s 4 23 10 jobhandler 1 3 306 1 5 97393 0 511 nsrnmmsv.exe -s GW-backupsrv01 -g "Exchange 2010/Exchange
2010/backup/Exchange 2010" -m GW-EXCHMB-DAG -l incr -y "Thu May 11 23:59:59 GMT+0100 2017" -Z GW-EXCHMB-DAG -A *NSR_BACKUP_GENERATIONID=1486817957 -A NSR_EXCH_CHECK=no -A
NSR_EXCH_DAG=GW-EXCHMB-DAG -A NSR_EXCH_INCL_SA=TRUE -A NSR_FEDERATED_BACKUP=yes -A NSR_FED_SECONDARY=yes -A NSR_SINGLE_SNAPSHOT=No -a "*POLICY ACTION JOBID=97379" -a
"*POLICY ACTION NAME=backup" -a "*POLICY NAME=Exchange 2010" -a "*POLICY WORKFLOW NAME=Exchange 2010" -a DIRECT_ACCE116712 1486818414 0 0 0 10956 14716 0 GW-exchmb-
nsrnmmsv NSR info 45 Starting 'secondary' backup job on host : %s. 1 12 25 GW-EXCHMB-02.GWENT51340 1486818422 0 0 0 10956 14716 0 GW-exchmb-02.GWENT nsrnmmsv
NSR info 45 %s(%d): Created Job ID: %d\n Save command: %s 4 23 10 jobhandler 1 3 306 1 5 97394 0 511 nsrnmmsv.exe -s GW-backupsrv01 -g "Exchange 2010/Exchange
2010/backup/Exchange 2010" -m GW-EXCHMB-DAG -l incr -y "Thu May 11 23:59:59 GMT+0100 2017" -Z GW-EXCHMB-DAG -A *NSR_BACKUP_GENERATIONID=1486817957 -A NSR_EXCH_CHECK=no -A
NSR_EXCH_DAG=GW-EXCHMB-DAG -A NSR_EXCH_INCL_SA=TRUE -A NSR_FEDERATED_BACKUP=yes -A NSR_FED_SECONDARY=yes -A NSR_SINGLE_SNAPSHOT=No -a "*POLICY ACTION JOBID=97379" -a
"*POLICY ACTION NAME=backup" -a "*POLICY NAME=Exchange 2010" -a "*POLICY WORKFLOW NAME=Exchange 2010" -a DIRECT_ACCE116712 1486818527 0 0 0 10956 14716 0 GW-exchmb-
nsrnmmsv NSR critical 76 A 'secondary' job failure has been identified, stopping all 'secondary' jobs 0139527 1486818855 3 0 0 10956 14716 0 GW-exchmb-02.GWENT
nsrnmmsv NSR error 51 The backup operation did not complete successfully. 0127160 1486818856 0 0 0 10956 14716 0 GW-exchmb-02.GWENT nsrnmmsv NSR info 34 Removing
files under temp path %s. 1 23 74 C:\Program Files\EMC NetWorker\nsr\tmp\nmm\2017-02-11_12-59-17_14716-10956102333 1486818856 3 0 0 10956 14716 0 GW-exchmb-02.GWENT
nsrnmmsv NSR error 21 Exiting with failure. 0
Does anything stand out to you?
Many thanks
Rich
CarlosRojas
1.7K Posts
0
February 13th, 2017 04:00
Hi Rich,
Can you please render the nsrnmmsv.raw log and attach it here?
Thank you,
Carlos
Du0b44UK5312468
12 Posts
0
February 14th, 2017 08:00
Hi Carlos,
Many thanks for agreeing to look at this.
Please find nsrnmmsv.raw log (ran from the DAG server): https://dl.dropboxusercontent.com/u/15403592/Carlos.txt
Regards
Rich
lukaskienitz
1 Message
0
July 24th, 2018 02:00
Hello,
Is there any solution for this problem?
We are facing the same issue and still have tried all solutions found in the internet.
Best regards,
Lukas
Princeaijazbhat
41 Posts
0
July 26th, 2018 00:00
I see backups have failed due to pseudo_save set failed. Correct the
permission issues . You can use NMM Exchange Admin Configuration Tool which
Facilitates the creation and management of users with privileges to perform
Exchange backup and recovery operations
On Thu, Jul 26, 2018 at 12:42 PM, Aijaz Ahmad Bhat <
Princeaijazbhat
41 Posts
0
July 26th, 2018 00:00
nsrsnap_vss_save and nsrsnap_vss_recover commands are no longer used , they
are replaced by the new backup command, nsrnmmsv, and the new recovery
command nsrnmmrc.
NMM 9.0 for Exchange uses BBB exclusively in its backing up of data.
With the 9.0 NMM client, nsrexecd initiates one process, nsrnmmsv, and that
is it!
Run this command and see the save sets
nsrnmmsv -A NSR_FEDERATED_BACKUP=yes -A NSR_EXCH_DAG=DAG1.abc.com -P
Or nsrnmmsv -P
You will get following o/p with list of save sets
C:\Windows\system32>nsrnmmsv -P
107092:nsrnmmsv: Version information for C:\Program Files\EMC
NetWorker\nsr\bin\
nsrnmmsv.exe: Original file name: nsrnmmsv.exe Version: 9.0.1.669
Comments: Supporting Microsoft Volume Shadow Copy Service
On Tue, Jul 24, 2018 at 7:39 PM, lukaskienitz
Chan46
10 Posts
0
January 7th, 2019 01:00
Hi princeaijaz/All,
We are facing similar issue with our DAG Exchange backup..
107092:nsrnmmsv: Version information for C:\Program Files\EMC NetWorker\nsr\bin\nsrnmmsv.exe: Original file name: nsrnmmsv.exe Version: 9.2.1 (ntx64)
Comments: Supporting Microsoft Volume Shadow Copy Service
127159:nsrnmmsv: Created temp path C:\Program Files\EMC NetWorker\nsr\tmp\nmm\2019-01-07_03-31-31_1685536-1622908\.
nsrnmmsv: multithreaded save set parallelism==12
145369:nsrnmmsv: Initialization success -- Exchange shell successfully initialized. Required for Exchange.
133296 1546828293 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 26 Starting backup operation. 0
145369 1546828293 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 89 Initialization success -- Exchange shell successfully initialized. Required for Exchange. 0
149887 1546828293 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 11 DAG IP: %s. 1 0 12 138.106.6.34
0 1546828293 1 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR notice 84 The Exchange DAG name "%s" was provided by the user. The actual DAG name is "%s". 2 0 7 DAG01 0 29 DAG01.global.scd.yyyy.com
128715 1546828294 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 118 No federated Exchange backup state for selecting a database was provided. Setting to default backup type of PREFERRED. 0
128721 1546828294 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 127 Exchange federated .. No preferred server order list was provided. A list of all servers in the DAG will be used during backup. 0
0 1546828294 1 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR notice 57 Exchange federated .. Server order checked for databases: 0
0 1546828294 1 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR notice 7 %s 1 0 32 xxxxx0021.global.scd.yyyy.com
0 1546828294 1 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR notice 7 %s 1 0 32 xxxxx0018.global.scd.yyyy.com
0 1546828294 1 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR notice 7 %s 1 0 32 xxxxx0017.global.scd.yyyy.com
0 1546828294 1 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR notice 7 %s 1 0 32 xxxxx0019.global.scd.yyyy.com
0 1546828294 1 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR notice 7 %s 1 0 32 xxxxx0012.global.scd.yyyy.com
0 1546828294 1 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR notice 7 %s 1 0 32 xxxxx0014.global.scd.yyyy.com
0 1546828294 1 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR notice 7 %s 1 0 32 xxxxx0015.global.scd.yyyy.com
0 1546828294 1 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR notice 7 %s 1 0 32 xxxxx0016.global.scd.yyyy.com
0 1546828294 1 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR notice 7 %s 1 0 32 xxxxx0013.global.scd.yyyy.com
0 1546828294 1 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR notice 7 %s 1 0 32 xxxxx0020.global.scd.yyyy.com
0 1546828294 1 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR notice 7 %s 1 0 32 xxxxx0010.global.scd.yyyy.com
0 1546828294 1 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR notice 7 %s 1 0 32 xxxxx0011.global.scd.yyyy.com
128686 1546828494 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 83 Exchange federated .. Databases in DAG have been evaluated for backup..continuing. 0
111828 1546828494 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 Starting 'secondary' backup job on host : %s. 1 12 32 xxxxx0021.global.scd.yyyy.com
51340 1546828494 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 %s(%d): Created Job ID: %d\n Save command: %s 4 23 10 jobhandler 1 3 306 1 7 2729055 0 511 nsrnmmsv.exe -s ZZZZ08.global.scd.yyyy.com -g Gold-File/Exchange/backup/Exchange -m DAG01 -b Database -l incr -y "Mon Jan 28 23:59:59 GMT+0100 2019" -Z DAG01 -A *NSR_BACKUP_GENERATIONID=1546828291 -A NSR_APP_TYPE= -A NSR_EXCH_CHECK=no -A NSR_EXCH_DAG=DAG01 -A NSR_FEDERATED_BACKUP=yes -A NSR_FED_SECONDARY=yes -A NSR_SINGLE_SNAPSHOT=No -a "*POLICY ACTION JOBID=2728711" -a "*POLICY ACTION NAME=backup" -a "*POLICY NAME=Gold-File" -a "*POLICY WORKFLOW NAME=Exchange" -c xxxxx0021.global.scd.yyyy.co
116712 1546829222 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 32 Signal message received from %s. 1 12 32 xxxxx0021.global.scd.yyyy.com
111828 1546829222 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 Starting 'secondary' backup job on host : %s. 1 12 32 xxxxx0018.global.scd.yyyy.com
51340 1546829222 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 %s(%d): Created Job ID: %d\n Save command: %s 4 23 10 jobhandler 1 3 306 1 7 2729063 0 511 nsrnmmsv.exe -s ZZZZ08.global.scd.yyyy.com -g Gold-File/Exchange/backup/Exchange -m DAG01 -b Database -l incr -y "Mon Jan 28 23:59:59 GMT+0100 2019" -Z DAG01 -A *NSR_BACKUP_GENERATIONID=1546828291 -A NSR_APP_TYPE= -A NSR_EXCH_CHECK=no -A NSR_EXCH_DAG=DAG01 -A NSR_FEDERATED_BACKUP=yes -A NSR_FED_SECONDARY=yes -A NSR_SINGLE_SNAPSHOT=No -a "*POLICY ACTION JOBID=2728711" -a "*POLICY ACTION NAME=backup" -a "*POLICY NAME=Gold-File" -a "*POLICY WORKFLOW NAME=Exchange" -c xxxxx0018.global.scd.yyyy.co
116712 1546829579 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 32 Signal message received from %s. 1 12 32 xxxxx0018.global.scd.yyyy.com
111828 1546829579 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 Starting 'secondary' backup job on host : %s. 1 12 32 xxxxx0017.global.scd.yyyy.com
51340 1546829579 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 %s(%d): Created Job ID: %d\n Save command: %s 4 23 10 jobhandler 1 3 306 1 7 2729067 0 511 nsrnmmsv.exe -s ZZZZ08.global.scd.yyyy.com -g Gold-File/Exchange/backup/Exchange -m DAG01 -b Database -l incr -y "Mon Jan 28 23:59:59 GMT+0100 2019" -Z DAG01 -A *NSR_BACKUP_GENERATIONID=1546828291 -A NSR_APP_TYPE= -A NSR_EXCH_CHECK=no -A NSR_EXCH_DAG=DAG01 -A NSR_FEDERATED_BACKUP=yes -A NSR_FED_SECONDARY=yes -A NSR_SINGLE_SNAPSHOT=No -a "*POLICY ACTION JOBID=2728711" -a "*POLICY ACTION NAME=backup" -a "*POLICY NAME=Gold-File" -a "*POLICY WORKFLOW NAME=Exchange" -c xxxxx0017.global.scd.yyyy.co
116712 1546830333 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 32 Signal message received from %s. 1 12 32 xxxxx0017.global.scd.yyyy.com
111828 1546830333 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 Starting 'secondary' backup job on host : %s. 1 12 32 xxxxx0019.global.scd.yyyy.com
51340 1546830333 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 %s(%d): Created Job ID: %d\n Save command: %s 4 23 10 jobhandler 1 3 306 1 7 2729072 0 511 nsrnmmsv.exe -s ZZZZ08.global.scd.yyyy.com -g Gold-File/Exchange/backup/Exchange -m DAG01 -b Database -l incr -y "Mon Jan 28 23:59:59 GMT+0100 2019" -Z DAG01 -A *NSR_BACKUP_GENERATIONID=1546828291 -A NSR_APP_TYPE= -A NSR_EXCH_CHECK=no -A NSR_EXCH_DAG=DAG01 -A NSR_FEDERATED_BACKUP=yes -A NSR_FED_SECONDARY=yes -A NSR_SINGLE_SNAPSHOT=No -a "*POLICY ACTION JOBID=2728711" -a "*POLICY ACTION NAME=backup" -a "*POLICY NAME=Gold-File" -a "*POLICY WORKFLOW NAME=Exchange" -c xxxxx0019.global.scd.yyyy.co
116712 1546830752 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 32 Signal message received from %s. 1 12 32 xxxxx0019.global.scd.yyyy.com
111828 1546830752 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 Starting 'secondary' backup job on host : %s. 1 12 32 xxxxx0012.global.scd.yyyy.com
51340 1546830752 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 %s(%d): Created Job ID: %d\n Save command: %s 4 23 10 jobhandler 1 3 306 1 7 2729076 0 511 nsrnmmsv.exe -s ZZZZ08.global.scd.yyyy.com -g Gold-File/Exchange/backup/Exchange -m DAG01 -b Database -l incr -y "Mon Jan 28 23:59:59 GMT+0100 2019" -Z DAG01 -A *NSR_BACKUP_GENERATIONID=1546828291 -A NSR_APP_TYPE= -A NSR_EXCH_CHECK=no -A NSR_EXCH_DAG=DAG01 -A NSR_FEDERATED_BACKUP=yes -A NSR_FED_SECONDARY=yes -A NSR_SINGLE_SNAPSHOT=No -a "*POLICY ACTION JOBID=2728711" -a "*POLICY ACTION NAME=backup" -a "*POLICY NAME=Gold-File" -a "*POLICY WORKFLOW NAME=Exchange" -c xxxxx0012.global.scd.yyyy.co
116712 1546831414 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 32 Signal message received from %s. 1 12 32 xxxxx0012.global.scd.yyyy.com
111828 1546831414 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 Starting 'secondary' backup job on host : %s. 1 12 32 xxxxx0014.global.scd.yyyy.com
51340 1546831414 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 %s(%d): Created Job ID: %d\n Save command: %s 4 23 10 jobhandler 1 3 306 1 7 2729084 0 511 nsrnmmsv.exe -s ZZZZ08.global.scd.yyyy.com -g Gold-File/Exchange/backup/Exchange -m DAG01 -b Database -l incr -y "Mon Jan 28 23:59:59 GMT+0100 2019" -Z DAG01 -A *NSR_BACKUP_GENERATIONID=1546828291 -A NSR_APP_TYPE= -A NSR_EXCH_CHECK=no -A NSR_EXCH_DAG=DAG01 -A NSR_FEDERATED_BACKUP=yes -A NSR_FED_SECONDARY=yes -A NSR_SINGLE_SNAPSHOT=No -a "*POLICY ACTION JOBID=2728711" -a "*POLICY ACTION NAME=backup" -a "*POLICY NAME=Gold-File" -a "*POLICY WORKFLOW NAME=Exchange" -c xxxxx0014.global.scd.yyyy.co
116712 1546832092 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 32 Signal message received from %s. 1 12 32 xxxxx0014.global.scd.yyyy.com
111828 1546832092 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 Starting 'secondary' backup job on host : %s. 1 12 32 xxxxx0015.global.scd.yyyy.com
51340 1546832092 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 %s(%d): Created Job ID: %d\n Save command: %s 4 23 10 jobhandler 1 3 306 1 7 2729092 0 511 nsrnmmsv.exe -s ZZZZ08.global.scd.yyyy.com -g Gold-File/Exchange/backup/Exchange -m DAG01 -b Database -l incr -y "Mon Jan 28 23:59:59 GMT+0100 2019" -Z DAG01 -A *NSR_BACKUP_GENERATIONID=1546828291 -A NSR_APP_TYPE= -A NSR_EXCH_CHECK=no -A NSR_EXCH_DAG=DAG01 -A NSR_FEDERATED_BACKUP=yes -A NSR_FED_SECONDARY=yes -A NSR_SINGLE_SNAPSHOT=No -a "*POLICY ACTION JOBID=2728711" -a "*POLICY ACTION NAME=backup" -a "*POLICY NAME=Gold-File" -a "*POLICY WORKFLOW NAME=Exchange" -c xxxxx0015.global.scd.yyyy.co
116712 1546832954 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 32 Signal message received from %s. 1 12 32 xxxxx0015.global.scd.yyyy.com
111828 1546832954 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 Starting 'secondary' backup job on host : %s. 1 12 32 xxxxx0016.global.scd.yyyy.com
51340 1546832954 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 %s(%d): Created Job ID: %d\n Save command: %s 4 23 10 jobhandler 1 3 306 1 7 2729100 0 511 nsrnmmsv.exe -s ZZZZ08.global.scd.yyyy.com -g Gold-File/Exchange/backup/Exchange -m DAG01 -b Database -l incr -y "Mon Jan 28 23:59:59 GMT+0100 2019" -Z DAG01 -A *NSR_BACKUP_GENERATIONID=1546828291 -A NSR_APP_TYPE= -A NSR_EXCH_CHECK=no -A NSR_EXCH_DAG=DAG01 -A NSR_FEDERATED_BACKUP=yes -A NSR_FED_SECONDARY=yes -A NSR_SINGLE_SNAPSHOT=No -a "*POLICY ACTION JOBID=2728711" -a "*POLICY ACTION NAME=backup" -a "*POLICY NAME=Gold-File" -a "*POLICY WORKFLOW NAME=Exchange" -c xxxxx0016.global.scd.yyyy.co
116712 1546833622 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 32 Signal message received from %s. 1 12 32 xxxxx0016.global.scd.yyyy.com
111828 1546833622 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 Starting 'secondary' backup job on host : %s. 1 12 32 xxxxx0013.global.scd.yyyy.com
51340 1546833622 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 %s(%d): Created Job ID: %d\n Save command: %s 4 23 10 jobhandler 1 3 306 1 7 2729108 0 511 nsrnmmsv.exe -s ZZZZ08.global.scd.yyyy.com -g Gold-File/Exchange/backup/Exchange -m DAG01 -b Database -l incr -y "Mon Jan 28 23:59:59 GMT+0100 2019" -Z DAG01 -A *NSR_BACKUP_GENERATIONID=1546828291 -A NSR_APP_TYPE= -A NSR_EXCH_CHECK=no -A NSR_EXCH_DAG=DAG01 -A NSR_FEDERATED_BACKUP=yes -A NSR_FED_SECONDARY=yes -A NSR_SINGLE_SNAPSHOT=No -a "*POLICY ACTION JOBID=2728711" -a "*POLICY ACTION NAME=backup" -a "*POLICY NAME=Gold-File" -a "*POLICY WORKFLOW NAME=Exchange" -c xxxxx0013.global.scd.yyyy.co
116712 1546834248 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 32 Signal message received from %s. 1 12 32 xxxxx0013.global.scd.yyyy.com
111828 1546834248 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 Starting 'secondary' backup job on host : %s. 1 12 32 xxxxx0020.global.scd.yyyy.com
51340 1546834248 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 %s(%d): Created Job ID: %d\n Save command: %s 4 23 10 jobhandler 1 3 306 1 7 2729112 0 511 nsrnmmsv.exe -s ZZZZ08.global.scd.yyyy.com -g Gold-File/Exchange/backup/Exchange -m DAG01 -b Database -l incr -y "Mon Jan 28 23:59:59 GMT+0100 2019" -Z DAG01 -A *NSR_BACKUP_GENERATIONID=1546828291 -A NSR_APP_TYPE= -A NSR_EXCH_CHECK=no -A NSR_EXCH_DAG=DAG01 -A NSR_FEDERATED_BACKUP=yes -A NSR_FED_SECONDARY=yes -A NSR_SINGLE_SNAPSHOT=No -a "*POLICY ACTION JOBID=2728711" -a "*POLICY ACTION NAME=backup" -a "*POLICY NAME=Gold-File" -a "*POLICY WORKFLOW NAME=Exchange" -c xxxxx0020.global.scd.yyyy.co
116712 1546834948 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 32 Signal message received from %s. 1 12 32 xxxxx0020.global.scd.yyyy.com
111828 1546834948 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 Starting 'secondary' backup job on host : %s. 1 12 32 xxxxx0010.global.scd.yyyy.com
51340 1546834948 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 45 %s(%d): Created Job ID: %d\n Save command: %s 4 23 10 jobhandler 1 3 306 1 7 2729120 0 511 nsrnmmsv.exe -s ZZZZ08.global.scd.yyyy.com -g Gold-File/Exchange/backup/Exchange -m DAG01 -b Database -l incr -y "Mon Jan 28 23:59:59 GMT+0100 2019" -Z DAG01 -A *NSR_BACKUP_GENERATIONID=1546828291 -A NSR_APP_TYPE= -A NSR_EXCH_CHECK=no -A NSR_EXCH_DAG=DAG01 -A NSR_FEDERATED_BACKUP=yes -A NSR_FED_SECONDARY=yes -A NSR_SINGLE_SNAPSHOT=No -a "*POLICY ACTION JOBID=2728711" -a "*POLICY ACTION NAME=backup" -a "*POLICY NAME=Gold-File" -a "*POLICY WORKFLOW NAME=Exchange" -c xxxxx0010.global.scd.yyyy.co
116712 1546835869 0 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 32 Signal message received from %s. 1 12 32 xxxxx0010.global.scd.yyyy.com
111830 1546836319 0 5 14 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR info 54 Secondary backup with job id (%d) failed on host '%s' 2 1 7 2729120 12 32 xxxxx0010.global.scd.yyyy.com
111833 1546836319 5 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR critical 76 A 'secondary' job failure has been identified, stopping all 'secondary' jobs 0
139527 1546836405 3 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR error 51 The backup operation did not complete successfully. 0
102333 1546836406 3 0 0 1622908 1685536 0 xxxxx0020.global.scd.yyyy.com nsrnmmsv NSR error 21 Exiting with failure. 0
1/7/2019 5:47:01 AM Removing files under temp path C:\Program Files\EMC NetWorker\nsr\tmp\nmm\2019-01-07_03-31-31_1685536-1622908.