MFE SRDF-HC: SDDF session stalls after recovery from a ConGroup Trip

Summary: Symmetrix Differential Data Facility (SDDF) session stops after recovery from a link drop.

This article applies to This article does not apply to This article is not tied to any specific product. Not all product versions are identified in this article.
Check out other resources

Symptoms


 

Error message: GDDS233E GDDR MSC SDDF Reset for group msc-groupname 
delayed - (0919201821441111 - 45635.85 seconds ago)


Testing a ConGroup trip in a SRDF/STAR environment by dropping the links between the two sites in the SRDF/S relationship. Geographically Dispersed Disaster Restart (GDDR) controlling the environment.  
The links are dropped twice. After the first link drop and ConGroup trip, the SDDF sessions recovered successfully. After the second drop, an SDDF session fails and the GDDS233E message is issued. The message indicates that the rotation of the SDDF sessions had stalled.

See the notes section for the sequence of events that occur. 

 


 

Cause

After a link failure, SDDF session processing stops in a SRDF/STAR or SRDF/SQAR environment due to incorrect program logic. A mismatch in counters that should be updated in synchronous, are not updated, causing a polling loop. 

Resolution

Workaround

  • A restart of the MSC environment is necessary to enable the SDDF session rotation.

Permanent Fix

  • For Mainframe Enablers 8.3, Program Temporary Fix (PTF) SF83083 and PTF SR83049 have been developed to correct the issue. They are available to download from Dell EMC Online Support.
  • For Mainframe Enablers 8.2, PTF SF82142 and PTF SR82088 have been developed to correct the issue. They are available to download from Dell EMC Online Support.
  • For Mainframe Enablers 8.1, PTF SF81137 and PTF SR81096 have been developed to correct the issue. They are available to download from Dell EMC Online Support.



 

Additional Information

The issue re-created in the Dell lab environment and the following sequence of events are seen.

Links are taken off in the middle of a RESET SDDF for sessions 2. The messages SCF1543E and SCF1523E indicated the issue. The RESET fails with an error code of 87. The error code of 87 is normal in this situation and indicates that the remote command failed.  
 
 

06.58.03 STC01813  SCF1345I MSC - GROUP=PISTAR_DC1                MOTHER TASK FUNCTION TIMER
 06.58.03 STC01813  SCF1343I MSC - GROUP=PISTAR_DC1                PROCESS_FC04-TIME FOR SWITCH
 06.58.03 STC01813  SCF1382I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC04-CAN WE SWITCH?
 06.58.03 STC01813  SCF1344I MSC - GROUP=PISTAR_DC1                PROCESS_FC05-ALL BOXES CAN SWITCH
 06.58.03 STC01813  SCF1383I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC05-OPEN AND SWITCH
 06.58.03 STC01813  SCF1346I MSC - GROUP=PISTAR_DC1                PROCESS_FC06-ALL BOXES OPENED WINDOW AND CYCLE SWITCHED
 06.58.03 STC01813  SCF1564I MSC - GROUP=PISTAR_DC1                TIME OF DAY FOR CYCLE 00000052 IS 06:58:03.00
 06.58.03 STC01813  SCF1384I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC06-CLOSE WINDOW
 06.58.03 STC01813  SCF1347I MSC - GROUP=PISTAR_DC1                PROCESS_FC07-ALL BOXES CLOSED WINDOW
 06.58.04 STC01813  SCF1454I MSC - GROUP=PISTAR_DC1                NEXT WAKE UP AT X'10581800'
 06.58.04 STC01813  SCF1497I MSC - GROUP=PISTAR_DC1                 Perform STAR SDDF RESET for Session 2
 06.58.04 STC01813  SCF1501I MSC - GROUP=PISTAR_DC1                 (0C00A,01) PERFORM SDDF FUNCTION FOR SDDF J02
 06.58.04 STC01813  SCF1514I MSC - GROUP=PISTAR_DC1                 (0C00A,01) RESET SDDF SESSION 2
 06.58.05 STC01813  SCF1454I MSC - GROUP=PISTAR_DC1                NEXT WAKE UP AT X'10581800'
 06.58.05 STC01813  SCF1499I MSC - GROUP=PISTAR_DC1                DONE PERFORMING SDDF FUNCTION
 06.58.06 STC01813  SCF1454I MSC - GROUP=PISTAR_DC1                NEXT WAKE UP AT X'10581800'
 06.58.18 STC01813  SCF1345I MSC - GROUP=PISTAR_DC1                MOTHER TASK FUNCTION TIMER
 06.58.18 STC01813  SCF1343I MSC - GROUP=PISTAR_DC1                PROCESS_FC04-TIME FOR SWITCH
 06.58.18 STC01813  SCF1382I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC04-CAN WE SWITCH?
 06.58.18 STC01813  SCF1344I MSC - GROUP=PISTAR_DC1                PROCESS_FC05-ALL BOXES CAN SWITCH
 06.58.18 STC01813  SCF1383I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC05-OPEN AND SWITCH
 06.58.18 STC01813  SCF1346I MSC - GROUP=PISTAR_DC1                PROCESS_FC06-ALL BOXES OPENED WINDOW AND CYCLE SWITCHED
 06.58.18 STC01813  SCF1564I MSC - GROUP=PISTAR_DC1                TIME OF DAY FOR CYCLE 00000053 IS 06:58:18.00
 06.58.18 STC01813  SCF1384I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC06-CLOSE WINDOW
 06.58.18 STC01813  SCF1347I MSC - GROUP=PISTAR_DC1                PROCESS_FC07-ALL BOXES CLOSED WINDOW
 06.58.18 STC01813  SCF1499I MSC - GROUP=PISTAR_DC1                DONE PERFORMING SDDF FUNCTION
 06.58.19 STC01813  SCF1454I MSC - GROUP=PISTAR_DC1                NEXT WAKE UP AT X'10583300'
 06.58.33 STC01813  SCF1345I MSC - GROUP=PISTAR_DC1                MOTHER TASK FUNCTION TIMER
 06.58.33 STC01813  SCF1343I MSC - GROUP=PISTAR_DC1                PROCESS_FC04-TIME FOR SWITCH
 06.58.33 STC01813  SCF1382I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC04-CAN WE SWITCH?
 06.58.33 STC01813  SCF1344I MSC - GROUP=PISTAR_DC1                PROCESS_FC05-ALL BOXES CAN SWITCH
 06.58.33 STC01813  SCF1383I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC05-OPEN AND SWITCH
 06.58.33 STC01813  SCF1346I MSC - GROUP=PISTAR_DC1                PROCESS_FC06-ALL BOXES OPENED WINDOW AND CYCLE SWITCHED
 06.58.33 STC01813  SCF1564I MSC - GROUP=PISTAR_DC1                TIME OF DAY FOR CYCLE 00000054 IS 06:58:33.04
 06.58.33 STC01813  SCF1384I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC06-CLOSE WINDOW
 06.58.33 STC01813  SCF1347I MSC - GROUP=PISTAR_DC1                PROCESS_FC07-ALL BOXES CLOSED WINDOW
 06.58.33 STC01813  SCF1499I MSC - GROUP=PISTAR_DC1                DONE PERFORMING SDDF FUNCTION
 06.58.34 STC01813  SCF1454I MSC - GROUP=PISTAR_DC1                NEXT WAKE UP AT X'10584800'
 06.58.34 STC01813  SCF1534E MSC - GROUP=PISTAR_DC1                (0C00A,01) GLOBAL SDDF RESET FAILURE
 06.58.34 STC01813  SCF1532E MSC - GROUP=PISTAR_DC1                (0C00A,01) ERROR = (87) FOR DEVICE (1044)
 06.58.48 STC01813  SCF1345I MSC - GROUP=PISTAR_DC1                MOTHER TASK FUNCTION TIMER
 06.58.48 STC01813  SCF1343I MSC - GROUP=PISTAR_DC1                PROCESS_FC04-TIME FOR SWITCH
 06.58.48 STC01813  SCF1382I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC04-CAN WE SWITCH?
 06.58.48 STC01813  SCF1344I MSC - GROUP=PISTAR_DC1                PROCESS_FC05-ALL BOXES CAN SWITCH
 06.58.48 STC01813  SCF1383I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC05-OPEN AND SWITCH
 06.58.48 STC01813  SCF1346I MSC - GROUP=PISTAR_DC1                PROCESS_FC06-ALL BOXES OPENED WINDOW AND CYCLE SWITCHED
 06.58.48 STC01813  SCF1564I MSC - GROUP=PISTAR_DC1                TIME OF DAY FOR CYCLE 00000055 IS 06:58:48.00
 06.58.48 STC01813  SCF1384I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC06-CLOSE WINDOW
 06.58.48 STC01813  SCF1347I MSC - GROUP=PISTAR_DC1                PROCESS_FC07-ALL BOXES CLOSED WINDOW
 06.58.48 STC01813  SCF1499I MSC - GROUP=PISTAR_DC1                DONE PERFORMING SDDF FUNCTION
 06.58.49 STC01813  SCF1454I MSC - GROUP=PISTAR_DC1                NEXT WAKE UP AT X'10590300'
 06.59.03 STC01813  SCF1345I MSC - GROUP=PISTAR_DC1                MOTHER TASK FUNCTION TIMER
 06.59.03 STC01813  SCF1343I MSC - GROUP=PISTAR_DC1                PROCESS_FC04-TIME FOR SWITCH
 06.59.03 STC01813  SCF1382I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC04-CAN WE SWITCH?
 06.59.03 STC01813  SCF1344I MSC - GROUP=PISTAR_DC1                PROCESS_FC05-ALL BOXES CAN SWITCH
 06.59.03 STC01813  SCF1383I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC05-OPEN AND SWITCH
 06.59.03 STC01813  SCF1346I MSC - GROUP=PISTAR_DC1                PROCESS_FC06-ALL BOXES OPENED WINDOW AND CYCLE SWITCHED
 06.59.03 STC01813  SCF1564I MSC - GROUP=PISTAR_DC1                TIME OF DAY FOR CYCLE 00000056 IS 06:59:03.00
 06.59.03 STC01813  SCF1384I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC06-CLOSE WINDOW
 06.59.03 STC01813  SCF1347I MSC - GROUP=PISTAR_DC1                PROCESS_FC07-ALL BOXES CLOSED WINDOW
 06.59.04 STC01813  SCF1454I MSC - GROUP=PISTAR_DC1                NEXT WAKE UP AT X'10591800'
 06.59.04 STC01813  SCF1497I MSC - GROUP=PISTAR_DC1                 Perform STAR SDDF ACTIVATE for Session 2
 06.59.04 STC01813  SCF1501I MSC - GROUP=PISTAR_DC1                 (0C00A,01) PERFORM SDDF FUNCTION FOR SDDF J02
 06.59.04 STC01813  SCF1516I MSC - GROUP=PISTAR_DC1                 (0C00A,01) ACTIVATE SDDF SESSION 2
 06.59.04 STC01813  SCF1560I MSC - GROUP=PISTAR_DC1                (0C00A,01) GOT THE FOLLOWING ERROR
 06.59.04 STC01813  SCF1325E MSC - SAI ERROR FOR VID=SDDFACTI R15=24 EMCRC=28 EMCRS=135 EMCRCX=X'17873206',
                             MD/ACTIVATE_SDDF_SESSION
 . . . . . . . . . .



SDDF rotation continues to fail with a remote call syscall failure 87.
 
When the links are brought back online the first RESET of session 2, seems to complete but it only takes a single cycle switch. It takes four cycles to complete in a normal situation. Session rotation appears to continue as normal.
 
 

07.00.18 STC01813  SCF1345I MSC - GROUP=PISTAR_DC1                MOTHER TASK FUNCTION TIMER
 07.00.18 STC01813  SCF1343I MSC - GROUP=PISTAR_DC1                PROCESS_FC04-TIME FOR SWITCH
 07.00.18 STC01813  SCF1382I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC04-CAN WE SWITCH?
 07.00.18 STC01813  SCF1344I MSC - GROUP=PISTAR_DC1                PROCESS_FC05-ALL BOXES CAN SWITCH
 07.00.18 STC01813  SCF1383I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC05-OPEN AND SWITCH
 07.00.18 STC01813  SCF1346I MSC - GROUP=PISTAR_DC1                PROCESS_FC06-ALL BOXES OPENED WINDOW AND CYCLE SWITCHED
 07.00.18 STC01813  SCF1564I MSC - GROUP=PISTAR_DC1                TIME OF DAY FOR CYCLE 0000005B IS 07:00:18.00
 07.00.18 STC01813  SCF1384I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC06-CLOSE WINDOW
 07.00.18 STC01813  SCF1347I MSC - GROUP=PISTAR_DC1                PROCESS_FC07-ALL BOXES CLOSED WINDOW
 07.00.19 STC01813  SCF1454I MSC - GROUP=PISTAR_DC1                NEXT WAKE UP AT X'11003300'
 07.00.19 STC01813  SCF1497I MSC - GROUP=PISTAR_DC1                 Perform STAR SDDF RESET for Session 2
 07.00.19 STC01813  SCF1501I MSC - GROUP=PISTAR_DC1                 (0C00A,01) PERFORM SDDF FUNCTION FOR SDDF J02
 07.00.19 STC01813  SCF1514I MSC - GROUP=PISTAR_DC1                 (0C00A,01) RESET SDDF SESSION 2
 07.00.20 STC01813  SCF1454I MSC - GROUP=PISTAR_DC1                NEXT WAKE UP AT X'11003300'
 07.00.20 STC01813  SCF1499I MSC - GROUP=PISTAR_DC1                DONE PERFORMING SDDF FUNCTION
 07.00.21 STC01813  SCF1454I MSC - GROUP=PISTAR_DC1                NEXT WAKE UP AT X'11003300'
 07.00.33 STC01813  SCF1345I MSC - GROUP=PISTAR_DC1                MOTHER TASK FUNCTION TIMER
 07.00.33 STC01813  SCF1343I MSC - GROUP=PISTAR_DC1                PROCESS_FC04-TIME FOR SWITCH
 07.00.33 STC01813  SCF1382I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC04-CAN WE SWITCH?
 07.00.33 STC01813  SCF1344I MSC - GROUP=PISTAR_DC1                PROCESS_FC05-ALL BOXES CAN SWITCH
 07.00.33 STC01813  SCF1383I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC05-OPEN AND SWITCH
 07.00.33 STC01813  SCF1346I MSC - GROUP=PISTAR_DC1                PROCESS_FC06-ALL BOXES OPENED WINDOW AND CYCLE SWITCHED
 07.00.33 STC01813  SCF1564I MSC - GROUP=PISTAR_DC1                TIME OF DAY FOR CYCLE 0000005C IS 07:00:33.02
 07.00.33 STC01813  SCF1384I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC06-CLOSE WINDOW
 07.00.33 STC01813  SCF1347I MSC - GROUP=PISTAR_DC1                PROCESS_FC07-ALL BOXES CLOSED WINDOW
 07.00.34 STC01813  SCF1454I MSC - GROUP=PISTAR_DC1                NEXT WAKE UP AT X'11004800'
 07.00.34 STC01813  SCF1497I MSC - GROUP=PISTAR_DC1                 Perform STAR SDDF ACTIVATE for Session 2
 07.00.34 STC01813  SCF1501I MSC - GROUP=PISTAR_DC1                 (0C00A,01) PERFORM SDDF FUNCTION FOR SDDF J02
 07.00.34 STC01813  SCF1516I MSC - GROUP=PISTAR_DC1                 (0C00A,01) ACTIVATE SDDF SESSION 2

 
Next time the session 2 is RESET, it never completes. Session 1 completes OK.
  
 

07.02.33 STC01813  SCF1345I MSC - GROUP=PISTAR_DC1                MOTHER TASK FUNCTION TIMER
 07.02.33 STC01813  SCF1343I MSC - GROUP=PISTAR_DC1                PROCESS_FC04-TIME FOR SWITCH
 07.02.33 STC01813  SCF1382I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC04-CAN WE SWITCH?
 07.02.33 STC01813  SCF1344I MSC - GROUP=PISTAR_DC1                PROCESS_FC05-ALL BOXES CAN SWITCH
 07.02.33 STC01813  SCF1383I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC05-OPEN AND SWITCH
 07.02.33 STC01813  SCF1346I MSC - GROUP=PISTAR_DC1                PROCESS_FC06-ALL BOXES OPENED WINDOW AND CYCLE SWITCHED
 07.02.33 STC01813  SCF1564I MSC - GROUP=PISTAR_DC1                TIME OF DAY FOR CYCLE 00000064 IS 07:02:33.00
 07.02.33 STC01813  SCF1384I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC06-CLOSE WINDOW
 07.02.33 STC01813  SCF1347I MSC - GROUP=PISTAR_DC1                PROCESS_FC07-ALL BOXES CLOSED WINDOW
 07.02.34 STC01813  SCF1454I MSC - GROUP=PISTAR_DC1                NEXT WAKE UP AT X'11024800'
 07.02.34 STC01813  SCF1497I MSC - GROUP=PISTAR_DC1                 Perform STAR SDDF RESET for Session 2
 07.02.34 STC01813  SCF1501I MSC - GROUP=PISTAR_DC1                 (0C00A,01) PERFORM SDDF FUNCTION FOR SDDF J02
 07.02.34 STC01813  SCF1514I MSC - GROUP=PISTAR_DC1                 (0C00A,01) RESET SDDF SESSION 2
 07.02.35 STC01813  SCF1454I MSC - GROUP=PISTAR_DC1                NEXT WAKE UP AT X'11024800'
 07.02.35 STC01813  SCF1499I MSC - GROUP=PISTAR_DC1                DONE PERFORMING SDDF FUNCTION
 07.02.36 STC01813  SCF1454I MSC - GROUP=PISTAR_DC1                NEXT WAKE UP AT X'11024800'
 07.02.48 STC01813  SCF1345I MSC - GROUP=PISTAR_DC1                MOTHER TASK FUNCTION TIMER
 07.02.48 STC01813  SCF1343I MSC - GROUP=PISTAR_DC1                PROCESS_FC04-TIME FOR SWITCH
 07.02.48 STC01813  SCF1382I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC04-CAN WE SWITCH?
 07.02.48 STC01813  SCF1344I MSC - GROUP=PISTAR_DC1                PROCESS_FC05-ALL BOXES CAN SWITCH
 07.02.48 STC01813  SCF1383I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC05-OPEN AND SWITCH
 07.02.48 STC01813  SCF1346I MSC - GROUP=PISTAR_DC1                PROCESS_FC06-ALL BOXES OPENED WINDOW AND CYCLE SWITCHED
 07.02.48 STC01813  SCF1564I MSC - GROUP=PISTAR_DC1                TIME OF DAY FOR CYCLE 00000065 IS 07:02:48.05
 07.02.48 STC01813  SCF1384I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC06-CLOSE WINDOW
 07.02.48 STC01813  SCF1347I MSC - GROUP=PISTAR_DC1                PROCESS_FC07-ALL BOXES CLOSED WINDOW
 07.02.48 STC01813  SCF1499I MSC - GROUP=PISTAR_DC1                DONE PERFORMING SDDF FUNCTION
 07.02.49 STC01813  SCF1454I MSC - GROUP=PISTAR_DC1                NEXT WAKE UP AT X'11030300'
 07.03.03 STC01813  SCF1345I MSC - GROUP=PISTAR_DC1                MOTHER TASK FUNCTION TIMER
 07.03.03 STC01813  SCF1343I MSC - GROUP=PISTAR_DC1                PROCESS_FC04-TIME FOR SWITCH
 07.03.03 STC01813  SCF1382I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC04-CAN WE SWITCH?
 07.03.03 STC01813  SCF1344I MSC - GROUP=PISTAR_DC1                PROCESS_FC05-ALL BOXES CAN SWITCH
 07.03.03 STC01813  SCF1383I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC05-OPEN AND SWITCH
 07.03.03 STC01813  SCF1346I MSC - GROUP=PISTAR_DC1                PROCESS_FC06-ALL BOXES OPENED WINDOW AND CYCLE SWITCHED
 07.03.03 STC01813  SCF1564I MSC - GROUP=PISTAR_DC1                TIME OF DAY FOR CYCLE 00000066 IS 07:03:03.00
 07.03.03 STC01813  SCF1384I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC06-CLOSE WINDOW
 07.03.03 STC01813  SCF1347I MSC - GROUP=PISTAR_DC1                PROCESS_FC07-ALL BOXES CLOSED WINDOW
 07.03.03 STC01813  SCF1499I MSC - GROUP=PISTAR_DC1                DONE PERFORMING SDDF FUNCTION
 07.03.04 STC01813  SCF1454I MSC - GROUP=PISTAR_DC1                NEXT WAKE UP AT X'11031800'
 07.03.18 STC01813  SCF1345I MSC - GROUP=PISTAR_DC1                MOTHER TASK FUNCTION TIMER
 07.03.18 STC01813  SCF1343I MSC - GROUP=PISTAR_DC1                PROCESS_FC04-TIME FOR SWITCH
 07.03.18 STC01813  SCF1382I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC04-CAN WE SWITCH?
 07.03.18 STC01813  SCF1344I MSC - GROUP=PISTAR_DC1                PROCESS_FC05-ALL BOXES CAN SWITCH
 07.03.18 STC01813  SCF1383I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC05-OPEN AND SWITCH
 07.03.18 STC01813  SCF1346I MSC - GROUP=PISTAR_DC1                PROCESS_FC06-ALL BOXES OPENED WINDOW AND CYCLE SWITCHED
 07.03.18 STC01813  SCF1564I MSC - GROUP=PISTAR_DC1                TIME OF DAY FOR CYCLE 00000067 IS 07:03:18.00
 07.03.18 STC01813  SCF1384I MSC - GROUP=PISTAR_DC1                (0C00A,05) PROCESS_FC06-CLOSE WINDOW

 
 DONE PERFORMING SDDF SESSION continues without any further SDDF rotation until MSC is disabled.
 
 

Affected Products

Geographically Dispersed Disaster Restart (GDDR), Mainframe Enablers
Article Properties
Article Number: 000164821
Article Type: Solution
Last Modified: 25 Sept 2025
Version:  4
Find answers to your questions from other Dell users
Support Services
Check if your device is covered by Support Services.