Mainframe Enablers SCF: MSC Host Cleanup Does Not Complete on Secondary Server After a CACA.10 Drop Causing Subsequent GDDR Script to Fail

Summary: MSC Host Cleanup does not complete on a secondary server after a CACA.10 drop causing subsequent GDDR script to fail with a timeout in step 16 of script GDDRPF29.

This article applies to This article does not apply to This article is not tied to any specific product. Not all product versions are identified in this article.
Check out other resources

Symptoms

Configuration: GDDR Concurrent STAR-HA   
Software levels: GDDR 5.2, Mainframe Enablers 8.4  

After an SRDF/A drop, the host cleanup completes successfully on the primary server but the host cleanup message is never retuned on the secondary server. This results in a GDDR script GDDRPF29 timing out in step 16 when it attempts to restore SRDF/A HA capability by issuing an MSC,REFRESH command to the secondary server. 

On the primary server, host cleanup completes as normal. 
SCF1463E MSC - GROUP=MSCGRP................... (aaaaa,A1) SRDFA IS NOT ACTIVE4               
SCF1405E MSC - GROUP=MSCGRP................... (bbbbb,A2) HOST CLEANUP INVOKED               
SCF1435I MSC - GROUP=MSCGRP................... (bbbbb,A2) FREEING SEL LOCKS                  
SCF1435I MSC - GROUP=MSCGRP................... (aaaaa,A1) FREEING SEL LOCKS                  
SCF1480I MSC - GROUP=MSCGRP................... (bbbbb,S2) FREEING STAR SEL LOCKS             
SCF1480I MSC - GROUP=MSCGRP................... (aaaaa,S1) FREEING STAR SEL LOCKS             
SCF1404I MSC - GROUP=MSCGRP................... (bbbbb,A2) PROCESS_FC07-CHECK STATUS          
SCF1404I MSC - GROUP=MSCGRP................... (aaaaa,A1) PROCESS_FC07-CHECK STATUS          
SCF1406I MSC - GROUP=MSCGRP................... HOST CLEANUP IS RUNNING                       
SCF1407I MSC - GROUP=MSCGRP................... (bbbbb,A2) PROCESS_FC08-DROP SRDFA            
SCF1407I MSC - GROUP=MSCGRP................... (aaaaa,A1) PROCESS_FC08-DROP SRDFA            
SCF1463E MSC - GROUP=MSCGRP................... (aaaaa,A1) SRDFA IS NOT ACTIVE4               
SCF1414I MSC - GROUP=MSCGRP................... HOST CLEANUP - PHASE2 IS RUNNING              
SCF14S1I MSC - GROUP=MSCGRP................... HOST CLEANUP CASE1 RUNNING                    
SCF1408I MSC - GROUP=MSCGRP................... (bbbbb,A2) PROCESS_FC09-COMMIT INACTIVE CYCLE 
SCF1408I MSC - GROUP=MSCGRP................... (aaaaa,A1) PROCESS_FC09-COMMIT INACTIVE CYCLE 
SCF153AI MSC - GROUP=MSCGRP................... (aaaaa,S1) Wait for SDDF task completion      
SCF1234I ASY -- CONTROLLER 02016 RDFGRP(A2) ACT CHANGED ON -> OFF       
SCF1234I ASY -- CONTROLLER 00870 RDFGRP(A1) ACT CHANGED ON -> OFF       
SCFS222I MSC - AUTO RECOVERY DISABLED                                   
SCF14S2I MSC - GROUP=MSCGRP................... HOST CLEANUP IS FINISHED


On the secondary server, host cleanup does not complete. No SCF14S2I message is displayed, and apparently MSC is still trying to cycle the switch even though SRDF/A has dropped. 
SCF1463E MSC - GROUP=MSCGRP................... (aaaaa,A1) SRDFA IS NOT ACTIVE4               
SCF1405E MSC - GROUP=MSCGRP................... (bbbbb,A2) HOST CLEANUP INVOKED               
SCF1435I MSC - GROUP=MSCGRP................... (bbbbb,A2) FREEING SEL LOCKS                  
SCF1435I MSC - GROUP=MSCGRP................... (aaaaa,A1) FREEING SEL LOCKS                  
SCF1480I MSC - GROUP=MSCGRP................... (bbbbb,S2) FREEING STAR SEL LOCKS             
SCF1480I MSC - GROUP=MSCGRP................... (aaaaa,S1) FREEING STAR SEL LOCKS             
SCF1571I MSC - GROUP=MSCGRP................... CYCLE SWITCH BACK LEVEL     
SCFS247I MSC - GROUP=MSCGRP................... PROCESS_FC07-ALL BOXES CLOSED WINDOW          
SCF1454I MSC - GROUP=MSCGRP................... NEXT WAKE UP AT X'03354500' 
SCF1404I MSC - GROUP=MSCGRP................... (bbbbb,A2) PROCESS_FC07-CHECK STATUS          
SCF1404I MSC - GROUP=MSCGRP................... (aaaaa,A1) PROCESS_FC07-CHECK STATUS          
SCF1406I MSC - GROUP=MSCGRP................... HOST CLEANUP IS RUNNING     
SCF1407I MSC - GROUP=MSCGRP................... (bbbbb,A2) PROCESS_FC08-DROP SRDFA            
SCF1407I MSC - GROUP=MSCGRP................... (aaaaa,A1) PROCESS_FC08-DROP SRDFA            
SCFS229I MSC - GROUP=MSCGRP................... (bbbbb,A2) SRDFA INACTIVE   
SCFS245I MSC - GROUP=MSCGRP................... MOTHER TASK FUNCTION TIMER 
SCFS243I MSC - GROUP=MSCGRP................... PROCESS_FC04-TIME FOR SWITCH                  
SCF1467I MSC - GROUP=MSCGRP................... WAITING FOR WEIGHT FACTOR   
SCF1468I MSC - GROUP=MSCGRP................... DONE WAITING FOR WEIGHT FACTOR                
SCF1463E MSC - GROUP=MSCGRP................... (bbbbb,A2) SRDFA IS NOT ACTIVE4               
SCFS282I MSC - GROUP=MSCGRP................... (bbbbb,A2) PROCESS_FC04-CAN WE SWITCH?        
SCF1463E MSC - GROUP=MSCGRP................... (aaaaa,A1) SRDFA IS NOT ACTIVE4               
SCFS282I MSC - GROUP=MSCGRP................... (aaaaa,A1) PROCESS_FC04-CAN WE SWITCH?        
SCF1414I MSC - GROUP=MSCGRP................... HOST CLEANUP - PHASE2 IS RUNNING              
SCF14S1I MSC - GROUP=MSCGRP................... HOST CLEANUP CASE1 RUNNING 
SCF1463E MSC - GROUP=MSCGRP................... (bbbbb,A2) SRDFA IS NOT ACTIVE4               
SCF1408I MSC - GROUP=MSCGRP................... (bbbbb,A2) PROCESS_FC09-COMMIT INACTIVE CYCLE 
SCF1463E MSC - GROUP=MSCGRP................... (aaaaa,A1) SRDFA IS NOT ACTIVE4               
SCF1408I MSC - GROUP=MSCGRP................... (aaaaa,A1) PROCESS_FC09-COMMIT INACTIVE CYCLE 
SCF1234I ASY -- CONTROLLER 02016 RDFGRP(A2) ACT CHANGED ON -> OFF         
SCF1234I ASY -- CONTROLLER 00870 RDFGRP(A1) ACT CHANGED ON -> OFF         
SCFS201I MSC - TASK TIMER                                                 
SCFS275I MSC - GROUP=MSCGRP................... (bbbbb,A2) SYMMETRIX TASK TIMER               
SCFS275I MSC - GROUP=MSCGRP................... (aaaaa,A1) SYMMETRIX TASK TIMER               
SCFS234I MSC - GROUP=MSCGRP................... MOTHER TASK TIMER 

The GDDR script GDDRPF29 fails with a timeout because the status returned to GDDR indicates that host cleanup is still running. 
23.08.44 JOB27670  +GDDR721I GDDR Starting Submit GDDR function to remote C system for command GDDRMSC0 at Site DC1  
23.18.44 JOB27670  +GDDM124I GDDRPA29 Remote command GDDRMSC0 to DC1 timed out. (1)  900          
   900              To continue to wait, enter a number of minutes    
   900              To stop waiting, enter 0                       
23.18.45 JOB27670 @075 GDDM123A Enter number of minutes to wait (0 to end now)                    
23.35.57 JOB27670  R 75,0                                                                         
23.35.57 JOB27670  +GDDR992E Error 849 in GDDRUNRX: Work request to DC1 timed out  
23.35.57 JOB27670  +GDDR998E GDDR INTERNAL ERROR: CALL TECH SUPPORT - ID = RCMD-99-40-133        
23.35.57 JOB27670  +GDDR998E ->   cmdrc =gddrunrx(rmtsite,wait_minutes,override,cmdname,cmdparms) 
23.35.57 JOB27670  +GDDR639I GDDR Completed Submit GDDR function to remote C system with rc 40    
23.35.57 JOB27670  +GDDR721I GDDR Starting Script Function Call Stats                              23.35.57 JOB27670  +GDDR639I GDDR Function Status ===>  926                                       
   926              >                                                                             
   926              > GDDR Function Issue MSC Command ( GDDRMSC0 )  
   926              >      Completed step 16 of 24 in 1632.71639 Seconds     
   926              >      With Return code 40 

Cause

Under investigation by Dell engineering.

Resolution

Workaround:
The MSC,REFRESH command should be run manually and the GDDRPF29 scripted restarted from the next step.

Permanent Fix
  • For Mainframe Enablers 8.5, PTF SR85025 is developed to correct the issue. It is available to download from Dell Technologies Online Support.
  • For Mainframe Enablers 8.4, PTF SR84041 is developed to correct the issue. It is available to download from Dell Technologies Online Support.

Affected Products

Mainframe Enablers
Article Properties
Article Number: 000195450
Article Type: Solution
Last Modified: 29 Jul 2025
Version:  7
Find answers to your questions from other Dell users
Support Services
Check if your device is covered by Support Services.