Try rebooting your management server and see if the issue goes away.

hi,

rebooting the management server is temporarily solving the problem, the problem still persists

The message means at the moment there are no enough GK devices to process the request.

+ Are the devices multipathd? If yes(and there is no PowerPath installed), it is recommended to use single pathd to Symm.
+ Are there any stale semaphores associated with GK devices which are not released?
+ Are the GK devices part of device group?

Addition to that please confirm if you have followed all the guidelines mentioned in EMC Primus article emc255976

HI fedex,

if rebooting the mgmt server temporarily fixes the problem then its more than likely that you have less GK devices assigned to this mgmt host.

If the problem occurs next time, do the following (before you reboot):

1) run this command 

stordaemon action storapid –cmd show -gk_pdevs –all

2) it will give you an output similar to this:

              S Y M M E T R I X   G A T E K E E P E R S

--------------------------------------------------------------------

Symmetrix ID: 0002XXXXXXX

GK Select   : Disabled

GK Use      : Legacy

--------------------------------------------------------------------

                                             Flags   Children

  PdevName                                   ASDCV   (count)   State

  ----------------------------------------   -----   --------  -----

  \\.\PHYSICALDRIVE1                         ....X              CLS

  \\.\PHYSICALDRIVE3                         ..X..              CLS

  \\.\PHYSICALDRIVE4                         ..X..              CLS

  \\.\PHYSICALDRIVE5                         ..X..              CLS

  \\.\PHYSICALDRIVE6                         ..X..              CLS

  \\.\PHYSICALDRIVE7                         ..X..              CLS

  \\.\PHYSICALDRIVE8                         ..X..              CLS

  \\.\PHYSICALDRIVE9                         ..X..              CLS

  \\.\PHYSICALDRIVE10                        ..X..              OPN

  \\.\PHYSICALDRIVE11                        ..X..              CLS

  \\.\PHYSICALDRIVE12                        ..X..              OPN

3) The devices (GK devices) which are OPN are in used and cant be used by SYMAPI until they return to CLS state. This will tell you if you have enough GKs.

4) Also, as hemachandra said, make sure you dont have multipath GKs

regards, Saurabh

hi Saurabh,

when i have run the command that you have given,

bash-3.00# stordaemon action storapid -cmd show -dh_devs -all

                               [ Operation not supported by daemon ]

i am not able to see the output that you have shown, our symcli version is

bash-3.00# symcli

Symmetrix Command Line Interface (SYMCLI) Version V7.3.2.0 (Edit Level: 1404)

built with SYMAPI Version V7.3.2.0 (Edit Level: 1404)

Also there are no multipath GK devices

Its a Typo error .. Should be -gk_pdevs and not -dh_devs

Well, the command works fine for me on SE 7.3.1, I am sure it will run on 7.3.2 also.

stordaemon action storapid -cmd show -gk_pdevs all

are you copying the command from here and then pasting it on Unix terminal? Try to type it?

regards,

Saurabh

Here's my 2 cents -

To check the number of GK devices and number of GK device presently opened for each symmetrix array

# stordaemon action storapid -cmd show_gk_stats

The command provided from Saurabh would provide detail info on the device names which are presently opened as GK devices and should work(you used -dh_devs)

If possible try to provide the symapi & storapid logs available @ symapi/log by masking the symm id's if you see not all the GK being used.