akopsuniwa

updated

2 years ago

A

akopsuniwa

1 Rookie

•

5 Posts

•

2 Points

0

569

September 30th, 2024 09:49

scv2020 cannot enable cache

Hello,

at our university we have an old Dell scv2020 storage that we use as secondary storage.

The last year, both batteries went off, so the cache was automatically disabled. 

Specifically since then  we have two alerts (one for each controller) with the text: an unrecoverable problem was found with caching hardware on controller XXXX during system startup.

Also the cache cards status was at off status.

A few days ago, we managed to buy two batteries to replace the broken ones.  After replacing the batteries 

both cache cards went UP (fully charged).

The problem is that the alerts remains even i shutdown and restart the entire storage. 

Under the Storage Settings we still see a message in red saying: write cache is current down on the storage center.

Any ideas, what can i do to restore cache(write/read)??

The storage of course is EOL.

Regards,

akops

  • DELL-Joey C

    Moderator

    •

    4170 Posts

    •

    20965 Points

    0

    0

    Posted October 7th, 2024 09:42

    Hi,

     

    There are some sets of commands to run, but I'm unsure if those commands can run without updating the SCOS. Let's try this command first, to see if it helps:

     

    cache resetinternalstate 1

    DELL-Joey C

    Social Media and Communities Professional

    Dell Technologies | Enterprise Support Services

    #IWork4Dell

    Did I answer your query? Please click on ‘Mark as Accepted Answer’ if I did. 

  • DELL-Chris H

    7 Practitioner

    •

    9682 Posts

    •

    48046 Points

    0

    0

    Posted September 30th, 2024 15:12

    Akopsuniwa,

     

    I believe this is something that you have to work with support on, as it isn't just a simple fix and requires reviewing the logs and outputs of certain commands to identify the specific path to resolve, but lets start by checking a couple of things. 

     

    What version of SCOS are you using?

    Is the firmware up to date?

    Do you see any reference to BMC in the errors?

     

    Let me know what you see.

     

     

    DELL-Chris H

    Social Media and Communities Professional

    Dell Technologies | Enterprise Support Services

    #IWork4Dell

    Did I answer your query? Please click on ‘Mark as Accepted Answer’. ‘Thumbs up’ the posts you like!

  • akopsuniwa

    1 Rookie

    •

    5 Posts

    •

    2 Points

    0

    0

    Posted September 30th, 2024 16:45

    Hello,

    The system is EOL, so Dell support is not an valid option anymore.

    The system is running SCOS 7.3.20.19. The specific version was chosen 4 year ago by DELL Support (we had active support at 2020) due to possible compatibility issues with the connected fiber switches.

    Regarding BMC, i did find anything in the logs.

    By the way, when i connect through console to the storage and run the: "cache status" command

    i see the below output.

    Inde WCacheEnab RCacheEnab WCacheStat RCacheStat RMWCacheEn ForceWaitF MaxWaitTag          AbnormalDesc          Operating
                                                                                                                       Normal
    ==== ========== ========== ========== ========== ========== ========== ========== ============================== ==========
       1 (1) Enable (1) Enable (2) Down   (1) Up     (1) Enable (1) Enable         10 Write cache enabled but not up (0) Extern
    Walk: Display 1 of 1

    akops

    (edited)

  • DELL-Chris H

    7 Practitioner

    •

    9682 Posts

    •

    48046 Points

    0

    0

    Posted September 30th, 2024 20:13

    There have been numerous firmware updates that address these issues. What I would recommend is to update the SCOS firmware, since it is not at the expected level for the SCOS version: 7.4.21 is the minimum that is expected, but I would update to the latest available.

    DELL-Chris H

    Social Media and Communities Professional

    Dell Technologies | Enterprise Support Services

    #IWork4Dell

    Did I answer your query? Please click on ‘Mark as Accepted Answer’. ‘Thumbs up’ the posts you like!

  • tianchou

    2 Intern

    •

    109 Posts

    0

    0

    Posted October 5th, 2024 09:35

    There are many factors can resulted in cache disable.  So pls. run 

    fm pfm showcachefault

  • akopsuniwa

    1 Rookie

    •

    5 Posts

    •

    2 Points

    0

    0

    Posted October 7th, 2024 08:49

    @tianchou​ The output of the requested command is:

    sn202xxx> fm pfm showcachefault
    sn202xxx> 

    cacheDisabled[ Temperature       ] = False
    cacheDisabled[ Fan               ] = False
    cacheDisabled[ Power             ] = False
    cacheDisabled[ Memory            ] = False
    cacheDisabled[ UPS               ] = False
    cacheDisabled[ Flash             ] = False
    cacheDisabled[ Interface         ] = False
    cacheDisabled[ SelectingLeader   ] = False
    cacheDisabled[ Hibernate         ] = False
    cacheDisabled[ Heartbeat         ] = False
    cacheDisabled[ Controller        ] = False
    cacheDisabled[ Cache Device      ] = False
    cacheDisabled[ Cache Battery     ] = False
    cacheDisabled[ Fault Control     ] = False
    cacheDisabled[ IPC Link          ] = False
    cacheDisabled[ Cache Nvdimm      ] = False
    cacheDisabled[ IP Address Update ] = False
    cacheDisabled[ Peer Presence     ] = False

  • akopsuniwa

    1 Rookie

    •

    5 Posts

    •

    2 Points

    0

    0

    Posted October 7th, 2024 08:52

    @DELL-Chris H ​ I cannot and i dont want to firmware upgrade.

    As the system is EOL (without active support) i dont have access to newer firmwares and i dont want to risk any compatibility issues with the (also very old) connected fiber switches.

  • akopsuniwa

    1 Rookie

    •

    5 Posts

    •

    2 Points

    0

    0

    Posted October 8th, 2024 05:55

    @DELL-Joey C​ Hello, the "cache resetinternalstate 1" command did the work.

    The write cache is up again.

     [202xxx] Cache:Cache 10/08/2024 08:49:27 AM

    Inde WCacheEnab RCacheEnab WCacheStat RCacheStat RMWCacheEn ForceWaitF MaxWaitTag          AbnormalDesc          Operating
                                                                                                                       Normal
    ==== ========== ========== ========== ========== ========== ========== ========== ============================== ==========
       1 (1) Enable (1) Enable (1) Up     (1) Up     (1) Enable (1) Enable         10                                (1) Normal
    Walk: Display 1 of 1

  • cosminidis

    1 Rookie

    •

    22 Posts

    •

    2 Points

    0

    0

    Posted January 2nd, 2025 17:29

    @akopsuniwa​ - you need to run "shellaccess developer" first, otherwise you won't have access to the resetinternalstate command. 

    I've had the same issue after replacing the cache cartridges, which resulted in "Cache Battery Not Armed", even though the batteries were fully charged. After running "cache resetinternalstate 1" on both controller from CLI, the error went away.

    PS: I've noticed other options as well - cache flush / cache erase / etc.. What do those do?