Troubleshooting memory errors on PowerEdge systems by swap testing
Resumen:Swapping memory DIMMs to troubleshoot memory errors on Dell Technologies PowerEdge servers.
Seleccione un producto para comprobar la relevancia del artículo
Este artículo se aplica a Este artículo no se aplica aEste artículo no está vinculado a ningún producto específico.No se identifican todas las versiones del producto en este artículo.
Troubleshooting memory errors on PowerEdge systems by swap testing
When a single-bit error (SBE) and/or multi-bit error (MBE) is reported on one or more memory DIMM locations, the cause might not be down to the DIMM itself, so some simple troubleshooting must be performed to determine where exactly the fault lies. See Figure 1 for an example of memory errors appearing in the iDRAC interface on an R715.
Figure 1: Memory errors as displayed in iDRAC 6 logs (English Only)
Isolating memory issues means swapping memory DIMMs into different memory sockets, channels, banks, and controllers. There are several ways that you can swap the DIMMs around to narrow down the fault. You might have to use more than one of these methods to pinpoint the faulty DIMM or Socket. Below, you find a representation of these methods. To make the explanation straightforward, we assume that the faulty DIMM is A1 or one of the sets marked in Blue in the images.
Swapping DIMMs in groups (by Channel or Bank) rather than individually is the best method to identify the failed DIMM or DIMMs. Once a group of DIMMs has been identified to contain the failed DIMM or DIMMs, then moving single DIMMs can be used to identify which DIMMs have failed.
Method 1:
Swapping DIMM A1 (marked in blue) with DIMM A9 (Marked in red) to try the DIMM in a different memory channel and bank
Figure 2: Swapping DIMM A1 with DIMM A9
Method 2:
Swapping DIMM A1 (marked in blue) with DIMM B1 (marked in red) puts the DIMM on an altogether different memory controller (CPU).
Figure 3: Swapping DIMM A1 with DIMM B1
Method 3:
Swapping the whole bank of DIMMS (A1, A2, A3 - marked blue) with another bank (B1, B2, B3 - marked red) tests the whole bank of DIMMs in a new bank, on a new memory controller.
Swapping a whole channel of DIMMs (A1, A4, A7 - marked blue) with another channel (B1, B2, B3 - marked red) test the whole channel of DIMMs in a new channel, and on a new memory controller.
Generally, DIMM errors tend to follow the DIMMs identified in the errors. For example with a SBE reporting on DIMM A1, swapping this DIMM with different DIMM results in one of the following:
The error message is no longer reported, and the problem is resolved
This indicates that reseating the memory resolved the issue
The error message follows the DIMM (DIMM A1 is swapped with DIMM B1, and error messages is now reported against DIMM B1)
This indicates that the DIMM is most likely failed and requires replacement.
The error message follows the DIMM socket (DIMM A1 is swapped with DIMM B1, and error messages is still reported against DIMM A1)
This indicates that the system board or CPU is most likely failed
Swapping CPUs confirms which component requires replacement
If the problem follows the CPU (the error message moves after swapping CPUs), replace the CPU
If the problem stays with the DIMM socket, replace the system board
The error message does not follow the DIMM or the socket (the error is reported against a different DIMM after swapping)
This indicates that a different DIMM or DIMMs is most likely bad
NOTE: We would advise you to also keep your firmware levels up to date as this can reduce the risk of receiving memory errors and prolong the life of the DIMMs.
For more information, see Dell Knowledge Base article Dell Repository Manager (DRM).