Configuration of AMD Epyc for virtualization (NPS, L3 as Numa Domain, MADT)

Hello festuc,

I think these references may help you:

Model:7552  -  NPSx Options=2, 1, 0 is the AMD documentation recommends.

You can review NPSx here. See page 7 -  Socket SP3 Platform NUMA Topology for AMD Family 17h Models 30h-3Fh

https://developer.amd.com/wp-content/resources/56338_1.00_pub.pdf

Microsoft Windows® Server Tuning Guide for AMD EPYC™ 7002 Processors

https://developer.amd.com/wp-content/resources/56782_1.0.pdf

Windows Server support and installation instructions for the AMD EPYC 7000 Series server processors

https://docs.microsoft.com/en-us/troubleshoot/windows-server/deployment/windows-server-support-installation-for-amd-role-family-processor

SLN318449  -Windows Server support and installation instructions for the AMD EPYC 7xx2 series of processors.

https://www.dell.com/support/kbdoc/en-us/000130134/windows-server-support-and-installation-instructions-for-the-amd-epyc-7xx2-series-of-processors

SLN319499  - EMC PowerEdge servers with 2nd Generation AMD EPYC processors fail to boot after installing the Hyper-V role

https://www.dell.com/support/kbdoc/en-us/000134895/dell-emc-poweredge-servers-with-2nd-generation-amd-epyc-processors-fail-to-boot-after-installing-the-hyper-v-role

Hello festuc,

Did you get to look over this one :

SLN319499  - EMC PowerEdge servers with 2nd Generation AMD EPYC processors fail to boot after installing the Hyper-V role

https://www.dell.com/support/kbdoc/en-us/000134895/dell-emc-poweredge-servers-with-2nd-generation-amd-epyc-processors-fail-to-boot-after-installing-the-hyper-v-role

*Perform the following steps to install the Windows Server 2019 Hyper-V role on the affected PowerEdge servers

*Perform the following steps to recover the operating system when the operating system goes into a recovery state or a blue screen (stop error) occurs

We have no problem with booting or windows or anything like that.

We simply try to choose the optimal bios values (NPS, L3 as Numa Domain, MADT) for virtualization, in this case, in hyper-v.

For example we have found that for HPC should be NPS4, No L3 as numa, MADT linear), but no info about virtualization.

Thanks

Thanks.

Hi, could you refer to page 15? https://dell.to/3kHWKJP

Hello, 

We do not have the problem with maxium cores since the CPU's are 16 cores each. Epyc 7302 (Rome)

What we are looking for is the Bios Characterization for Virtualization, and especially the parameters that have the most influence:

NPS: (0,1, 4)

L3 as Numa Domain: (YES - NO)

MADT Core Enumeration: (Linear - Round Robin)

Something similar to this paper but refered to virtualization: AMD Milan - BIOS Characterization for HPC | Dell Technologies Info Hub

Thanks!

Hello,

I searched our knowledgebase but I'm afraid we don't have this type of document unfortunately, sorry.

Marco

Hey I’m wondering if you ever found the answer to this question. I’m also looking for the Bios Characterization for virtualization. I have a R7515 with a 16 core epyc runnimg hyper v server 2019 and want optimal bios settings for VMs. 

I have not found any answer but this are our configs.

In all servers, for optimal performance, populate 8 DIMMs per processor so as to have 1 DIMM per channel. Total 16 DIMMs in 2CPU servers.

• We are using in 2*MILAN 16 cores, Windows 2022: NPS1 and CCX as NUMA Domain = OFF. No NUMA spanning, VM are then limited to 32 vCPU. It seems that config best utilize the shared L3 cache.

• We are using in 2*ROME 16 cores, Windows 2019: NPS4 and CCX as NUMA Domain )= ON. No NUMA spanning, VM are then limited to <=8 vCPU
• If needed in ROME and WIN19, more than >8vCPU, them allow NUMA spanning and then: NPS4 and CCX as NUMA DOMAIN OFF
• Maybe now with all WIN19 updates I will try the NPS1 config.

Regards.