Unsolved

This post is more than 5 years old

2 Posts

54199

December 17th, 2013 13:00

Having problem enabling SR-IOV in ESXi 5.5 with Intel 82599EB 10-GIG card on Dell T110 II Server

I'm having problem enabling SR-IOV in ESXi 5.5 on my Dell T110 II server. I enabled SR-IOV BIOS and all other virtualization related options. I have also set the max_vfs in the ixgbe driver. I tried moving around the 10-GIG card to different PCIe slot (tried 1, 2, and 3) but to no avail. The vmkernel log keeps saying " Enable VFs failed for device @0000:01:00.0, Please make sure the system has proper BIOS installed and enabled for SRIOV."

http://en.community.dell.com/techcenter/b/techcenter/archive/2012/10/26/sr-iov-and-vmware-esxi.aspx

According to the above link, T110 II supports SR-IOV.

The processor is Intel Xeon E3-1230 V2 3.3GHz. The Dell BIOS 2.5.1, which supports SR-IOV. The card is Intel Ethernet Converged Network Adapter X540-T2

 

I'm running out of ideas to try. I appreciate any tips. Here is what's in the vmkernel.log:

 

2013-12-16T14:40:21.646Z cpu3:33329)PCI: driver ixgbe is looking for devices

2013-12-16T14:40:21.646Z cpu3:33329)DMA: 612: DMA Engine 'vmklnxpci-0:1:0.0' created using mapper 'DMANull'.

2013-12-16T14:40:21.646Z cpu3:33329)DMA: 612: DMA Engine 'vmklnxpci-0:1:0.0' created using mapper 'DMANull'.

2013-12-16T14:40:21.646Z cpu3:33329)DMA: 612: DMA Engine 'vmklnxpci-0:1:0.0' created using mapper 'DMANull'.

2013-12-16T14:40:21.646Z cpu3:33329)DMA: 657: DMA Engine 'vmklnxpci-0:1:0.0' destroyed.

2013-12-16T14:40:22.714Z cpu3:33329)<6>ixgbe: Enabled/Disable CNA set to 1

2013-12-16T14:40:22.714Z cpu3:33329)<6>ixgbe: 0000:01:00.0: ixgbe_check_options: CNA enabled, 1 queues

2013-12-16T14:40:22.714Z cpu3:33329)<6>ixgbe: I/O Virtualization (IOV) set to 2

2013-12-16T14:40:22.714Z cpu3:33329)<6>ixgbe: 0000:01:00.0: ixgbe_check_options: CNA turned off when SR-IOV is enabled.

2013-12-16T14:40:22.714Z cpu3:33329)<6>ixgbe: 0000:01:00.0: ixgbe_check_options: VMDQ reduced to 2 when SR-IOV is enabled.

2013-12-16T14:40:22.714Z cpu3:33329)<6>ixgbe: 0000:01:00.0: ixgbe_check_options: Packet split is not supported.

2013-12-16T14:40:22.714Z cpu3:33329)LinPCI: vmklnx_enable_vfs:1369: enabling 2 VFs on PCI device 0000:01:00.0

2013-12-16T14:40:22.714Z cpu3:33329)WARNING: PCI: 157: 0000:01:00.0: Bypassing non-ACS capable device in hierarchy

2013-12-16T14:40:22.714Z cpu3:33329)WARNING: PCI: 1431: Enable VFs failed for device @0000:01:00.0, Please make sure the system has proper BIOS installed and enabled for SRIOV.

2013-12-16T14:40:22.714Z cpu3:33329)WARNING: LinPCI: vmklnx_enable_vfs:1373: unable to enable SR-IOV on PCI device 0000:01:00.0

2013-12-16T14:40:22.714Z cpu3:33329)<3>ixgbe 0000:01:00.0: (unregistered net_device): Failed to enable PCI sriov: -524

2013-12-16T14:40:22.714Z cpu3:33329)<6>ixgbe 0000:01:00.0: (unregistered net_device): FCoE offload feature is not available. Disabling FCoE offload feature

2013-12-16T14:40:22.738Z cpu3:33329)IntrVector: 288: Vector 0x35 allocated, 183 vectors available

2013-12-16T14:40:22.738Z cpu3:33329)IntrVector: 288: Vector 0x36 allocated, 182 vectors available

2013-12-16T14:40:22.738Z cpu3:33329)IntrVector: 288: Vector 0x37 allocated, 181 vectors available

2013-12-16T14:40:22.738Z cpu3:33329)VMK_PCI: 720: device 0000:01:00.0 allocated 3 interrupts (intrType 3)

2013-12-16T14:40:22.738Z cpu3:33329)MSIX enabled for dev 0000:01:00.0

2013-12-16T14:40:22.738Z cpu3:33329)<3>ixgbe: 0000:01:00.0: ixgbe_alloc_queues: using rx_count = 512

2013-12-16T14:40:22.738Z cpu3:33329)<6>ixgbe: 0000:01:00.0: ixgbe_probe: Registering for VMware NetQueue Ops

<6>ixgbe 0000:01:00.0: (PCI Express:5.0GT/s:Width x8) 90:e2:ba:4c:5f:14

2013-12-16T14:40:22.738Z cpu3:33329)<6>ixgbe 0000:01:00.0: 0000:01:00.0: MAC: 2, PHY: 1, PBA No: E68793-006

2013-12-16T14:40:22.738Z cpu3:33329)<6>ixgbe 0000:01:00.0: 0000:01:00.0: Enabled Features: RxQ: 2 TxQ: 2

2013-12-16T14:40:22.738Z cpu3:33329)<6>ixgbe 0000:01:00.0: 0000:01:00.0: Intel(R) 10 Gigabit Network Connection

2013-12-16T14:40:22.738Z cpu3:33329)PCI: Registering network device 0000:01:00.0

2013-12-16T14:40:22.738Z cpu3:33329)VMK_PCI: 395: Device 0000:01:00.0 name: vmnic2

2013-12-16T14:40:23.717Z cpu3:33329)Uplink: 6511: Device vmnic2 not yet opened

2013-12-16T14:40:23.717Z cpu3:33329)DMA: 612: DMA Engine 'vmnic2' created using mapper 'DMANull'.

2013-12-16T14:40:23.717Z cpu3:33329)PCI: driver ixgbe claimed device 0000:01:00.0

2013-12-16T14:40:23.717Z cpu3:33329)DMA: 612: DMA Engine 'vmklnxpci-0:1:0.1' created using mapper 'DMANull'.

2013-12-16T14:40:23.717Z cpu3:33329)DMA: 612: DMA Engine 'vmklnxpci-0:1:0.1' created using mapper 'DMANull'.

2013-12-16T14:40:23.717Z cpu3:33329)DMA: 612: DMA Engine 'vmklnxpci-0:1:0.1' created using mapper 'DMANull'.

2013-12-16T14:40:23.717Z cpu3:33329)DMA: 657: DMA Engine 'vmklnxpci-0:1:0.1' destroyed.

2 Posts

December 17th, 2013 13:00

This is a fresh install of ESXi 5.5, which I downloaded from VMware site. 

~ # uname -a
VMkernel t110-esxi 5.5.0 #1 SMP Release build-1331820 Sep 18 2013 23:08:31 x86_64 GNU/Linux

7 Practitioner

 • 

9.7K Posts

 • 

48K Points

December 17th, 2013 13:00

DANIEL.KAN,

Quick question. Did you upgrade up to 5.5? If so from what version did you update from?

Let me know.

No Events found!

Top