This post is more than 5 years old
7 Posts
0
69784
DELLR730 server halts during boot-up when "intel_iommu=on" parameter is enabled in grub for SRIOV functionality.
Hi,
I am facing an issue with "LSI Logic / Symbios Logic MegaRAID SAS-3 3008 [Fury] (rev 02)" controller when "intel_iommu=on" parameter is enabled in grub.I am working on SRIOV and I need to enable intel_iommu=on in grub so that it allows memory management and pass-through mechanism.But when I enable intel_iommu=on and after reboot my system halts with error("megaraid:Failed to get PD list") pls find the attchement for error details.I just googled this error but didn't find proper fix to carry on.If the similar issue has already been resolved from DELL,please send me the fix and proper steps to move forward.
My system Configuration:
DELLR730 13G Server with Intel(R) Xeon(R) CPU E5-2620 v3 @ 2.40GHz with 32GB RAM
OS:SLES12 and I also tried on RHEL7.1
SRIOV and Intel VT-d is enabled in BIOS
Note:If intel_iommu=on parameter is removed from grub then everything is working as expected.
-->SLES12 error
-->RHEL error
-------------------------------------************************************------------------------------------------------------
--> lspci details:
03:00.0 RAID bus controller: LSI Logic / Symbios Logic MegaRAID SAS-3 3008 [Fury] (rev 02)
Subsystem: Dell PERC H330 Mini
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- SERR- Latency: 0
Interrupt: pin A routed to IRQ 26
Region 0: I/O ports at 2000
Region 1: Memory at 94500000 (64-bit, non-prefetchable) [size=64K]
Region 3: Memory at 94400000 (64-bit, non-prefetchable) [size=1M]
Expansion ROM at 93600000 [disabled] [size=1M]
Capabilities: [50] Power Management version 3
Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [68] Express (v2) Endpoint, MSI 00
DevCap: MaxPayload 4096 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
DevCtl: Report errors: Correctable- Non-Fatal+ Fatal+ Unsupported+
RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+ FLReset-
MaxPayload 256 bytes, MaxReadReq 512 bytes
DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
LnkCap: Port #0, Speed 8GT/s, Width x8, ASPM L0s, Exit Latency L0s <2us, L1 <4us
ClockPM- Surprise- LLActRep- BwNot-
LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
LnkSta: Speed 8GT/s, Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
DevCap2: Completion Timeout: Range BC, TimeoutDis+, LTR-, OBFF Not Supported
DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis-, LTR-, OBFF Disabled
LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
Compliance De-emphasis: -6dB
LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+
EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest+
Capabilities: [d0] Vital Product Data
Unknown small resource type 00, will not decode more.
Capabilities: [a8] MSI: Enable- Count=1/1 Maskable+ 64bit+
Address: 0000000000000000 Data: 0000
Masking: 00000000 Pending: 00000000
Capabilities: [c0] MSI-X: Enable+ Count=97 Masked-
Vector table: BAR=1 offset=0000e000
PBA: BAR=1 offset=0000f000
Capabilities: [100 v2] Advanced Error Reporting
UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt+ UnxCmplt+ RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
UESvrt: DLP+ SDES+ TLP+ FCP+ CmpltTO+ CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC+ UnsupReq- ACSViol-
CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
CEMsk: RxErr+ BadTLP+ BadDLLP+ Rollover+ Timeout+ NonFatalErr+
AERCap: First Error Pointer: 00, GenCap+ CGenEn+ ChkCap+ ChkEn+
Capabilities: [1e0 v1] #19
Capabilities: [1c0 v1] Power Budgeting
Capabilities: [190 v1] #16
Capabilities: [148 v1] Alternative Routing-ID Interpretation (ARI)
ARICap: MFVC- ACS-, Next Function: 0
ARICtl: MFVC- ACS-, Function Group: 0
Kernel driver in use: megaraid_sas
--------------------------------------------------**************************************----------------------------------------------
Cheers,
Praveen
DELL-Daniel My
Moderator
Moderator
•
6.2K Posts
0
May 6th, 2015 12:00
Hello Praveen
The H330 does not have an I/O memory management unit. Enabling a feature that is not present is likely why the issue is occurring.
Thanks
DELL-Daniel My
Moderator
Moderator
•
6.2K Posts
0
May 7th, 2015 11:00
There is not a firmware update that will add an IOMMU to the H330. The PERC H730 has an IOMMU.
praveen16
7 Posts
0
May 6th, 2015 23:00
Hi Daniel,
1.Which PERC controller do I need to install for Virtualization(SRIOV) to work on this server?
2.If H330 is not capable of I/O mmu, then are there any new controller firmware updates which can support iommu on DELLR730 server.If yes then please provide me a link.
3.Please provide me an alternative through which "intel_iommu=on" when enabled in grub does not give any errors to work with Virtualization(SR-IOV).