Dell EMC Unity: Multiple storage processor reboots when fibre-channel cables are plugged in (User Correctable)
This article applies to
This article does not apply to
This article is not tied to any specific product.
Not all product versions are identified in this article.
Symptoms
When fibre channel cables are connected to Dell EMC Unity storage processors the storage processors will reboot multiple times and may eventually go into service mode
Cause
This is caused by a switch port being configured as an L port (loop), FL port (fabric loop), or NL port (network loop). The current code doesn't handle this very well and will panic; usually generating a safe panic dump and with the below entries found in the logs.
/EMC/C4Core/log/c4_safe_ktrace.log:
2016/12/06-22:07:25.330032 15K 7FB701160705 std:FCDMQL 1 [11.0.0] QLAPI Recvd Aen mbox[0]=8014 [1]=7fe [5..2]=0x0000000016000007
2016/12/06-22:07:25.330033 1 7FB701160705 std:FCDMQL 1 [11.0.0] QLAPI ISR: Received Port Logged Out INOT, sts_sub_code:0x9, nport_handle:0x7fe
2016/12/06-22:07:25.330035 2 7FB701160705 std:FCDMQL 1 [11.0.0] DVM Disc Comp- Dev List Size: 0x3
2016/12/06-22:07:25.330035 0 7FB701160705 std:FCDMQL 1 [11.0.0] TPM Discovery Complete: port_state=0x1005, link_state=0x9001, command=0x100
2016/12/06-22:07:26.018988 688K 7FB701160705 std:FCDMQL 1 [11.0.0] Second Report Id, already online. Dropping it
2016/12/06-22:07:26.018989 1 7FB701160705 std:FCDMQL 1 [11.0.0] QLAPI Recvd Aen mbox[0]=8010 [1]=f7f7 [5..2]=0x0000000000000000
2016/12/06-22:07:26.018989 0 7FB701160705 std:FCDMQL 1 [11.0.0] QLAPI Recd LIP Occurred Aen. LIP Type: 8010
2016/12/06-22:07:26.109409 90K 7FB701160705 std:
#### CPD PANIC #### FCDMQL 1 (FE5/SC) 0x03b03076 0x 725e40 0x 1 <<<<<<<<<<<<<<<<<<<<<<<
2016/12/06-22:07:26.109413 4 7FB701160705 std:
#### CPD PANIC #### FCDMQL 1 [11.0.0] 0x03b03076 0x 725e40 0x 1 <<<<<<<<<<<<<<<<<<<<<<<
Unable to peek Ktrace_info struct at 0x7fb6f40124c0; st=IC_TERMINATED
/EMC/C4Core/log/c4_safe_native.log
CSX RT: panic requested at: EmcPAL_Misc.c:73 (thread: 140423973963520 aka 140423973963520) [PID:27434 TID:27813 CORE:5 [csx_ic_std.x] [csx_usr_irq!_5] [12/06/2016 22:07:26 UTC]] (panic action:DEFAULT expr:<no-expr> fl
ags:-) [info:0x7fb70115e7b0]
CSX RT: bugcheck: 00000000 [00000000] [03b03076] [00725e40] [00000001]
CSX RT: rax/rbx/rcx/rdx: 0000000000000000 0000000000000000 0000000000725e40 0000000003b03076
CSX RT: rsi/rdi/rbp/rsp: 0000000000000000 0000000000000000 0000000000000000 00007fb70115e9a0
CSX RT: r8 /r9 /r10/r11: 0000000000000001 0000000000000001 00007fb6f40124f0 0000000000000000
CSX RT: r12/r13/r14/r15: 0000000003b03076 0000000000725e40 0000000000000001 00007fb6e12d5700
CSX RT: rip: 00007fb6f420b114
CSX RT: panic backtrace: [01160700] 00007fb701a78e96 <csx_rt_proc_request_backtrace +0x00000176> (sp=00007fb70115da00) proc=7fb701a78d20-7fb701a79434 csx_urt.so
CSX RT: panic backtrace: [01160700] 00007fb701a4585a <csx_rt_assert_int_emit_core_info +0x0000041a> (sp=00007fb70115e650) proc=7fb701a45440-7fb701a45d78 csx_urt.so
CSX RT: panic backtrace: [01160700] 00007fb701a45f2e <csx_rt_assert_request_panic_with_info +0x000000be> (sp=00007fb70115e880) proc=7fb701a45e70-7fb701a45f43 csx_urt.so
CSX RT: panic backtrace: [01160700] 00007fb6f420b14e <EmcpalBugCheck +0x0000007e> (sp=00007fb70115e9a0) proc=7fb6f420b0d0-7fb6f420b14e EmcPAL.sys
CSX RT: panic backtrace: [01160700] 00007fb6e101d4ce <cpd_osw_panic +0x000000ce> (sp=00007fb70115e9f0) proc=7fb6e101d400-7fb6e101d5b0 fcdmql.sys
CSX RT: panic backtrace: [01160700] 00007fb6e101d618 <cpd_osw_panic_index +0x00000028> (sp=00007fb70115ea40) proc=7fb6e101d5f0-7fb6e101d618 fcdmql.sys
CSX RT: panic backtrace: [01160700] 00007fb6e104fb5a <fc_ql_handle_report_id_acquisition_iocb +0x000002ea> (sp=00007fb70115ea60) proc=7fb6e104f870-7fb6e104fc18 fcdmql.sys
CSX RT: panic backtrace: [01160700] 00007fb6e1051e2b <fc_ql_process_completion_queues +0x0000066b> (sp=00007fb70115eae0) proc=7fb6e10517c0-7fb6e1052002 fcdmql.sys
CSX RT: panic backtrace: [01160700] 00007fb6e1052172 <cpd_ctlr_isr +0x00000162> (sp=00007fb70115eb40) proc=7fb6e1052010-7fb6e105217c fcdmql.sys
CSX RT: panic backtrace: [01160700] 00007fb6e1043988 <cpd_osw_msi_isr +0x00000018> (sp=00007fb70115eba0) proc=7fb6e1043970-7fb6e104399b fcdmql.sys
CSX RT: panic backtrace: [01160700] 00007fb6e1092922 <port_interrupt_service_msix +0x00000112> (sp=00007fb70115ebc0) proc=7fb6e1092810-7fb6e10929ac fcdmql.sys
CSX RT: panic backtrace: [01160700] 00007fb701e88fd3 <csx_p_int_isr_execute +0x00000053> (sp=00007fb70115ebf0) proc=7fb701e88f80-7fb701e89006 csx_uci.so
CSX RT: panic backtrace: [01160700] 00007fb701ed3bb8 <csx_p_int_io_pci_int_wait_thread +0x00000598> (sp=00007fb70115ed30) proc=7fb701ed3620-7fb701ed3e2c csx_uci.so
CSX RT: panic backtrace: [01160700] 00007fb701a3037e <csx_rt_sked_thread_wrapper +0x0000004e> (sp=00007fb70115f900) proc=7fb701a30330-7fb701a303c1 csx_urt.so
CSX RT: panic backtrace: [01160700] 00007fb700a08694 <start_thread +0x000000c4> (sp=00007fb70115fa60) proc=7fb700a085d0-7fb700a088c4 libpthread-2.19.so
CSX RT: panic backtrace: [01160700] 00007fb6ffee503d <clone +0x0000006d> (sp=00007fb70115fb00) proc=7fb6ffee5009-7fb6ffee5045 libc-2.19.so
CSX RT: panic backtrace: [01160700] 0000000000000000 <===========unknown=========== > (sp=00007fb70115fb08) proc=0-1
CSX RT: panic backtrace: backtrace: took 16(10) msecs to generate
/EMC/C4Core/log/c4_safe_ktrace.log:
2016/12/06-22:07:25.330032 15K 7FB701160705 std:FCDMQL 1 [11.0.0] QLAPI Recvd Aen mbox[0]=8014 [1]=7fe [5..2]=0x0000000016000007
2016/12/06-22:07:25.330033 1 7FB701160705 std:FCDMQL 1 [11.0.0] QLAPI ISR: Received Port Logged Out INOT, sts_sub_code:0x9, nport_handle:0x7fe
2016/12/06-22:07:25.330035 2 7FB701160705 std:FCDMQL 1 [11.0.0] DVM Disc Comp- Dev List Size: 0x3
2016/12/06-22:07:25.330035 0 7FB701160705 std:FCDMQL 1 [11.0.0] TPM Discovery Complete: port_state=0x1005, link_state=0x9001, command=0x100
2016/12/06-22:07:26.018988 688K 7FB701160705 std:FCDMQL 1 [11.0.0] Second Report Id, already online. Dropping it
2016/12/06-22:07:26.018989 1 7FB701160705 std:FCDMQL 1 [11.0.0] QLAPI Recvd Aen mbox[0]=8010 [1]=f7f7 [5..2]=0x0000000000000000
2016/12/06-22:07:26.018989 0 7FB701160705 std:FCDMQL 1 [11.0.0] QLAPI Recd LIP Occurred Aen. LIP Type: 8010
2016/12/06-22:07:26.109409 90K 7FB701160705 std:
#### CPD PANIC #### FCDMQL 1 (FE5/SC) 0x03b03076 0x 725e40 0x 1 <<<<<<<<<<<<<<<<<<<<<<<
2016/12/06-22:07:26.109413 4 7FB701160705 std:
#### CPD PANIC #### FCDMQL 1 [11.0.0] 0x03b03076 0x 725e40 0x 1 <<<<<<<<<<<<<<<<<<<<<<<
Unable to peek Ktrace_info struct at 0x7fb6f40124c0; st=IC_TERMINATED
/EMC/C4Core/log/c4_safe_native.log
CSX RT: panic requested at: EmcPAL_Misc.c:73 (thread: 140423973963520 aka 140423973963520) [PID:27434 TID:27813 CORE:5 [csx_ic_std.x] [csx_usr_irq!_5] [12/06/2016 22:07:26 UTC]] (panic action:DEFAULT expr:<no-expr> fl
ags:-) [info:0x7fb70115e7b0]
CSX RT: bugcheck: 00000000 [00000000] [03b03076] [00725e40] [00000001]
CSX RT: rax/rbx/rcx/rdx: 0000000000000000 0000000000000000 0000000000725e40 0000000003b03076
CSX RT: rsi/rdi/rbp/rsp: 0000000000000000 0000000000000000 0000000000000000 00007fb70115e9a0
CSX RT: r8 /r9 /r10/r11: 0000000000000001 0000000000000001 00007fb6f40124f0 0000000000000000
CSX RT: r12/r13/r14/r15: 0000000003b03076 0000000000725e40 0000000000000001 00007fb6e12d5700
CSX RT: rip: 00007fb6f420b114
CSX RT: panic backtrace: [01160700] 00007fb701a78e96 <csx_rt_proc_request_backtrace +0x00000176> (sp=00007fb70115da00) proc=7fb701a78d20-7fb701a79434 csx_urt.so
CSX RT: panic backtrace: [01160700] 00007fb701a4585a <csx_rt_assert_int_emit_core_info +0x0000041a> (sp=00007fb70115e650) proc=7fb701a45440-7fb701a45d78 csx_urt.so
CSX RT: panic backtrace: [01160700] 00007fb701a45f2e <csx_rt_assert_request_panic_with_info +0x000000be> (sp=00007fb70115e880) proc=7fb701a45e70-7fb701a45f43 csx_urt.so
CSX RT: panic backtrace: [01160700] 00007fb6f420b14e <EmcpalBugCheck +0x0000007e> (sp=00007fb70115e9a0) proc=7fb6f420b0d0-7fb6f420b14e EmcPAL.sys
CSX RT: panic backtrace: [01160700] 00007fb6e101d4ce <cpd_osw_panic +0x000000ce> (sp=00007fb70115e9f0) proc=7fb6e101d400-7fb6e101d5b0 fcdmql.sys
CSX RT: panic backtrace: [01160700] 00007fb6e101d618 <cpd_osw_panic_index +0x00000028> (sp=00007fb70115ea40) proc=7fb6e101d5f0-7fb6e101d618 fcdmql.sys
CSX RT: panic backtrace: [01160700] 00007fb6e104fb5a <fc_ql_handle_report_id_acquisition_iocb +0x000002ea> (sp=00007fb70115ea60) proc=7fb6e104f870-7fb6e104fc18 fcdmql.sys
CSX RT: panic backtrace: [01160700] 00007fb6e1051e2b <fc_ql_process_completion_queues +0x0000066b> (sp=00007fb70115eae0) proc=7fb6e10517c0-7fb6e1052002 fcdmql.sys
CSX RT: panic backtrace: [01160700] 00007fb6e1052172 <cpd_ctlr_isr +0x00000162> (sp=00007fb70115eb40) proc=7fb6e1052010-7fb6e105217c fcdmql.sys
CSX RT: panic backtrace: [01160700] 00007fb6e1043988 <cpd_osw_msi_isr +0x00000018> (sp=00007fb70115eba0) proc=7fb6e1043970-7fb6e104399b fcdmql.sys
CSX RT: panic backtrace: [01160700] 00007fb6e1092922 <port_interrupt_service_msix +0x00000112> (sp=00007fb70115ebc0) proc=7fb6e1092810-7fb6e10929ac fcdmql.sys
CSX RT: panic backtrace: [01160700] 00007fb701e88fd3 <csx_p_int_isr_execute +0x00000053> (sp=00007fb70115ebf0) proc=7fb701e88f80-7fb701e89006 csx_uci.so
CSX RT: panic backtrace: [01160700] 00007fb701ed3bb8 <csx_p_int_io_pci_int_wait_thread +0x00000598> (sp=00007fb70115ed30) proc=7fb701ed3620-7fb701ed3e2c csx_uci.so
CSX RT: panic backtrace: [01160700] 00007fb701a3037e <csx_rt_sked_thread_wrapper +0x0000004e> (sp=00007fb70115f900) proc=7fb701a30330-7fb701a303c1 csx_urt.so
CSX RT: panic backtrace: [01160700] 00007fb700a08694 <start_thread +0x000000c4> (sp=00007fb70115fa60) proc=7fb700a085d0-7fb700a088c4 libpthread-2.19.so
CSX RT: panic backtrace: [01160700] 00007fb6ffee503d <clone +0x0000006d> (sp=00007fb70115fb00) proc=7fb6ffee5009-7fb6ffee5045 libc-2.19.so
CSX RT: panic backtrace: [01160700] 0000000000000000 <===========unknown=========== > (sp=00007fb70115fb08) proc=0-1
CSX RT: panic backtrace: backtrace: took 16(10) msecs to generate
Resolution
To work around this issue, set the corresponding switch ports to N port (network port) or F port (fabric port).
This will be fixed in a future code release.
This will be fixed in a future code release.
Affected Products
Dell EMC Unity FamilyProducts
Dell EMC Unity FamilyArticle Properties
Article Number: 000052602
Article Type: Solution
Last Modified: 12 Dec 2025
Version: 3
Find answers to your questions from other Dell users
Support Services
Check if your device is covered by Support Services.