CPU processing values are too high. Is this type of performance common?

Hi,

This issue is probably more caming from OS than hardware. I could recommand you first to check which of top 5 process are consumming the CPU ressources then investigate for each of them if software patch could be appplied or if a task could be stopped or his load reduced.

regards,

Good Day,

I'm having the same issue with my Dell Z-9100. THe hihgest CPU consuming process are

bcmCNTR.0

bmcLink.0

KP

as Shown below

PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
0x9ed6d020 1629613530 162961353 10000 16.30% 21.18% 21.32% 0 bcmCNTR.0
0x9f1c2020 1079844880 107984488 10000 15.11% 14.02% 14.12% 0 bcmLINK.0
0x9efee020 798688140 79868814 10000 11.33% 10.26% 10.55% 0 KP
0xb05f7020 34864710 3486471 10000 0.60% 0.42% 0.44% 0 tExcTask
0x9ece4020 23435950 2343595 10000 0.40% 0.30% 0.32% 0 frrpagt
0x9ef79020 138610 13861 10000 0.00% 0.00% 0.00% 0 dla
0x9efcc020 512010 51201 10000 0.00% 0.02% 0.01% 0 sysAdmTsk
0x9efd0020 2600390 260039 10000 0.00% 0.05% 0.03% 0 timerMgr
0x9efd5020 1942670 194267 10000 0.00% 0.02% 0.02% 0 PM
0x9ef02020 1396850 139685 10000 0.00% 0.00% 0.02% 0 diagagt
0x9f005020 0 0 0 0.00% 0.00% 0.00% 0 evagt
0x9f04b020 213380 21338 10000 0.00% 0.00% 0.00% 0 ipc
0x9f04d020 47330 4733 10000 0.00% 0.00% 0.00% 0 sysReaper
0x9f052020 10 1 10000 0.00% 0.00% 0.00% 0 tme
0x9f04f020 0 0 0 0.00% 0.00% 0.00% 0 ttraceIpFlow
0x9f149020 0 0 0 0.00% 0.00% 0.00% 0 bcmStkLScan
0x9f14e020 0 0 0 0.00% 0.00% 0.00% 0 bcmDISC
0x9f150020 0 0 0 0.00% 0.00% 0.00% 0 bcmATP-RX
0x9f153020 0 0 0 0.00% 0.00% 0.00% 0 bcmATP-TX
0x9f1aa020 0 0 0 0.00% 0.00% 0.00% 0 stack_listen_thread

I will like to know what function those process have within the Dell switch, where can I find that Information?

Thank you

Hi CocoPhoenix,

Is the switch OS up to date? Does rebooting the switch resolve it? Is there a lot of network traffic? It is the controller and link tasks, so something is causing a lot of traffic on the switch.

Hi thank you for your answer, below my answers to your question

We are using the following OS

Real Time Operating System Software
Operating System Version: 2.0
Application Software Version: 9.14(2.5)

Does rebooting the switch resolve it?

No rebooting does not solve the issue

Is there a lot of network traffic? 

No, there is not a lot of network traffic, it has a lot of server connect to it, but at the moment the servers are not generating any traffic.

The switch have configured OSPF, BGP and BFD, also VLT, do you think that it can be related to the high CPU usage?

It is possible that running all of those things could cause it. Is it impacting performance?

Hi, 

When you try to ping the ips configured in the switch you have high latency above 600 ms in Back to Back links. All traffic that pass through the switch it does not seem to be affected.

That is a little odd. Can you mirror any of those ports and see if wireshark provides any additional information?

Hello.

In our case we upgraded to version 9.14 ( 2.8) with this we restarted several times during the process but it continues with the same processing value over that..

Leaf.SW02.CBB.CMG#show processes cpu

CPU Statistics Of Unit 1
=======================================

CPUID 5sec 1min 5min
--------------------------------------------------
CORE 0 40.87 50.55 48.97
CORE 1 23.81 23.67 22.85
CORE 2 11.11 13.25 15.21
CORE 3 8.73 13.32 11.88
Overall 21.13 25.20 24.73

CPU utilization of sysdlp for five seconds: 46%/8%; one minute: 53%; five minutes: 53%
PID Runtime(ms) Invoked uSecs 5Sec 1Min 5Min TTY Process
0xa6c65020 16320320 1632032 10000 23.21% 20.66% 21.39% 0 bcmCNTR.0
0x9f1be020 10874090 1087409 10000 13.49% 14.18% 14.10% 0 bcmLINK.0
0x9efe9020 7943130 794313 10000 7.94% 10.28% 10.51% 0 KP
0x9ed95020 239900 23990 10000 0.60% 0.35% 0.31% 0 frrpagt
0xb05f5020 359810 35981 10000 0.40% 0.48% 0.52% 0 tExcTask
0x9ed80020 47990 4799 10000 0.20% 0.07% 0.06% 0 L2Agent
0x9f5bd020 28200 2820 10000 0.20% 0.03% 0.04% 0 l2ProcMwpAck
0xa6c7a020 55490 5549 10000 0.20% 0.08% 0.06% 0 CtrEvict.0
--More-- Leaf.SW02.CBB.CMG#show tech-support

----------------------------------- show version -------------------------------
Real Time Operating System Software
Operating System Version: 2.0
Application Software Version: 9.14(2.8)
Build Time: Mon Sep 14 14:28:48 2020
Build Path: /build/build04/SW/SRC
Networking OS uptime is 21 hour(s), 30 minute(s)

System image file is "system://B"

System Type: Z9100-ON
Control Processor: Intel Rangeley with 3 Gbytes (3203260416 bytes) of memory, core(s) 4.

16G bytes of boot flash memory.

1 34-port TE/TF/FO/FI/HU G (Z9100-ON)
82 Ten GigabitEthernet/IEEE 802.3 interface(s)
12 Hundred GigabitEthernet/IEEE 802.3 interface(s)

----------------------------------- show os version ----------------------------

RELEASE IMAGE INFORMATION :
---------------------------------------------------------------------
Platform Version Size ReleaseTime
Z-Series:Z9100-ON 9.14(2.8) 69459446 Sep 14 2020 14:50:27

TARGET IMAGE INFORMATION :
---------------------------------------------------------------------
Type Version Target checksum
runtime 9.14(2.8) Control Processor passed

BOOT IMAGE INFORMATION :
---------------------------------------------------------------------
Type Version Target checksum
boot flash 3.23.2.13 Control Processor passed

BOOTSEL IMAGE INFORMATION :
---------------------------------------------------------------------
Type Version Target checksum
boot selector 3.23.0.0-9 Control Processor passed

FPGA IMAGE INFORMATION :
---------------------------------------------------------------------
Card FPGA Name Version
stack-unit 1 Z9100-ON CPLD 1 7
stack-unit 1 Z9100-ON CPLD 2 4
stack-unit 1 Z9100-ON CPLD 3 4
stack-unit 1 Z9100-ON CPLD 4 4
stack-unit 1 Z9100-ON MSS FPGA 2.2
stack-unit 1 Z9100-ON MSS IAP 2.5
stack-unit 1 Z9100-ON OOB-FPGA 1.0

----------------------------------- show revision -------------------------------

-- Stack unit 1 --
Z9100-ON CPLD 1 : 7

Z9100-ON CPLD 2 : 4

Z9100-ON CPLD 3 : 4

Z9100-ON CPLD 4 : 4

Z9100-ON MSS FPGA : 2.2

Z9100-ON MSS IAP : 2.5

Z9100-ON OOB-FPGA : 1.0

------------------------------------ show clock -------------------------------
09:55:11.774 BOL Wed Mar 17 2021

Alain D,

Would you confirm a couple things for me please?

How long has this been happening?