Start a Conversation

Unsolved

N

1 Message

2273

August 14th, 2020 09:00

Brocade TOP command and Wait IO ...

Hi

on a DCX8510 ,  i have a CPU 100 % busy but with no processus using CPU only a lot of  wa ( so wait/IO)

how can  have wait/IO on a SW without warning, except about CPU 

someone  have an idea ??

thanks

top - 18:36:34 up 522 days, 3:50, 2 users, load average: 2.11, 1.95, 1.93
Tasks: 100 total, 2 running, 98 sleeping, 0 stopped, 0 zombie
Cpu(s): 3.6%us, 16.2%sy, 0.0%ni, 0.0%id, 59.1%wa, 0.0%hi, 21.1%si, 0.0%st
Mem: 1863104k total, 1738548k used, 124556k free, 228k buffers
Swap: 0k total, 0k used, 0k free, 111120k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
2129 root 16 0 71328 3900 2412 S 27.7 0.2 39204:06 emd
2236 root 16 0 134m 44m 5240 S 5.0 2.5 26735:48 mdd
2257 root 16 0 75440 24m 2768 S 2.3 1.4 8189:02 trafd
2242 root 16 0 57740 5740 2544 S 1.0 0.3 76:10.60 fcpd
2250 root 15 0 100m 17m 5980 S 0.7 1.0 3128:54 nsd
29988 root 16 0 2440 712 468 R 0.7 0.0 0:00.18 top
2374 root 16 0 87768 10m 5552 S 0.3 0.6 3314:26 0.weblinker.fcg
1 root 16 0 1696 244 172 S 0.0 0.0 0:04.70 init
2 root 34 19 0 0 0 S 0.0 0.0 6:24.96 ksoftirqd/0
3 root 10 -5 0 0 0 S 0.0 0.0 0:30.98 events/0
4 root 19 -5 0 0 0 S 0.0 0.0 0:00.12 khelper
5 root 10 -5 0 0 0 S 0.0 0.0 0:00.00 kthread
27 root 10 -5 0 0 0 S 0.0 0.0 0:00.42 kblockd/0
61 root 15 0 0 0 0 S 0.0 0.0 0:03.35 pdflush
63 root 19 -5 0 0 0 S 0.0 0.0 0:00.00 aio/0
62 root 15 0 0 0 0 D 0.0 0.0 6:45.71 kswapd0
739 root 15 0 0 0 0 S 0.0 0.0 4:31.03 kjournald
779 root RT 0 1676 188 124 S 0.0 0.0 0:00.28 wdtd
849 root 15 0 0 0 0 S 0.0 0.0 0:06.24 kjournald

 

*USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 1 0.0 0.0 1696 244 ? S 2019 0:04 init [3]
root 2 0.0 0.0 0 0 ? SN 2019 6:24 [ksoftirqd/0]
root 3 0.0 0.0 0 0 ? S< 2019 0:30 [events/0]
root 4 0.0 0.0 0 0 ? S< 2019 0:00 [khelper]
root 5 0.0 0.0 0 0 ? S< 2019 0:00 [kthread]
root 27 0.0 0.0 0 0 ? S< 2019 0:00 [kblockd/0]
root 61 0.0 0.0 0 0 ? S 2019 0:03 [pdflush]
root 63 0.0 0.0 0 0 ? S< 2019 0:00 [aio/0]
root 62 0.0 0.0 0 0 ? D 2019 6:46 [kswapd0]
root 739 0.0 0.0 0 0 ? S 2019 4:31 [kjournald]
root 779 0.0 0.0 1676 188 ? Ss 2019 0:00 /sbin/wdtd -p 30 -n 5
root 849 0.0 0.0 0 0 ? S 2019 0:06 [kjournald]
root 1036 0.0 0.0 0 0 ? S< 2019 0:00 [eth2/0]
root 1039 0.0 0.0 0 0 ? S< 2019 0:10 [eth1/0]
root 1048 0.0 0.0 0 0 ? S< 2019 0:22 [eth0/0]
root 1050 0.0 0.0 0 0 ? S< 2019 0:13 [eth3/0]
root 1109 0.0 0.0 2116 332 ? Ss 2019 0:00 /usr/sbin/inetd
root 1166 0.0 0.0 1808 272 ? Ss 2019 0:39 /usr/sbin/crond
root 1222 0.0 0.0 3724 1736 ? S 2019 0:08 insmod /fabos/modules/raslog-module.ko
root 1248 0.0 0.0 0 0 ? S< 2019 40:40 [XPRT]
root 1253 0.0 0.0 2700 1100 ? S 2019 0:00 insmod /fabos/modules/tp-module.ko
root 1254 0.0 0.0 0 0 ? S 2019 0:00 [rt_kthread]
root 1259 0.0 0.0 0 0 ? S 2019 0:00 [krscmon]
root 1614 0.0 0.0 0 0 ? S< 2019 0:00 [kwt_nb_thread]
root 1697 0.0 0.7 18060 14216 ? S 2019 458:48 insmod /fabos/modules/pen-module.ko
root 1700 0.0 0.0 3724 1592 ? S 2019 0:00 insmod /fabos/modules/striker-blade-module.ko
root 1717 0.0 0.0 0 0 ? S 2019 0:00 [kmtracer]
root 1856 0.0 0.1 25676 2308 ? Ssl 2019 17:59 /fabos/libexec/ipadmd -d3
root 1859 0.0 0.0 18712 1000 ? Ss 2019 0:00 /fabos/libexec/telnetmond
root 1860 0.0 0.2 36796 4696 ? Sl 2019 0:43 hasmd -p 77 -d d
root 1870 0.0 0.0 0 0 ? S< 2019 0:03 [FSSK_TH]
root 2100 0.0 0.0 5436 448 ? Ss 2019 0:15 /usr/sbin/sshd
root 2101 0.0 0.0 1720 208 ttyS0 Ss+ 2019 0:00 /sbin/getty -h ttyS0 console
root 2106 0.0 0.0 0 0 ? S< 2019 0:00 [ISCK_TH]
root 2107 0.0 0.0 0 0 ? S< 2019 0:00 [XLO_RX]
root 2108 0.0 0.0 0 0 ? S< 2019 69:14 [XLO_RX]
root 2109 0.0 0.0 0 0 ? S< 2019 4:59 [XCP_TX]
root 2110 0.0 0.0 0 0 ? S< 2019 0:17 [XCP_RX]
root 2111 0.0 0.0 0 0 ? S< 2019 0:00 [XCP_TX]
root 2112 0.0 0.0 0 0 ? S< 2019 0:00 [XCP_RX]
root 2113 0.0 0.0 0 0 ? S< 2019 0:00 [XCP_TX]
root 2114 0.0 0.0 0 0 ? S< 2019 0:00 [XCP_RX]
root 2115 0.0 0.1 26428 2264 ? Sl 2019 0:00 fcoed -S chassis
root 2116 0.0 0.1 34084 3584 ? Sl 2019 0:01 pdmd -S chassis
root 2117 0.0 0.2 48524 4464 ? Sl 2019 0:00 lfmd -S chassis
root 2120 0.0 0.2 36796 4696 ? S 2019 0:18 hasmd -p 77 -d d
root 2121 0.0 0.0 9028 468 ? S root 2122 0.0 0.3 56228 6900 ? Sl 2019 1:38 raslogd -S chassis -s 0
root 2123 0.0 0.1 30108 2244 ? Sl 2019 0:00 rmd -p 77 -S chassis -s 0
root 2125 0.0 0.1 37952 2440 ? Sl 2019 0:08 traced -p 77 -S chassis -s 0
root 2126 0.0 0.1 39888 2780 ? Sl 2019 0:01 bmd -d -S chassis -s 0
root 2127 0.0 0.1 21468 2280 ? S 2019 0:01 diagd -S chassis -s 0
root 2129 5.2 0.2 69928 3904 ? Sl 2019 39204:15 emd -S chassis -s 0
root 2143 0.0 0.1 24440 3112 ? S 2019 0:00 porttestd -S chassis -s 0
root 2155 0.0 0.0 0 0 ? S 2019 2:49 [porttestd]
root 2235 0.0 0.2 56780 4660 ? Sl 2019 25:38 webd -S fcsw
root 2236 3.5 2.4 133408 46148 ? Sl 2019 26735:52 mdd -S fcsw
root 2237 0.0 0.1 37304 2552 ? Sl 2019 0:02 arrd -S fcsw
root 2238 0.4 0.5 112808 10784 ? Sl 2019 3109:26 cald -S fcsw
root 2239 0.0 0.3 75624 6300 ? Sl 2019 53:58 essd -S fcsw
root 2240 0.0 0.2 56192 3852 ? Sl 2019 0:03 evmd -S fcsw
root 2241 0.0 0.3 73020 6124 ? S root 2242 0.0 0.3 53692 5740 ? Sl 2019 76:10 fcpd -S fcsw
root 2243 0.0 0.2 58312 4548 ? Sl 2019 16:16 fdmid -S fcsw
root 2244 0.0 0.2 51788 4456 ? Sl 2019 0:48 ficud -S fcsw
root 2245 0.0 0.6 61436 12420 ? Sl 2019 202:27 fspfd -S fcsw
root 2246 0.0 0.2 71724 3904 ? Sl 2019 1:12 rcsd -S fcsw
root 2247 0.0 0.1 38824 3064 ? Sl 2019 0:01 ipsd -S fcsw
root 2248 0.0 0.6 134492 12088 ? Sl 2019 4:26 iswitchd -S fcsw
root 2249 0.2 0.3 79572 6908 ? Sl 2019 1864:24 msd -S fcsw
root 2250 0.4 0.9 98776 17816 ? Sl 2019 3128:54 nsd -S fcsw
root 2251 0.0 0.2 36252 4896 ? Sl 2019 375:06 pdmd -S fcsw
root 2253 0.0 0.1 44112 3308 ? Sl 2019 0:01 psd -S fcsw
root 2254 0.0 0.1 77856 3508 ? Sl 2019 0:11 secd -S fcsw
root 2255 0.0 0.1 48516 3404 ? Sl 2019 108:12 authd -S fcsw
root 2256 0.6 0.5 106404 9348 ? Sl 2019 4625:55 snmpd -S fcsw
root 2257 1.0 1.3 71392 25156 ? Sl 2019 8189:04 trafd -S fcsw
root 2258 0.0 0.2 40112 4068 ? Sl 2019 18:26 tsd -S fcsw
root 2259 0.0 0.8 108612 16064 ? Sl 2019 96:15 zoned -S fcsw
root 2260 0.0 0.1 44012 2888 ? Sl 2019 0:35 vsd -S fcsw
root 2262 0.0 0.2 57544 3948 ? Sl 2019 0:29 appsrvrd -S fcsw
root 2371 0.0 0.0 6444 884 ? Ss 2019 0:19 /usr/apache/bin/httpd.0 -f /fabos/webtools/bin/httpd.conf.0
nobody 2372 0.0 0.0 6756 884 ? S 2019 0:00 /usr/apache/bin/fcgi-pm -f /fabos/webtools/bin/httpd.conf.0
root 2374 0.4 0.5 83720 10064 ? Sl 2019 3314:26 /fabos/webtools/htdocs/0.weblinker.fcg
root 2392 0.0 0.1 36328 2652 ? Sl 2019 0:00 isnscd -S fcsw -s 0
root 2393 0.0 0.1 36600 2528 ? Sl 2019 0:00 scpd -S fcsw -s 0
root 21614 0.0 0.0 0 0 ? S 2019 0:01 [pdflush]
root 29309 0.0 0.0 4212 1684 ? Ss 2019 0:00 /sbin/dhcpd -4 -cf /etc/dhcpd.conf.swbd77.cp1 -lf /tmp/dhcpd.leases -pf
root 17291 0.0 1.1 83360 21328 ? Sl 2019 43:17 npd -S fcsw -R
root 29472 0.0 0.0 6288 376 ? S Aug10 0:00 supervising syslog-ng
root 29474 0.0 0.0 6524 940 ? Ss Aug10 1:06 /sbin/syslog-ng -f /etc/syslog-ng/syslog-ng.conf
root 27807 0.0 0.1 34152 3372 ? Ssl 17:47 0:01 sshd: root@pts/0
root 27849 0.0 0.0 2964 524 pts/0 Ss+ 17:48 0:00 -sh
root 28653 0.0 0.1 34068 3520 ? Ssl 18:00 0:01 sshd: root@pts/1
root 28692 0.0 0.0 2956 1060 pts/1 Ss 18:01 0:00 -sh
nobody 29565 0.0 0.0 6956 1092 ? S 18:27 0:00 /usr/apache/bin/httpd.0 -f /fabos/webtools/bin/httpd.conf.0
nobody 29566 0.0 0.0 6952 1096 ? S 18:27 0:00 /usr/apache/bin/httpd.0 -f /fabos/webtools/bin/httpd.conf.0
nobody 29567 0.0 0.0 6952 1100 ? S 18:27 0:00 /usr/apache/bin/httpd.0 -f /fabos/webtools/bin/httpd.conf.0
root 30067 0.0 0.0 2336 916 pts/1 R+ 18:38 0:00 ps aux

143 Posts

August 15th, 2020 06:00

Hi,

I don't know.

But to lower the CPU utilization, you could on director switches, check that ha is enabled and in synch. and do a hafailover and on departmental switches, during low I/O or in a maintenance window, do a hareboot.

That will restart all process and all stuck processes, and should lower the CPU utilization.

If there is another issue going on, suggest to open a ticket.

Regards,

Ed

 

No Events found!

Top