OS10 Enterprise Edition User Guide Release 10.4.0E(R3)

PDF

Converged network DCB example

A converged data center network carries multiple traffic types (SAN, server, and LAN) that are sensitive to different aspects of data transmission. For example, storage traffic is sensitive to packet loss, while server traffic is latency-sensitive. In a single converged link, all traffic types coexist without imposing serious restrictions on others' performance. DCB allows iSCSI and FCoE SAN traffic to co-exist with server and LAN traffic on the same network. DCB features reduce or avoid dropped frames, retransmission, and network congestion.

DCB provides lossless transmission of FCoE and iSCSI storage traffic using:
  • Separate traffic classes for the different service needs of network applications.
  • PFC flow control to pause data transmission and avoid dropping packets during congestion.
  • ETS bandwidth allocation to guarantee a percentage of shared bandwidth to bursty traffic, while allowing each traffic class to exceed its allocated bandwidth if another traffic class is not using its share.
  • DCBX discovery of peers, including parameter exchange (PFC, ETS, and other DCB settings), mismatch detection, and remote configuration of DCB parameters.
  • iSCSI application protocol TLV information in DCBX advertisements to communicate iSCSI support to peer ports
This example shows how to configure a sample DCB converged network in which:
  • DCBx is enabled globally to ensure the exchange of DCBx, PFC, ETS, and ISCSI configurations between DCBx-enabled devices.
  • PFC is configured to ensure loseless traffic for dot1p priority 4, 5, 6, and 7 traffic.
  • ETS allocates 30% bandwidth for dot1p priority 0, 1, 2, and 3 traffic and 70% bandwidth for priority 4, 5, 6, and 7 traffic.
  • iSCSI is configured to use dot1p priority 6 for iSCSI traffic, and advertise priority 6 in iSCSI application TLVs.
  • The default class-trust class map honors dot1p priorities in ingress flows and applies a 1-to-1 dot1p-to-qos-group and a 1-to-1 qos-group-to-queue mapping. In OS10, qos-group represents a traffic class used only for internal processing.

1. DCBX configuration (global)

Configure DCBX globally on a switch to enable the exchange of DCBX TLV messages with PFC, ETS, and iSCSI configurations.

OS10# configure terminal
                                 OS10(config)# dcbx enable
                              

2. PFC configuration (global)

PFC is enabled on traffic classes with dot1p 4, 5, 6, and 7 traffic. The traffic classes all use the default PFC pause settings for shared buffer size and pause frames in ingress queue processing in the network-qos policy map. The pclass policy map honors (trusts) all dot1p ingress traffic. The reserved class-trust class map is configured by default. Trust does not modify ingress values in output flows.

OS10(config)# class-map type network-qos test4
                                 OS10(config-cmap-nqos)# match qos-group 4
                                 OS10(config-cmap-nqos)# exit
                                 OS10(config)# class-map type network-qos test5
                                 OS10(config-cmap-nqos)# match qos-group 5
                                 OS10(config-cmap-nqos)# exit
                                 OS10(config)# class-map type network-qos test6
                                 OS10(config-cmap-nqos)# match qos-group 6
                                 OS10(config-cmap-nqos)# exit
                                 OS10(config)# class-map type network-qos test7
                                 OS10(config-cmap-nqos)# match qos-group 7
                                 OS10(config-cmap-nqos)# exit
                                 
                                 OS10(config)# policy-map type network-qos test
                                 OS10(config-pmap-network-qos)# class test4
                                 OS10(config-pmap-c-nqos)# pause
                                 OS10(config-pmap-c-nqos)# pfc-cos 4
                                 OS10(config-pmap-c-nqos)# exit
                                 OS10(config-pmap-network-qos)# class test5
                                 OS10(config-pmap-c-nqos)# pause
                                 OS10(config-pmap-c-nqos)# pfc-cos 5
                                 OS10(config-pmap-c-nqos)# exit
                                 OS10(config-pmap-network-qos)# class test6
                                 OS10(config-pmap-c-nqos)# pause
                                 OS10(config-pmap-c-nqos)# pfc-cos 6
                                 OS10(config-pmap-c-nqos)# exit
                                 OS10(config-pmap-network-qos)# class test7
                                 OS10(config-pmap-c-nqos)# pause
                                 OS10(config-pmap-c-nqos)# pfc-cos 7
                                 OS10(config-pmap-c-nqos)# exit
                                 OS10(config-pmap-network-qos)# exit
                                 
                                 OS10(config)# policy-map pclass
                                 OS10(config-pmap-qos)# class class-trust
                                 OS10(config-pmap-c-qos)# trust dot1p
                                 OS10(config-pmap-c-qos)# end
                              

3. PFC configuration (interface)

Apply the service policies with dot1p trust and PFC configurations to an interface.

OS10(config)# interface ethernet 1/1/53
                                 OS10(conf-if-eth1/1/53)# no shutdown
                                 OS10(conf-if-eth1/1/53)# service-policy input type network-qos test
                                 OS10(conf-if-eth1/1/53)# service-policy input type qos pclass
                                 OS10(conf-if-eth1/1/53)# priority-flow-control mode on
                                 OS10(conf-if-eth1/1/53)# end
                              

4. ETS configuration (global)

A trust dot1p-map assigns dot1p 0, 1, 2, and 3 traffic to qos-group 0, and dot1p 4, 5, 6, and 7 traffic to qos-group 1. A qos-map traffic-class map assigns the traffic class in qos-group 0 to queue 0, and qos-group 1 traffic to queue 1. A queuing policy map assigns 30% of interface bandwidth to queue 0, and 70% of bandwidth to queue 1.

The pclass policy map applies trust to all dot1p ingress traffic. Trust does not modify ingress dot1p values in output flows. The reserved class-trust class map is configured by default.

OS10(config)# trust dot1p-map tmap1
                                 OS10(config-tmap-dot1p-map)# qos-group 0 dot1p 0-3
                                 OS10(config-tmap-dot1p-map)# qos-group 1 dot1p 4-7
                                 OS10(config-tmap-dot1p-map)# exit
                                 
                                 OS10(config)# qos-map traffic-class tmap2
                                 OS10(config-qos-map)# queue 0 qos-group 0
                                 OS10(config-qos-map)# queue 1 qos-group 1
                                 OS10(config-qos-map)# exit
                                 
                                 OS10(config)# class-map type queuing cmap1
                                 OS10(config-cmap-queuing)# match queue 0
                                 OS10(config-cmap-queuing)# exit
                                 OS10(config)# class-map type queuing cmap2
                                 OS10(config-cmap-queuing)# match queue 1
                                 OS10(config-cmap-queuing)# exit
                                 
                                 OS10(config)# policy-map type queuing pmap1
                                 OS10(config-pmap-queuing)# class cmap1
                                 OS10(config-pmap-c-que)# bandwidth percent 30
                                 OS10(config-pmap-c-que)# exit
                                 OS10(config-pmap-queuing)# class cmap2
                                 OS10(config-pmap-c-que)# bandwidth percent 70
                                 OS10(config-pmap-c-que)# end
                                 
                                 OS10(config)# policy-map pclass
                                 OS10(config-pmap-qos)# class class-trust
                                 OS10(config-pmap-c-qos)# trust dot1p
                                 OS10(config-pmap-c-qos)# end
                              

5. ETS configuration (interface and global)

Apply the service policies with dot1p trust and ETS configurations to an interface or on all switch interfaces. Only one qos-map traffic-class map is supported on a switch.

OS10(config)# interface ethernet 1/1/53
                                 OS10(conf-if-eth1/1/53)# trust-map dot1p tmap1
                                 OS10(conf-if-eth1/1/53)# qos-map traffic-class tmap2
                                 OS10(conf-if-eth1/1/53)# service-policy input type qos pclass
                                 OS10(conf-if-eth1/1/53)# service-policy output type queuing pmap1
                                 OS10(conf-if-eth1/1/53)# ets mode on
                                 OS10(conf-if-eth1/1/53)# end
                              
OS10(config)# system qos
                                 OS10(config-sys-qos)# trust-map dot1p tmap1 
                                 OS10(config-sys-qos)# qos-map traffic-class tmap2
                                 OS10(config-sys-qos)# service-policy input type qos pclass
                                 OS10(config-sys-qos)# service-policy output type queuing pmap1 
                                 OS10(config-sys-qos)# ets mode on
                                 
                              

6. Verify DCB configuration

OS10(conf-if-eth1/1/53)# show configuration
                                 !
                                 interface ethernet1/1/53
                                 switchport access vlan 1
                                 no shutdown
                                 service-policy input type network-qos test
                                 service-policy input type qos pclass
                                 service-policy output type queuing pmap1
                                 ets mode on
                                 qos-map traffic-class tmap2
                                 trust-map dot1p tmap1
                                 priority-flow-control mode on
                              

7. Verify DCBX operational status

OS10(conf-if-eth1/1/53)# do show lldp dcbx interface ethernet 1/1/53
                                 E-ETS Configuration TLV enabled           e-ETS Configuration TLV disabled
                                 R-ETS Recommendation TLV enabled          r-ETS Recommendation TLV disabled
                                 P-PFC Configuration TLV enabled           p-PFC Configuration TLV disabled
                                 F-Application priority for FCOE enabled   f-Application Priority for FCOE disabled
                                 I-Application priority for iSCSI enabled  i-Application Priority for iSCSI disabled
                                 -----------------------------------------------------------------------------------
                                 
                                 Interface ethernet1/1/53
                                 Port Role is Manual
                                 DCBX Operational Status is Enabled
                                 Is Configuration Source? FALSE
                                 Local DCBX Compatibility mode is IEEEv2.5
                                 Local DCBX Configured mode is AUTO
                                 Peer Operating version is IEEEv2.5
                                 Local DCBX TLVs Transmitted: ERPfI
                                 4 Input PFC TLV pkts, 3 Output PFC TLV pkts, 0 Error PFC pkts
                                 2 Input ETS Conf TLV Pkts, 27 Output ETS Conf TLV Pkts, 0 Error ETS Conf TLV Pkts
                                 2 Input ETS Reco TLV pkts, 27 Output ETS Reco TLV pkts, 0 Error ETS Reco TLV Pkts
                                 
                                 Total DCBX Frames transmitted 0
                                 Total DCBX Frames received 0
                                 Total DCBX Frame errors 0
                                 Total DCBX Frames unrecognized 0
                              

8. Verify PFC configuration and operation

OS10(conf-if-eth1/1/53)# do show lldp dcbx interface ethernet 1/1/53 pfc detail
                                 
                                 Interface ethernet1/1/53
                                 Admin mode is on
                                 Admin is enabled, Priority list is 4,5,6,7
                                 Remote is enabled, Priority list is 4,5,6,7
                                 Remote Willing Status is disabled
                                 Local is enabled, Priority list is 4,5,6,7
                                 Oper status is init
                                 PFC DCBX Oper status is Up
                                 State Machine Type is Symmetric
                                 PFC TLV Tx Status is enabled
                                 Application Priority TLV  Parameters :
                                 --------------------------------------
                                 ISCSI TLV Tx Status is enabled
                                 Local ISCSI PriorityMap is 0x10
                                 Remote ISCSI PriorityMap is 0x10
                                 
                                 4 Input TLV pkts, 3 Output TLV pkts, 0 Error pkts
                                 4 Input Appln Priority TLV pkts, 3 Output Appln Priority TLV pkts, 
                                 0 Error Appln Priority TLV Pkts
                              

9. Verify ETS configuration and operation

OS10(conf-if-eth1/1/53)# do show lldp dcbx interface ethernet 1/1/53 ets detail
                                 
                                 Interface ethernet1/1/53
                                 Max Supported PG is 8
                                 Number of Traffic Classes is 8
                                 Admin mode is on
                                 
                                 Admin Parameters :
                                 ------------------
                                 Admin is enabled
                                 
                                 PG-grp     Priority#         Bandwidth       TSA
                                 ------------------------------------------------
                                 0        0,1,2,3,                30%         ETS
                                 1        4,5,6,7                 70%         ETS
                                 2                                0%          ETS
                                 3                                0%          ETS
                                 4                                0%          ETS
                                 5                                0%          ETS
                                 6                                0%          ETS
                                 7                                0%          ETS
                                 
                                 Remote Parameters :
                                 -------------------
                                 Remote is enabled
                                 PG-grp     Priority#         Bandwidth       TSA
                                 ------------------------------------------------
                                 0        0,1,2,3,                30%         ETS
                                 1        4,5,6,7                 70%         ETS
                                 2                                0%          SP
                                 3                                0%          SP
                                 4                                0%          SP
                                 5                                0%          SP
                                 6                                0%          SP
                                 7                                0%          SP
                                 
                                 Remote Willing Status is disabled
                                 Local Parameters :
                                 -------------------
                                 Local is enabled
                                 
                                 PG-grp     Priority#         Bandwidth       TSA
                                 ------------------------------------------------
                                 0        0,1,2,3,                30%         ETS
                                 1        4,5,6,7                 70%         ETS
                                 2                                0%          ETS
                                 3                                0%          ETS
                                 4                                0%          ETS
                                 5                                0%          ETS
                                 6                                0%          ETS
                                 7                                0%          ETS
                                 
                                 Oper status is init
                                 ETS DCBX Oper status is Up
                                 State Machine Type is Asymmetric
                                 Conf TLV Tx Status is enabled
                                 Reco TLV Tx Status is enabled
                                 
                                 2 Input Conf TLV Pkts, 27 Output Conf TLV Pkts, 0 Error Conf TLV Pkts
                                 2 Input Reco TLV Pkts, 27 Output Reco TLV Pkts, 0 Error Reco TLV Pkts
                                 
                              

10. iSCSI optimization configuration (global)

This example accepts the default settings for aging time and TCP ports used in monitored iSCSi sessions. A Compellant storage array is connected to the port. The policy-iscsi policy map sets the CoS dot1p priority used for iSCSI traffic to 6 globally on the switch. By default, iSCSI traffic uses priority 4. The iscsi priority-bits 0x40 command sets the advertised dot1p priority used by iSCSI traffic in application TLVs to 6. Hexadecimal 0x40 is binary 0 1 0 0 0 0 0 0.

OS10(conf-if-eth1/1/53)# iscsi profile-storage compellent
                                 OS10(conf-if-eth1/1/53)# lldp tlv-select dcbxp-appln iscsi
                                 OS10(conf-if-eth1/1/53)# exit
                                 
                                 OS10(config)# iscsi target port 3261 ip-address 10.1.1.1
                                 OS10(config)# policy-map type application policy-iscsi
                                 OS10(config-pmap-application)# class class-iscsi
                                 OS10(config-pmap-c-app)# set qos-group 6
                                 OS10(config-pmap-c-app)# set cos 6
                                 OS10(config-pmap-c-app)# exit
                                 OS10(config-pmap-application)# exit
                                 
                                 OS10(config)# system qos
                                 OS10(config-sys-qos)# service-policy type application policy-iscsi
                                 OS10(config-sys-qos)# exit
                                 
                                 OS10(config)# iscsi session-monitoring enable
                                 OS10(config)# iscsi priority-bits 0x40
                                 OS10(config)# iscsi enable
                              

11. Verify iSCSI optimization (global)

After you enable iSCSI optimization, the iSCSI application priority TLV parameters are added in the show command output to verify a PFC configuration.

OS10(conf-if-eth1/1/53)# do show lldp dcbx interface ethernet 1/1/53 pfc detail
                                 
                                 Interface ethernet1/1/53
                                 Admin mode is on
                                 Admin is enabled, Priority list is 4,5,6,7
                                 Remote is enabled, Priority list is 4,5,6,7
                                 Remote Willing Status is disabled
                                 Local is enabled, Priority list is 4,5,6,7
                                 Oper status is init
                                 PFC DCBX Oper status is Up
                                 State Machine Type is Symmetric
                                 PFC TLV Tx Status is enabled
                                 Application Priority TLV  Parameters :
                                 --------------------------------------
                                 ISCSI TLV Tx Status is enabled
                                 Local ISCSI PriorityMap is 0x40
                                 Remote ISCSI PriorityMap is 0x10
                                 
                                 4 Input TLV pkts, 3 Output TLV pkts, 0 Error pkts
                                 4 Input Appln Priority TLV pkts, 3 Output Appln Priority TLV pkts, 0 Error Appln Priority TLV Pkts
                                 
                              

12. DCBX configuration (interface)

This example shows how to configure and verify different DCBX versions.

OS10(conf-if-eth1/1/53)# dcbx version cee
                                 OS10(conf-if-eth1/1/53)# show configuration
                                 !
                                 interface ethernet1/1/53
                                 switchport access vlan 1
                                 no shutdown
                                 dcbx version cee
                                 service-policy input type network-qos test
                                 service-policy input type qos pclass
                                 service-policy output type queuing pmap1
                                 ets mode on
                                 qos-map traffic-class tmap2
                                 trust-map dot1p tmap1
                                 priority-flow-control mode on
                                 
                                 OS10(conf-if-eth1/1/53)# do show lldp dcbx interface ethernet 1/1/53
                                 E-ETS Configuration TLV enabled           e-ETS Configuration TLV disabled
                                 R-ETS Recommendation TLV enabled          r-ETS Recommendation TLV disabled
                                 P-PFC Configuration TLV enabled           p-PFC Configuration TLV disabled
                                 F-Application priority for FCOE enabled   f-Application Priority for FCOE disabled
                                 I-Application priority for iSCSI enabled  i-Application Priority for iSCSI disabled
                                 -----------------------------------------------------------------------------------
                                 
                                 Interface ethernet1/1/53
                                 Port Role is Manual
                                 DCBX Operational Status is Enabled
                                 Is Configuration Source? FALSE
                                 Local DCBX Compatibility mode is CEE
                                 Local DCBX Configured mode is CEE
                                 Peer Operating version is CEE
                                 Local DCBX TLVs Transmitted: ErPfi
                                 
                                 Local DCBX Status
                                 -----------------
                                 DCBX Operational Version is 0
                                 DCBX Max Version Supported is 0
                                 Sequence Number: 2
                                 Acknowledgment Number: 1
                                 Protocol State: In-Sync
                                 
                                 Peer DCBX Status
                                 -----------------
                                 DCBX Operational Version is 0
                                 DCBX Max Version Supported is 0
                                 Sequence Number: 1
                                 Acknowledgment Number: 2
                                 3 Input PFC TLV pkts, 3 Output PFC TLV pkts, 0 Error PFC pkts
                                 3 Input PG TLV Pkts, 3 Output PG TLV Pkts, 0 Error PG TLV Pkts
                                 3 Input Appln Priority TLV pkts, 3 Output Appln Priority TLV pkts, 
                                 0 Error Appln Priority TLV Pkts
                                 
                                 Total DCBX Frames transmitted 3
                                 Total DCBX Frames received 3
                                 Total DCBX Frame errors 0
                                 Total DCBX Frames unrecognized 0                                                                                         
                                 
                                 
                              
OS10(conf-if-eth1/1/53)# dcbx version cee
                                 OS10(conf-if-eth1/1/53)# show configuration
                                 !
                                 interface ethernet1/1/53
                                 switchport access vlan 1
                                 no shutdown
                                 dcbx version ieee
                                 service-policy input type network-qos test
                                 service-policy input type qos pclass
                                 service-policy output type queuing pmap1
                                 ets mode on
                                 qos-map traffic-class tmap2
                                 trust-map dot1p tmap1
                                 priority-flow-control mode on
                                 
                                 OS10(conf-if-eth1/1/53)# do show lldp dcbx interface ethernet 1/1/53
                                 E-ETS Configuration TLV enabled           e-ETS Configuration TLV disabled
                                 R-ETS Recommendation TLV enabled          r-ETS Recommendation TLV disabled
                                 P-PFC Configuration TLV enabled           p-PFC Configuration TLV disabled
                                 F-Application priority for FCOE enabled   f-Application Priority for FCOE disabled
                                 I-Application priority for iSCSI enabled  i-Application Priority for iSCSI disabled
                                 -----------------------------------------------------------------------------------
                                 
                                 Interface ethernet1/1/53
                                 Port Role is Manual
                                 DCBX Operational Status is Enabled
                                 Is Configuration Source? FALSE
                                 Local DCBX Compatibility mode is IEEEv2.5
                                 Local DCBX Configured mode is IEEEv2.5
                                 Peer Operating version is IEEEv2.5
                                 Local DCBX TLVs Transmitted: ERPfI
                                 13 Input PFC TLV pkts, 4 Output PFC TLV pkts, 0 Error PFC pkts
                                 3 Input ETS Conf TLV Pkts, 26 Output ETS Conf TLV Pkts, 0 Error ETS Conf TLV Pkts
                                 3 Input ETS Reco TLV pkts, 26 Output ETS Reco TLV pkts, 0 Error ETS Reco TLV Pkts
                                 
                                 Total DCBX Frames transmitted 0
                                 Total DCBX Frames received 0
                                 Total DCBX Frame errors 0
                                 Total DCBX Frames unrecognized 0
                                 
                              

Rate this content

Accurate
Useful
Easy to understand
Was this article helpful?
0/3000 characters
  Please provide ratings (1-5 stars).
  Please provide ratings (1-5 stars).
  Please provide ratings (1-5 stars).
  Please select whether the article was helpful or not.
  Comments cannot contain these special characters: <>()\