Hi Team,I have a question regarding the esxi5.0 / FCoE/CNA with netapp3210,anybody can advise please ? I have a pair of filer 3210, installed FcoE license. NFS and iscsi tested ok. Now moving to FCOE.2 UTA connected to nexus 5548U, and I can see the connections.I have also brocade CNA card installed on ibm 3650 m4 servers with esxi 5.0 . But I cannot detect the storage from esxi host when I did a rescan. The LUN on filer has the initiator information of the CNA cards added and igroup as well. Nexus switch’s show flogi database and zoneset all looks ok. I feel something might be missing on the filer configuration, any advice please? Thanks
sh vsan 2001 membership
vsan 2001 interfaces:
fc1/31 fc1/32 vfc3 vfc4
vfc5 vfc6
sh fcoe
Global FCF details
FCF-MAC is 00:2a:6a:0f:fa:40
FC-MAP is 0e:fc:00
FCF Priority is 128
FKA Advertisement period for FCF is 8 seconds
VFC MAC details
vfc3 FCF-MAC is 00:2a:6a:0f:fa:6a
vfc4 FCF-MAC is 00:2a:6a:0f:fa:69
vfc5 FCF-MAC is 00:2a:6a:0f:fa:6b
vfc6 FCF-MAC is 00:2a:6a:0f:fa:6c
sh flogi data
--------------------------------------------------------------------------------
INTERFACE VSAN FCID PORT NAME NODE NAME
--------------------------------------------------------------------------------
vfc4 2001 0xd90060 50:0a:09:82:88:c9:92:0f 50:0a:09:80:88:c9:92:0f
vfc5 2001 0xd90000 10:00:8c:7c:ff:20:c0:99 20:00:8c:7c:ff:20:c0:99
vfc6 2001 0xd90020 10:00:8c:7c:ff:30:04:0d 20:00:8c:7c:ff:30:04:0d
Total number of flogi = 3.
Nexus5548-B# fcping pwwn 10:00:8c:7c:ff:20:c0:99 vsan 2001
28 bytes from 10:00:8c:7c:ff:20:c0:99 time = 236 usec
28 bytes from 10:00:8c:7c:ff:20:c0:99 time = 210 usec
28 bytes from 10:00:8c:7c:ff:20:c0:99 time = 209 usec
28 bytes from 10:00:8c:7c:ff:20:c0:99 time = 197 usec
igroup show iGroup_FCoE_01
iGroup_FCoE_01 (FCP) (ostype: vmware):
10:00:8c:7c:ff:20:10:fd (not logged in)
10:00:8c:7c:ff:20:84:3d (not logged in)
10:00:8c:7c:ff:30:04:0d (logged in on: vtic)
10:00:8c:7c:ff:20:c0:99 (not logged in)
10:00:8c:7c:ff:20:10:fc (not logged in)
10:00:8c:7c:ff:20:c0:98 (not logged in)
igroup show
iGroup_FCoE_01 (FCP) (ostype: vmware):
10:00:8c:7c:ff:20:c0:98 (not logged in)
10:00:8c:7c:ff:20:84:3c (not logged in)
10:00:8c:7c:ff:30:04:0c (not logged in)
10:00:8c:7c:ff:20:10:fc (not logged in)
10:00:8c:7c:ff:20:84:3d (logged in on: vtic, 1a)
10:00:8c:7c:ff:20:10:fd (logged in on: vtic, 1a)
10:00:8c:7c:ff:30:04:0d (logged in on: vtic, 1b)
10:00:8c:7c:ff:20:c0:99 (not logged in)
iGroup_iSCSI_SQL (iSCSI) (ostype: windows):
iqn.1991-05.com.microsoft:sql01 (not logged in)
iGroup_vmware_iscsi (iSCSI) (ostype: vmware):
iqn.1998-01.com.vmware (not logged in)
5548-B# fcping pwwn 50:0a:09:82:98:c9:92:0f vsan 2001
28 bytes from 50:0a:09:82:98:c9:92:0f time = 148 usec
28 bytes from 50:0a:09:82:98:c9:92:0f time = 185 usec
-Nexus5548-B# fcping pwwn 50:0a:09:82:88:c9:92:0f vsan 2001
28 bytes from 50:0a:09:82:88:c9:92:0f time = 148 usec
28 bytes from 50:0a:09:82:88:c9:92:0f time = 141 usec
28 bytes from 50:0a:09:82:88:c9:92:0f time = 228 usec
Nexus5548-B#
-3210b> ifconfig e1a
e1a: flags=0x8f48867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500
ether 02:a0:98:3d:9b:fc (auto-10g_twinax-fd-up) flowcontrol full
trunked VIF-b
s-3210b> ifconfig e1b
e1b: flags=0x8f48867<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM> mtu 1500
ether 02:a0:98:3d:9b:fc (auto-10g_twinax-fd-up) flowcontrol full
trunked VIF-b
3210b> ifconfig VIF-b
VIF-b: flags=0x24f48863<UP,BROADCAST,RUNNING,MULTICAST,TCPCKSUM,NOWINS> mtu 1500
inet 192.168.10.132 netmask 0xffffff00 broadcast 192.168.10.255
partner vif-a (not in use)
ether 02:a0:98:3d:9b:fc (Enabled interface groups)
-3210b>
VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic5"
InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic5
IsLargeBuildNumber = true
VersionString = igb driver 2.1.11.1
IsEntity = false
ElementName = igb driver
VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic6"
InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic6
IsLargeBuildNumber = true
VersionString = igb driver 2.1.11.1
IsEntity = false
ElementName = igb driver
VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic7"
InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic7
IsLargeBuildNumber = true
VersionString = igb driver 2.1.11.1
IsEntity = false
ElementName = igb driver
VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic1"
InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic1
IsLargeBuildNumber = true
VersionString = igb driver 2.1.11.1
IsEntity = false
ElementName = igb driver
VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic2"
InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic2
IsLargeBuildNumber = true
VersionString = igb driver 2.1.11.1
IsEntity = false
ElementName = igb driver
VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic3"
InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic3
IsLargeBuildNumber = true
VersionString = igb driver 2.1.11.1
IsEntity = false
ElementName = igb driver
VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vusb0"
InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vusb0
IsLargeBuildNumber = true
VersionString = cdc_ether driver 22-Aug-2005
IsEntity = false
ElementName = cdc_ether driver
VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic0"
InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic0
IsLargeBuildNumber = true
VersionString = igb driver 2.1.11.1
IsEntity = false
ElementName = igb driver
VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic4"
InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic4
IsLargeBuildNumber = true
VersionString = igb driver 2.1.11.1
IsEntity = false
ElementName = igb driver
VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic11"
InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic11
IsLargeBuildNumber = true
VersionString = bna driver 3.2.0.0
IsEntity = false
ElementName = bna driver
VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic9"
InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic9
IsLargeBuildNumber = true
VersionString = bna driver 3.2.0.0
IsEntity = false
ElementName = bna driver
VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic10"
InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic10
IsLargeBuildNumber = true
VersionString = bna driver 3.2.0.0
IsEntity = false
ElementName = bna driver
VMware_EPDriverSoftwareIdentity.InstanceID="VMware:VMware_EPDriverSoftwareIdentity:vmnic8"
InstanceID = VMware:VMware_EPDriverSoftwareIdentity:vmnic8
IsLargeBuildNumber = true
VersionString = bna driver 3.2.0.0
IsEntity = false
ElementName = bna driver
VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic5"
InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic5
IsLargeBuildNumber = true
VersionString = igb device firmware 3.19-0
IsEntity = false
ElementName = igb device firmware
VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic6"
InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic6
IsLargeBuildNumber = true
VersionString = igb device firmware 3.19-0
IsEntity = false
ElementName = igb device firmware
VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic7"
InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic7
IsLargeBuildNumber = true
VersionString = igb device firmware 3.19-0
IsEntity = false
ElementName = igb device firmware
VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic1"
InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic1
IsLargeBuildNumber = true
VersionString = igb device firmware 1.6-1
IsEntity = false
ElementName = igb device firmware
VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic2"
InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic2
IsLargeBuildNumber = true
VersionString = igb device firmware 1.6-1
IsEntity = false
ElementName = igb device firmware
VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic3"
InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic3
IsLargeBuildNumber = true
VersionString = igb device firmware 1.6-1
IsEntity = false
ElementName = igb device firmware
VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vusb0"
InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vusb0
IsLargeBuildNumber = true
VersionString = cdc_ether device firmware CDC Ethernet Device
IsEntity = false
ElementName = cdc_ether device firmware
VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic0"
InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic0
IsLargeBuildNumber = true
VersionString = igb device firmware 1.6-1
IsEntity = false
ElementName = igb device firmware
VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic4"
InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic4
IsLargeBuildNumber = true
VersionString = igb device firmware 3.19-0
IsEntity = false
ElementName = igb device firmware
VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic11"
InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic11
IsLargeBuildNumber = true
VersionString = bna device firmware 3.2.0.0
IsEntity = false
ElementName = bna device firmware
VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic9"
InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic9
IsLargeBuildNumber = true
VersionString = bna device firmware 3.2.0.0
IsEntity = false
ElementName = bna device firmware
VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic10"
InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic10
IsLargeBuildNumber = true
VersionString = bna device firmware 3.2.0.0
IsEntity = false
ElementName = bna device firmware
VMware_EPFirmwareSoftwareIdentity.InstanceID="VMware:VMware_EPFirmwareSoftwareIdentity:vmnic8"
InstanceID = VMware:VMware_EPFirmwareSoftwareIdentity:vmnic8
IsLargeBuildNumber = true
VersionString = bna device firmware 3.2.0.0
IsEntity = false
ElementName = bna device firmware
Namespace: vmware/esxv2
error: enumInstances Class not found
Namespace: root/interop
error: enumInstances Class not found
Namespace: root/config
error: enumInstances Class not found
000:144:00.0 Fibre Channel Serial bus controller: Brocade Communications Systems, Inc. Brocade-1010/1020/1007/1741 [vmhba4]
Class 0c04: 1657:0014
000:144:00.1 Fibre Channel Serial bus controller: Brocade Communications Systems, Inc. Brocade-1010/1020/1007/1741 [vmhba5]
Class 0c04: 1657:0014
000:144:00.2 Ethernet controller Network controller: Brocade Communications Systems, Inc. Brocade-1010/1020/1007/1741 10G PCIe Ethernet Adapter [vmnic10]
Class 0200: 1657:0014
000:144:00.3 Ethernet controller Network controller: Brocade Communications Systems, Inc. Brocade-1010/1020/1007/1741 10G PCIe Ethernet Adapter [vmnic11]
Class 0200: 1657:0014