After upgrading a Cisco UCS server using the Vmware-ESXi-6.5.0-5969303-Custom-Cisco-6.5.1.2.zip image, an Intel 82599 10 Gigabit Dual Port Network Adapter is missing. The 10Gb adapter that is missing happens to be the one that has active ports. The link on the switch is still active and the system sees all (the missing adapter) of the adapters:
lspci -v | grep -A1 -i ethernet
0000:02:00.0 Ethernet controller Network controller: Intel Corporation I350 Gigabit Network Connection [vmnic0]
Class 0200: 8086:1521
--
0000:02:00.1 Ethernet controller Network controller: Intel Corporation I350 Gigabit Network Connection [vmnic1]
Class 0200: 8086:1521
--
0000:02:00.2 Ethernet controller Network controller: Intel Corporation I350 Gigabit Network Connection [vmnic2]
Class 0200: 8086:1521
--
0000:02:00.3 Ethernet controller Network controller: Intel Corporation I350 Gigabit Network Connection [vmnic3]
Class 0200: 8086:1521
--
0000:04:00.0 Ethernet controller Network controller: Intel(R) 82599 10 Gigabit Dual Port Network Connection [vmnic4]
Class 0200: 8086:10fb
--
0000:04:00.1 Ethernet controller Network controller: Intel(R) 82599 10 Gigabit Dual Port Network Connection [vmnic5]
Class 0200: 8086:10fb
--
0000:07:00.0 Ethernet controller Network controller: Intel(R) 82599 10 Gigabit Dual Port Network Connection [vmnic6]
Class 0200: 8086:10fb
--
0000:07:00.1 Ethernet controller Network controller: Intel(R) 82599 10 Gigabit Dual Port Network Connection [vmnic7]
Class 0200: 8086:10fb
--
0000:83:00.0 Ethernet controller Network controller: Intel(R) 82599 10 Gigabit Dual Port Network Connection [vmnic10]
Class 0200: 8086:10fb
--
0000:83:00.1 Ethernet controller Network controller: Intel(R) 82599 10 Gigabit Dual Port Network Connection [vmnic11]
Class 0200: 8086:10fb
Here are the device contents of /etc/vmware/esx.conf:
/device/00000:131:00.0/vmkname = "vmnic10"
/device/00000:002:00.1/vmkname = "vmnic1"
/device/00000:004:00.0/vmkname = "vmnic4"
/device/00000:002:00.3/vmkname = "vmnic3"
/device/00000:007:00.0/vmkname = "vmnic6"
/device/00000:007:00.1/vmkname = "vmnic7"
/device/00000:130:00.0/vmkname = "vmhba0"
/device/00000:002:00.2/vmkname = "vmnic2"
/device/00000:002:00.0/vmkname = "vmnic0"
/device/00000:131:00.1/vmkname = "vmnic11"
/device/00000:004:00.1/vmkname = "vmnic5"
But ESXi is not registering one of them, previous vmnic4 and 5:
esxcfg-nics -l
Name PCI Driver Link Speed Duplex MAC Address MTU Description
vmnic0 0000:02:00.0 igbn Up 1000Mbps Full 50:57:a8:e1:3c:34 1500 Intel Corporation I350 Gigabit Network Connection
vmnic1 0000:02:00.1 igbn Down 0Mbps Half 50:57:a8:e1:3c:35 1500 Intel Corporation I350 Gigabit Network Connection
vmnic10 0000:83:00.0 ixgbe Down 0Mbps Half 90:e2:ba:99:27:1c 1500 Intel(R) 82599 10 Gigabit Dual Port Network Connection
vmnic11 0000:83:00.1 ixgbe Down 0Mbps Half 90:e2:ba:99:27:1d 1500 Intel(R) 82599 10 Gigabit Dual Port Network Connection
vmnic2 0000:02:00.2 igbn Down 0Mbps Half 50:57:a8:e1:3c:36 1500 Intel Corporation I350 Gigabit Network Connection
vmnic3 0000:02:00.3 igbn Down 0Mbps Half 50:57:a8:e1:3c:37 1500 Intel Corporation I350 Gigabit Network Connection
vmnic6 0000:07:00.0 ixgbe Down 0Mbps Half 90:e2:ba:99:95:88 9000 Intel(R) 82599 10 Gigabit Dual Port Network Connection
vmnic7 0000:07:00.1 ixgbe Down 0Mbps Half 90:e2:ba:99:95:89 9000 Intel(R) 82599 10 Gigabit Dual Port Network Connection
Updating to the latest driver does not seem to help:
esxcli software vib update -v "/vmfs/volumes/datastore1/net-ixgbe_4.5.3-1OEM.600.0.0.2494585.vib"
VIBs Installed: INT_bootbank_net-ixgbe_4.5.3-1OEM.600.0.0.2494585
VIBs Removed: INT_bootbank_net-ixgbe_4.4.1-1OEM.600.0.0.2159203
Also tried this setting this:
esxcli system settings kernel set --setting="netNetqueueEnabled" --value="FALSE"
Here are the currently installed drivers when querying for ixgbe:
esxcli software vib list | grep ixgbe
net-ixgbe 4.5.3-1OEM.600.0.0.2494585 INT VMwareCertified 2018-01-26
ixgben 1.4.1-2vmw.650.1.26.5969303 VMW VMwareCertified 2018-01-26
The driver that worked with version 6.0 was 3.7.13 but I was unable to find/download it for 6.5u1.
net-ixgbe 3.7.13.7.14iov-20vmw.600.0.0.2494585 VMware VMwareCertified 2016-02-11
Any troubleshooting tips would be appreciated!