Nested virtualization networking issues with bhyve

[Allan Jude]

On 2015-05-13 19:15, Jonathan Wong wrote:
> I've recently tried to experiment with vmware esxi 6 + vmworkstation and I
> managed to get nested virtualization with freebsd guest and nested bhyve
> ubuntu VM working. However, the networking doesn't seem to come up properly
> while installing, and post install for the ubuntu VM.
> 
> The bridged networking works as expected with freebsd guests and other
> network nodes on the network. However, the nested VMs themselves can't seem
> to bring up networking properly.
> 
> lspci seems to bring up the virtio network device, but even configuring
> static ips doesn't help. The VM is not able to receive or route any packets
> from any VM
> 
> FreeBSD guest can ssh into the nested VM. The nested VM can ssh into
> freebsd guest.  The nested VM cannot contact internet or local gateway.
> Tried with E1000 and VMXNET 2. Computers on network can ssh into freebsd
> guest. The freebsd guest can ssh into other computers on the network.
> Computers on the network cannot contact the VM. The vmware host cannot
> contact the nested VM or vice versa.
> 
> Any tips to getting this to work?
> 
> Thanks.
> _______________________________________________
> freebsd-virtualization at freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization
> To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe at freebsd.org"
> 

I helped you (or someone else) with this issue on IRC.

The answer was to enable promiscuous mode on the nic in ESXi

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1004099

So that the FreeBSD (middle) host would receive the packets destine for
the inner VM. Without promiscuous mode, any packets with an ethernet
address other than that of the ESXi virtual nic, will not be passed into
the VM.

-- 
Allan Jude

-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 834 bytes
Desc: OpenPGP digital signature
URL: <http://lists.freebsd.org/pipermail/freebsd-virtualization/attachments/20150513/bf5395e6/attachment.sig>