Day 2: VMware Center for Advanced Learning – Advanced Architecture Course

Day 1: VMware Center for Advanced Learning – Advanced Architecture Course

Day 2 kicks off learning to whiteboard the Value Model: how to work with clients to list needs, outcomes, problems and correlate and prioritize them.

Then we are into determining requirements and using the Requirements Traceability Matrix to organize requirements, risks, issues, constraint, dependencies, exclusion, and assumption.  This starts breaking the IT Value Model into smaller parts.

The afternoon covered TOGAF and then DevOps before the daily quiz and breaking into our teams to work on the deliverables for the day.


Posted in Virtualization, VMware | Leave a comment

vSphere 6.5 iSCSI port binding

I was goofing around with my home lab and ran into an interesting tidbit regarding iSCSI port binding in 6.5.

The documentation from VMware says:

  1. Browse to the host in the vSphere Web Client navigator.
  2. Click the Configure tab.
  3. Under Networking, click Virtual switches, and select the vSphere switch that you want to modify from the list.
  4. On the vSwitch diagram, select the VMkernel adapter and click the Edit Settings icon.
  5. On the Edit Settings wizard, click Teaming and Failover and select Override under Failover Order.

but when I try that, there is no Teaming and Failover option.

This really had me pulling my hair out, until (for kicks) I tried the new HTML5 client.

Found it!  So now there are features removed from the Flash client and only available in the HTML5 client?  Better keep them both open!


Posted in Network, Storage, Virtualization, VMware | Tagged | 6 Comments

Day 1: VMware Center for Advanced Learning – Advanced Architecture Course

Every wish there was a 9-day/81-hour course to propel you down the road to being a VMware Architect?   Wish no more.

The VMware Center for Advanced Learning has gone live with a course intended to:

Strengthen architectural & solution outcome skills in VMware Sr Consultants, Architects and Partners by establishing a baseline and model to interact with VMware Customers, leading the discovery, design and effectively communicate VMware solutions.

The Advanced Architecture Course is a very comprehensive program covering not just technical content across solutions; but it also includes presentation and business skills, our VMware IT Value Model and Digital Workspace Journey Model, solution design best practices, and internal and industry standard architectural methodologies.

Note that while it seems to have many parallels, it doesn’t actually have anything to do with the VCDX program.

I’m not entirely sure how you go about signing up for it, my company (a VMware partner) received an email in February inviting us to send someone – and one of my co-workers managed to get on one of the betas runs of the class in January, also by invite.  You might try @henryvillar  who has tweeted about it in the past.

In the run up to class start I received a link to the VMware Wire micro-learning platform which included an AAC prerequisite learning path consisting of 32 hours of training including VMware Hands On Labs and Pluralsight courses covering Agile, TOGAF and ITIL.

(If you are keeping score, that is 113 hours of training so far)

A few days before the class you get a packet to “become familiar with before class starts” that includes a case study (11 pages) and two SoWs (16 and 90 pages).

My class has 31 participants from around the world, grouped in to 6 teams – mostly employees, only a handful of partners – and all men.   Your team is important as on the last day you will present a solution you have been working on (as a team) since Day 1.

Class kicks off with a welcome and overview, then you are off and running learning about the IT Value Model and Digital Workspace Journey Model and how important it is to be talking about business needs and outcomes vs product names with client execs.

We then played a game (team vs team) where we chose IT projects to implement for a company based on brief case study and budget numbers.   The IT projects were presented with backing information, projected outcomes and cost.  The game was great as it made us decide on which projects to execute when and gave quick feedback on the results.   I found it very enlightening to see what the class developers wanted us to notice, take into account and focus on.

There’s also a daily quiz, which it turns out counts (along with many other things – tho mostly the team presentation at the end of the class) towards your grade – and you need a 70 at least to “pass” and get the coveted CAL AA badge:


Downside to the class: as a partner you get to see the PS Solution Builder tool which would make my life much easier – but isn’t available to partners.

Posted in Certification, Cloud, Computing, Network, Security, Virtualization, VMware | 2 Comments

vSphere 6.x Observed IP range

Way back when I wrote about the “Observed IP Range” information reported for physical NICs in v5 hosts.

I noted among other things that the field seems to be populated by a process that runs at boot time or when you run the “Add Adapter Wizard”.

With 6.x, ESXi seems to either periodically check for Observed Networks, or at least it checks when you refresh the “Physical adapters” tab.  This makes it  little easier to double-check your network setup.

Note that it tends to post if it detects traffic at all and only posts ranges corresponding to broadcast traffic the NICs receive.

non-Broadcast PINGs on NICs 0 and 1:
Broadcast Pings:

There’s about a 30 second delays between starting the ping xx.xx.xx.255 -t  (which works to populate the fields) and the networks updating.


Posted in Network, Virtualization, VMware | Tagged , , , , , , | Leave a comment

NSX: Upgrading to 6.4.0 from 6.3.x with a Control VM HA IP configured

tl/dr: If you upgrade from NSX 6.3.x to 6.4.0 make sure you remove the Control VM HA IP if it is set. Note that I have checked this with DLR and UDLRs.

So I wrote about this the other day and decided to see if it would blow things up during an upgrade to 6.4.0.

Official NSX Upgrade Guide

With my lab environment running 6.3.2 and the Control VM configured for HA with an IP address set:

I uploaded the bundle using the NSX Manager (note that with 6.4 you do it from the vSphere client!)

And started uploading

Enable SSH but don’t join CEiP for a temp environment

And wait …

[Note that I just did 6.3.1 to 6.3.2 to 6.4 and going to 6.4 is taking *a lot* longer for NSX manager.]

oops.  I see why it is taking long…

You should not be reading this error message

I hit enter and it came up, so I’ve got that going for me.  Which is nice.

Ok, so did the Edge blow up with the IP set like it does in 6.4 if you set the IP and then enable HA?


Ok, great so upgrading to 6.4 removed the HA IP?


Oops.  And if you disable HA…

Its still there.

Re-enable HA…

Note that repeated tests show that this might not error unless you open the window to change the IP address – even if you don’t change anything!

So, again – remove the HA IP configuration if you set it before upgrading!  and then don’t set it in HA during the install or while playing with HA.

Posted in Network, NSX, Virtualization, VMware | Tagged , , | Leave a comment

NSX 6.4 DLR HA changes

tl/dr: Enable HA during DLR deployment, don’t specify an HA IP address (if prompted),  use a unique logical switch for HA.

Edits: Some info from VMware below. Also, if you are upgrading from 6.3 I would remove the HA IP address first!

I wrote a few posts last year on the DLR components of NSX – specifically the Control VM that handles dynamic routing partnerships.

There are a few interesting changes to the Control VM for 6.4.0 I wanted to get down on paper cause they can result in a call to support if not handled right.

Enable HA and set an IP

Both of the issues concern the initial config wizard for the DLR. You are prompted on the first page to enable HA.

Make sure you enable HA here! It is very possible to not be able to enable it later w/o a call to support.

Note that whether or not you enable it, on the fourth screen you’ll need to set an HA interface connection.

Also on that fourth page note that you might be able to set an IP address (see my old posts on what happened with 6.3 when you set it).  If you don’t enable HA on the first screen you will be able to set an HA IP.  If you enable HA, you might be able to set an IP

If you see an entry for HA IP Do not set an IP address here. This isn’t that bad, as even tho you can add one, it won’t actually retain the IP address you set here.

Look ma! No IP!

The problem comes when you didn’t enable HA during install and go to add it later.  Or, disable HA.  Because when HA is disabled you can see – and add – an IP address under HA Interface Config:

Compare that to a DLR with HA enabled:

Now if you go and enable HA, you are in a world of hurt

I just deleted it instead of calling support so maybe they have a work around, but best bet is don’t do it!

EDIT: This is news to VMware apparently. Also I would really suggest removing the HA IP (if you configured it) before upgrading to 6.4!

Other Issue

The other issue is the “Connected To:” network for the HA interface.  In 6.3 you could easily set the same network for a regular (uplink/internal) interface and the HA interface.  and with 6.4 you can easily set them to be the same during the initial install.

But, after deployment, you can’t set the HA interface to one already used by an interface.

But you can set an interface to the one currently used by HA.

Is it a bug?  Are you not supposed to used the same network for HA and an interface?  If I find out I’ll let you know, but for now I’m creating a unique logical switch just for the control VM HA traffic.

EDIT:  Per VMware, set a dedicated network for HA, or use an uplink.  Exploiting the interface to set an internal network will cause problems (it will always fail the IP check).


I currently have an open support ticket out on why I lose traffic during a control VM failover – prior to 6.2.5  you would lose pings as the Active control VM would pull all routed from the hosts on its way down, but that was resolved. 

Note that I still saw it in 6.3.2 so YMMV.

Now what I see is the Edges changing the internal DLR networks to  “Weight 32768, AS Path ?” briefly when the Secondary takes over.  I have my BGP timers set to 1/3.  I’ll post what  support says when I hear from them.





Posted in Network, NSX, Virtualization, VMware | Tagged , , , | Leave a comment

VMware on AWS Quick Hits

vSphere plus SDDC Manager (VMware Cloud Foundation) plus NSX-V hosted on bare-metal at   AWS.

VMware manages hardware account and bills you (separate from any AWS account you have)

4 nodes to start – each 2 socket/36 core, 512GB RAM, 10.7TB storage (all flash)

Scales to 16 nodes currently

Just US (east and west regions) for now.

NSX-V with two IPSec VPN tunnels (one mgmt one compute) back to your data center (not required, but intended as hybrid)

Likes NSX on your DC but works with many hardware vendors for an IPSec endpoint.

One ESG, one DLR.

AWS services provided via direct connect (from compute Edge via a ENI) or internet connectivity.

Can connect to a AWS VPC Endpoint.

Includes routing table updates when connecting direct to AWS networks.

Gives a whole new meaning to “It’s not the cloud – it’s just someone else’s computer”

Posted in Cloud, Computing, Network, NSX, Security, Virtualization, VMware | Tagged , , , | Leave a comment

VMware AppDefense Quick Hits

Brought to you by the NSBU at VMware, home of NSX-V, NSX-T, VRNI.

Cloud-based with a local “proxy” (assuming local need).

Developer-focuses with tie-ins to development stream to track changes.

Supports Windows 2012, 2012R2, 2016 with *nix support coming.

Loads a “module” into the guest, which is protected in memory by the host

Watches a ton of “things” to determine proper operation and flags on improper

One “thing” : Creates hash of running executables and checks that hash periodically

Posted in Security, Virtualization, VMware | Tagged , | Leave a comment

VMware NSX-T Quick Hits

NSX-T(ransformers) is a multi-hypervisor (ESX/KVM) cousin of NSX-V.

Same SKU (if you own NSX-V 6.x, you own NSX-T 2.x).

One NSX-T Manager can have multiple vCenters as “Compute endpoints”

Standalone HTML5 client (not WebClient)

NSX-T Edges can be VMs or run on bare metal

Supports 8-way Edge ECMP but limited services on the Edge (vs V)

More/better BGP support/options/settings incl BFD

Uses Geneve instead of VXLAN for overlay due to extensible header

Protects cloud-native apps and container-level microsegmentation. The Google/Kubernetics project is protected by NSX-T

Posted in Network, NSX, Security, Virtualization, VMware | Tagged , , | Leave a comment

Migrate VMs between portgroups/virtual switches/vSS/vDS

I wrote this to help a client migrate to VXLAN from portgroups.

It pulls from a CSV file named c:\scripts\ImportPortGroups.csv which is structured:

123,dVLAN 123,

and accepts the initial number (VLAN) as a commandline parameter such as:
changeportgroups 123

The CSV file needs: identifier, portgroup name, virtual switch name

If you don’t enter a initial parameter it will remind you and exit.

Entering an initial parameter, the script grabs the line from the CSV where the first value matches your input.

It will then:
Pull the PG and VS from vcenter and verify that is what you are looking to work with.
Pull the number of VMs on the PG and VS and display and ask which way the move should go (all to VS or all to PG)
Migrate the VMs and display the # of VMs on the PG and VS.

You can get the script here.

FYI the one-liner version of the script is:

get-vm | get-networkadapter |where {$_.networkname -eq “OldPortGroup”} | set-networkadapter -networkname “NewPortGroup” -Confirm:$false

Posted in NSX, PowerShell, Scripting, Virtualization, VMware | Tagged , , , | Leave a comment