CVM & AHV host should be on the same VLAN, by Default CVM & AHV Hosts are untagged and shown as VLAN 0 placed as native VLAN.

Assign VLAN on AHV Host:

• Login to AHV host using root account
• Put the host & CVM into maintenance mode
• Assign the port br0 to VLAN

root@ahv# ovs-vsctl set port br0 tag=host_vlan_tag

Replace host_vlan_tag with the desire VLAN ID.

• Confirm VLAN tagging on port br0.

root@ahv# ovs-vsctl list port br0

• Confirm the tag parameter

Assign VLAN on CVM:

• Login to AHV Host using root account
• Login to CVM

ssh nutanix@192.168.5.254

• Assign VLAN to public interface for CVM

change_cvm_vlan vlan_id

• Replace vlan_id with the desire VLAN ID.
• Restart the network service
• sudo service network restart

Tips:

• Nutanix Recommend to configure CVM & Host VLAN as native VLAN or untagged, as New nodes send and received untagged traffic. If tagged VLAN is used VLAN must be updated on the new Nodes before adding new nodes.

Nutanix Bare-metal nodes Foundation

Nutanix Foundation is the process to install Hypervisor & CVM on the Nodes.

Bare Metal Imaging can be performed from workstation with the access to Shared port or IPMI and Network ports on the node. Imaging a cluster required Nutanix Foundation & AOS Binaries.

• AOS Binary
• Foundation Software (anyone of below can be used to do the foundation)
  • Foundation VM
  • Foundation for Windows
  • Foundation for MAC

You can download the foundation & AOS Binaries from Nutanix Support Portal à Download à Foundation / AOS

Prepare Workstation for Foundation.

Multiple option is available for Foundation, Foundation for Windows can be installed directly on Windows Laptop connected with Nutanix Nodes or Foundation VM can be imported in VMware Workstation / Oracle Virtual Box.

In this article I will proceeding with the imaging with Nutanix Foundation VMs.

Installing the Foundation VM

• Start Oracle Virtual Box / VMWare Workstation / Foundation
• Click the File menu and select Import Appliance… from the pull-down list.
• In the Import Virtual Appliance dialog box, browse to the location of the Foundation .ovf file, and select the Foundation_VM-version#.ovf file.
• Click Next.
• Click Import.
• In the left pane, select Foundation_VM-version#, and click Start.
• If the login screen ask for password, Foundation VM password is Nutanix/4u
• On the desktop you can find the set_foundation_ip address script to set the foundation VM IPs
• Once IP set, we are ready to do next stop

Copy Installation files to Foundation VM

Copy the Nutanix AOS Binaries (nutanix_installer_package-release-euphrates-X.XX.X.tar.gz) to /home/Nutanix/Foundation/NOS directory. Copy the hypervisor ISO to as below

• ESXi ISO image: /home/nutanix/foundation/isos/hypervisor/esx
• Hyper-V ISO image: /home/nutanix/foundation/isos/hypervisor/hyperv
• AHV: AHV is bundled with the Nutanix AOS package

Launch Foundation Applet

• Double click Foundation Applet, to start the foundation

• Select the Block hardware, CVM, IPMI Netmask and Gateway and click next to proceed.

• Click retry to discover the Nutanix node, currently new Nutanix Block comes with the discoveryOS so nodes are discoverable from Nutanix Foundation.
• As my LAB nodes are old one so I am proceeding with the manual add

• Specify the Number of Node per Block, Select how these nodes will be reached
  • I have configured the IPMI as my desired IP Address
    • This option is good if IPMI IP Address are already set
  • I will provide the IPMI MAC Address
    • This option is used to avoid setting up the IPMI Address manually, NODE IPMI MAC Addresses are mention on the backside on each node.
• Click Next to proceed.

• Specify the required IP Address (IPMI, CVM, HOST) , Hostname and click Next

• Specify the desired Cluster Name, Time Zone , Cluster Redundancy Factor, memory for CVM and click Next.

• Provide the AOS installer and click Next.

• Select the Desire Hypervisor and provide the Hypervisor ISO for installation. AHV is already bundled with AOS package. For Hyper-V & VMWare ESXi, whitelisted ISO need to provide before proceeding.

• Specify the IPMI username/password and click Start

• Foundation will validate the IP Addresses and proceed with the installation.

Tips:

• IP ver6 need to enable on the Laptop for the discovery
• Incase Symantec Endpoint protection is installed on the Laptop, disabled it even if you using the foundation VM as I saw Symantec Network Threat Protection is even blocking the Foundation VM Traffic
• Always use latest version of Foundation Software
• Use Flat Switch during the foundation

Happy Foundation 😊

Brush up on your Nutanix skills this summer, and get certified too! For the next two months, anyone who completes one of the following FREE online courses will also receive a FREE certification exam voucher.

Eligible courses:

• Enterprise Cloud Administration
• Nutanix Data Services Administration
• Nutanix End User Computing Administration
• Nutanix Database Administration

This is a great opportunity to build out your Nutanix skill set at no cost.

What are you waiting for? Get started today!

Terms and conditions

• Exam voucher will be assigned to student via their learning plan within 24-hours after the completion of the course
• Course must be completed and exam voucher redeemed by July 31, 2021
• Exam voucher code can only be used once
• Student will receive one (1) exam voucher for each completed online course from the list above

Enjoy 😊 Happy Learning

LCM Inventory is getting failed with the error “ Foundation Service running on one of the nodes, test failed”

SSH to one of the CVM, and run below command to get the foundation service status

allssh ‘genesis status | grep foundation’

nutanix@NTNX-15SXXXXXXAAAA-A-CVM:192.168.1.10:~$ allssh ‘genesis status | grep foundation’

================== 192.168.1.10 =================

foundation: []

================== 192.168.1.11 =================

================== 192.168.1.12 =================

foundation: [14525, 14556, 14557]

================== 192.168.1.13 =================

================== 192.168.1.14 =================

As per the output, foundation service is running on one of the node( 192.168.1.12), ssh to the node where foundation service is running. And run the below command.

genesis stop foundation

nutanix@NTNX-15SXXXXXXAAAA-C-CVM:192.168.1.12:~$ genesis stop foundation

2021-02-17 13:15:16.382143: Stopping foundation (pids [14525, 14556, 14557])

Once genesis stop you can confirm it while running the command again.

nutanix@NTNX-15SXXXXXXAAAA-A-CVM:192.168.1.12:~$ allssh ‘genesis status | grep foundation’

================== 192.168.1.10 =================

foundation: []

================== 192.168.1.11 =================

================== 192.168.1.12 =================

foundation: []

================== 192.168.1.13 =================

================== 192.168.1.14 =================

Rerun LCM inventory, its running fine now

Enjoy 😊

Yesterday I faced an issue which took more 2-3 hour to get sorted. I had old Nutanix Block on which I need to do the foundation when I started the foundation using Nutanix Foundation VM and got error foundation process failed with error “ Unable to set IPMI IPs)

• I tried to set IPMI IP on the Nutanix Nodes manually, but strange thing even after setting up IPMI IPs I was unable to ping the IPMI interface. I tried on Shared/ dedicated IPMI Port but failed.
• The hardware I was using was old Nutanix Block from G4 Generation, and there was no other options in IPMI Menu in System Setup to modify except IP Address
• I tried to login Hypervisor , but failed as I don’t have IP root password.

Moving forward, I got an idea make one bootable using download IPMItool from SuperMicro Website, boot the nodes from USB Drive.

• When I run the IPMICFG tool and get the current VLAN Status, VLAN ID was ON on the IPMI interface. I turned off the VLAN ID.

IPMICFG -vlan off

Incase if you have access on the hypervisor IPMItool can be used to trun-off the VLAN ID, using below command to turn off VLAN Id from ESXi Host.

/ipmitool lan set 1 vlan ID off

Once the VLAN off, I am able to access IPMI ports and proceed with foundation.

IPMICFG Can be download from below link

https://www.supermicro.com/SwDownload/SwSelect_Free.aspx?cat=IPMI

Yesterday, I had initiated the AHV host restart task after reaching to 24% task got stuck, I wait for 1 hour but task didn’t move seems it’s got stuck. I tried to get the list using:

acli task.list

but didn’t get anything related to my task i am looking for, Finally found the solution using Egron Task manager Service. Nutanix Egron is the task manager that is responsible to start / kill the running, stuck task automatically or manually if needed.

Below are the steps to kill the running/stuck tasks.

Step 1: login to Nutanix CVM using SSH

Step 2: Get the task list

nutanix@NTNX-16SM65330119-A-CVM:XXX.XXX.XXX.XXX:~$ ecli task.list include_completed=false

Output:

Task UUID Parent Task UUID Component Sequence-id Type Status

6b2179c4-5459-474e-8521-637028e1418b Genesis 11 Hypervisor rolling restart kRunning

Step 3: Kill the desire task from the list

ergon_update_task –task_uuid='<Task UUID>’ –task_status=aborted

Replace the task_uuid with the Task UUID form Step 2. So the command will be as below

nutanix@NTNX-16SM65330119-A-CVM:XXX.XXX.XXX.XXX:~$ ergon_update_task –task_uuid=’6b2179c4-5459-474e-8521-637028e1418b’ –task_status=aborted

hopes this works incase if the TASK are not getting listed using acli / progress_monitor_cli

Attention: Above mention commands are irreversible, use it carefully if you are not confident better open the support case with Nutanix Support / local Nutanix Partner.

Just got a feedback from Nutanix Support Team, above mentioned taskkill can leads to serious issues please do not do it yourself, incase if any assistance is required please reach-out to Nutanix Support for the fix.

Issue: Nutanix Prism Element Responding Very slow or not responding properly

Solution: I have encountered the prism each operation like VM Clone, VM update, VM Snapshot operation taking very long time or just waiting for menu to open. I have fixed the issue after restarting the Prism Service. Below is the solution to restart Prism Service

STEP 1:

Login to any CVM using SSH/ Console

Enter –> Curl Enter –> curl http://0:2019/prism/leader && echo

Above command will return the Prism Leader info.

Check if you are connected to same CVM otherwise connect to the leader CVM

Step 2:

Stop Prism Service

Enter –> genesis stop prism

Wait for few second till prism service stop

Step 3:

Enter — > Start Cluster

This will start the Prism Service again.

Ref: https://portal.nutanix.com/page/documents/kbs/details/?targetId=kA0600000008RwaCAE

As all we know Nutanix Move is the great tool to migration Workload from Hyper-V, VMware and AWS to Nutanix AHV. Recently during one of migration project I faced once issue, One of the Migration Job stuck and I tried to abort the job from GUI but unable to do that. Below is the solution which I tried and its works.

login to Nutanix MOVE VM from Console/SSH

User: admin

Password: Default password (Nutanix/4u)

Type RS and enter

Now you have Elevated access on OS like a Root User. Connect to POSTGree database

STEP 1:Open Postgres-shell

Postgres-shell

psql -d datamover

STEP 2: List available Migration Plan with using below command

select mpuuid,name from migrationplans;

Step 2: locate the migratoinplan and the run below last command to delete the migrationplans (Replace ID with desire migration mpuuid you get from Step 2)

delete from migrationplans where mpuuid=’ID’;

Hopes its work

Attention: Above mention commands are irreversible, use it carefully if you are not confident better open the support case with Nutanix Support / local Nutanix Partner.

Nutanix Image Service:

The Image service allows us to import Disk Images & ISO or disk type supported in Hyper-V & VMware directly in AHV Virtualization Management. Some of the supported formats are .qcow2, vmdk, VHD, raw, vdi, iso.

We can import the disk images directly using prism UI from Http / NFS Source.

Prism à Gear Icon à Image Configuration

So the imported images will be available in repository for future use. Any prism user with permission can spin up the VM based on available images in images repository.

Note: Before importing Images to AHV, install VertiO to avoid VM boot failures.

Why we required Images:

1. We can use disk images as temple, like install OS with latest patch and import it in Image service for future Use. Next time we can directly add bootable disk to newly create VM.
2. Attach data disk to other VM

Create Image using existing vmdisk Attached to VM:

To create the Image using existing vmdisk, we have to use acli. Login to any CVM using SSH.

Get the vmdisk UUID from desire Virtual machine.

vm.list ‘VM Name’

image.create ‘Image Name’ source_url=nfs://127.0.0.1/<Source_Container_Name >/.acropolis/vmdisk/<vmdisk UUID> container=<Target_Container_Name> Image_type=kDiskImage

Image Name: new Image name

Source Container: Container having vmdisk stored

vmdisk UUID: vmdisk UUID you found using vm.get command

Target Container: Where you want to create new Image

Create vmdisk using available Images in Image Configuration:

Use Prism GUI > VM >Create new VM/Update existing VM. While adding disk, select “Clone from Image Service” and select the desire image and add the image as disk.