Live Migration Fails on Opennebula 5.0

Hi,
I have some problems with Opennebula 5.0 Live Migration using Ubuntu 14.04 as frontend and Ubuntu 14.04 as node01 & node02.

It seems that not found the file or directory. Please anyone could help me troubleshooting this error.
Show the following error:

Mon Apr 30 11:35:10 2018 [Z0][VM][I]: New LCM state is MIGRATE
Mon Apr 30 11:35:10 2018 [Z0][VMM][I]: Successfully execute transfer manager driver operation: tm_premigrate.
Mon Apr 30 11:35:10 2018 [Z0][VMM][I]: Successfully execute network driver operation: pre.
Mon Apr 30 11:35:11 2018 [Z0][VMM][I]: Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/migrate 'one-0' 'node02' 'node01' 0 node01
Mon Apr 30 11:35:11 2018 [Z0][VMM][E]: migrate: Command "virsh --connect qemu:///system migrate --live one-0 qemu+ssh://node02/system" failed: error: Failed to open file '/var/lib/one//datastores/0/0/disk.1': No such file or directory
Mon Apr 30 11:35:11 2018 [Z0][VMM][E]: Could not migrate one-0 to node02
Mon Apr 30 11:35:11 2018 [Z0][VMM][I]: ExitCode: 1
Mon Apr 30 11:35:11 2018 [Z0][VMM][I]: Successfully execute transfer manager driver operation: tm_failmigrate.
Mon Apr 30 11:35:11 2018 [Z0][VMM][I]: Failed to execute virtualization driver operation: migrate.
Mon Apr 30 11:35:11 2018 [Z0][VMM][E]: Error live migrating VM: Could not migrate one-0 to node02
Mon Apr 30 11:35:11 2018 [Z0][VM][I]: New LCM state is RUNNING
Mon Apr 30 11:35:11 2018 [Z0][LCM][I]: Fail to live migrate VM. Assuming that the VM is still RUNNING (will poll VM).

DataStore List:

ID NAME                SIZE AVAIL CLUSTERS     IMAGES TYPE DS      TM      STAT
0 system             96.3G 91%   0                 0 sys  -       shared  on  
1 default            96.3G 91%   0                 1 img  fs      shared  on  
2 files              96.3G 91%   0                 0 fil  fs      ssh     on

onehost list

ID NAME CLUSTER RVM ALLOCATED_CPU ALLOCATED_MEM STAT
0 node01 default 1 10 / 100 (10%) 128M / 1.9G (6%) on
1 node02 default 0 0 / 100 (0%) 0K / 1.9G (0%) on
2 front default 0 0 / 100 (0%) 0K / 1.9G (0%) on

VM Template (ttylinux image):

CONTEXT = [
NETWORK = “YES”,
SSH_PUBLIC_KEY = “$USER[SSH_PUBLIC_KEY]” ]
CPU = “0.1”
DISK = [
IMAGE_ID = “0” ]
GRAPHICS = [
LISTEN = “0.0.0.0”,
TYPE = “VNC” ]
HYPERVISOR = “kvm”
LOGO = “images/logos/linux.png”
MEMORY = “128”
SCHED_REQUIREMENTS = “ID="0" | ID="1"”

Thanks :slight_smile:

hi,

this seems to be a datastore access problem, apparently node02 cannot reach the datastore, see:

Failed to open file ‘/var/lib/one//datastores/0/0/disk.1’: No such file or directory

You can check this by logging in to node02 and see if your datastores show the same content.
If you want to be able to migrate live, all nodes should be connected to the same shared storage.
In this case, it looks like node02 does not have the same access as node01 has.
(by the way, if you are trying out opennebula, try the latest version, which is now @ 5.4)