Could not open disk image : Permission denied

I am new to opennebula. I can instantiate a VM with images in default datastore, but I can’t instantiate a VM with images in shared datastore (NFS).

Hostname: jndfrontend.jundit.corp - Fontend
Hostname: jndkvm.jundit.corp - Host KVM

VM log:
Tue Mar 20 15:53:40 2018 [Z0][VMM][I]: Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/deploy ‘/var/lib/one//datastores/111/80/deployment.3’ ‘jndkvm.jundit.corp’ 80 jndkvm.jundit.corp
Tue Mar 20 15:53:40 2018 [Z0][VMM][I]: error: Failed to create domain from /var/lib/one//datastores/111/80/deployment.3
Tue Mar 20 15:53:40 2018 [Z0][VMM][I]: error: internal error: qemu unexpectedly closed the monitor: 2018-03-20T18:53:40.592467Z qemu-kvm: -drive file=/var/lib/one//datastores/111/80/disk.0,format=raw,if=none,media=cdrom,id=drive-virtio-disk0,readonly=on,cache=none: could not open disk image /var/lib/one//datastores/111/80/disk.0: Could not open ‘/var/lib/one//datastores/111/80/disk.0’: Permission denied
Tue Mar 20 15:53:40 2018 [Z0][VMM][E]: Could not create domain from /var/lib/one//datastores/111/80/deployment.3

oned.log:

Tue Mar 20 15:53:40 2018 [Z0][VMM][D]: Message received: LOG I 80 Command execution fail: cat << EOT | /var/tmp/one/vmm/kvm/deploy ‘/var/lib/one//datastores/111/80/deployment.3’ ‘jndkvm.jundit.corp’ 80 jndkvm.jundit.corp

Tue Mar 20 15:53:40 2018 [Z0][VMM][D]: Message received: LOG I 80 error: Failed to create domain from /var/lib/one//datastores/111/80/deployment.3

Tue Mar 20 15:53:40 2018 [Z0][VMM][D]: Message received: LOG I 80 error: internal error: qemu unexpectedly closed the monitor: 2018-03-20T18:53:40.592467Z qemu-kvm: -drive file=/var/lib/one//datastores/111/80/disk.0,format=raw,if=none,media=cdrom,id=drive-virtio-disk0,readonly=on,cache=none: could not open disk image /var/lib/one//datastores/111/80/disk.0: Could not open ‘/var/lib/one//datastores/111/80/disk.0’: Permission denied

Tue Mar 20 15:53:40 2018 [Z0][VMM][D]: Message received: LOG E 80 Could not create domain from /var/lib/one//datastores/111/80/deployment.3

Tue Mar 20 15:53:40 2018 [Z0][VMM][D]: Message received: LOG I 80 ExitCode: 255

Tue Mar 20 15:53:40 2018 [Z0][VMM][D]: Message received: LOG I 80 Failed to execute virtualization driver operation: deploy.

Tue Mar 20 15:53:40 2018 [Z0][VMM][D]: Message received: DEPLOY FAILURE 80 Could not create domain from /var/lib/one//datastores/111/80/deployment.3

Image Datastore (NFS):

[oneadmin@jndkvm 80]$ ls -l /var/lib/one/datastores/110/
total 1578673
-rwxrwxrwx. 1 oneadmin oneadmin 197120 Mar 20 12:15 6c71f9947965e9cac43b9f5cadd256a2
-rwxrwxrwx. 1 oneadmin oneadmin 1624211456 Mar 20 12:21 b2e1de40cf20c18336ce02d28175a482

System Datastore 111:

[root@jndkvm 80]# ls -l /var/lib/one/datastores/111/80
total 560
-rw-rw-r–. 1 oneadmin oneadmin 1270 Mar 20 16:42 deployment.3
lrwxrwxrwx. 1 oneadmin oneadmin 60 Mar 20 16:42 disk.0 -> /var/lib/one/datastores/110/b2e1de40cf20c18336ce02d28175a482
-rwxrwxr-x. 1 oneadmin oneadmin 197120 Mar 20 16:42 disk.1
-rw-r–r--. 1 oneadmin oneadmin 372736 Mar 20 16:42 disk.2

[root@jndkvm 80]# df -Th
Sist. Arq. Tipo Tam. Usado Disp. Uso% Montado em
/dev/mapper/centos-root xfs 50G 29G 22G 58% /
devtmpfs devtmpfs 3,8G 0 3,8G 0% /dev
tmpfs tmpfs 3,9G 0 3,9G 0% /dev/shm
tmpfs tmpfs 3,9G 9,0M 3,9G 1% /run
tmpfs tmpfs 3,9G 0 3,9G 0% /sys/fs/cgroup
/dev/sda1 xfs 1014M 352M 663M 35% /boot
/dev/mapper/centos-home xfs 407G 222M 407G 1% /home
tmpfs tmpfs 783M 28K 783M 1% /run/user/0
tmpfs tmpfs 783M 0 783M 0% /run/user/9869
192.168.15.55:/mnt/storage/compartilhamento_unix/Imagens nfs4 2,7T 1,6G 2,7T 1% /Imagens

[root@jndkvm 80]# ls -l /var/lib/one/datastores
total 0
drwxrwxr-x. 2 oneadmin oneadmin 22 Mar 17 18:38 0
drwxrwxr-x. 2 oneadmin oneadmin 22 Mar 20 11:01 108
lrwxrwxrwx. 1 oneadmin oneadmin 8 Mar 20 15:52 110 -> /Imagens
drwxrwxr-x. 3 oneadmin oneadmin 16 Mar 20 16:42 111

[oneadmin@jndkvm 80]$ ls -l /Imagens
total 1578673
-rwxrwxrwx. 1 oneadmin oneadmin 197120 Mar 20 12:15 6c71f9947965e9cac43b9f5cadd256a2
-rwxrwxrwx. 1 oneadmin oneadmin 1624211456 Mar 20 12:21 b2e1de40cf20c18336ce02d28175a482

root@jndkvm 80]# cat /etc/libvirt/qemu.conf
user = “oneadmin”
group = “oneadmin”
dynamic_ownership = 0

[oneadmin@jndfrontend one]$ onedatastore list
ID NAME SIZE AVAIL CLUSTERS IMAGES TYPE DS TM STAT
0 system - - 0 0 sys - ssh on
1 default 50G 62% 0 3 img fs ssh on
2 files 50G 62% 0 1 fil fs ssh on
110 Imagens 2.6T 100% 0 2 img fs shared on
111 SystemNFS 2.6T 100% 0 0 sys - shared on

Exports file:

Freenas

Can anybody help?

Hi,

What’s the output of “ls -ld /imagens”?
At a first look, it seams to me that onadmin has no permissions to write on “/imagens”.

(Just in case,) Can you confirm that “/imagens” is mounted read/write? : mount | grep imagens

Alex