2016-07-19 16:27:04.559 28625 INFO nova.compute.resource_tracker [req-13b87b2d-c75b-4908-9295-3b0604f717bc - - - - -] Compute_service record updated for hl-201-63:hl-201-63
2016-07-19 16:27:08.819 28625 INFO nova.compute.manager [req-11064c9a-023e-49fb-8731-66664892b722 75b531075ac845f9b8ad18316b38c6ed 91f79196f56547c2b5ca3b4df67f8d45 - - -] [instance: a4752092-5bc1-4bc1-b33b-455dcdacecc9] instance snapshotting
2016-07-19 16:27:08.883 28625 INFO nova.compute.manager [req-b1481b51-c844-4de6-b62b-e2dca24c1fef - - - - -] [instance: a4752092-5bc1-4bc1-b33b-455dcdacecc9] VM Paused (Lifecycle Event)
2016-07-19 16:27:09.328 28625 INFO nova.compute.manager [req-b1481b51-c844-4de6-b62b-e2dca24c1fef - - - - -] [instance: a4752092-5bc1-4bc1-b33b-455dcdacecc9] During sync_power_state the instance has a pending task (image_snapshot). Skip.
2016-07-19 16:27:09.344 28625 INFO nova.compute.manager [req-b1481b51-c844-4de6-b62b-e2dca24c1fef - - - - -] [instance: a4752092-5bc1-4bc1-b33b-455dcdacecc9] VM Resumed (Lifecycle Event)
2016-07-19 16:27:09.623 28625 INFO nova.compute.manager [req-b1481b51-c844-4de6-b62b-e2dca24c1fef - - - - -] [instance: a4752092-5bc1-4bc1-b33b-455dcdacecc9] During sync_power_state the instance has a pending task (image_snapshot). Skip.
2016-07-19 16:27:09.700 28625 INFO nova.compute.manager [req-11064c9a-023e-49fb-8731-66664892b722 75b531075ac845f9b8ad18316b38c6ed 91f79196f56547c2b5ca3b4df67f8d45 - - -] [instance: a4752092-5bc1-4bc1-b33b-455dcdacecc9] Successfully reverted task state from image_snapshot on failure for instance.
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher [req-11064c9a-023e-49fb-8731-66664892b722 75b531075ac845f9b8ad18316b38c6ed 91f79196f56547c2b5ca3b4df67f8d45 - - -] Exception during message handling: internal error: unable to execute QEMU command 'migrate': Migration disabled: failed to allocate shared memory
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher Traceback (most recent call last):
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 138, in _dispatch_and_reply
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     incoming.message))
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 185, in _dispatch
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 127, in _do_dispatch
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     result = func(ctxt, **new_args)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 110, in wrapped
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     payload)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     self.force_reraise()
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 89, in wrapped
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     return f(self, context, *args, **kw)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 359, in decorated_function
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     LOG.warning(msg, e, instance=instance)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     self.force_reraise()
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 328, in decorated_function
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 387, in decorated_function
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     kwargs['instance'], e, sys.exc_info())
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     self.force_reraise()
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 375, in decorated_function
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 435, in decorated_function
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     instance=instance)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     self.force_reraise()
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 425, in decorated_function
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     *args, **kwargs)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3150, in snapshot_instance
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     task_states.IMAGE_SNAPSHOT)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3180, in _snapshot_instance
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     update_task_state)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1667, in snapshot
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     instance)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1751, in _prepare_domain_for_snapshot
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     self.suspend(context, instance)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2640, in suspend
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     guest.save_memory_state()
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/guest.py", line 379, in save_memory_state
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     self._domain.managedSave(0)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 186, in doit
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     result = proxy_call(self._autowrap, f, *args, **kwargs)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 144, in proxy_call
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     rv = execute(f, *args, **kwargs)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 125, in execute
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     six.reraise(c, e, tb)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 83, in tworker
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     rv = meth(*args, **kwargs)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/libvirt.py", line 1403, in managedSave
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher     if ret == -1: raise libvirtError ('virDomainManagedSave() failed', dom=self)
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher libvirtError: internal error: unable to execute QEMU command 'migrate': Migration disabled: failed to allocate shared memory
2016-07-19 16:27:09.709 28625 ERROR oslo_messaging.rpc.dispatcher

SOLVE
https://github.com/tigerlinux/openstack-mitaka-installer-ubuntu1604lts/blob/master/DOCS/Libvirt-NOVA-Bug-Live-Migration.txt#L8

# apt-get install apparmor-utils
# aa-status
apparmor module is loaded.
6 profiles are loaded.
6 profiles are in enforce mode.
/sbin/dhclient
/usr/lib/NetworkManager/nm-dhcp-client.action
/usr/lib/connman/scripts/dhclient-script
/usr/lib/libvirt/virt-aa-helper
/usr/sbin/libvirtd
/usr/sbin/tcpdump
0 profiles are in complain mode.
1 processes have profiles defined.
1 processes are in enforce mode.
/usr/sbin/libvirtd (6501)
0 processes are in complain mode.
0 processes are unconfined but have a profile defined.

# aa-disable /etc/apparmor.d/usr.sbin.libvirtd
Disabling /etc/apparmor.d/usr.sbin.libvirtd.

# aa-status
apparmor module is loaded.
5 profiles are loaded.
5 profiles are in enforce mode.
/sbin/dhclient
/usr/lib/NetworkManager/nm-dhcp-client.action
/usr/lib/connman/scripts/dhclient-script
/usr/lib/libvirt/virt-aa-helper
/usr/sbin/tcpdump
0 profiles are in complain mode.
0 processes have profiles defined.
0 processes are in enforce mode.
0 processes are in complain mode.
0 processes are unconfined but have a profile defined.