Re: FreeBSD 14.2-p1, XEN 4.19.0.20241112, unable to create domain

From: Subbsd <subbsd_at_gmail.com>
Date: Thu, 20 Feb 2025 11:28:45 UTC
Hello,

On Tue, Feb 18, 2025 at 8:54 PM Roger Pau Monné <roger.pau@citrix.com> wrote:

> I've pushed updated ports, 4.19.1.20250217 should contain the fixes.
>
> Regards, Roger.

Thank you - I took into account your comments on the configuration
file and removed unnecessary or outdated parameters.

Unfortunately the domain still does not start with the new version:

xl info:
---
host                   : zx
release                : 14.2-RELEASE-p1
version                : FreeBSD 14.2-RELEASE-p1 GENERIC
machine                : amd64
nr_cpus                : 20
max_cpu_id             : 19
nr_nodes               : 2
cores_per_socket       : 10
threads_per_core       : 1
cpu_mhz                : 3000.003
hw_caps                :
bfebfbff:77bee3ff:2c100800:00000001:00000001:00000281:00000000:00000100
virt_caps              : pv hvm hvm_directio pv_directio hap shadow
iommu_hap_pt_share gnttab-v1 gnttab-v2
total_memory           : 262108
free_memory            : 255424
sharing_freed_memory   : 0
sharing_used_memory    : 0
outstanding_claims     : 0
free_cpus              : 0
xen_major              : 4
xen_minor              : 19
xen_extra              : .2-pre
xen_version            : 4.19.2-pre
xen_caps               : xen-3.0-x86_64 hvm-3.0-x86_32 hvm-3.0-x86_32p
hvm-3.0-x86_64
xen_scheduler          : credit2
xen_pagesize           : 4096
platform_params        : virt_start=0x0
xen_changeset          :
xen_commandline        : dom0_mem=4096M dom0_max_vcpus=4 dom0=pvh
com1=115200,8n1 guest_loglvl=all loglvl=all
cc_compiler            : FreeBSD clang version 18.1.6
(https://github.com/llvm/llvm-proj
cc_compile_by          : root
cc_compile_domain      :
cc_compile_date        : Tue Feb 18 20:51:50 MSK 2025
build_id               : 2614e680ab3296071b4a67b4d673ebfed5c4d816
xend_config_format     : 4
---

pkg info | grep xen:
--
edk2-xen-x64-g202308_5         EDK2 Firmware for xen_x64
xen-kernel-4.19.1.20250217     Hypervisor using a microkernel design
xen-tools-4.19.1.20250217      Xen Hypervisor management tools
--

/usr/local/sbin/xl -vvv create -c ./xen.cfg
--
Parsing config from ./xen.cfg
libxl: debug: libxl_create.c:2122:do_domain_create: ao 0x14ab7c2e0a0:
create: how=0x0 callback=0x0 poller=0x14ab7c230a0
libxl: detail: libxl_create.c:672:libxl__domain_make: passthrough: disabled
libxl: detail: libxl_create.c:680:libxl__domain_make: altp2m: disabled
libxl: debug: libxl_device.c:445:libxl__device_disk_set_backend: Disk
vdev=xvda spec.backend=unknown specification=xen
libxl: debug: libxl_device.c:485:libxl__device_disk_set_backend: Disk
vdev=xvda, using backend phy
libxl: debug: libxl_device.c:445:libxl__device_disk_set_backend: Disk
vdev=hdb spec.backend=qdisk specification=xen
libxl: debug: libxl_create.c:1377:initiate_domain_create: Domain
6:running bootloader
libxl: debug: libxl_bootloader.c:410:libxl__bootloader_run: Domain
6:not a PV/PVH domain, skipping bootloader
libxl: debug: libxl_event.c:863:libxl__ev_xswatch_deregister: watch
w=0x14ab7c51dc8: deregister unregistered
libxl: debug: libxl_numa.c:502:libxl__get_numa_candidate: New best
NUMA placement candidate found: nr_nodes=1, nr_cpus=10, nr_vcpus=8,
free_memkb=128704
libxl: detail: libxl_dom.c:228:numa_place_domain: NUMA placement
candidate with 1 nodes, 10 cpus and 128704 KB free selected
domainbuilder: detail: xc_dom_allocate: cmdline="", features=""
domainbuilder: detail: xc_dom_kernel_file:
filename="/usr/local/lib/xen/boot/hvmloader"
domainbuilder: detail: xc_dom_malloc_filemap    : 170 kB
libxl: debug: libxl_dom.c:838:libxl__load_hvm_firmware_module: Loading
BIOS: /usr/local/share/seabios/bios.bin
domainbuilder: detail: xc_dom_boot_xen_init: ver 4.19, caps
xen-3.0-x86_64 hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
domainbuilder: detail: xc_dom_parse_image: called
domainbuilder: detail: xc_dom_find_loader: trying multiboot-binary loader ...
domainbuilder: detail: loader probe failed
domainbuilder: detail: xc_dom_find_loader: trying HVM-generic loader ...
domainbuilder: detail: loader probe OK
xc: detail: ELF: phdr: paddr=0x100000 memsz=0x2fea0
xc: detail: ELF: memory: 0x100000 -> 0x12fea0
domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-3.0-x86_64
domainbuilder: detail: xc_dom_compat_check: supported guest type:
hvm-3.0-x86_32 <= matches
domainbuilder: detail: xc_dom_compat_check: supported guest type:
hvm-3.0-x86_32p
domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-3.0-x86_64
domainbuilder: detail: xc_dom_mem_init: mem 4064 MB, pages 0xfe000
pages, 4k each
domainbuilder: detail: xc_dom_mem_init: 0xfe000 pages
domainbuilder: detail: xc_dom_boot_mem_init: called
domainbuilder: detail: range: start=0x0 end=0xf0000000
domainbuilder: detail: range: start=0x100000000 end=0x10e000000
xc: detail: PHYSICAL MEMORY ALLOCATION:
xc: detail:   4KB PAGES: 0x0000000000000200
xc: detail:   2MB PAGES: 0x00000000000003ef
xc: detail:   1GB PAGES: 0x0000000000000002
domainbuilder: detail: xc_dom_build_image: called
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn
0x100+0x30 at 0x8300c6000
domainbuilder: detail: xc_dom_alloc_segment:   kernel       : 0x100000
-> 0x12fea0  (pfn 0x100 + 0x30 pages)
xc: detail: ELF: phdr 0 at 0x8300f6000 -> 0x83011f3ac
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn
0x130+0x40 at 0x831cf6000
domainbuilder: detail: xc_dom_alloc_segment:   System Firmware module
: 0x130000 -> 0x170000  (pfn 0x130 + 0x40 pages)
domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn
0x170+0x1 at 0x833736000
domainbuilder: detail: xc_dom_alloc_segment:   HVM start info :
0x170000 -> 0x1708a8  (pfn 0x170 + 0x1 pages)
domainbuilder: detail: xc_dom_build_image  : virt_alloc_end : 0x171000
domainbuilder: detail: xc_dom_build_image  : virt_pgtab_end : 0x0
domainbuilder: detail: xc_dom_boot_image: called
domainbuilder: detail: domain builder memory footprint
domainbuilder: detail:    allocated
domainbuilder: detail:       malloc             : 5848 bytes
domainbuilder: detail:       anon mmap          : 0 bytes
domainbuilder: detail:    mapped
domainbuilder: detail:       file mmap          : 170 kB
domainbuilder: detail:       domU mmap          : 452 kB
domainbuilder: detail: vcpu_hvm: called
domainbuilder: detail: compat_gnttab_hvm_seed: d6: pfn=0x10e000
domainbuilder: detail: xc_dom_set_gnttab_entry: d6 gnt[0] -> d0 0xfefff
domainbuilder: detail: xc_dom_set_gnttab_entry: d6 gnt[1] -> d0 0xfeffc
domainbuilder: detail: xc_dom_release: called
libxl: debug: libxl_device.c:445:libxl__device_disk_set_backend: Disk
vdev=xvda spec.backend=phy specification=xen
libxl: debug: libxl_event.c:813:libxl__ev_xswatch_register: watch
w=0x14ab7c904d0 wpath=/local/domain/0/backend/vbd/6/51712/state
token=3/0: register slotnum=3
libxl: debug: libxl_device.c:445:libxl__device_disk_set_backend: Disk
vdev=hdb spec.backend=qdisk specification=xen
libxl: debug: libxl_device.c:1268:device_hotplug: Domain 6:No hotplug
script to execute
libxl: debug: libxl_event.c:863:libxl__ev_xswatch_deregister: watch
w=0x14ab7c909d0: deregister unregistered
libxl: debug: libxl_create.c:2161:do_domain_create: ao 0x14ab7c2e0a0:
inprogress: poller=0x14ab7c230a0, flags=i
libxl: debug: libxl_event.c:751:watchfd_callback: watch
w=0x14ab7c904d0 wpath=/local/domain/0/backend/vbd/6/51712/state
token=3/0: event epath=/local/domain/0/backend/vbd/6/51712/state
libxl: debug: libxl_event.c:1051:devstate_callback: backend
/local/domain/0/backend/vbd/6/51712/state wanted state 2 ok
libxl: debug: libxl_event.c:850:libxl__ev_xswatch_deregister: watch
w=0x14ab7c904d0 wpath=/local/domain/0/backend/vbd/6/51712/state
token=3/0: deregister slotnum=3
libxl: debug: libxl_device.c:1181:device_backend_callback: Domain
6:calling device_backend_cleanup
libxl: debug: libxl_event.c:863:libxl__ev_xswatch_deregister: watch
w=0x14ab7c904d0: deregister unregistered
libxl: debug: libxl_device.c:1283:device_hotplug: Domain 6:calling
hotplug script: /usr/local/etc/xen/scripts/block
/local/domain/0/backend/vbd/6/51712
libxl: debug: libxl_device.c:1284:device_hotplug: Domain 6:extra args:
libxl: debug: libxl_device.c:1290:device_hotplug: Domain 6:     add
libxl: debug: libxl_device.c:1292:device_hotplug: Domain 6:env:
libxl: debug: libxl_aoutils.c:593:libxl__async_exec_start: forking to
execute: /usr/local/etc/xen/scripts/block
/local/domain/0/backend/vbd/6/51712
libxl: debug: libxl_event.c:720:watchfd_callback: watch
epath=/local/domain/0/backend/vbd/6/51712/state token=3/0: empty slot
libxl: debug: libxl_event.c:863:libxl__ev_xswatch_deregister: watch
w=0x14ab7c905d0: deregister unregistered
libxl: debug: libxl_device.c:1268:device_hotplug: Domain 6:No hotplug
script to execute
libxl: debug: libxl_event.c:863:libxl__ev_xswatch_deregister: watch
w=0x14ab7c905d0: deregister unregistered
libxl: debug: libxl_dm.c:180:libxl__domain_get_device_model_uid:
Domain 6:dm_restrict disabled, starting QEMU as root
libxl: debug: libxl_disk.c:1346:libxl__device_disk_find_local_path:
Directly accessing local RAW disk
/usr/jails/jails-data/freebsd1-data/dsk1.vhd
libxl: debug: libxl_disk.c:1346:libxl__device_disk_find_local_path:
Directly accessing local RAW disk
/usr/jails/src/iso/cbsd-iso-FreeBSD-14.2-RELEASE-amd64-disc1.iso
libxl: debug: libxl_dm.c:3001:libxl__spawn_local_dm: Domain 6:Spawning
device-model /usr/local/lib/xen/bin/qemu-system-i386 with arguments:
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:
/usr/local/lib/xen/bin/qemu-system-i386
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -xen-domid
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  6
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -no-shutdown
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -chardev
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:
socket,id=libxl-cmd,path=/var/run/xen/qmp-libxl-6,server=on,wait=off
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -mon
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:
chardev=libxl-cmd,mode=control
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -chardev
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:
socket,id=libxenstat-cmd,path=/var/run/xen/qmp-libxenstat-6,server=on,wait=off
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -mon
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:
chardev=libxenstat-cmd,mode=control
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -nodefaults
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -no-user-config
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -name
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  freebsd1
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -vnc
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:
0.0.0.0:0,password=on
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -display
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  none
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -serial
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  pty
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -device
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  VGA,vgamem_mb=32
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -boot
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  order=d
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -usb
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -usbdevice
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  tablet
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -smp
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  4,maxcpus=4
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -device
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:
rtl8139,id=nic0,netdev=net0,mac=00:16:3e:1f:4e:7b
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -netdev
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:
type=tap,id=net0,ifname=xnb6.0-emu,br=bridge2,script=no,downscript=no
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -machine
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:
xenfv,suppress-vmdesc=on
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -m
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  4064
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -drive
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:
file=/usr/jails/jails-data/freebsd1-data/dsk1.vhd,if=ide,index=0,media=disk,format=raw,cache=writeback
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -drive
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:
if=none,readonly=on,id=ide-832,file=/usr/jails/src/iso/cbsd-iso-FreeBSD-14.2-RELEASE-amd64-disc1.iso,format=raw
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:  -device
libxl: debug: libxl_dm.c:3003:libxl__spawn_local_dm: Domain 6:
ide-cd,id=ide-832,drive=ide-832,bus=ide.0,unit=1
libxl: debug: libxl_dm.c:3005:libxl__spawn_local_dm: Domain 6:Spawning
device-model /usr/local/lib/xen/bin/qemu-system-i386 with additional
environment:
libxl: debug: libxl_dm.c:3007:libxl__spawn_local_dm: Domain 6:
XEN_QEMU_CONSOLE_LIMIT=1048576
libxl: debug: libxl_dm.c:3007:libxl__spawn_local_dm: Domain 6:  XEN_DOMAIN_ID=6
libxl: debug: libxl_event.c:813:libxl__ev_xswatch_register: watch
w=0x14ab7c520c0 wpath=/local/domain/0/device-model/6/state token=3/1:
register slotnum=3
libxl: debug: libxl_event.c:751:watchfd_callback: watch
w=0x14ab7c520c0 wpath=/local/domain/0/device-model/6/state token=3/1:
event epath=/local/domain/0/device-model/6/state
libxl: debug: libxl_exec.c:407:spawn_watch_event: domain 6 device
model: spawn watch p=(null)
libxl: debug: libxl_event.c:751:watchfd_callback: watch
w=0x14ab7c520c0 wpath=/local/domain/0/device-model/6/state token=3/1:
event epath=/local/domain/0/device-model/6/state
libxl: debug: libxl_exec.c:407:spawn_watch_event: domain 6 device
model: spawn watch p=running
libxl: debug: libxl_event.c:850:libxl__ev_xswatch_deregister: watch
w=0x14ab7c520c0 wpath=/local/domain/0/device-model/6/state token=3/1:
deregister slotnum=3
libxl: debug: libxl_exec.c:129:libxl_report_child_exitstatus: domain 6
device model (dying as expected) [7257] died due to fatal signal
Killed
libxl: debug: libxl_event.c:863:libxl__ev_xswatch_deregister: watch
w=0x14ab7c520c0: deregister unregistered
libxl: debug: libxl_qmp.c:1884:libxl__ev_qmp_send: Domain 6: ev
0x14ab7c520d8, cmd 'query-chardev'
libxl: debug: libxl_qmp.c:1324:qmp_ev_lock_aquired: Domain
6:Connecting to /var/run/xen/qmp-libxl-6
libxl: error: libxl_qmp.c:1335:qmp_ev_lock_aquired: Domain 6:Failed to
connect to QMP socket /var/run/xen/qmp-libxl-6: Connection refused
libxl: debug: libxl_qmp.c:1920:libxl__ev_qmp_dispose: Domain 6: ev 0x14ab7c520d8
libxl: error: libxl_dm.c:3378:device_model_postconfig_done: Domain
6:Post DM startup configs failed, rc=-3
libxl: debug: libxl_qmp.c:1920:libxl__ev_qmp_dispose: Domain 6: ev 0x14ab7c520d8
libxl: error: libxl_create.c:1937:domcreate_devmodel_started: Domain
6:device model did not start: -3
libxl: debug: libxl_event.c:863:libxl__ev_xswatch_deregister: watch
w=0x14ab7c537d0: deregister unregistered
libxl: debug: libxl_dm.c:3592:libxl__destroy_device_model: Domain
6:Didn't find dm UID; destroying by pid
libxl: debug: libxl_aoutils.c:649:libxl__kill_xs_path: Device Model signaled
libxl: debug: libxl_event.c:813:libxl__ev_xswatch_register: watch
w=0x14ab7ce24d0 wpath=/local/domain/0/backend/vbd/6/51712/state
token=3/2: register slotnum=3
libxl: debug: libxl_event.c:751:watchfd_callback: watch
w=0x14ab7ce24d0 wpath=/local/domain/0/backend/vbd/6/51712/state
token=3/2: event epath=/local/domain/0/backend/vbd/6/51712/state
libxl: debug: libxl_event.c:1051:devstate_callback: backend
/local/domain/0/backend/vbd/6/51712/state wanted state 6 ok
libxl: debug: libxl_event.c:850:libxl__ev_xswatch_deregister: watch
w=0x14ab7ce24d0 wpath=/local/domain/0/backend/vbd/6/51712/state
token=3/2: deregister slotnum=3
libxl: debug: libxl_device.c:1181:device_backend_callback: Domain
6:calling device_backend_cleanup
libxl: debug: libxl_event.c:863:libxl__ev_xswatch_deregister: watch
w=0x14ab7ce24d0: deregister unregistered
libxl: debug: libxl_device.c:1283:device_hotplug: Domain 6:calling
hotplug script: /usr/local/etc/xen/scripts/block
/local/domain/0/backend/vbd/6/51712
libxl: debug: libxl_device.c:1284:device_hotplug: Domain 6:extra args:
libxl: debug: libxl_device.c:1290:device_hotplug: Domain 6:     remove
libxl: debug: libxl_device.c:1292:device_hotplug: Domain 6:env:
libxl: debug: libxl_aoutils.c:593:libxl__async_exec_start: forking to
execute: /usr/local/etc/xen/scripts/block
/local/domain/0/backend/vbd/6/51712
libxl: debug: libxl_event.c:720:watchfd_callback: watch
epath=/local/domain/0/backend/vbd/6/51712/state token=3/2: empty slot
libxl: debug: libxl_event.c:720:watchfd_callback: watch
epath=/local/domain/0/backend/vbd/6/51712/state token=3/2: empty slot
libxl: debug: libxl_event.c:863:libxl__ev_xswatch_deregister: watch
w=0x14ab7ce25d0: deregister unregistered
libxl: debug: libxl_device.c:1268:device_hotplug: Domain 6:No hotplug
script to execute
libxl: debug: libxl_event.c:863:libxl__ev_xswatch_deregister: watch
w=0x14ab7ce25d0: deregister unregistered
libxl: debug: libxl_device.c:1268:device_hotplug: Domain 6:No hotplug
script to execute
libxl: debug: libxl_event.c:863:libxl__ev_xswatch_deregister: watch
w=0x14ab7ce29d0: deregister unregistered
libxl: debug: libxl_device.c:1268:device_hotplug: Domain 6:No hotplug
script to execute
libxl: debug: libxl_event.c:863:libxl__ev_xswatch_deregister: watch
w=0x14ab7ce2dd0: deregister unregistered
libxl: debug: libxl_domain.c:1597:devices_destroy_cb: Domain 6:Forked
pid 7295 for destroy of domain
libxl: debug: libxl_event.c:2067:libxl__ao_complete: ao 0x14ab7c2e0a0:
complete, rc=-3
libxl: debug: libxl_event.c:2036:libxl__ao__destroy: ao 0x14ab7c2e0a0: destroy
libxl: debug: libxl_domain.c:1042:libxl_domain_destroy: Domain 6:ao
0x14ab7c2e0a0: create: how=0x0 callback=0x0 poller=0x14ab7c230a0
libxl: error: libxl_xshelp.c:206:libxl__xs_read_mandatory: xenstore
read failed: `/libxl/6/type': No such file or directory
libxl: warning: libxl_dom.c:51:libxl__domain_type: unable to get
domain type for domid=6, assuming HVM
libxl: debug: libxl_domain.c:1597:devices_destroy_cb: Domain 6:Forked
pid 7296 for destroy of domain
libxl: debug: libxl_domain.c:1051:libxl_domain_destroy: Domain 6:ao
0x14ab7c2e0a0: inprogress: poller=0x14ab7c230a0, flags=i
libxl: error: libxl_domain.c:1617:domain_destroy_domid_cb: Domain
6:xc_domain_destroy failed: No such process
libxl: error: libxl_domain.c:1133:domain_destroy_callback: Domain
6:Unable to destroy guest
libxl: error: libxl_domain.c:1060:domain_destroy_cb: Domain
6:Destruction of domain failed
libxl: debug: libxl_event.c:2067:libxl__ao_complete: ao 0x14ab7c2e0a0:
complete, rc=-3
libxl: debug: libxl_event.c:2036:libxl__ao__destroy: ao 0x14ab7c2e0a0: destroy
xencall:buffer: debug: total allocations:714 total releases:714
xencall:buffer: debug: current allocations:0 maximum allocations:3
xencall:buffer: debug: cache current size:3
xencall:buffer: debug: cache hits:693 misses:3 toobig:18
xencall:buffer: debug: total allocations:0 total releases:0
xencall:buffer: debug: current allocations:0 maximum allocations:0
xencall:buffer: debug: cache current size:0
xencall:buffer: debug: cache hits:0 misses:0 toobig:0

# echo $?
3

# xl list
Name                                        ID   Mem VCPUs      State   Time(s)
Domain-0                                     0  4095     4     r-----    7642.4

# ls -la /var/run/xen
total 11
drwxr-xr-x   2 root wheel  6 Feb 20 14:20 .
drwxr-xr-x  11 root wheel 28 Feb 20 12:52 ..
-rw-r--r--   1 root wheel 32 Feb 20 14:20 domid-history
-rw-------   1 root wheel  5 Feb 19 16:32 xenconsoled.pid
-rw-------   1 root wheel  5 Feb 19 16:32 xenstored.pid
-rw-------   1 root wheel  5 Feb 19 16:32 xldevd.pid

# ps axf | grep xen
  16   -  SL      0:04.72 [xenwatch]
  17   -  IL      0:00.04 [xenstore_rcv]
1848   -  I       0:00.39 /usr/local/sbin/xenstored --pid-file
/var/run/xen/xenstored.pid
1853   -  I       0:00.08 /usr/local/sbin/xenconsoled
1859   -  Is      0:00.08 /usr/local/sbin/xl devd --pidfile
/var/run/xen/xldevd.pid
---