Created socket at /tmp/ganeti-qa-multiplexer.33pf3v6i Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -N -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=yes moe.staging.ganeti.org SSH command for node moe.staging.ganeti.org: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org Created socket at /tmp/ganeti-qa-multiplexer.u41n6zn5 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -N -oControlPath=/tmp/ganeti-qa-multiplexer.u41n6zn5 -oControlMaster=yes bart.staging.ganeti.org SSH command for node bart.staging.ganeti.org: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.u41n6zn5 -oControlMaster=no bart.staging.ganeti.org Created socket at /tmp/ganeti-qa-multiplexer.fox6rlvu Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -N -oControlPath=/tmp/ganeti-qa-multiplexer.fox6rlvu -oControlMaster=yes lisa.staging.ganeti.org SSH command for node lisa.staging.ganeti.org: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.fox6rlvu -oControlMaster=no lisa.staging.ganeti.org vvvv BLOCK 2026-09-23 03:14:13.825802 start [RunEnvTests] Run several environment tests <<<< 2026-09-23 03:14:13.826157 start [TestSshConnection] Test SSH connection Command: ssh moe.staging.ganeti.org exit Command: ssh bart.staging.ganeti.org exit Command: ssh lisa.staging.ganeti.org exit ---- PASSED [TestSshConnection] Test SSH connection -------------------- >>>> 2026-09-23 03:14:14.129517 time=0:00:00.303360 [TestSshConnection] Test SSH connection <<<< 2026-09-23 03:14:14.129635 start [TestIcmpPing] ICMP ping each node Command: ssh moe.staging.ganeti.org 'fping -e moe.staging.ganeti.org bart.staging.ganeti.org lisa.staging.ganeti.org && fping -e 192.168.1.5 192.168.1.6 192.168.1.7' moe.staging.ganeti.org is alive (0.018 ms) bart.staging.ganeti.org is alive (0.136 ms) lisa.staging.ganeti.org is alive (0.121 ms) 192.168.1.5 is alive (0.018 ms) 192.168.1.6 is alive (0.125 ms) 192.168.1.7 is alive (0.112 ms) Command: ssh bart.staging.ganeti.org 'fping -e moe.staging.ganeti.org bart.staging.ganeti.org lisa.staging.ganeti.org && fping -e 192.168.1.5 192.168.1.6 192.168.1.7' moe.staging.ganeti.org is alive (0.186 ms) bart.staging.ganeti.org is alive (0.026 ms) lisa.staging.ganeti.org is alive (0.270 ms) 192.168.1.5 is alive (0.145 ms) 192.168.1.6 is alive (0.021 ms) 192.168.1.7 is alive (0.123 ms) Command: ssh lisa.staging.ganeti.org 'fping -e moe.staging.ganeti.org bart.staging.ganeti.org lisa.staging.ganeti.org && fping -e 192.168.1.5 192.168.1.6 192.168.1.7' moe.staging.ganeti.org is alive (0.133 ms) bart.staging.ganeti.org is alive (0.148 ms) lisa.staging.ganeti.org is alive (0.015 ms) 192.168.1.5 is alive (0.167 ms) 192.168.1.6 is alive (0.189 ms) 192.168.1.7 is alive (0.019 ms) ---- PASSED [TestIcmpPing] ICMP ping each node ------------------------- >>>> 2026-09-23 03:14:14.327314 time=0:00:00.197679 [TestIcmpPing] ICMP ping each node <<<< 2026-09-23 03:14:14.327464 start [TestGanetiCommands] Test availibility of Ganeti commands Command: ssh moe.staging.ganeti.org 'gnt-backup --version && gnt-cluster --version && gnt-debug --version && gnt-instance --version && gnt-job --version && gnt-network --version && gnt-node --version && gnt-os --version && gnt-storage --version && gnt-filter --version && ganeti-noded --version && ganeti-rapi --version && ganeti-watcher --version && ganeti-confd --version && ganeti-luxid --version && ganeti-wconfd --version' gnt-backup (ganeti ) 3.2.0~alpha1 gnt-cluster (ganeti ) 3.2.0~alpha1 gnt-debug (ganeti ) 3.2.0~alpha1 gnt-instance (ganeti ) 3.2.0~alpha1 gnt-job (ganeti ) 3.2.0~alpha1 gnt-network (ganeti ) 3.2.0~alpha1 gnt-node (ganeti ) 3.2.0~alpha1 gnt-os (ganeti ) 3.2.0~alpha1 gnt-storage (ganeti ) 3.2.0~alpha1 gnt-filter (ganeti ) 3.2.0~alpha1 ganeti-noded (ganeti) 3.2.0~alpha1 ganeti-rapi (ganeti) 3.2.0~alpha1 ganeti-watcher (ganeti) 3.2.0~alpha1 ganeti-confd (ganeti) version compiled with ghc 9.0 running on linux x86_64 ganeti-luxid (ganeti) version compiled with ghc 9.0 running on linux x86_64 ganeti-wconfd (ganeti) version compiled with ghc 9.0 running on linux x86_64 Command: ssh bart.staging.ganeti.org 'gnt-backup --version && gnt-cluster --version && gnt-debug --version && gnt-instance --version && gnt-job --version && gnt-network --version && gnt-node --version && gnt-os --version && gnt-storage --version && gnt-filter --version && ganeti-noded --version && ganeti-rapi --version && ganeti-watcher --version && ganeti-confd --version && ganeti-luxid --version && ganeti-wconfd --version' gnt-backup (ganeti ) 3.2.0~alpha1 gnt-cluster (ganeti ) 3.2.0~alpha1 gnt-debug (ganeti ) 3.2.0~alpha1 gnt-instance (ganeti ) 3.2.0~alpha1 gnt-job (ganeti ) 3.2.0~alpha1 gnt-network (ganeti ) 3.2.0~alpha1 gnt-node (ganeti ) 3.2.0~alpha1 gnt-os (ganeti ) 3.2.0~alpha1 gnt-storage (ganeti ) 3.2.0~alpha1 gnt-filter (ganeti ) 3.2.0~alpha1 ganeti-noded (ganeti) 3.2.0~alpha1 ganeti-rapi (ganeti) 3.2.0~alpha1 ganeti-watcher (ganeti) 3.2.0~alpha1 ganeti-confd (ganeti) version compiled with ghc 9.0 running on linux x86_64 ganeti-luxid (ganeti) version compiled with ghc 9.0 running on linux x86_64 ganeti-wconfd (ganeti) version compiled with ghc 9.0 running on linux x86_64 Command: ssh lisa.staging.ganeti.org 'gnt-backup --version && gnt-cluster --version && gnt-debug --version && gnt-instance --version && gnt-job --version && gnt-network --version && gnt-node --version && gnt-os --version && gnt-storage --version && gnt-filter --version && ganeti-noded --version && ganeti-rapi --version && ganeti-watcher --version && ganeti-confd --version && ganeti-luxid --version && ganeti-wconfd --version' gnt-backup (ganeti ) 3.2.0~alpha1 gnt-cluster (ganeti ) 3.2.0~alpha1 gnt-debug (ganeti ) 3.2.0~alpha1 gnt-instance (ganeti ) 3.2.0~alpha1 gnt-job (ganeti ) 3.2.0~alpha1 gnt-network (ganeti ) 3.2.0~alpha1 gnt-node (ganeti ) 3.2.0~alpha1 gnt-os (ganeti ) 3.2.0~alpha1 gnt-storage (ganeti ) 3.2.0~alpha1 gnt-filter (ganeti ) 3.2.0~alpha1 ganeti-noded (ganeti) 3.2.0~alpha1 ganeti-rapi (ganeti) 3.2.0~alpha1 ganeti-watcher (ganeti) 3.2.0~alpha1 ganeti-confd (ganeti) version compiled with ghc 9.0 running on linux x86_64 ganeti-luxid (ganeti) version compiled with ghc 9.0 running on linux x86_64 ganeti-wconfd (ganeti) version compiled with ghc 9.0 running on linux x86_64 ---- PASSED [TestGanetiCommands] Test availibility of Ganeti commands -- >>>> 2026-09-23 03:14:21.877608 time=0:00:07.550144 [TestGanetiCommands] Test availibility of Ganeti commands ^^^^ BLOCK 2026-09-23 03:14:21.877763 time=0:00:08.051961 [RunEnvTests] Run several environment tests **** 2026-09-23 03:14:21.877862 skipping [TestClusterInit] gnt-cluster init, test(s) create-cluster disabled Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'cat /var/lib/ganeti/rapi/users' ganeti-qa ganeti-qa writeWARNING:root:Deprecated permission 'write' found and automatically mapped to '@admin'. Please update to use roles (@readonly or @admin) instead. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'openssl x509 -in /var/lib/ganeti/rapi.pem' -----BEGIN CERTIFICATE----- MIIC9zCCAd+gAwIBAgIBATANBgkqhkiG9w0BAQsFADAdMRswGQYDVQQDDBJnYW5l dGkuZXhhbXBsZS5jb20wHhcNMjYwOTIzMDExMzU5WhcNMzEwOTIyMDExMzU5WjAd MRswGQYDVQQDDBJnYW5ldGkuZXhhbXBsZS5jb20wggEiMA0GCSqGSIb3DQEBAQUA A4IBDwAwggEKAoIBAQCbcFFXNfAAloNNaFMdmjT01JZDAIuUtbBv/Sde0hdMTJUn fyDElB5A+oR0k3DXsweoJgGwkycgUM8RLwCLhUvqVpPzV0x8QNjhDhueVESa+Fza F449LhyHW5cvfqFb0jQ5Egd5cqlcEoChdhq5HcafLb472gzCZgAeRNjAuJ0sop1Z 4SLtsFNYMZ0q9y4CbRL5ztdwnUWnRwyMYXz4sNEKKMa7nRkxdXoK73hAiseJyAp7 CJTq1XkbLFVgL6ybsbFTI/1ld56ysHmE/a1Jue64/wWcDjWfvVM9eN66lJPz+e8c kvz5pnXSSoQO7btGOGavC4r4OXCTsoRmvt1roRWRAgMBAAGjQjBAMA8GA1UdEwEB /wQFMAMBAf8wDgYDVR0PAQH/BAQDAgGmMB0GA1UdDgQWBBT8jswyF3gAOaeHkYu7 Ef7Y0DBpojANBgkqhkiG9w0BAQsFAAOCAQEAHCDbJx9zOOao4byPIYIDVBOZdtAX E1i5Nmqm5esPHHbg+vOTcLvNiuaz2MjngHt8KhlsYwodOj0OCs7cnYeB+eQHs91V ihRIajxXrtlGvSzurOy/OoJWYS/ZTgsnBaU4uyuGjRM1OJ8wbSl58R0NKN8vsxbx qOQBFs2LF+BsezLDpmu8r2ZDxioCvRLVoRoglmnEdrbr6miVHlWyqR2FCQG1KU26 oxk2oYwMxI83cgrbjs6cuDAaFYm7bFaR8pQhsCZkYlPTurHdSq6Ouj/ltOMzkN7+ 7hHTg7j/Po/QzlOr3GmE2KgyB8hf9+jPT3N8xIlN0Emdk4EDjUH7ECEyVw== -----END CERTIFICATE----- RAPI protocol version: 2 Command: ssh moe.staging.ganeti.org 'iptables-save | grep -v '\''ganeti_qa_script'\'' | iptables-restore' Command: ssh bart.staging.ganeti.org 'iptables-save | grep -v '\''ganeti_qa_script'\'' | iptables-restore' Command: ssh lisa.staging.ganeti.org 'iptables-save | grep -v '\''ganeti_qa_script'\'' | iptables-restore' <<<< 2026-09-23 03:14:22.199841 start [TestNodeList] gnt-node list ----- Command: ssh moe.staging.ganeti.org 'gnt-node list --output sptotal,bootid,mtime,vm_capable,ndp/cpu_speed,tags,pinst_list,disk_state,cnos,ndp/ovs_name,uuid,name,pip,ndp/exclusive_storage,group.uuid,ndp/oob_program,sinst_cnt,cnodes,hv_state,master,custom_ndparams,ndp/ovs_link,dfree,ndparams,drained,master_capable,role,ndp/spindle_count,group,master_candidate,mtotal,ndp/ovs,sip,ctime,dtotal,ndp/ssh_port,spfree,serial_no,powered,ctotal,csockets,offline,pinst_cnt,mnode,sinst_list,mfree >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output bootid,cnodes,cnos,csockets,ctime,ctotal,custom_ndparams,dfree,disk_state,drained,dtotal,group,group.uuid,hv_state,master,master_candidate,master_capable,mfree,mnode,mtime,mtotal,name,ndp/cpu_speed,ndp/exclusive_storage,ndp/oob_program,ndp/ovs,ndp/ovs_link,ndp/ovs_name,ndp/spindle_count,ndp/ssh_port,ndparams,offline,pinst_cnt,pinst_list,pip,powered,role,serial_no,sinst_cnt,sinst_list,sip,spfree,sptotal,tags,uuid,vm_capable >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output sptotal,bootid,mtime,vm_capable,ndp/cpu_speed,tags,pinst_list,disk_state,cnos,ndp/ovs_name,uuid,name,pip,ndp/exclusive_storage,group.uuid,ndp/oob_program,sinst_cnt,cnodes,hv_state,master,custom_ndparams,ndp/ovs_link,dfree,ndparams,drained,master_capable,role,ndp/spindle_count,group,master_candidate,mtotal,ndp/ovs,sip,ctime,dtotal,ndp/ssh_port,spfree,serial_no,powered,ctotal,csockets,offline,pinst_cnt,mnode,sinst_list,mfree,sptotal,bootid,mtime,vm_capable,ndp/cpu_speed,tags,pinst_list,disk_state,cnos,ndp/ovs_name,uuid,name,pip,ndp/exclusive_storage,group.uuid,ndp/oob_program,sinst_cnt,cnodes,hv_state,master,custom_ndparams,ndp/ovs_link,dfree,ndparams,drained,master_capable,role,ndp/spindle_count,group,master_candidate,mtotal,ndp/ovs,sip,ctime,dtotal,ndp/ssh_port,spfree,serial_no,powered,ctotal,csockets,offline,pinst_cnt,mnode,sinst_list,mfree >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output mfree,sinst_list,mnode,pinst_cnt >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output offline,csockets,ctotal,powered,serial_no,spfree,ndp/ssh_port,dtotal,ctime,sip >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output ndp/ovs,mtotal,master_candidate,group,ndp/spindle_count,role >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output master_capable,drained,ndparams,dfree,ndp/ovs_link >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output custom_ndparams,master,hv_state,cnodes,sinst_cnt,ndp/oob_program >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output group.uuid,ndp/exclusive_storage,pip,name,uuid,ndp/ovs_name,cnos,disk_state >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output pinst_list,tags,ndp/cpu_speed,vm_capable,mtime,bootid >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output sptotal >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list '\''--separator=|'\'' --no-headers --output name' bart.staging.ganeti.org lisa.staging.ganeti.org moe.staging.ganeti.org Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list '\''--separator=|'\'' --no-headers --output name moe.staging.ganeti.org lisa.staging.ganeti.org bart.staging.ganeti.org' moe.staging.ganeti.org lisa.staging.ganeti.org bart.staging.ganeti.org Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list '\''--separator=|'\'' --no-headers --output name bart.staging.ganeti.org lisa.staging.ganeti.org moe.staging.ganeti.org' bart.staging.ganeti.org lisa.staging.ganeti.org moe.staging.ganeti.org Command: ssh moe.staging.ganeti.org 'gnt-node list this.name.certainly.does.not.exist' Stderr was: Failure: prerequisites not met for this operation: error type: unknown_entity, error details: Node name this.name.certainly.does.not.exist not found Command: ssh moe.staging.ganeti.org 'gnt-node list --output=field/does/not/exist >> /var/log/ganeti/qa-output.log' Stderr was: ---- PASSED [TestNodeList] gnt-node list ------------------------------- >>>> 2026-09-23 03:14:28.978684 time=0:00:06.778843 [TestNodeList] gnt-node list Warning: Queried for unknown fields field/does/not/exist <<<< 2026-09-23 03:14:28.978796 start [TestInstanceList] gnt-instance list Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.vlan/7,nic.bridge/5,disk.name/6,hv/num_ttys,nic.network/6,hv/usb_mouse,hv/spice_tls_ciphers,custom_hvparams,nic.ip/0,nic.mac/4,nic.mode/4,disks_active,disk.uuid/4,nic_network,hv/vif_type,nic.count,nic.mode/2,nic.mac/0,nic.ip/1,hv/machine_version,be/minmem,uuid,hv/spice_zlib_glz_wan_compression,disk.size/15,nic.mac/3,sda_size,nic_mode,disk.spindles/1,hv/use_chroot,hv/security_model,hv/initrd_path,nic.network.name/5,disk.name/1,hv/bootloader_path,disk.spindles/2,hv/cdrom_disk_type,hv/cpu_cap,hv/kvm_pci_reservations,nic.names,nic.name/1,hv/keymap,nic.uuid/2,pnode.group,nic.network/4,hv/pci_pass,disk.size/5,disk.size/10,snodes,nic.ip/7,oper_vcpus,nic.link/7,hv/blockdev_prefix,hv/cpu_weight,hv/boot_order,hv/extra_cgroups,hv/spice_password_file,nic.mac/5,disk.size/7,nic.name/0,pnode.group.uuid,nic.uuid/1,disk.name/7,hv/spice_image_compression,disk.uuids,disk.name/15,nic.name/6,disk.sizes,disk.size/12,nic.mode/7,nic.networks,hv/user_shutdown,disk.spindles/12,nic.name/2,nic.network/7,nic.network/3,hv/spice_streaming_video,nic.link/2,hv/cpuid,disk.size/6,vcpus,disk.spindles,disk.uuid/15,be/auto_balance,mtime,disk.uuid/13,disk.size/1,nic.mac/1,nic.vlan/5,disk.size/14,pnode,nic.network.name/3,nic.vlan/1,hv/cpu_cores,disk.name/12,nic.vlan/3,nic.network.name/2,hv/vif_script,nic.network/5,nic.mode/1,nic.links,nic.link/0,disk.spindles/7,nic.mode/5,nic.link/4,hv/disk_cache,nic.bridge/6,nic.mac/6,disk.name/2,disk.name/14,disk.name/5,disk.spindles/13,network_port,name,disk.uuid/2,hv/use_bootloader,be/maxmem,nic.name/4,hv/cpu_threads,forthcoming,nic.vlan/0,hv/use_localtime,nic.network.name/7,nic.mode/0,osparams,disk.name/10,serial_no,nic.uuid/4,hv/security_domain,beparams,disk.name/8,disk.name/9,disk.spindles/10,hv/vnc_x509_path,nic.uuid/0,nic.network/0,hv/cdrom2_image_path,hv/spice_jpeg_wan_compression,hv/vhost_net,disk_template,hv/virtio_net_queues,nic.bridges,disk.spindles/14,nic.mode/6,nic.mode/3,hv/migration_downtime,hv/vnc_password_file,nic.link/3,hv/disk_discard,hv/vnet_hdr,hv/init_script,console,disk.size/3,hv/acpi,nic.vlan/2,disk.spindles/0,nic.uuid/5,disk.size/9,hv/spice_ip_version,disk.uuid/7,hv/spice_use_vdagent,nic.bridge/7,hv/kernel_path,ctime,nic.bridge/4,status,oper_state,hv/migration_caps,disk.names,hv/kernel_args,disk.count,disk.size/0,hv/mem_path,disk.uuid/6,hv/viridian,hv/scsi_controller_type,hv/drop_capabilities,hv/vga,hv/virtio_disk_iothreads,nic.network.name/6,disk.size/11,hv/device_model,nic.uuid/3,nic.bridge/2,hv/vnc_bind_address,nic.ip/6,disk.spindles/4,nic.link/1,disk.uuid/3,nic.ip/2,hv/kvm_extra,disk.uuid/9,nic.vlan/6,hv/usb_devices,disk.uuid/10,be/vcpus,disk.size/4,disk.uuid/5,hv/vnc_x509_verify,oper_ram,nic.uuid/7,nic.ip/4,nic.uuid/6,nic.name/7,nic.ip/3,hvparams,hv/startup_timeout,disk.size/8,hv/disk_type,custom_nicparams,disk.spindles/11,nic.network.name/0,mac,be/always_failover,admin_state,nic.macs,disk.name/13,nic.network/1,hv/kvm_flag,hv/soundhw,hv/floppy_image_path,nic.vlans,nic.name/5,nic.mac/2,hv/reboot_behavior,disk_usage,nic.uuids,hv/pae,hv/cpu_mask,nic.link/6,admin_state_source,nic.networks.names,disk.uuid/8,sdb_size,hv/extra_config,disk.spindles/6,disk.name/3,snodes.group.uuid,nic.network/2,nic.bridge/1,hv/disk_aio,custom_osparams,nic_link,snodes.group,disk.uuid/12,hv/vnc_tls,disk.name/11,hv/kvm_path,disk.name/0,tags,hv/spice_bind,hv/spice_use_tls,hv/use_guest_agent,hv/spice_playback_compression,disk.spindles/3,hv/cpu_sockets,nic.bridge/3,nic.ip/5,hv/devices,disk.name/4,disk.uuid/14,nic.network.name/1,bridge,disk.spindles/15,hypervisor,nic.ips,disk.size/13,nic.modes,custom_beparams,be/memory,disk.spindles/8,os,nic.name/3,nic.vlan/4,disk.uuid/1,disk.spindles/5,nic.mac/7,hv/cpu_type,hv/cdrom_image_path,admin_up,hv/root_path,hv/serial_speed,disk.size/2,disk.spindles/9,nic.link/5,ip,hv/serial_console,nic.network.name/4,hv/bootloader_args,disk.uuid/11,hv/nic_type,disk.uuid/0,nic.bridge/0,be/spindle_use >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output admin_state,admin_state_source,admin_up,be/always_failover,be/auto_balance,be/maxmem,be/memory,be/minmem,be/spindle_use,be/vcpus,beparams,bridge,console,ctime,custom_beparams,custom_hvparams,custom_nicparams,custom_osparams,disk.count,disk.name/0,disk.name/1,disk.name/10,disk.name/11,disk.name/12,disk.name/13,disk.name/14,disk.name/15,disk.name/2,disk.name/3,disk.name/4,disk.name/5,disk.name/6,disk.name/7,disk.name/8,disk.name/9,disk.names,disk.size/0,disk.size/1,disk.size/10,disk.size/11,disk.size/12,disk.size/13,disk.size/14,disk.size/15,disk.size/2,disk.size/3,disk.size/4,disk.size/5,disk.size/6,disk.size/7,disk.size/8,disk.size/9,disk.sizes,disk.spindles,disk.spindles/0,disk.spindles/1,disk.spindles/10,disk.spindles/11,disk.spindles/12,disk.spindles/13,disk.spindles/14,disk.spindles/15,disk.spindles/2,disk.spindles/3,disk.spindles/4,disk.spindles/5,disk.spindles/6,disk.spindles/7,disk.spindles/8,disk.spindles/9,disk.uuid/0,disk.uuid/1,disk.uuid/10,disk.uuid/11,disk.uuid/12,disk.uuid/13,disk.uuid/14,disk.uuid/15,disk.uuid/2,disk.uuid/3,disk.uuid/4,disk.uuid/5,disk.uuid/6,disk.uuid/7,disk.uuid/8,disk.uuid/9,disk.uuids,disk_template,disk_usage,disks_active,forthcoming,hv/acpi,hv/blockdev_prefix,hv/boot_order,hv/bootloader_args,hv/bootloader_path,hv/cdrom2_image_path,hv/cdrom_disk_type,hv/cdrom_image_path,hv/cpu_cap,hv/cpu_cores,hv/cpu_mask,hv/cpu_sockets,hv/cpu_threads,hv/cpu_type,hv/cpu_weight,hv/cpuid,hv/device_model,hv/devices,hv/disk_aio,hv/disk_cache,hv/disk_discard,hv/disk_type,hv/drop_capabilities,hv/extra_cgroups,hv/extra_config,hv/floppy_image_path,hv/init_script,hv/initrd_path,hv/kernel_args,hv/kernel_path,hv/keymap,hv/kvm_extra,hv/kvm_flag,hv/kvm_path,hv/kvm_pci_reservations,hv/machine_version,hv/mem_path,hv/migration_caps,hv/migration_downtime,hv/nic_type,hv/num_ttys,hv/pae,hv/pci_pass,hv/reboot_behavior,hv/root_path,hv/scsi_controller_type,hv/security_domain,hv/security_model,hv/serial_console,hv/serial_speed,hv/soundhw,hv/spice_bind,hv/spice_image_compression,hv/spice_ip_version,hv/spice_jpeg_wan_compression,hv/spice_password_file,hv/spice_playback_compression,hv/spice_streaming_video,hv/spice_tls_ciphers,hv/spice_use_tls,hv/spice_use_vdagent,hv/spice_zlib_glz_wan_compression,hv/startup_timeout,hv/usb_devices,hv/usb_mouse,hv/use_bootloader,hv/use_chroot,hv/use_guest_agent,hv/use_localtime,hv/user_shutdown,hv/vga,hv/vhost_net,hv/vif_script,hv/vif_type,hv/viridian,hv/virtio_disk_iothreads,hv/virtio_net_queues,hv/vnc_bind_address,hv/vnc_password_file,hv/vnc_tls,hv/vnc_x509_path,hv/vnc_x509_verify,hv/vnet_hdr,hvparams,hypervisor,ip,mac,mtime,name,network_port,nic.bridge/0,nic.bridge/1,nic.bridge/2,nic.bridge/3,nic.bridge/4,nic.bridge/5,nic.bridge/6,nic.bridge/7,nic.bridges,nic.count,nic.ip/0,nic.ip/1,nic.ip/2,nic.ip/3,nic.ip/4,nic.ip/5,nic.ip/6,nic.ip/7,nic.ips,nic.link/0,nic.link/1,nic.link/2,nic.link/3,nic.link/4,nic.link/5,nic.link/6,nic.link/7,nic.links,nic.mac/0,nic.mac/1,nic.mac/2,nic.mac/3,nic.mac/4,nic.mac/5,nic.mac/6,nic.mac/7,nic.macs,nic.mode/0,nic.mode/1,nic.mode/2,nic.mode/3,nic.mode/4,nic.mode/5,nic.mode/6,nic.mode/7,nic.modes,nic.name/0,nic.name/1,nic.name/2,nic.name/3,nic.name/4,nic.name/5,nic.name/6,nic.name/7,nic.names,nic.network.name/0,nic.network.name/1,nic.network.name/2,nic.network.name/3,nic.network.name/4,nic.network.name/5,nic.network.name/6,nic.network.name/7,nic.network/0,nic.network/1,nic.network/2,nic.network/3,nic.network/4,nic.network/5,nic.network/6,nic.network/7,nic.networks,nic.networks.names,nic.uuid/0,nic.uuid/1,nic.uuid/2,nic.uuid/3,nic.uuid/4,nic.uuid/5,nic.uuid/6,nic.uuid/7,nic.uuids,nic.vlan/0,nic.vlan/1,nic.vlan/2,nic.vlan/3,nic.vlan/4,nic.vlan/5,nic.vlan/6,nic.vlan/7,nic.vlans,nic_link,nic_mode,nic_network,oper_ram,oper_state,oper_vcpus,os,osparams,pnode,pnode.group,pnode.group.uuid,sda_size,sdb_size,serial_no,snodes,snodes.group,snodes.group.uuid,status,tags,uuid,vcpus >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.vlan/7,nic.bridge/5,disk.name/6,hv/num_ttys,nic.network/6,hv/usb_mouse,hv/spice_tls_ciphers,custom_hvparams,nic.ip/0,nic.mac/4,nic.mode/4,disks_active,disk.uuid/4,nic_network,hv/vif_type,nic.count,nic.mode/2,nic.mac/0,nic.ip/1,hv/machine_version,be/minmem,uuid,hv/spice_zlib_glz_wan_compression,disk.size/15,nic.mac/3,sda_size,nic_mode,disk.spindles/1,hv/use_chroot,hv/security_model,hv/initrd_path,nic.network.name/5,disk.name/1,hv/bootloader_path,disk.spindles/2,hv/cdrom_disk_type,hv/cpu_cap,hv/kvm_pci_reservations,nic.names,nic.name/1,hv/keymap,nic.uuid/2,pnode.group,nic.network/4,hv/pci_pass,disk.size/5,disk.size/10,snodes,nic.ip/7,oper_vcpus,nic.link/7,hv/blockdev_prefix,hv/cpu_weight,hv/boot_order,hv/extra_cgroups,hv/spice_password_file,nic.mac/5,disk.size/7,nic.name/0,pnode.group.uuid,nic.uuid/1,disk.name/7,hv/spice_image_compression,disk.uuids,disk.name/15,nic.name/6,disk.sizes,disk.size/12,nic.mode/7,nic.networks,hv/user_shutdown,disk.spindles/12,nic.name/2,nic.network/7,nic.network/3,hv/spice_streaming_video,nic.link/2,hv/cpuid,disk.size/6,vcpus,disk.spindles,disk.uuid/15,be/auto_balance,mtime,disk.uuid/13,disk.size/1,nic.mac/1,nic.vlan/5,disk.size/14,pnode,nic.network.name/3,nic.vlan/1,hv/cpu_cores,disk.name/12,nic.vlan/3,nic.network.name/2,hv/vif_script,nic.network/5,nic.mode/1,nic.links,nic.link/0,disk.spindles/7,nic.mode/5,nic.link/4,hv/disk_cache,nic.bridge/6,nic.mac/6,disk.name/2,disk.name/14,disk.name/5,disk.spindles/13,network_port,name,disk.uuid/2,hv/use_bootloader,be/maxmem,nic.name/4,hv/cpu_threads,forthcoming,nic.vlan/0,hv/use_localtime,nic.network.name/7,nic.mode/0,osparams,disk.name/10,serial_no,nic.uuid/4,hv/security_domain,beparams,disk.name/8,disk.name/9,disk.spindles/10,hv/vnc_x509_path,nic.uuid/0,nic.network/0,hv/cdrom2_image_path,hv/spice_jpeg_wan_compression,hv/vhost_net,disk_template,hv/virtio_net_queues,nic.bridges,disk.spindles/14,nic.mode/6,nic.mode/3,hv/migration_downtime,hv/vnc_password_file,nic.link/3,hv/disk_discard,hv/vnet_hdr,hv/init_script,console,disk.size/3,hv/acpi,nic.vlan/2,disk.spindles/0,nic.uuid/5,disk.size/9,hv/spice_ip_version,disk.uuid/7,hv/spice_use_vdagent,nic.bridge/7,hv/kernel_path,ctime,nic.bridge/4,status,oper_state,hv/migration_caps,disk.names,hv/kernel_args,disk.count,disk.size/0,hv/mem_path,disk.uuid/6,hv/viridian,hv/scsi_controller_type,hv/drop_capabilities,hv/vga,hv/virtio_disk_iothreads,nic.network.name/6,disk.size/11,hv/device_model,nic.uuid/3,nic.bridge/2,hv/vnc_bind_address,nic.ip/6,disk.spindles/4,nic.link/1,disk.uuid/3,nic.ip/2,hv/kvm_extra,disk.uuid/9,nic.vlan/6,hv/usb_devices,disk.uuid/10,be/vcpus,disk.size/4,disk.uuid/5,hv/vnc_x509_verify,oper_ram,nic.uuid/7,nic.ip/4,nic.uuid/6,nic.name/7,nic.ip/3,hvparams,hv/startup_timeout,disk.size/8,hv/disk_type,custom_nicparams,disk.spindles/11,nic.network.name/0,mac,be/always_failover,admin_state,nic.macs,disk.name/13,nic.network/1,hv/kvm_flag,hv/soundhw,hv/floppy_image_path,nic.vlans,nic.name/5,nic.mac/2,hv/reboot_behavior,disk_usage,nic.uuids,hv/pae,hv/cpu_mask,nic.link/6,admin_state_source,nic.networks.names,disk.uuid/8,sdb_size,hv/extra_config,disk.spindles/6,disk.name/3,snodes.group.uuid,nic.network/2,nic.bridge/1,hv/disk_aio,custom_osparams,nic_link,snodes.group,disk.uuid/12,hv/vnc_tls,disk.name/11,hv/kvm_path,disk.name/0,tags,hv/spice_bind,hv/spice_use_tls,hv/use_guest_agent,hv/spice_playback_compression,disk.spindles/3,hv/cpu_sockets,nic.bridge/3,nic.ip/5,hv/devices,disk.name/4,disk.uuid/14,nic.network.name/1,bridge,disk.spindles/15,hypervisor,nic.ips,disk.size/13,nic.modes,custom_beparams,be/memory,disk.spindles/8,os,nic.name/3,nic.vlan/4,disk.uuid/1,disk.spindles/5,nic.mac/7,hv/cpu_type,hv/cdrom_image_path,admin_up,hv/root_path,hv/serial_speed,disk.size/2,disk.spindles/9,nic.link/5,ip,hv/serial_console,nic.network.name/4,hv/bootloader_args,disk.uuid/11,hv/nic_type,disk.uuid/0,nic.bridge/0,be/spindle_use,nic.vlan/7,nic.bridge/5,disk.name/6,hv/num_ttys,nic.network/6,hv/usb_mouse,hv/spice_tls_ciphers,custom_hvparams,nic.ip/0,nic.mac/4,nic.mode/4,disks_active,disk.uuid/4,nic_network,hv/vif_type,nic.count,nic.mode/2,nic.mac/0,nic.ip/1,hv/machine_version,be/minmem,uuid,hv/spice_zlib_glz_wan_compression,disk.size/15,nic.mac/3,sda_size,nic_mode,disk.spindles/1,hv/use_chroot,hv/security_model,hv/initrd_path,nic.network.name/5,disk.name/1,hv/bootloader_path,disk.spindles/2,hv/cdrom_disk_type,hv/cpu_cap,hv/kvm_pci_reservations,nic.names,nic.name/1,hv/keymap,nic.uuid/2,pnode.group,nic.network/4,hv/pci_pass,disk.size/5,disk.size/10,snodes,nic.ip/7,oper_vcpus,nic.link/7,hv/blockdev_prefix,hv/cpu_weight,hv/boot_order,hv/extra_cgroups,hv/spice_password_file,nic.mac/5,disk.size/7,nic.name/0,pnode.group.uuid,nic.uuid/1,disk.name/7,hv/spice_image_compression,disk.uuids,disk.name/15,nic.name/6,disk.sizes,disk.size/12,nic.mode/7,nic.networks,hv/user_shutdown,disk.spindles/12,nic.name/2,nic.network/7,nic.network/3,hv/spice_streaming_video,nic.link/2,hv/cpuid,disk.size/6,vcpus,disk.spindles,disk.uuid/15,be/auto_balance,mtime,disk.uuid/13,disk.size/1,nic.mac/1,nic.vlan/5,disk.size/14,pnode,nic.network.name/3,nic.vlan/1,hv/cpu_cores,disk.name/12,nic.vlan/3,nic.network.name/2,hv/vif_script,nic.network/5,nic.mode/1,nic.links,nic.link/0,disk.spindles/7,nic.mode/5,nic.link/4,hv/disk_cache,nic.bridge/6,nic.mac/6,disk.name/2,disk.name/14,disk.name/5,disk.spindles/13,network_port,name,disk.uuid/2,hv/use_bootloader,be/maxmem,nic.name/4,hv/cpu_threads,forthcoming,nic.vlan/0,hv/use_localtime,nic.network.name/7,nic.mode/0,osparams,disk.name/10,serial_no,nic.uuid/4,hv/security_domain,beparams,disk.name/8,disk.name/9,disk.spindles/10,hv/vnc_x509_path,nic.uuid/0,nic.network/0,hv/cdrom2_image_path,hv/spice_jpeg_wan_compression,hv/vhost_net,disk_template,hv/virtio_net_queues,nic.bridges,disk.spindles/14,nic.mode/6,nic.mode/3,hv/migration_downtime,hv/vnc_password_file,nic.link/3,hv/disk_discard,hv/vnet_hdr,hv/init_script,console,disk.size/3,hv/acpi,nic.vlan/2,disk.spindles/0,nic.uuid/5,disk.size/9,hv/spice_ip_version,disk.uuid/7,hv/spice_use_vdagent,nic.bridge/7,hv/kernel_path,ctime,nic.bridge/4,status,oper_state,hv/migration_caps,disk.names,hv/kernel_args,disk.count,disk.size/0,hv/mem_path,disk.uuid/6,hv/viridian,hv/scsi_controller_type,hv/drop_capabilities,hv/vga,hv/virtio_disk_iothreads,nic.network.name/6,disk.size/11,hv/device_model,nic.uuid/3,nic.bridge/2,hv/vnc_bind_address,nic.ip/6,disk.spindles/4,nic.link/1,disk.uuid/3,nic.ip/2,hv/kvm_extra,disk.uuid/9,nic.vlan/6,hv/usb_devices,disk.uuid/10,be/vcpus,disk.size/4,disk.uuid/5,hv/vnc_x509_verify,oper_ram,nic.uuid/7,nic.ip/4,nic.uuid/6,nic.name/7,nic.ip/3,hvparams,hv/startup_timeout,disk.size/8,hv/disk_type,custom_nicparams,disk.spindles/11,nic.network.name/0,mac,be/always_failover,admin_state,nic.macs,disk.name/13,nic.network/1,hv/kvm_flag,hv/soundhw,hv/floppy_image_path,nic.vlans,nic.name/5,nic.mac/2,hv/reboot_behavior,disk_usage,nic.uuids,hv/pae,hv/cpu_mask,nic.link/6,admin_state_source,nic.networks.names,disk.uuid/8,sdb_size,hv/extra_config,disk.spindles/6,disk.name/3,snodes.group.uuid,nic.network/2,nic.bridge/1,hv/disk_aio,custom_osparams,nic_link,snodes.group,disk.uuid/12,hv/vnc_tls,disk.name/11,hv/kvm_path,disk.name/0,tags,hv/spice_bind,hv/spice_use_tls,hv/use_guest_agent,hv/spice_playback_compression,disk.spindles/3,hv/cpu_sockets,nic.bridge/3,nic.ip/5,hv/devices,disk.name/4,disk.uuid/14,nic.network.name/1,bridge,disk.spindles/15,hypervisor,nic.ips,disk.size/13,nic.modes,custom_beparams,be/memory,disk.spindles/8,os,nic.name/3,nic.vlan/4,disk.uuid/1,disk.spindles/5,nic.mac/7,hv/cpu_type,hv/cdrom_image_path,admin_up,hv/root_path,hv/serial_speed,disk.size/2,disk.spindles/9,nic.link/5,ip,hv/serial_console,nic.network.name/4,hv/bootloader_args,disk.uuid/11,hv/nic_type,disk.uuid/0,nic.bridge/0,be/spindle_use >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output be/spindle_use,nic.bridge/0,disk.uuid/0,hv/nic_type,disk.uuid/11,hv/bootloader_args >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.network.name/4,hv/serial_console,ip,nic.link/5,disk.spindles/9,disk.size/2,hv/serial_speed,hv/root_path,admin_up,hv/cdrom_image_path >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/cpu_type,nic.mac/7 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.spindles/5,disk.uuid/1,nic.vlan/4,nic.name/3,os,disk.spindles/8,be/memory,custom_beparams,nic.modes >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.size/13,nic.ips,hypervisor,disk.spindles/15,bridge,nic.network.name/1,disk.uuid/14,disk.name/4,hv/devices,nic.ip/5 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.bridge/3,hv/cpu_sockets,disk.spindles/3,hv/spice_playback_compression,hv/use_guest_agent,hv/spice_use_tls,hv/spice_bind,tags,disk.name/0,hv/kvm_path >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.name/11,hv/vnc_tls,disk.uuid/12,snodes.group,nic_link,custom_osparams,hv/disk_aio,nic.bridge/1 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.network/2,snodes.group.uuid,disk.name/3,disk.spindles/6,hv/extra_config,sdb_size,disk.uuid/8,nic.networks.names,admin_state_source >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.link/6,hv/cpu_mask,hv/pae,nic.uuids,disk_usage,hv/reboot_behavior,nic.mac/2,nic.name/5,nic.vlans,hv/floppy_image_path >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/soundhw,hv/kvm_flag >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.network/1,disk.name/13,nic.macs >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output admin_state,be/always_failover >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output mac,nic.network.name/0,disk.spindles/11,custom_nicparams,hv/disk_type,disk.size/8,hv/startup_timeout,hvparams >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.ip/3,nic.name/7,nic.uuid/6,nic.ip/4,nic.uuid/7,oper_ram >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/vnc_x509_verify,disk.uuid/5,disk.size/4,be/vcpus,disk.uuid/10,hv/usb_devices,nic.vlan/6 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.uuid/9,hv/kvm_extra,nic.ip/2 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.uuid/3,nic.link/1,disk.spindles/4 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.ip/6,hv/vnc_bind_address,nic.bridge/2,nic.uuid/3,hv/device_model,disk.size/11 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.network.name/6,hv/virtio_disk_iothreads,hv/vga,hv/drop_capabilities,hv/scsi_controller_type,hv/viridian,disk.uuid/6 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/mem_path,disk.size/0,disk.count,hv/kernel_args,disk.names,hv/migration_caps >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output oper_state,status,nic.bridge/4,ctime,hv/kernel_path,nic.bridge/7,hv/spice_use_vdagent,disk.uuid/7,hv/spice_ip_version,disk.size/9 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.uuid/5,disk.spindles/0,nic.vlan/2,hv/acpi >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.size/3,console,hv/init_script,hv/vnet_hdr,hv/disk_discard,nic.link/3 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/vnc_password_file,hv/migration_downtime,nic.mode/3,nic.mode/6,disk.spindles/14,nic.bridges,hv/virtio_net_queues >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk_template,hv/vhost_net,hv/spice_jpeg_wan_compression,hv/cdrom2_image_path >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.network/0,nic.uuid/0,hv/vnc_x509_path,disk.spindles/10 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.name/9,disk.name/8 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output beparams,hv/security_domain,nic.uuid/4,serial_no,disk.name/10,osparams,nic.mode/0,nic.network.name/7,hv/use_localtime >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.vlan/0,forthcoming,hv/cpu_threads,nic.name/4,be/maxmem,hv/use_bootloader,disk.uuid/2,name >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output network_port,disk.spindles/13,disk.name/5,disk.name/14,disk.name/2,nic.mac/6,nic.bridge/6,hv/disk_cache,nic.link/4,nic.mode/5 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.spindles/7,nic.link/0,nic.links,nic.mode/1,nic.network/5,hv/vif_script >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.network.name/2,nic.vlan/3,disk.name/12,hv/cpu_cores,nic.vlan/1,nic.network.name/3,pnode,disk.size/14,nic.vlan/5,nic.mac/1 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.size/1,disk.uuid/13,mtime,be/auto_balance,disk.uuid/15,disk.spindles,vcpus,disk.size/6,hv/cpuid,nic.link/2 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/spice_streaming_video,nic.network/3,nic.network/7 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.name/2,disk.spindles/12,hv/user_shutdown,nic.networks,nic.mode/7,disk.size/12 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.sizes,nic.name/6 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.name/15,disk.uuids,hv/spice_image_compression,disk.name/7,nic.uuid/1 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output pnode.group.uuid,nic.name/0,disk.size/7,nic.mac/5,hv/spice_password_file,hv/extra_cgroups >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/boot_order,hv/cpu_weight,hv/blockdev_prefix,nic.link/7,oper_vcpus,nic.ip/7,snodes,disk.size/10 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.size/5,hv/pci_pass,nic.network/4 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output pnode.group,nic.uuid/2,hv/keymap,nic.name/1,nic.names,hv/kvm_pci_reservations,hv/cpu_cap,hv/cdrom_disk_type >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.spindles/2,hv/bootloader_path,disk.name/1,nic.network.name/5,hv/initrd_path,hv/security_model,hv/use_chroot,disk.spindles/1,nic_mode,sda_size >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.mac/3,disk.size/15,hv/spice_zlib_glz_wan_compression,uuid,be/minmem,hv/machine_version,nic.ip/1,nic.mac/0,nic.mode/2 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.count,hv/vif_type,nic_network,disk.uuid/4,disks_active >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.mode/4,nic.mac/4,nic.ip/0,custom_hvparams,hv/spice_tls_ciphers >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/usb_mouse,nic.network/6,hv/num_ttys,disk.name/6,nic.bridge/5,nic.vlan/7 >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-instance list '\''--separator=|'\'' --no-headers --output name' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-instance list '\''--separator=|'\'' --no-headers --output name' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-instance list '\''--separator=|'\'' --no-headers --output name' Command: ssh moe.staging.ganeti.org 'gnt-instance list this.name.certainly.does.not.exist' Stderr was: Failure: prerequisites not met for this operation: error type: unknown_entity, error details: Instance name this.name.certainly.does.not.exist not found Command: ssh moe.staging.ganeti.org 'gnt-instance list --output=field/does/not/exist >> /var/log/ganeti/qa-output.log' Stderr was: ---- PASSED [TestInstanceList] gnt-instance list ----------------------- >>>> 2026-09-23 03:14:40.174037 time=0:00:11.195241 [TestInstanceList] gnt-instance list Warning: Queried for unknown fields field/does/not/exist <<<< 2026-09-23 03:14:40.174162 start [TestJobList] gnt-job list ------- Command: ssh moe.staging.ganeti.org 'gnt-job list --output id,ops,received_ts,priority,status,oplog,opexec,archived,summary,start_ts,opresult,opstatus,opstart,oppriority,opend,end_ts >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-job list --output archived,end_ts,id,opend,opexec,oplog,oppriority,opresult,ops,opstart,opstatus,priority,received_ts,start_ts,status,summary >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-job list --output id,ops,received_ts,priority,status,oplog,opexec,archived,summary,start_ts,opresult,opstatus,opstart,oppriority,opend,end_ts,id,ops,received_ts,priority,status,oplog,opexec,archived,summary,start_ts,opresult,opstatus,opstart,oppriority,opend,end_ts >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-job list --output end_ts,opend,oppriority,opstart,opstatus,opresult,start_ts,summary,archived,opexec >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-job list --output oplog,status,priority,received_ts,ops,id >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-job list '\''--separator=|'\'' --no-headers --output id' 1 2 3 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-job list '\''--separator=|'\'' --no-headers --output id 3 2 1' 3 2 1 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-job list '\''--separator=|'\'' --no-headers --output id 1 3 2' 1 3 2 Command: ssh moe.staging.ganeti.org 'gnt-job list --output=field/does/not/exist >> /var/log/ganeti/qa-output.log' Stderr was: ---- PASSED [TestJobList] gnt-job list --------------------------------- Warning: Queried for unknown fields field/does/not/exist >>>> 2026-09-23 03:14:41.998707 time=0:00:01.824545 [TestJobList] gnt-job list **** 2026-09-23 03:14:41.998865 skipping [TestNodeAddAll] Adding all nodes to cluster, test(s) create-cluster disabled <<<< 2026-09-23 03:14:41.998902 start [TestJobqueue] gnt-debug test-jobqueue Command: ssh moe.staging.ganeti.org 'gnt-debug test-jobqueue' Testing job submission Job submission tests were successful Testing job dependencies Submitted jobs 4, 5, 6, 7, 8 Waiting for job 4 ... Waiting for job 7 ... Waiting for job 5 ... Waiting for job 6 ... Waiting for job 8 ... Job dependency tests were successful Testing job success Wed Sep 23 03:14:51 2026 - INFO: Expanding names Wed Sep 23 03:14:51 2026 - INFO: Executing Wed Sep 23 03:14:51 2026 - INFO: Sending log message 1 Wed Sep 23 03:14:51 2026 - INFO: Sending log message 2 Wed Sep 23 03:14:51 2026 - INFO: Sending log message 3 Wed Sep 23 03:14:51 2026 - INFO: Sending log message 4 Wed Sep 23 03:14:51 2026 - INFO: Sending log message 5 Wed Sep 23 03:14:52 2026 - INFO: Sending log message 6 Wed Sep 23 03:14:52 2026 - INFO: Sending log message 7 Testing multiple successful opcodes Wed Sep 23 03:14:53 2026 - INFO: Expanding names Wed Sep 23 03:14:53 2026 - INFO: Executing Wed Sep 23 03:14:53 2026 - INFO: Sending log message 1 Wed Sep 23 03:14:53 2026 - INFO: Sending log message 2 Wed Sep 23 03:14:53 2026 - INFO: Sending log message 3 Wed Sep 23 03:14:53 2026 - INFO: Sending log message 4 Wed Sep 23 03:14:53 2026 - INFO: Sending log message 5 Wed Sep 23 03:14:53 2026 - INFO: Sending log message 6 Wed Sep 23 03:14:54 2026 - INFO: Sending log message 7 Wed Sep 23 03:14:54 2026 - INFO: Expanding names Wed Sep 23 03:14:54 2026 - INFO: Executing Wed Sep 23 03:14:54 2026 - INFO: Sending log message 1 Wed Sep 23 03:14:54 2026 - INFO: Sending log message 2 Wed Sep 23 03:14:54 2026 - INFO: Sending log message 3 Wed Sep 23 03:14:54 2026 - INFO: Sending log message 4 Wed Sep 23 03:14:55 2026 - INFO: Sending log message 5 Wed Sep 23 03:14:55 2026 - INFO: Sending log message 6 Wed Sep 23 03:14:55 2026 - INFO: Sending log message 7 Testing job failure Wed Sep 23 03:14:56 2026 - INFO: Expanding names Wed Sep 23 03:14:56 2026 - INFO: Executing Wed Sep 23 03:14:56 2026 - INFO: Sending log message 1 Wed Sep 23 03:14:56 2026 - INFO: Sending log message 2 Wed Sep 23 03:14:56 2026 - INFO: Sending log message 3 Wed Sep 23 03:14:56 2026 - INFO: Sending log message 4 Wed Sep 23 03:14:56 2026 - INFO: Sending log message 5 Wed Sep 23 03:14:57 2026 - INFO: Sending log message 6 Wed Sep 23 03:14:57 2026 - INFO: Sending log message 7 Ignoring error for 'job fail' test: Opcode failure was requested Testing partial job failure Wed Sep 23 03:14:58 2026 - INFO: Expanding names Wed Sep 23 03:14:58 2026 - INFO: Executing Wed Sep 23 03:14:58 2026 - INFO: Sending log message 1 Wed Sep 23 03:14:58 2026 - INFO: Sending log message 2 Wed Sep 23 03:14:58 2026 - INFO: Sending log message 3 Wed Sep 23 03:14:58 2026 - INFO: Sending log message 4 Wed Sep 23 03:14:58 2026 - INFO: Sending log message 5 Wed Sep 23 03:14:58 2026 - INFO: Sending log message 6 Wed Sep 23 03:14:59 2026 - INFO: Sending log message 7 Wed Sep 23 03:14:59 2026 - INFO: Expanding names Wed Sep 23 03:14:59 2026 - INFO: Executing Wed Sep 23 03:14:59 2026 - INFO: Sending log message 1 Wed Sep 23 03:14:59 2026 - INFO: Sending log message 2 Wed Sep 23 03:14:59 2026 - INFO: Sending log message 3 Wed Sep 23 03:14:59 2026 - INFO: Sending log message 4 Wed Sep 23 03:15:00 2026 - INFO: Sending log message 5 Wed Sep 23 03:15:00 2026 - INFO: Sending log message 6 Wed Sep 23 03:15:00 2026 - INFO: Sending log message 7 Wed Sep 23 03:15:00 2026 - INFO: Expanding names Wed Sep 23 03:15:00 2026 - INFO: Executing Wed Sep 23 03:15:01 2026 - INFO: Sending log message 1 Wed Sep 23 03:15:01 2026 - INFO: Sending log message 2 Wed Sep 23 03:15:01 2026 - INFO: Sending log message 3 Wed Sep 23 03:15:01 2026 - INFO: Sending log message 4 Wed Sep 23 03:15:01 2026 - INFO: Sending log message 5 Wed Sep 23 03:15:01 2026 - INFO: Sending log message 6 Wed Sep 23 03:15:01 2026 - INFO: Sending log message 7 Ignoring error for 'job fail' test: Opcode failure was requested Job queue test successful ---- PASSED [TestJobqueue] gnt-debug test-jobqueue --------------------- >>>> 2026-09-23 03:15:01.915153 time=0:00:19.916251 [TestJobqueue] gnt-debug test-jobqueue <<<< 2026-09-23 03:15:01.915446 start [TestJobCancellation] gnt-job cancel Command: ssh moe.staging.ganeti.org 'gnt-debug delay --submit 10.0' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-debug delay --submit 3.0 2>&1'JobID: 13 JobID: 14 Command: ssh moe.staging.ganeti.org 'gnt-job cancel 14' Job successfully cancelled Command: ssh moe.staging.ganeti.org 'gnt-job watch 14' Stdout was: Output from job 14 follows -------------------------- Stderr was: Job 14 failed: Unhandled Ganeti error: Job was canceled Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-job list --no-headers --output=id,status 14 2>&1' 14 canceled ---- PASSED [TestJobCancellation] gnt-job cancel ----------------------- >>>> 2026-09-23 03:15:08.928331 time=0:00:07.012885 [TestJobCancellation] gnt-job cancel <<<< 2026-09-23 03:15:08.928548 start [TestResumeWatcher] Tests and unpauses the watcher Command: ssh moe.staging.ganeti.org 'gnt-cluster watcher continue' The watcher is no longer paused. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-cluster watcher info' The watcher is not paused. ---- PASSED [TestResumeWatcher] Tests and unpauses the watcher --------- >>>> 2026-09-23 03:15:09.657152 time=0:00:00.728604 [TestResumeWatcher] Tests and unpauses the watcher <<<< 2026-09-23 03:15:09.657309 start [TestNodeList] gnt-node list ----- Command: ssh moe.staging.ganeti.org 'gnt-node list --output sptotal,bootid,mtime,vm_capable,ndp/cpu_speed,tags,pinst_list,disk_state,cnos,ndp/ovs_name,uuid,name,pip,ndp/exclusive_storage,group.uuid,ndp/oob_program,sinst_cnt,cnodes,hv_state,master,custom_ndparams,ndp/ovs_link,dfree,ndparams,drained,master_capable,role,ndp/spindle_count,group,master_candidate,mtotal,ndp/ovs,sip,ctime,dtotal,ndp/ssh_port,spfree,serial_no,powered,ctotal,csockets,offline,pinst_cnt,mnode,sinst_list,mfree >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output bootid,cnodes,cnos,csockets,ctime,ctotal,custom_ndparams,dfree,disk_state,drained,dtotal,group,group.uuid,hv_state,master,master_candidate,master_capable,mfree,mnode,mtime,mtotal,name,ndp/cpu_speed,ndp/exclusive_storage,ndp/oob_program,ndp/ovs,ndp/ovs_link,ndp/ovs_name,ndp/spindle_count,ndp/ssh_port,ndparams,offline,pinst_cnt,pinst_list,pip,powered,role,serial_no,sinst_cnt,sinst_list,sip,spfree,sptotal,tags,uuid,vm_capable >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output sptotal,bootid,mtime,vm_capable,ndp/cpu_speed,tags,pinst_list,disk_state,cnos,ndp/ovs_name,uuid,name,pip,ndp/exclusive_storage,group.uuid,ndp/oob_program,sinst_cnt,cnodes,hv_state,master,custom_ndparams,ndp/ovs_link,dfree,ndparams,drained,master_capable,role,ndp/spindle_count,group,master_candidate,mtotal,ndp/ovs,sip,ctime,dtotal,ndp/ssh_port,spfree,serial_no,powered,ctotal,csockets,offline,pinst_cnt,mnode,sinst_list,mfree,sptotal,bootid,mtime,vm_capable,ndp/cpu_speed,tags,pinst_list,disk_state,cnos,ndp/ovs_name,uuid,name,pip,ndp/exclusive_storage,group.uuid,ndp/oob_program,sinst_cnt,cnodes,hv_state,master,custom_ndparams,ndp/ovs_link,dfree,ndparams,drained,master_capable,role,ndp/spindle_count,group,master_candidate,mtotal,ndp/ovs,sip,ctime,dtotal,ndp/ssh_port,spfree,serial_no,powered,ctotal,csockets,offline,pinst_cnt,mnode,sinst_list,mfree >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output mfree,sinst_list,mnode,pinst_cnt >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output offline,csockets,ctotal,powered,serial_no,spfree,ndp/ssh_port,dtotal,ctime,sip >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output ndp/ovs,mtotal,master_candidate,group,ndp/spindle_count,role >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output master_capable,drained,ndparams,dfree,ndp/ovs_link >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output custom_ndparams,master,hv_state,cnodes,sinst_cnt,ndp/oob_program >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output group.uuid,ndp/exclusive_storage,pip,name,uuid,ndp/ovs_name,cnos,disk_state >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output pinst_list,tags,ndp/cpu_speed,vm_capable,mtime,bootid >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output sptotal >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list '\''--separator=|'\'' --no-headers --output name' bart.staging.ganeti.org lisa.staging.ganeti.org moe.staging.ganeti.org Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list '\''--separator=|'\'' --no-headers --output name moe.staging.ganeti.org lisa.staging.ganeti.org bart.staging.ganeti.org' moe.staging.ganeti.org lisa.staging.ganeti.org bart.staging.ganeti.org Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list '\''--separator=|'\'' --no-headers --output name bart.staging.ganeti.org lisa.staging.ganeti.org moe.staging.ganeti.org' bart.staging.ganeti.org lisa.staging.ganeti.org moe.staging.ganeti.org Command: ssh moe.staging.ganeti.org 'gnt-node list this.name.certainly.does.not.exist' Stderr was: Failure: prerequisites not met for this operation: error type: unknown_entity, error details: Node name this.name.certainly.does.not.exist not found Command: ssh moe.staging.ganeti.org 'gnt-node list --output=field/does/not/exist >> /var/log/ganeti/qa-output.log' Stderr was: ---- PASSED [TestNodeList] gnt-node list ------------------------------- >>>> 2026-09-23 03:15:16.469004 time=0:00:06.811695 [TestNodeList] gnt-node list Warning: Queried for unknown fields field/does/not/exist <<<< 2026-09-23 03:15:16.469157 start [TestNodeListFields] gnt-node list-fields Command: ssh moe.staging.ganeti.org 'gnt-node list-fields >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list-fields pip sip tags master group group.uuid powered ndparams custom_ndparams hv_state disk_state ndp/cpu_speed ndp/exclusive_storage ndp/oob_program ndp/ovs ndp/ovs_link ndp/ovs_name ndp/spindle_count ndp/ssh_port role pinst_cnt pinst_list sinst_cnt sinst_list drained master_candidate master_capable name offline serial_no uuid vm_capable bootid cnodes cnos csockets ctotal dfree dtotal spfree sptotal mfree mnode mtotal ctime mtime >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-fields '\''--separator=|'\'' --no-headers' bootid|Text|BootID|Random UUID renewed for each system reboot, can be used for detecting reboots by tracking changes cnodes|Number|CNodes|Number of NUMA domains on node (if exported by hypervisor) cnos|Number|CNOs|Number of logical processors used by the node OS (dom0 for Xen) csockets|Number|CSockets|Number of physical CPU sockets (if exported by hypervisor) ctime|Timestamp|CTime|Creation timestamp ctotal|Number|CTotal|Number of logical processors custom_ndparams|Custom|CustomNodeParameters|Custom node parameters dfree|Storage size|DFree|Available storage space on storage unit disk_state|Custom|DiskState|Disk state drained|Boolean|Drained|Whether node is drained dtotal|Storage size|DTotal|Total storage space on storage unit for instance disk allocation group|Text|Group|Node group group.uuid|Text|GroupUUID|UUID of node group hv_state|Custom|HypervisorState|Hypervisor state master|Boolean|IsMaster|Whether node is master master_candidate|Boolean|MasterC|Whether node is a master candidate master_capable|Boolean|MasterCapable|Whether node can become a master candidate mfree|Storage size|MFree|Memory available for instance allocations mnode|Storage size|MNode|Amount of memory used by node (dom0 for Xen) mtime|Timestamp|MTime|Modification timestamp mtotal|Storage size|MTotal|Total amount of memory of physical machine name|Text|Node|Node name ndp/cpu_speed|Floating-point number|ndp/cpu_speed|The "cpu_speed" node parameter ndp/exclusive_storage|Boolean|ExclusiveStorage|The "exclusive_storage" node parameter ndp/oob_program|Custom|OutOfBandProgram|The "oob_program" node parameter ndp/ovs|Boolean|OpenvSwitch|The "ovs" node parameter ndp/ovs_link|Custom|OpenvSwitchLink|The "ovs_link" node parameter ndp/ovs_name|Custom|OpenvSwitchName|The "ovs_name" node parameter ndp/spindle_count|Number|SpindleCount|The "spindle_count" node parameter ndp/ssh_port|Number|ndp/ssh_port|The "ssh_port" node parameter ndparams|Custom|NodeParameters|Merged node parameters offline|Boolean|Offline|Whether node is marked offline pinst_cnt|Number|Pinst|Number of instances with this node as primary pinst_list|Custom|PriInstances|List of instances with this node as primary pip|Text|PrimaryIP|Primary IP address powered|Boolean|Powered|Whether node is thought to be powered on role|Text|Role|Node role; "M" for master, "C" for master candidate, "R" for regular, "D" for drained, "O" for offline serial_no|Number|SerialNo|Node object serial number, incremented on each modification sinst_cnt|Number|Sinst|Number of instances with this node as secondary sinst_list|Custom|SecInstances|List of instances with this node as secondary sip|Text|SecondaryIP|Secondary IP address spfree|Number|SpFree|Available spindles in volume group (exclusive storage only) sptotal|Number|SpTotal|Total spindles in volume group (exclusive storage only) tags|Custom|Tags|Tags uuid|Text|UUID|Node UUID vm_capable|Boolean|VMCapable|Whether node can host instances Command: ssh moe.staging.ganeti.org 'gnt-node list-fields field/does/not/exist' Stdout was: Name Type Title Description field/does/not/exist Unknown field/does/not/exist Unknown field 'field/does/not/exist' Stderr was: ---- PASSED [TestNodeListFields] gnt-node list-fields ------------------ Warning: Queried for unknown fields field/does/not/exist >>>> 2026-09-23 03:15:17.582323 time=0:00:01.113166 [TestNodeListFields] gnt-node list-fields <<<< 2026-09-23 03:15:17.582532 start [TestInstanceListFields] gnt-instance list-fields Command: ssh moe.staging.ganeti.org 'gnt-instance list-fields >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list-fields pnode pnode.group pnode.group.uuid snodes snodes.group snodes.group.uuid admin_state admin_up admin_state_source disks_active tags console forthcoming disk_template hypervisor name network_port os serial_no uuid oper_state oper_ram oper_vcpus status nic.count nic.macs nic.ips nic.names nic.uuids nic.modes nic.links nic.vlans nic.bridges nic.networks nic.networks.names nic.ip/0 nic.mac/0 nic.name/0 nic.uuid/0 nic.mode/0 nic.link/0 nic.bridge/0 nic.vlan/0 nic.network/0 nic.network.name/0 nic.ip/1 nic.mac/1 nic.name/1 nic.uuid/1 nic.mode/1 nic.link/1 nic.bridge/1 nic.vlan/1 nic.network/1 nic.network.name/1 nic.ip/2 nic.mac/2 nic.name/2 nic.uuid/2 nic.mode/2 nic.link/2 nic.bridge/2 nic.vlan/2 nic.network/2 nic.network.name/2 nic.ip/3 nic.mac/3 nic.name/3 nic.uuid/3 nic.mode/3 nic.link/3 nic.bridge/3 nic.vlan/3 nic.network/3 nic.network.name/3 nic.ip/4 nic.mac/4 nic.name/4 nic.uuid/4 nic.mode/4 nic.link/4 nic.bridge/4 nic.vlan/4 nic.network/4 nic.network.name/4 nic.ip/5 nic.mac/5 nic.name/5 nic.uuid/5 nic.mode/5 nic.link/5 nic.bridge/5 nic.vlan/5 nic.network/5 nic.network.name/5 nic.ip/6 nic.mac/6 nic.name/6 nic.uuid/6 nic.mode/6 nic.link/6 nic.bridge/6 nic.vlan/6 nic.network/6 nic.network.name/6 nic.ip/7 nic.mac/7 nic.name/7 nic.uuid/7 nic.mode/7 nic.link/7 nic.bridge/7 nic.vlan/7 nic.network/7 nic.network.name/7 hvparams beparams osparams custom_hvparams custom_beparams custom_osparams custom_nicparams hv/acpi hv/blockdev_prefix hv/boot_order hv/bootloader_args hv/bootloader_path hv/cdrom2_image_path hv/cdrom_disk_type hv/cdrom_image_path hv/cpu_cap hv/cpu_cores hv/cpu_mask hv/cpu_sockets hv/cpu_threads hv/cpu_type hv/cpu_weight hv/cpuid hv/device_model hv/devices hv/disk_aio hv/disk_cache hv/disk_discard hv/disk_type hv/drop_capabilities hv/extra_cgroups hv/extra_config hv/floppy_image_path hv/init_script hv/initrd_path hv/kernel_args hv/kernel_path hv/keymap hv/kvm_extra hv/kvm_flag hv/kvm_path hv/kvm_pci_reservations hv/machine_version hv/mem_path hv/migration_caps hv/migration_downtime hv/nic_type hv/num_ttys hv/pae hv/pci_pass hv/reboot_behavior hv/root_path hv/scsi_controller_type hv/security_domain hv/security_model hv/serial_console hv/serial_speed hv/soundhw hv/spice_bind hv/spice_image_compression hv/spice_ip_version hv/spice_jpeg_wan_compression hv/spice_password_file hv/spice_playback_compression hv/spice_streaming_video hv/spice_tls_ciphers hv/spice_use_tls hv/spice_use_vdagent hv/spice_zlib_glz_wan_compression hv/startup_timeout hv/usb_devices hv/usb_mouse hv/use_bootloader hv/use_chroot hv/use_guest_agent hv/use_localtime hv/user_shutdown hv/vga hv/vhost_net hv/vif_script hv/vif_type hv/viridian hv/virtio_disk_iothreads hv/virtio_net_queues hv/vnc_bind_address hv/vnc_password_file hv/vnc_tls hv/vnc_x509_path hv/vnc_x509_verify hv/vnet_hdr be/always_failover be/auto_balance be/maxmem be/minmem be/spindle_use be/vcpus disk_usage disk.count disk.sizes disk.spindles disk.names disk.uuids disk.size/0 disk.spindles/0 disk.name/0 disk.uuid/0 disk.size/1 disk.spindles/1 disk.name/1 disk.uuid/1 disk.size/2 disk.spindles/2 disk.name/2 disk.uuid/2 disk.size/3 disk.spindles/3 disk.name/3 disk.uuid/3 disk.size/4 disk.spindles/4 disk.name/4 disk.uuid/4 disk.size/5 disk.spindles/5 disk.name/5 disk.uuid/5 disk.size/6 disk.spindles/6 disk.name/6 disk.uuid/6 disk.size/7 disk.spindles/7 disk.name/7 disk.uuid/7 disk.size/8 disk.spindles/8 disk.name/8 disk.uuid/8 disk.size/9 disk.spindles/9 disk.name/9 disk.uuid/9 disk.size/10 disk.spindles/10 disk.name/10 disk.uuid/10 disk.size/11 disk.spindles/11 disk.name/11 disk.uuid/11 disk.size/12 disk.spindles/12 disk.name/12 disk.uuid/12 disk.size/13 disk.spindles/13 disk.name/13 disk.uuid/13 disk.size/14 disk.spindles/14 disk.name/14 disk.uuid/14 disk.size/15 disk.spindles/15 disk.name/15 disk.uuid/15 ctime mtime vcpus be/memory sda_size sdb_size ip mac bridge nic_mode nic_link nic_network >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-instance list-fields '\''--separator=|'\'' --no-headers' admin_state|Text|InstanceState|Desired state of instance admin_state_source|Text|InstanceStateSource|Who last changed the desired state of the instance admin_up|Boolean|Autostart|Desired state of instance be/always_failover|Boolean|be/always_failover|The "always_failover" backend parameter be/auto_balance|Boolean|Auto_balance|The "auto_balance" backend parameter be/maxmem|Storage size|ConfigMaxMem|The "maxmem" backend parameter be/memory|Storage size|ConfigMaxMem|The "maxmem" backend parameter be/minmem|Storage size|ConfigMinMem|The "minmem" backend parameter be/spindle_use|Number|be/spindle_use|The "spindle_use" backend parameter be/vcpus|Number|ConfigVCPUs|The "vcpus" backend parameter beparams|Custom|BackendParameters|Backend parameters (merged) bridge|Text|NicBridge/0|Bridge of 1st network interface console|Custom|Console|Instance console information ctime|Timestamp|CTime|Creation timestamp custom_beparams|Custom|CustomBackendParameters|Custom backend parameters custom_hvparams|Custom|CustomHypervisorParameters|Custom hypervisor parameters custom_nicparams|Custom|CustomNicParameters|Custom network interface parameters custom_osparams|Custom|CustomOpSysParameters|Custom operating system parameters disk.count|Number|Disks|Number of disks disk.name/0|Text|DiskName/0|Name of 1st disk disk.name/1|Text|DiskName/1|Name of 2nd disk disk.name/2|Text|DiskName/2|Name of 3rd disk disk.name/3|Text|DiskName/3|Name of 4th disk disk.name/4|Text|DiskName/4|Name of 5th disk disk.name/5|Text|DiskName/5|Name of 6th disk disk.name/6|Text|DiskName/6|Name of 7th disk disk.name/7|Text|DiskName/7|Name of 8th disk disk.name/8|Text|DiskName/8|Name of 9th disk disk.name/9|Text|DiskName/9|Name of 10th disk disk.name/10|Text|DiskName/10|Name of 11th disk disk.name/11|Text|DiskName/11|Name of 12th disk disk.name/12|Text|DiskName/12|Name of 13th disk disk.name/13|Text|DiskName/13|Name of 14th disk disk.name/14|Text|DiskName/14|Name of 15th disk disk.name/15|Text|DiskName/15|Name of 16th disk disk.names|Custom|Disk_names|List of disk names disk.size/0|Storage size|Disk/0|Disk size of 1st disk disk.size/1|Storage size|Disk/1|Disk size of 2nd disk disk.size/2|Storage size|Disk/2|Disk size of 3rd disk disk.size/3|Storage size|Disk/3|Disk size of 4th disk disk.size/4|Storage size|Disk/4|Disk size of 5th disk disk.size/5|Storage size|Disk/5|Disk size of 6th disk disk.size/6|Storage size|Disk/6|Disk size of 7th disk disk.size/7|Storage size|Disk/7|Disk size of 8th disk disk.size/8|Storage size|Disk/8|Disk size of 9th disk disk.size/9|Storage size|Disk/9|Disk size of 10th disk disk.size/10|Storage size|Disk/10|Disk size of 11th disk disk.size/11|Storage size|Disk/11|Disk size of 12th disk disk.size/12|Storage size|Disk/12|Disk size of 13th disk disk.size/13|Storage size|Disk/13|Disk size of 14th disk disk.size/14|Storage size|Disk/14|Disk size of 15th disk disk.size/15|Storage size|Disk/15|Disk size of 16th disk disk.sizes|Custom|Disk_sizes|List of disk sizes disk.spindles|Custom|Disk_spindles|List of disk spindles disk.spindles/0|Number|DiskSpindles/0|Spindles of 1st disk disk.spindles/1|Number|DiskSpindles/1|Spindles of 2nd disk disk.spindles/2|Number|DiskSpindles/2|Spindles of 3rd disk disk.spindles/3|Number|DiskSpindles/3|Spindles of 4th disk disk.spindles/4|Number|DiskSpindles/4|Spindles of 5th disk disk.spindles/5|Number|DiskSpindles/5|Spindles of 6th disk disk.spindles/6|Number|DiskSpindles/6|Spindles of 7th disk disk.spindles/7|Number|DiskSpindles/7|Spindles of 8th disk disk.spindles/8|Number|DiskSpindles/8|Spindles of 9th disk disk.spindles/9|Number|DiskSpindles/9|Spindles of 10th disk disk.spindles/10|Number|DiskSpindles/10|Spindles of 11th disk disk.spindles/11|Number|DiskSpindles/11|Spindles of 12th disk disk.spindles/12|Number|DiskSpindles/12|Spindles of 13th disk disk.spindles/13|Number|DiskSpindles/13|Spindles of 14th disk disk.spindles/14|Number|DiskSpindles/14|Spindles of 15th disk disk.spindles/15|Number|DiskSpindles/15|Spindles of 16th disk disk.uuid/0|Text|DiskUUID/0|UUID of 1st disk disk.uuid/1|Text|DiskUUID/1|UUID of 2nd disk disk.uuid/2|Text|DiskUUID/2|UUID of 3rd disk disk.uuid/3|Text|DiskUUID/3|UUID of 4th disk disk.uuid/4|Text|DiskUUID/4|UUID of 5th disk disk.uuid/5|Text|DiskUUID/5|UUID of 6th disk disk.uuid/6|Text|DiskUUID/6|UUID of 7th disk disk.uuid/7|Text|DiskUUID/7|UUID of 8th disk disk.uuid/8|Text|DiskUUID/8|UUID of 9th disk disk.uuid/9|Text|DiskUUID/9|UUID of 10th disk disk.uuid/10|Text|DiskUUID/10|UUID of 11th disk disk.uuid/11|Text|DiskUUID/11|UUID of 12th disk disk.uuid/12|Text|DiskUUID/12|UUID of 13th disk disk.uuid/13|Text|DiskUUID/13|UUID of 14th disk disk.uuid/14|Text|DiskUUID/14|UUID of 15th disk disk.uuid/15|Text|DiskUUID/15|UUID of 16th disk disk.uuids|Custom|Disk_UUIDs|List of disk UUIDs disk_template|Text|Disk_template|Instance disk template disk_usage|Storage size|DiskUsage|Total disk space used by instance on each of its nodes; this is not the disk size visible to the instance, but the usage on the node disks_active|Boolean|DisksActive|Desired state of instance disks forthcoming|Boolean|Forthcoming|whether the Instance is forthcoming hv/acpi|Boolean|ACPI|The "acpi" hypervisor parameter hv/blockdev_prefix|Custom|hv/blockdev_prefix|The "blockdev_prefix" hypervisor parameter hv/boot_order|Custom|Boot_order|The "boot_order" hypervisor parameter hv/bootloader_args|Custom|hv/bootloader_args|The "bootloader_args" hypervisor parameter hv/bootloader_path|Custom|hv/bootloader_path|The "bootloader_path" hypervisor parameter hv/cdrom2_image_path|Custom|hv/cdrom2_image_path|The "cdrom2_image_path" hypervisor parameter hv/cdrom_disk_type|Custom|hv/cdrom_disk_type|The "cdrom_disk_type" hypervisor parameter hv/cdrom_image_path|Custom|CDROM_image_path|The "cdrom_image_path" hypervisor parameter hv/cpu_cap|Number|hv/cpu_cap|The "cpu_cap" hypervisor parameter hv/cpu_cores|Number|hv/cpu_cores|The "cpu_cores" hypervisor parameter hv/cpu_mask|Custom|hv/cpu_mask|The "cpu_mask" hypervisor parameter hv/cpu_sockets|Number|hv/cpu_sockets|The "cpu_sockets" hypervisor parameter hv/cpu_threads|Number|hv/cpu_threads|The "cpu_threads" hypervisor parameter hv/cpu_type|Custom|cpu_type|The "cpu_type" hypervisor parameter hv/cpu_weight|Number|hv/cpu_weight|The "cpu_weight" hypervisor parameter hv/cpuid|Custom|hv/cpuid|The "cpuid" hypervisor parameter hv/device_model|Custom|hv/device_model|The "device_model" hypervisor parameter hv/devices|Custom|hv/devices|The "devices" hypervisor parameter hv/disk_aio|Custom|hv/disk_aio|The "disk_aio" hypervisor parameter hv/disk_cache|Custom|hv/disk_cache|The "disk_cache" hypervisor parameter hv/disk_discard|Custom|hv/disk_discard|The "disk_discard" hypervisor parameter hv/disk_type|Custom|Disk_type|The "disk_type" hypervisor parameter hv/drop_capabilities|Custom|hv/drop_capabilities|The "drop_capabilities" hypervisor parameter hv/extra_cgroups|Custom|hv/extra_cgroups|The "extra_cgroups" hypervisor parameter hv/extra_config|Custom|hv/extra_config|The "extra_config" hypervisor parameter hv/floppy_image_path|Custom|hv/floppy_image_path|The "floppy_image_path" hypervisor parameter hv/init_script|Custom|hv/init_script|The "init_script" hypervisor parameter hv/initrd_path|Custom|Initrd_path|The "initrd_path" hypervisor parameter hv/kernel_args|Custom|hv/kernel_args|The "kernel_args" hypervisor parameter hv/kernel_path|Custom|Kernel_path|The "kernel_path" hypervisor parameter hv/keymap|Custom|hv/keymap|The "keymap" hypervisor parameter hv/kvm_extra|Custom|hv/kvm_extra|The "kvm_extra" hypervisor parameter hv/kvm_flag|Custom|hv/kvm_flag|The "kvm_flag" hypervisor parameter hv/kvm_path|Custom|hv/kvm_path|The "kvm_path" hypervisor parameter hv/kvm_pci_reservations|Number|hv/kvm_pci_reservations|The "kvm_pci_reservations" hypervisor parameter hv/machine_version|Custom|hv/machine_version|The "machine_version" hypervisor parameter hv/mem_path|Custom|hv/mem_path|The "mem_path" hypervisor parameter hv/migration_caps|Custom|hv/migration_caps|The "migration_caps" hypervisor parameter hv/migration_downtime|Number|hv/migration_downtime|The "migration_downtime" hypervisor parameter hv/nic_type|Custom|NIC_type|The "nic_type" hypervisor parameter hv/num_ttys|Number|hv/num_ttys|The "num_ttys" hypervisor parameter hv/pae|Boolean|PAE|The "pae" hypervisor parameter hv/pci_pass|Custom|pci_pass|The "pci_pass" hypervisor parameter hv/reboot_behavior|Custom|hv/reboot_behavior|The "reboot_behavior" hypervisor parameter hv/root_path|Custom|hv/root_path|The "root_path" hypervisor parameter hv/scsi_controller_type|Custom|hv/scsi_controller_type|The "scsi_controller_type" hypervisor parameter hv/security_domain|Custom|hv/security_domain|The "security_domain" hypervisor parameter hv/security_model|Custom|hv/security_model|The "security_model" hypervisor parameter hv/serial_console|Boolean|hv/serial_console|The "serial_console" hypervisor parameter hv/serial_speed|Number|hv/serial_speed|The "serial_speed" hypervisor parameter hv/soundhw|Custom|hv/soundhw|The "soundhw" hypervisor parameter hv/spice_bind|Custom|hv/spice_bind|The "spice_bind" hypervisor parameter hv/spice_image_compression|Custom|hv/spice_image_compression|The "spice_image_compression" hypervisor parameter hv/spice_ip_version|Number|hv/spice_ip_version|The "spice_ip_version" hypervisor parameter hv/spice_jpeg_wan_compression|Custom|hv/spice_jpeg_wan_compression|The "spice_jpeg_wan_compression" hypervisor parameter hv/spice_password_file|Custom|hv/spice_password_file|The "spice_password_file" hypervisor parameter hv/spice_playback_compression|Boolean|hv/spice_playback_compression|The "spice_playback_compression" hypervisor parameter hv/spice_streaming_video|Custom|hv/spice_streaming_video|The "spice_streaming_video" hypervisor parameter hv/spice_tls_ciphers|Custom|hv/spice_tls_ciphers|The "spice_tls_ciphers" hypervisor parameter hv/spice_use_tls|Boolean|hv/spice_use_tls|The "spice_use_tls" hypervisor parameter hv/spice_use_vdagent|Boolean|hv/spice_use_vdagent|The "spice_use_vdagent" hypervisor parameter hv/spice_zlib_glz_wan_compression|Custom|hv/spice_zlib_glz_wan_compression|The "spice_zlib_glz_wan_compression" hypervisor parameter hv/startup_timeout|Number|hv/startup_timeout|The "startup_timeout" hypervisor parameter hv/usb_devices|Custom|hv/usb_devices|The "usb_devices" hypervisor parameter hv/usb_mouse|Custom|hv/usb_mouse|The "usb_mouse" hypervisor parameter hv/use_bootloader|Boolean|hv/use_bootloader|The "use_bootloader" hypervisor parameter hv/use_chroot|Boolean|hv/use_chroot|The "use_chroot" hypervisor parameter hv/use_guest_agent|Boolean|hv/use_guest_agent|The "use_guest_agent" hypervisor parameter hv/use_localtime|Boolean|hv/use_localtime|The "use_localtime" hypervisor parameter hv/user_shutdown|Boolean|hv/user_shutdown|The "user_shutdown" hypervisor parameter hv/vga|Custom|hv/vga|The "vga" hypervisor parameter hv/vhost_net|Boolean|hv/vhost_net|The "vhost_net" hypervisor parameter hv/vif_script|Custom|hv/vif_script|The "vif_script" hypervisor parameter hv/vif_type|Custom|hv/vif_type|The "vif_type" hypervisor parameter hv/viridian|Boolean|hv/viridian|The "viridian" hypervisor parameter hv/virtio_disk_iothreads|Number|hv/virtio_disk_iothreads|The "virtio_disk_iothreads" hypervisor parameter hv/virtio_net_queues|Custom|hv/virtio_net_queues|The "virtio_net_queues" hypervisor parameter hv/vnc_bind_address|Custom|VNC_bind_address|The "vnc_bind_address" hypervisor parameter hv/vnc_password_file|Custom|hv/vnc_password_file|The "vnc_password_file" hypervisor parameter hv/vnc_tls|Boolean|hv/vnc_tls|The "vnc_tls" hypervisor parameter hv/vnc_x509_path|Custom|hv/vnc_x509_path|The "vnc_x509_path" hypervisor parameter hv/vnc_x509_verify|Boolean|hv/vnc_x509_verify|The "vnc_x509_verify" hypervisor parameter hv/vnet_hdr|Boolean|hv/vnet_hdr|The "vnet_hdr" hypervisor parameter hvparams|Custom|HypervisorParameters|Hypervisor parameters (merged) hypervisor|Text|Hypervisor|Hypervisor name ip|Text|NicIP/0|IP address of 1st network interface mac|Text|NicMAC/0|MAC address of 1st network interface mtime|Timestamp|MTime|Modification timestamp name|Text|Instance|Instance name network_port|Custom|Network_port|Instance network port if available (e.g. for VNC console) nic.bridge/0|Text|NicBridge/0|Bridge of 1st network interface nic.bridge/1|Text|NicBridge/1|Bridge of 2nd network interface nic.bridge/2|Text|NicBridge/2|Bridge of 3rd network interface nic.bridge/3|Text|NicBridge/3|Bridge of 4th network interface nic.bridge/4|Text|NicBridge/4|Bridge of 5th network interface nic.bridge/5|Text|NicBridge/5|Bridge of 6th network interface nic.bridge/6|Text|NicBridge/6|Bridge of 7th network interface nic.bridge/7|Text|NicBridge/7|Bridge of 8th network interface nic.bridges|Custom|NIC_bridges|List containing each network interface's bridge nic.count|Number|NICs|Number of network interfaces nic.ip/0|Text|NicIP/0|IP address of 1st network interface nic.ip/1|Text|NicIP/1|IP address of 2nd network interface nic.ip/2|Text|NicIP/2|IP address of 3rd network interface nic.ip/3|Text|NicIP/3|IP address of 4th network interface nic.ip/4|Text|NicIP/4|IP address of 5th network interface nic.ip/5|Text|NicIP/5|IP address of 6th network interface nic.ip/6|Text|NicIP/6|IP address of 7th network interface nic.ip/7|Text|NicIP/7|IP address of 8th network interface nic.ips|Custom|NIC_IPs|List containing each network interface's IP address nic.link/0|Text|NicLink/0|Link of 1st network interface nic.link/1|Text|NicLink/1|Link of 2nd network interface nic.link/2|Text|NicLink/2|Link of 3rd network interface nic.link/3|Text|NicLink/3|Link of 4th network interface nic.link/4|Text|NicLink/4|Link of 5th network interface nic.link/5|Text|NicLink/5|Link of 6th network interface nic.link/6|Text|NicLink/6|Link of 7th network interface nic.link/7|Text|NicLink/7|Link of 8th network interface nic.links|Custom|NIC_links|List containing each network interface's link nic.mac/0|Text|NicMAC/0|MAC address of 1st network interface nic.mac/1|Text|NicMAC/1|MAC address of 2nd network interface nic.mac/2|Text|NicMAC/2|MAC address of 3rd network interface nic.mac/3|Text|NicMAC/3|MAC address of 4th network interface nic.mac/4|Text|NicMAC/4|MAC address of 5th network interface nic.mac/5|Text|NicMAC/5|MAC address of 6th network interface nic.mac/6|Text|NicMAC/6|MAC address of 7th network interface nic.mac/7|Text|NicMAC/7|MAC address of 8th network interface nic.macs|Custom|NIC_MACs|List containing each network interface's MAC address nic.mode/0|Text|NicMode/0|Mode of 1st network interface nic.mode/1|Text|NicMode/1|Mode of 2nd network interface nic.mode/2|Text|NicMode/2|Mode of 3rd network interface nic.mode/3|Text|NicMode/3|Mode of 4th network interface nic.mode/4|Text|NicMode/4|Mode of 5th network interface nic.mode/5|Text|NicMode/5|Mode of 6th network interface nic.mode/6|Text|NicMode/6|Mode of 7th network interface nic.mode/7|Text|NicMode/7|Mode of 8th network interface nic.modes|Custom|NIC_modes|List containing each network interface's mode nic.name/0|Text|NicName/0|Name address of 1st network interface nic.name/1|Text|NicName/1|Name address of 2nd network interface nic.name/2|Text|NicName/2|Name address of 3rd network interface nic.name/3|Text|NicName/3|Name address of 4th network interface nic.name/4|Text|NicName/4|Name address of 5th network interface nic.name/5|Text|NicName/5|Name address of 6th network interface nic.name/6|Text|NicName/6|Name address of 7th network interface nic.name/7|Text|NicName/7|Name address of 8th network interface nic.names|Custom|NIC_Names|List containing each network interface's name nic.network.name/0|Text|NicNetworkName/0|Network name of 1st network interface nic.network.name/1|Text|NicNetworkName/1|Network name of 2nd network interface nic.network.name/2|Text|NicNetworkName/2|Network name of 3rd network interface nic.network.name/3|Text|NicNetworkName/3|Network name of 4th network interface nic.network.name/4|Text|NicNetworkName/4|Network name of 5th network interface nic.network.name/5|Text|NicNetworkName/5|Network name of 6th network interface nic.network.name/6|Text|NicNetworkName/6|Network name of 7th network interface nic.network.name/7|Text|NicNetworkName/7|Network name of 8th network interface nic.network/0|Text|NicNetwork/0|Network of 1st network interface nic.network/1|Text|NicNetwork/1|Network of 2nd network interface nic.network/2|Text|NicNetwork/2|Network of 3rd network interface nic.network/3|Text|NicNetwork/3|Network of 4th network interface nic.network/4|Text|NicNetwork/4|Network of 5th network interface nic.network/5|Text|NicNetwork/5|Network of 6th network interface nic.network/6|Text|NicNetwork/6|Network of 7th network interface nic.network/7|Text|NicNetwork/7|Network of 8th network interface nic.networks|Custom|NIC_networks|List containing each interface's network nic.networks.names|Custom|NIC_networks_names|List containing the name of each interface's network nic.uuid/0|Text|NicUUID/0|UUID address of 1st network interface nic.uuid/1|Text|NicUUID/1|UUID address of 2nd network interface nic.uuid/2|Text|NicUUID/2|UUID address of 3rd network interface nic.uuid/3|Text|NicUUID/3|UUID address of 4th network interface nic.uuid/4|Text|NicUUID/4|UUID address of 5th network interface nic.uuid/5|Text|NicUUID/5|UUID address of 6th network interface nic.uuid/6|Text|NicUUID/6|UUID address of 7th network interface nic.uuid/7|Text|NicUUID/7|UUID address of 8th network interface nic.uuids|Custom|NIC_UUIDs|List containing each network interface's UUID nic.vlan/0|Text|NicVLAN/0|VLAN of 1st network interface nic.vlan/1|Text|NicVLAN/1|VLAN of 2nd network interface nic.vlan/2|Text|NicVLAN/2|VLAN of 3rd network interface nic.vlan/3|Text|NicVLAN/3|VLAN of 4th network interface nic.vlan/4|Text|NicVLAN/4|VLAN of 5th network interface nic.vlan/5|Text|NicVLAN/5|VLAN of 6th network interface nic.vlan/6|Text|NicVLAN/6|VLAN of 7th network interface nic.vlan/7|Text|NicVLAN/7|VLAN of 8th network interface nic.vlans|Custom|NIC_VLANs|List containing each network interface's VLAN nic_link|Text|NicLink/0|Link of 1st network interface nic_mode|Text|NicMode/0|Mode of 1st network interface nic_network|Text|NicNetwork/0|Network of 1st network interface oper_ram|Storage size|Memory|Actual memory usage as seen by hypervisor oper_state|Boolean|Running|Actual state of instance oper_vcpus|Number|VCPUs|Actual number of VCPUs as seen by hypervisor os|Text|OS|Operating system osparams|Custom|OpSysParameters|Operating system parameters (merged) pnode|Text|Primary_node|Primary node pnode.group|Text|PrimaryNodeGroup|Primary node's group pnode.group.uuid|Text|PrimaryNodeGroupUUID|Primary node's group UUID sda_size|Storage size|Disk/0|Disk size of 1st disk sdb_size|Storage size|Disk/1|Disk size of 2nd disk serial_no|Number|SerialNo|Instance object serial number, incremented on each modification snodes|Custom|Secondary_Nodes|Secondary nodes; usually this will just be one node snodes.group|Custom|SecondaryNodesGroups|Node groups of secondary nodes snodes.group.uuid|Custom|SecondaryNodesGroupsUUID|Node group UUIDs of secondary nodes status|Text|Status|Instance status; "running" if instance is set to be running and actually is, "ADMIN_down" if instance is stopped and is not running, "ERROR_wrongnode" if instance running, but not on its designated primary node, "ERROR_up" if instance should be stopped, but is actually running, "ERROR_down" if instance should run, but doesn't, "ERROR_nodedown" if instance's primary node is down, "ERROR_nodeoffline" if instance's primary node is marked offline, "ADMIN_offline" if instance is offline and does not use dynamic resources tags|Custom|Tags|Tags uuid|Text|UUID|Instance UUID vcpus|Number|ConfigVCPUs|The "vcpus" backend parameter Command: ssh moe.staging.ganeti.org 'gnt-instance list-fields field/does/not/exist' Stdout was: Name Type Title Description field/does/not/exist Unknown field/does/not/exist Unknown field 'field/does/not/exist' Stderr was: ---- PASSED [TestInstanceListFields] gnt-instance list-fields ---------- Warning: Queried for unknown fields field/does/not/exist >>>> 2026-09-23 03:15:18.396214 time=0:00:00.813682 [TestInstanceListFields] gnt-instance list-fields <<<< 2026-09-23 03:15:18.396360 start [TestJobListFields] gnt-node list-fields Command: ssh moe.staging.ganeti.org 'gnt-job list-fields >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-job list-fields id status priority archived ops opresult opstatus oplog opstart opexec opend oppriority summary received_ts start_ts end_ts >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-job list-fields '\''--separator=|'\'' --no-headers' archived|Boolean|Archived|Whether job is archived end_ts|Custom|End|Timestamp of job end (tuple containing seconds and microseconds) id|Number|ID|Job ID opend|Custom|OpCode_end|List of opcode execution end timestamps opexec|Custom|OpCode_exec|List of opcode execution start timestamps (after acquiring locks) oplog|Custom|OpCode_log|List of opcode output logs oppriority|Custom|OpCode_prio|List of opcode priorities opresult|Custom|OpCode_result|List of opcodes results ops|Custom|OpCodes|List of all opcodes opstart|Custom|OpCode_start|List of opcode start timestamps (before acquiring locks) opstatus|Custom|OpCode_status|List of opcodes status priority|Number|Priority|Current job priority (19 to -20) received_ts|Custom|Received|Timestamp of when job was received (tuple containing seconds and microseconds) start_ts|Custom|Start|Timestamp of job start (tuple containing seconds and microseconds) status|Text|Status|Job status summary|Custom|Summary|List of per-opcode summaries Command: ssh moe.staging.ganeti.org 'gnt-job list-fields field/does/not/exist' Stdout was: Name Type Title Description field/does/not/exist Unknown field/does/not/exist Unknown field 'field/does/not/exist' Stderr was: ---- PASSED [TestJobListFields] gnt-node list-fields ------------------- Warning: Queried for unknown fields field/does/not/exist >>>> 2026-09-23 03:15:19.183839 time=0:00:00.787479 [TestJobListFields] gnt-node list-fields **** 2026-09-23 03:15:19.184015 skipping [TestBackupListFields] gnt-backup list-fields, test(s) instance-export disabled <<<< 2026-09-23 03:15:19.184046 start [TestNodeInfo] gnt-node info ----- Command: ssh moe.staging.ganeti.org 'gnt-node info' - Node name: bart.staging.ganeti.org primary ip: 192.168.1.6 secondary ip: 192.168.1.6 master candidate: True drained: False offline: False master_capable: True vm_capable: True primary for instances: secondary for instances: node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) - Node name: lisa.staging.ganeti.org primary ip: 192.168.1.7 secondary ip: 192.168.1.7 master candidate: True drained: False offline: False master_capable: True vm_capable: True primary for instances: secondary for instances: node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) - Node name: moe.staging.ganeti.org primary ip: 192.168.1.5 secondary ip: 192.168.1.5 master candidate: True drained: False offline: False master_capable: True vm_capable: True primary for instances: secondary for instances: node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) ---- PASSED [TestNodeInfo] gnt-node info ------------------------------- >>>> 2026-09-23 03:15:19.449326 time=0:00:00.265280 [TestNodeInfo] gnt-node info vvvv BLOCK 2026-09-23 03:15:19.449461 start [RunClusterTests] Runs tests related to gnt-cluster **** 2026-09-23 03:15:19.449598 skipping [TestClusterInitDisk] gnt-cluster init -D, test(s) create-cluster disabled <<<< 2026-09-23 03:15:19.449627 start [TestClusterRenewCrypto] gnt-cluster renew-crypto Command: ssh moe.staging.ganeti.org 'gnt-cluster renew-crypto --force --new-cluster-certificate --new-confd-hmac-key --new-rapi-certificate --rapi-certificate=/dev/null' Stdout was: Updating certificates now. Running "gnt-cluster verify" is recommended after this operation. Stderr was: Command: ssh moe.staging.ganeti.org 'gnt-cluster renew-crypto --force --new-cluster-certificate --new-confd-hmac-key --new-cluster-domain-secret --cluster-domain-secret=/dev/null' Only one of the --new-rapi-certificate and --rapi-certificate options can be specified at the same time. Stdout was: Updating certificates now. Running "gnt-cluster verify" is recommended after this operation. Stderr was: Command: ssh moe.staging.ganeti.org 'gnt-cluster renew-crypto --force --rapi-certificate=/dev/null'Only one of the --new-cluster-domain-secret and --cluster-domain-secret options can be specified at the same time. Stdout was: Updating certificates now. Running "gnt-cluster verify" is recommended after this operation. Stderr was: Unable to load X509 certificate from /dev/null: Unable to load certificate: Unable to load PEM file. See https://cryptography.io/en/latest/faq/#why-can-t-i-import-my-pem-file for more details. MalformedFraming Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'tmp=$(mktemp .gnt.XXXXXX --tmpdir=$(dirname /var/lib/ganeti/rapi.pem)) && [[ -f "$tmp" ]] && cp /var/lib/ganeti/rapi.pem $tmp && echo $tmp' /var/lib/ganeti/.gnt.YaYQz0 Backup filename: /var/lib/ganeti/.gnt.YaYQz0 /tmp/gnt.phFYNG Command: ssh moe.staging.ganeti.org 'gnt-cluster renew-crypto --force --rapi-certificate=/tmp/gnt.phFYNG' Updating certificates now. Running "gnt-cluster verify" is recommended after this operation. All requested certificates and keys have been replaced. Running "gnt-cluster verify" now is recommended. Command: ssh moe.staging.ganeti.org 'rm -f /tmp/gnt.phFYNG' /tmp/gnt.Vz5ciJ Command: ssh moe.staging.ganeti.org 'gnt-cluster renew-crypto --force --cluster-domain-secret=/tmp/gnt.Vz5ciJ' Updating certificates now. Running "gnt-cluster verify" is recommended after this operation. All requested certificates and keys have been replaced. Running "gnt-cluster verify" now is recommended. Command: ssh moe.staging.ganeti.org 'rm -f /tmp/gnt.Vz5ciJ' Command: ssh moe.staging.ganeti.org 'gnt-cluster renew-crypto --force --new-cluster-certificate --new-confd-hmac-key --new-rapi-certificate --new-cluster-domain-secret --new-node-certificates --new-ssh-keys --no-ssh-key-check' Updating certificates now. Running "gnt-cluster verify" is recommended after this operation. Gathering cluster information Blocking watcher Stopping master daemons Stopping daemons on moe.staging.ganeti.org Stopping daemons on bart.staging.ganeti.org Stopping daemons on lisa.staging.ganeti.org Updating certificates and keys Copying /var/lib/ganeti/rapi.pem, /var/lib/ganeti/hmac.key, /var/lib/ganeti/cluster-domain-secret to bart.staging.ganeti.org:22 Copying /var/lib/ganeti/rapi.pem, /var/lib/ganeti/hmac.key, /var/lib/ganeti/cluster-domain-secret to lisa.staging.ganeti.org:22 Starting daemons on bart.staging.ganeti.org Starting daemons on lisa.staging.ganeti.org Starting daemons on moe.staging.ganeti.org Gathering cluster information Blocking watcher Stopping master daemons Stopping daemons on moe.staging.ganeti.org Starting daemon 'ganeti-noded' on moe.staging.ganeti.org Starting daemon 'ganeti-wconfd' on moe.staging.ganeti.org Stopping daemons on bart.staging.ganeti.org Stopping daemons on lisa.staging.ganeti.org Updating the cluster SSL certificate. Copying /var/lib/ganeti/server.pem to bart.staging.ganeti.org:22 Copying /var/lib/ganeti/server.pem to lisa.staging.ganeti.org:22 Updating client SSL certificates. Copying /var/lib/ganeti/ssconf_master_candidates_certs to bart.staging.ganeti.org:22 Copying /var/lib/ganeti/ssconf_master_candidates_certs to lisa.staging.ganeti.org:22 Starting daemons on bart.staging.ganeti.org Starting daemons on lisa.staging.ganeti.org Stopping daemon 'ganeti-wconfd' on moe.staging.ganeti.org Stopping daemon 'ganeti-noded' on moe.staging.ganeti.org Starting daemons on moe.staging.ganeti.org Wed Sep 23 03:15:51 2026 Renewing Node SSL certificates Wed Sep 23 03:15:51 2026 Cannot renew SSH keys if the cluster is configured to not modify the SSH setup. All requested certificates and keys have been replaced. Running "gnt-cluster verify" now is recommended. Ssconf Master Certificates of node 'moe.staging.ganeti.org'. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'cat /var/lib/ganeti/ssconf_master_candidates_certs' 225a8154-f533-4482-b346-f97aa50aef2d=EE:65:3A:E0:B8:E2:97:67:E1:B2:6D:93:8B:F3:6A:EB:DA:AD:E4:AD 2395f0f3-a73f-4e1a-9029-3ea40cbccbc6=D4:21:D9:64:BD:28:6D:F9:B6:BE:9F:5D:CD:B7:80:85:47:0A:08:AC 542e16dc-eb39-4063-aade-f655d965140f=59:C8:9D:52:9A:4C:76:99:C3:57:1E:DE:FA:3C:5F:D1:FA:C1:03:B6 Ssconf Master Certificates of node 'bart.staging.ganeti.org'. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.u41n6zn5 -oControlMaster=no bart.staging.ganeti.org 'cat /var/lib/ganeti/ssconf_master_candidates_certs' 225a8154-f533-4482-b346-f97aa50aef2d=EE:65:3A:E0:B8:E2:97:67:E1:B2:6D:93:8B:F3:6A:EB:DA:AD:E4:AD 2395f0f3-a73f-4e1a-9029-3ea40cbccbc6=D4:21:D9:64:BD:28:6D:F9:B6:BE:9F:5D:CD:B7:80:85:47:0A:08:AC 542e16dc-eb39-4063-aade-f655d965140f=59:C8:9D:52:9A:4C:76:99:C3:57:1E:DE:FA:3C:5F:D1:FA:C1:03:B6 Ssconf Master Certificates of node 'lisa.staging.ganeti.org'. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.fox6rlvu -oControlMaster=no lisa.staging.ganeti.org 'cat /var/lib/ganeti/ssconf_master_candidates_certs' 225a8154-f533-4482-b346-f97aa50aef2d=EE:65:3A:E0:B8:E2:97:67:E1:B2:6D:93:8B:F3:6A:EB:DA:AD:E4:AD 2395f0f3-a73f-4e1a-9029-3ea40cbccbc6=D4:21:D9:64:BD:28:6D:F9:B6:BE:9F:5D:CD:B7:80:85:47:0A:08:AC 542e16dc-eb39-4063-aade-f655d965140f=59:C8:9D:52:9A:4C:76:99:C3:57:1E:DE:FA:3C:5F:D1:FA:C1:03:B6 Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 17, 18 Waiting for job 17 ... Wed Sep 23 03:15:53 2026 * Verifying cluster config Wed Sep 23 03:15:53 2026 * Verifying cluster certificate files Wed Sep 23 03:15:53 2026 * Verifying hypervisor parameters Wed Sep 23 03:15:53 2026 * Verifying all nodes belong to an existing group Waiting for job 18 ... Wed Sep 23 03:15:54 2026 * Verifying group 'default' Wed Sep 23 03:15:54 2026 * Gathering data (3 nodes) Wed Sep 23 03:15:54 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:15:55 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:15:55 2026 * Verifying configuration file consistency Wed Sep 23 03:15:55 2026 * Verifying node status Wed Sep 23 03:15:55 2026 * Verifying instance status Wed Sep 23 03:15:55 2026 * Verifying orphan volumes Wed Sep 23 03:15:55 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:15:56 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:15:56 2026 * Other Notes Wed Sep 23 03:15:56 2026 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-cluster renew-crypto --force --new-node-certificates' Updating certificates now. Running "gnt-cluster verify" is recommended after this operation. Gathering cluster information Blocking watcher Stopping master daemons Stopping daemons on moe.staging.ganeti.org Starting daemon 'ganeti-noded' on moe.staging.ganeti.org Starting daemon 'ganeti-wconfd' on moe.staging.ganeti.org Stopping daemons on bart.staging.ganeti.org Stopping daemons on lisa.staging.ganeti.org Updating client SSL certificates. Copying /var/lib/ganeti/ssconf_master_candidates_certs to bart.staging.ganeti.org:22 Copying /var/lib/ganeti/ssconf_master_candidates_certs to lisa.staging.ganeti.org:22 Starting daemons on bart.staging.ganeti.org Starting daemons on lisa.staging.ganeti.org Stopping daemon 'ganeti-wconfd' on moe.staging.ganeti.org Stopping daemon 'ganeti-noded' on moe.staging.ganeti.org Starting daemons on moe.staging.ganeti.org Wed Sep 23 03:16:13 2026 Renewing Node SSL certificates All requested certificates and keys have been replaced. Running "gnt-cluster verify" now is recommended. Ssconf Master Certificates of node 'moe.staging.ganeti.org'. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'cat /var/lib/ganeti/ssconf_master_candidates_certs' 225a8154-f533-4482-b346-f97aa50aef2d=2D:47:C5:56:6E:98:F9:7C:5F:15:7C:1C:27:08:81:B8:F5:95:83:03 2395f0f3-a73f-4e1a-9029-3ea40cbccbc6=B3:A9:7E:D3:B7:94:69:E3:2C:F5:0C:45:19:37:A6:E1:32:EE:22:D0 542e16dc-eb39-4063-aade-f655d965140f=52:4D:7B:52:78:9E:00:75:8E:5D:0A:F0:CC:9A:B8:EA:F3:1D:36:88 Ssconf Master Certificates of node 'bart.staging.ganeti.org'. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.u41n6zn5 -oControlMaster=no bart.staging.ganeti.org 'cat /var/lib/ganeti/ssconf_master_candidates_certs' 225a8154-f533-4482-b346-f97aa50aef2d=2D:47:C5:56:6E:98:F9:7C:5F:15:7C:1C:27:08:81:B8:F5:95:83:03 2395f0f3-a73f-4e1a-9029-3ea40cbccbc6=B3:A9:7E:D3:B7:94:69:E3:2C:F5:0C:45:19:37:A6:E1:32:EE:22:D0 542e16dc-eb39-4063-aade-f655d965140f=52:4D:7B:52:78:9E:00:75:8E:5D:0A:F0:CC:9A:B8:EA:F3:1D:36:88 Ssconf Master Certificates of node 'lisa.staging.ganeti.org'. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.fox6rlvu -oControlMaster=no lisa.staging.ganeti.org 'cat /var/lib/ganeti/ssconf_master_candidates_certs' 225a8154-f533-4482-b346-f97aa50aef2d=2D:47:C5:56:6E:98:F9:7C:5F:15:7C:1C:27:08:81:B8:F5:95:83:03 2395f0f3-a73f-4e1a-9029-3ea40cbccbc6=B3:A9:7E:D3:B7:94:69:E3:2C:F5:0C:45:19:37:A6:E1:32:EE:22:D0 542e16dc-eb39-4063-aade-f655d965140f=52:4D:7B:52:78:9E:00:75:8E:5D:0A:F0:CC:9A:B8:EA:F3:1D:36:88 Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 21, 22 Waiting for job 21 ... Wed Sep 23 03:16:16 2026 * Verifying cluster config Wed Sep 23 03:16:16 2026 * Verifying cluster certificate files Wed Sep 23 03:16:16 2026 * Verifying hypervisor parameters Wed Sep 23 03:16:16 2026 * Verifying all nodes belong to an existing group Waiting for job 22 ... Wed Sep 23 03:16:16 2026 * Verifying group 'default' Wed Sep 23 03:16:16 2026 * Gathering data (3 nodes) Wed Sep 23 03:16:16 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:16:17 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:16:17 2026 * Verifying configuration file consistency Wed Sep 23 03:16:18 2026 * Verifying node status Wed Sep 23 03:16:18 2026 * Verifying instance status Wed Sep 23 03:16:18 2026 * Verifying orphan volumes Wed Sep 23 03:16:18 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:16:18 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:16:18 2026 * Other Notes Wed Sep 23 03:16:18 2026 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-cluster renew-crypto --force --new-cluster-certificate' Updating certificates now. Running "gnt-cluster verify" is recommended after this operation. Gathering cluster information Blocking watcher Stopping master daemons Stopping daemons on moe.staging.ganeti.org Starting daemon 'ganeti-noded' on moe.staging.ganeti.org Starting daemon 'ganeti-wconfd' on moe.staging.ganeti.org Stopping daemons on bart.staging.ganeti.org Stopping daemons on lisa.staging.ganeti.org Updating the cluster SSL certificate. Copying /var/lib/ganeti/server.pem to bart.staging.ganeti.org:22 Copying /var/lib/ganeti/server.pem to lisa.staging.ganeti.org:22 Updating client SSL certificates. Copying /var/lib/ganeti/ssconf_master_candidates_certs to bart.staging.ganeti.org:22 Copying /var/lib/ganeti/ssconf_master_candidates_certs to lisa.staging.ganeti.org:22 Starting daemons on bart.staging.ganeti.org Starting daemons on lisa.staging.ganeti.org Stopping daemon 'ganeti-wconfd' on moe.staging.ganeti.org Stopping daemon 'ganeti-noded' on moe.staging.ganeti.org Starting daemons on moe.staging.ganeti.org Wed Sep 23 03:16:36 2026 Renewing Node SSL certificates All requested certificates and keys have been replaced. Running "gnt-cluster verify" now is recommended. Ssconf Master Certificates of node 'moe.staging.ganeti.org'. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'cat /var/lib/ganeti/ssconf_master_candidates_certs' 225a8154-f533-4482-b346-f97aa50aef2d=B2:13:C5:BB:59:41:26:E3:87:7E:FA:DB:E1:9F:D3:DA:60:50:5A:28 2395f0f3-a73f-4e1a-9029-3ea40cbccbc6=8C:74:81:AB:EF:3E:51:C4:61:DF:A8:B4:F9:CF:BB:0B:EC:78:9B:FA 542e16dc-eb39-4063-aade-f655d965140f=CC:7E:0F:4E:AB:C6:DD:BF:36:41:79:89:CC:F7:37:8E:6D:16:9A:D0 Ssconf Master Certificates of node 'bart.staging.ganeti.org'. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.u41n6zn5 -oControlMaster=no bart.staging.ganeti.org 'cat /var/lib/ganeti/ssconf_master_candidates_certs' 225a8154-f533-4482-b346-f97aa50aef2d=B2:13:C5:BB:59:41:26:E3:87:7E:FA:DB:E1:9F:D3:DA:60:50:5A:28 2395f0f3-a73f-4e1a-9029-3ea40cbccbc6=8C:74:81:AB:EF:3E:51:C4:61:DF:A8:B4:F9:CF:BB:0B:EC:78:9B:FA 542e16dc-eb39-4063-aade-f655d965140f=CC:7E:0F:4E:AB:C6:DD:BF:36:41:79:89:CC:F7:37:8E:6D:16:9A:D0 Ssconf Master Certificates of node 'lisa.staging.ganeti.org'. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.fox6rlvu -oControlMaster=no lisa.staging.ganeti.org 'cat /var/lib/ganeti/ssconf_master_candidates_certs' 225a8154-f533-4482-b346-f97aa50aef2d=B2:13:C5:BB:59:41:26:E3:87:7E:FA:DB:E1:9F:D3:DA:60:50:5A:28 2395f0f3-a73f-4e1a-9029-3ea40cbccbc6=8C:74:81:AB:EF:3E:51:C4:61:DF:A8:B4:F9:CF:BB:0B:EC:78:9B:FA 542e16dc-eb39-4063-aade-f655d965140f=CC:7E:0F:4E:AB:C6:DD:BF:36:41:79:89:CC:F7:37:8E:6D:16:9A:D0 Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 25, 26 Waiting for job 25 ... Wed Sep 23 03:16:39 2026 * Verifying cluster config Wed Sep 23 03:16:39 2026 * Verifying cluster certificate files Wed Sep 23 03:16:39 2026 * Verifying hypervisor parameters Wed Sep 23 03:16:39 2026 * Verifying all nodes belong to an existing group Waiting for job 26 ... Wed Sep 23 03:16:39 2026 * Verifying group 'default' Wed Sep 23 03:16:39 2026 * Gathering data (3 nodes) Wed Sep 23 03:16:39 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:16:41 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:16:41 2026 * Verifying configuration file consistency Wed Sep 23 03:16:41 2026 * Verifying node status Wed Sep 23 03:16:41 2026 * Verifying instance status Wed Sep 23 03:16:41 2026 * Verifying orphan volumes Wed Sep 23 03:16:41 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:16:41 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:16:41 2026 * Other Notes Wed Sep 23 03:16:41 2026 * Hooks Results Skipping SSH key replacement checks: cluster was initialized with --no-ssh-init Command: ssh moe.staging.ganeti.org 'gnt-cluster renew-crypto --force --rapi-certificate=/var/lib/ganeti/.gnt.YaYQz0' Updating certificates now. Running "gnt-cluster verify" is recommended after this operation. All requested certificates and keys have been replaced. Running "gnt-cluster verify" now is recommended. Ssconf Master Certificates of node 'moe.staging.ganeti.org'. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'cat /var/lib/ganeti/ssconf_master_candidates_certs' 225a8154-f533-4482-b346-f97aa50aef2d=B2:13:C5:BB:59:41:26:E3:87:7E:FA:DB:E1:9F:D3:DA:60:50:5A:28 2395f0f3-a73f-4e1a-9029-3ea40cbccbc6=8C:74:81:AB:EF:3E:51:C4:61:DF:A8:B4:F9:CF:BB:0B:EC:78:9B:FA 542e16dc-eb39-4063-aade-f655d965140f=CC:7E:0F:4E:AB:C6:DD:BF:36:41:79:89:CC:F7:37:8E:6D:16:9A:D0 Ssconf Master Certificates of node 'bart.staging.ganeti.org'. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.u41n6zn5 -oControlMaster=no bart.staging.ganeti.org 'cat /var/lib/ganeti/ssconf_master_candidates_certs' 225a8154-f533-4482-b346-f97aa50aef2d=B2:13:C5:BB:59:41:26:E3:87:7E:FA:DB:E1:9F:D3:DA:60:50:5A:28 2395f0f3-a73f-4e1a-9029-3ea40cbccbc6=8C:74:81:AB:EF:3E:51:C4:61:DF:A8:B4:F9:CF:BB:0B:EC:78:9B:FA 542e16dc-eb39-4063-aade-f655d965140f=CC:7E:0F:4E:AB:C6:DD:BF:36:41:79:89:CC:F7:37:8E:6D:16:9A:D0 Ssconf Master Certificates of node 'lisa.staging.ganeti.org'. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.fox6rlvu -oControlMaster=no lisa.staging.ganeti.org 'cat /var/lib/ganeti/ssconf_master_candidates_certs' 225a8154-f533-4482-b346-f97aa50aef2d=B2:13:C5:BB:59:41:26:E3:87:7E:FA:DB:E1:9F:D3:DA:60:50:5A:28 2395f0f3-a73f-4e1a-9029-3ea40cbccbc6=8C:74:81:AB:EF:3E:51:C4:61:DF:A8:B4:F9:CF:BB:0B:EC:78:9B:FA 542e16dc-eb39-4063-aade-f655d965140f=CC:7E:0F:4E:AB:C6:DD:BF:36:41:79:89:CC:F7:37:8E:6D:16:9A:D0 Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 28, 29 Waiting for job 28 ... Wed Sep 23 03:16:44 2026 * Verifying cluster config Wed Sep 23 03:16:44 2026 * Verifying cluster certificate files Wed Sep 23 03:16:44 2026 * Verifying hypervisor parameters Wed Sep 23 03:16:44 2026 * Verifying all nodes belong to an existing group Waiting for job 29 ... Wed Sep 23 03:16:44 2026 * Verifying group 'default' Wed Sep 23 03:16:44 2026 * Gathering data (3 nodes) Wed Sep 23 03:16:44 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:16:46 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:16:46 2026 * Verifying configuration file consistency Wed Sep 23 03:16:46 2026 * Verifying node status Wed Sep 23 03:16:46 2026 * Verifying instance status Wed Sep 23 03:16:46 2026 * Verifying orphan volumes Wed Sep 23 03:16:46 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:16:46 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:16:46 2026 * Other Notes Wed Sep 23 03:16:46 2026 * Hooks Results Command: ssh moe.staging.ganeti.org 'rm -f /var/lib/ganeti/.gnt.YaYQz0' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'openssl x509 -in /var/lib/ganeti/rapi.pem' -----BEGIN CERTIFICATE----- MIIC9zCCAd+gAwIBAgIBATANBgkqhkiG9w0BAQsFADAdMRswGQYDVQQDDBJnYW5l dGkuZXhhbXBsZS5jb20wHhcNMjYwOTIzMDExNTI1WhcNMzEwOTIyMDExNTI1WjAd MRswGQYDVQQDDBJnYW5ldGkuZXhhbXBsZS5jb20wggEiMA0GCSqGSIb3DQEBAQUA A4IBDwAwggEKAoIBAQC4QWorEU3YddvfpAJNhaWe8TjvBv2gVvcx9nFAoyAMek1e lR9G16Mv+G2K4PPTBqB5tP+pQ1C1TM9IdUntm+fBDLXPpaGVMuAg+hoU/Zl+hxHK 0sQv4ikdoM/uyW9EY5GFWQjmUtzW1mtVXoM5A/Yd397bNUHPPzJ6e6VBg9KqCHYf Ar91Gyuh4TJj8UBRMqteVhUjD7/k6us1L6puz+0NOPgK28hh1Q6bc6yq6aNY+an4 jnLi5K7d9tL/MLMe/l+ZE7Q4IJ7dJfEPDK8ovW3/Sg1UhRUDibS5fUf7yp8pNS9K +4Qz5/Hi6SKItyxJDuM2TfzsSfDx3Ox5RY38ROppAgMBAAGjQjBAMA8GA1UdEwEB /wQFMAMBAf8wDgYDVR0PAQH/BAQDAgGmMB0GA1UdDgQWBBQ2fgaJjmSP7GWNiwB/ ayh2TJAxgDANBgkqhkiG9w0BAQsFAAOCAQEApOZCqeeusQSI2dBWxV/sZOkceil5 4WPaBMvU1/mFqhEMiNbltC7ILCZRX3p8KJc3ul9wP+EOZGbdgW16P3h5MJHLD522 Dc+Pfvx6kSuR+PUw+Z1kxDBhz7UeQszRd+15cocFjeg9TOYX9EDgdYxKpAyadVGA rO3Sj5iTLELwAflSq3Km2kdMrvpTD8rtlLuvlmW+FD/xEPKzyFxcanfffqPMVAw5 TGUN31QRVNPlOIzQGzMAfZ/A7iMDmfKVlUzAZp9+2UCF2l9SfDhEwzEbvqx5joOD MyasSWjZZNTqLavJf7Kw0N5v/6gUFl7jctrJIntACbXMqG2pG46yZqYpfQ== -----END CERTIFICATE----- RAPI protocol version: 2 ---- PASSED [TestClusterRenewCrypto] gnt-cluster renew-crypto ---------- >>>> 2026-09-23 03:16:46.730714 time=0:01:27.281087 [TestClusterRenewCrypto] gnt-cluster renew-crypto <<<< 2026-09-23 03:16:46.730903 start [TestClusterVerify] gnt-cluster verify Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 31, 32 Waiting for job 31 ... Wed Sep 23 03:16:48 2026 * Verifying cluster config Wed Sep 23 03:16:48 2026 * Verifying cluster certificate files Wed Sep 23 03:16:48 2026 * Verifying hypervisor parameters Wed Sep 23 03:16:48 2026 * Verifying all nodes belong to an existing group Waiting for job 32 ... Wed Sep 23 03:16:49 2026 * Verifying group 'default' Wed Sep 23 03:16:49 2026 * Gathering data (3 nodes) Wed Sep 23 03:16:49 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:16:50 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:16:50 2026 * Verifying configuration file consistency Wed Sep 23 03:16:50 2026 * Verifying node status Wed Sep 23 03:16:50 2026 * Verifying instance status Wed Sep 23 03:16:50 2026 * Verifying orphan volumes Wed Sep 23 03:16:50 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:16:50 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:16:50 2026 * Other Notes Wed Sep 23 03:16:51 2026 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-cluster verify-disks' ---- PASSED [TestClusterVerify] gnt-cluster verify --------------------- >>>> 2026-09-23 03:16:52.363212 time=0:00:05.632309 [TestClusterVerify] gnt-cluster verify <<<< 2026-09-23 03:16:52.363370 start [TestClusterReservedLvs] gnt-cluster reserved lvs Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' bc9e3985a9c26b8962fc6e490746d05e693bda34 /var/lib/ganeti/config.data Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 35, 36 Waiting for job 35 ... Wed Sep 23 03:16:54 2026 * Verifying cluster config Wed Sep 23 03:16:54 2026 * Verifying cluster certificate files Wed Sep 23 03:16:54 2026 * Verifying hypervisor parameters Wed Sep 23 03:16:54 2026 * Verifying all nodes belong to an existing group Waiting for job 36 ... Wed Sep 23 03:16:54 2026 * Verifying group 'default' Wed Sep 23 03:16:54 2026 * Gathering data (3 nodes) Wed Sep 23 03:16:54 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:16:56 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:16:56 2026 * Verifying configuration file consistency Wed Sep 23 03:16:56 2026 * Verifying node status Wed Sep 23 03:16:56 2026 * Verifying instance status Wed Sep 23 03:16:56 2026 * Verifying orphan volumes Wed Sep 23 03:16:56 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:16:56 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:16:56 2026 * Other Notes Wed Sep 23 03:16:56 2026 * Hooks Results Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' bc9e3985a9c26b8962fc6e490746d05e693bda34 /var/lib/ganeti/config.data Command: ssh moe.staging.ganeti.org 'gnt-cluster modify --reserved-lvs '\'''\''' Command: ssh moe.staging.ganeti.org 'lvcreate -L1G -n qa-test gnt' Logical volume "qa-test" created. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' 0fbba212c3cbf0a600464180e884e3dbe7cf6231 /var/lib/ganeti/config.data Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-cluster verify --error-codes' Submitted jobs 39, 40 Waiting for job 39 ... Wed Sep 23 03:17:00 2026 * Verifying cluster config Wed Sep 23 03:17:00 2026 * Verifying cluster certificate files Wed Sep 23 03:17:00 2026 * Verifying hypervisor parameters Wed Sep 23 03:17:00 2026 * Verifying all nodes belong to an existing group Waiting for job 40 ... Wed Sep 23 03:17:01 2026 * Verifying group 'default' Wed Sep 23 03:17:01 2026 * Gathering data (3 nodes) Wed Sep 23 03:17:01 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:17:02 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:17:02 2026 * Verifying configuration file consistency Wed Sep 23 03:17:02 2026 * Verifying node status Wed Sep 23 03:17:02 2026 * Verifying instance status Wed Sep 23 03:17:02 2026 * Verifying orphan volumes Wed Sep 23 03:17:02 2026 - WARNING:ENODEORPHANLV:node:moe.staging.ganeti.org:volume gnt/qa-test is unknown Wed Sep 23 03:17:02 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:17:02 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:17:02 2026 * Other Notes Wed Sep 23 03:17:02 2026 * Hooks Results Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' 0fbba212c3cbf0a600464180e884e3dbe7cf6231 /var/lib/ganeti/config.data Submitted jobs 39, 40 Waiting for job 39 ... Wed Sep 23 03:17:00 2026 * Verifying cluster config Wed Sep 23 03:17:00 2026 * Verifying cluster certificate files Wed Sep 23 03:17:00 2026 * Verifying hypervisor parameters Wed Sep 23 03:17:00 2026 * Verifying all nodes belong to an existing group Waiting for job 40 ... Wed Sep 23 03:17:01 2026 * Verifying group 'default' Wed Sep 23 03:17:01 2026 * Gathering data (3 nodes) Wed Sep 23 03:17:01 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:17:02 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:17:02 2026 * Verifying configuration file consistency Wed Sep 23 03:17:02 2026 * Verifying node status Wed Sep 23 03:17:02 2026 * Verifying instance status Wed Sep 23 03:17:02 2026 * Verifying orphan volumes Wed Sep 23 03:17:02 2026 - WARNING:ENODEORPHANLV:node:moe.staging.ganeti.org:volume gnt/qa-test is unknown Wed Sep 23 03:17:02 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:17:02 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:17:02 2026 * Other Notes Wed Sep 23 03:17:02 2026 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-cluster modify --reserved-lvs '\''gnt/qa-test,.*/other-test'\''' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' a539373bb78c722c32043d497bc053b8fb17cd1b /var/lib/ganeti/config.data Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-cluster verify --error-codes' Submitted jobs 43, 44 Waiting for job 43 ... Wed Sep 23 03:17:06 2026 * Verifying cluster config Wed Sep 23 03:17:06 2026 * Verifying cluster certificate files Wed Sep 23 03:17:06 2026 * Verifying hypervisor parameters Wed Sep 23 03:17:06 2026 * Verifying all nodes belong to an existing group Waiting for job 44 ... Wed Sep 23 03:17:07 2026 * Verifying group 'default' Wed Sep 23 03:17:07 2026 * Gathering data (3 nodes) Wed Sep 23 03:17:07 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:17:08 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:17:08 2026 * Verifying configuration file consistency Wed Sep 23 03:17:08 2026 * Verifying node status Wed Sep 23 03:17:08 2026 * Verifying instance status Wed Sep 23 03:17:08 2026 * Verifying orphan volumes Wed Sep 23 03:17:08 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:17:08 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:17:08 2026 * Other Notes Wed Sep 23 03:17:09 2026 * Hooks Results Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' a539373bb78c722c32043d497bc053b8fb17cd1b /var/lib/ganeti/config.data Submitted jobs 43, 44 Waiting for job 43 ... Wed Sep 23 03:17:06 2026 * Verifying cluster config Wed Sep 23 03:17:06 2026 * Verifying cluster certificate files Wed Sep 23 03:17:06 2026 * Verifying hypervisor parameters Wed Sep 23 03:17:06 2026 * Verifying all nodes belong to an existing group Waiting for job 44 ... Wed Sep 23 03:17:07 2026 * Verifying group 'default' Wed Sep 23 03:17:07 2026 * Gathering data (3 nodes) Wed Sep 23 03:17:07 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:17:08 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:17:08 2026 * Verifying configuration file consistency Wed Sep 23 03:17:08 2026 * Verifying node status Wed Sep 23 03:17:08 2026 * Verifying instance status Wed Sep 23 03:17:08 2026 * Verifying orphan volumes Wed Sep 23 03:17:08 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:17:08 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:17:08 2026 * Other Notes Wed Sep 23 03:17:09 2026 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-cluster modify --reserved-lvs '\''.*/qa-.*'\''' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' 78325439831e1c789b224ee946b75e7953410b23 /var/lib/ganeti/config.data Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-cluster verify --error-codes' Submitted jobs 47, 48 Waiting for job 47 ... Wed Sep 23 03:17:12 2026 * Verifying cluster config Wed Sep 23 03:17:12 2026 * Verifying cluster certificate files Wed Sep 23 03:17:12 2026 * Verifying hypervisor parameters Wed Sep 23 03:17:12 2026 * Verifying all nodes belong to an existing group Waiting for job 48 ... Wed Sep 23 03:17:13 2026 * Verifying group 'default' Wed Sep 23 03:17:13 2026 * Gathering data (3 nodes) Wed Sep 23 03:17:13 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:17:14 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:17:14 2026 * Verifying configuration file consistency Wed Sep 23 03:17:14 2026 * Verifying node status Wed Sep 23 03:17:14 2026 * Verifying instance status Wed Sep 23 03:17:14 2026 * Verifying orphan volumes Wed Sep 23 03:17:14 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:17:14 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:17:14 2026 * Other Notes Wed Sep 23 03:17:15 2026 * Hooks Results Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' 78325439831e1c789b224ee946b75e7953410b23 /var/lib/ganeti/config.data Submitted jobs 47, 48 Waiting for job 47 ... Wed Sep 23 03:17:12 2026 * Verifying cluster config Wed Sep 23 03:17:12 2026 * Verifying cluster certificate files Wed Sep 23 03:17:12 2026 * Verifying hypervisor parameters Wed Sep 23 03:17:12 2026 * Verifying all nodes belong to an existing group Waiting for job 48 ... Wed Sep 23 03:17:13 2026 * Verifying group 'default' Wed Sep 23 03:17:13 2026 * Gathering data (3 nodes) Wed Sep 23 03:17:13 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:17:14 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:17:14 2026 * Verifying configuration file consistency Wed Sep 23 03:17:14 2026 * Verifying node status Wed Sep 23 03:17:14 2026 * Verifying instance status Wed Sep 23 03:17:14 2026 * Verifying orphan volumes Wed Sep 23 03:17:14 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:17:14 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:17:14 2026 * Other Notes Wed Sep 23 03:17:15 2026 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-cluster modify --reserved-lvs '\'''\''' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' a92d5b4ffb2eab6d8ef112bcd20ce5be0ffac5bc /var/lib/ganeti/config.data Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-cluster verify --error-codes' Submitted jobs 51, 52 Waiting for job 51 ... Wed Sep 23 03:17:18 2026 * Verifying cluster config Wed Sep 23 03:17:18 2026 * Verifying cluster certificate files Wed Sep 23 03:17:18 2026 * Verifying hypervisor parameters Wed Sep 23 03:17:18 2026 * Verifying all nodes belong to an existing group Waiting for job 52 ... Wed Sep 23 03:17:19 2026 * Verifying group 'default' Wed Sep 23 03:17:19 2026 * Gathering data (3 nodes) Wed Sep 23 03:17:19 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:17:20 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:17:20 2026 * Verifying configuration file consistency Wed Sep 23 03:17:20 2026 * Verifying node status Wed Sep 23 03:17:20 2026 * Verifying instance status Wed Sep 23 03:17:20 2026 * Verifying orphan volumes Wed Sep 23 03:17:20 2026 - WARNING:ENODEORPHANLV:node:moe.staging.ganeti.org:volume gnt/qa-test is unknown Wed Sep 23 03:17:20 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:17:21 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:17:21 2026 * Other Notes Wed Sep 23 03:17:21 2026 * Hooks Results Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' a92d5b4ffb2eab6d8ef112bcd20ce5be0ffac5bc /var/lib/ganeti/config.data Submitted jobs 51, 52 Waiting for job 51 ... Wed Sep 23 03:17:18 2026 * Verifying cluster config Wed Sep 23 03:17:18 2026 * Verifying cluster certificate files Wed Sep 23 03:17:18 2026 * Verifying hypervisor parameters Wed Sep 23 03:17:18 2026 * Verifying all nodes belong to an existing group Waiting for job 52 ... Wed Sep 23 03:17:19 2026 * Verifying group 'default' Wed Sep 23 03:17:19 2026 * Gathering data (3 nodes) Wed Sep 23 03:17:19 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:17:20 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:17:20 2026 * Verifying configuration file consistency Wed Sep 23 03:17:20 2026 * Verifying node status Wed Sep 23 03:17:20 2026 * Verifying instance status Wed Sep 23 03:17:20 2026 * Verifying orphan volumes Wed Sep 23 03:17:20 2026 - WARNING:ENODEORPHANLV:node:moe.staging.ganeti.org:volume gnt/qa-test is unknown Wed Sep 23 03:17:20 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:17:21 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:17:21 2026 * Other Notes Wed Sep 23 03:17:21 2026 * Hooks Results Command: ssh moe.staging.ganeti.org 'lvremove -f gnt/qa-test' Logical volume "qa-test" successfully removed. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' a92d5b4ffb2eab6d8ef112bcd20ce5be0ffac5bc /var/lib/ganeti/config.data Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 54, 55 Waiting for job 54 ... Wed Sep 23 03:17:23 2026 * Verifying cluster config Wed Sep 23 03:17:23 2026 * Verifying cluster certificate files Wed Sep 23 03:17:23 2026 * Verifying hypervisor parameters Wed Sep 23 03:17:23 2026 * Verifying all nodes belong to an existing group Waiting for job 55 ... Wed Sep 23 03:17:24 2026 * Verifying group 'default' Wed Sep 23 03:17:24 2026 * Gathering data (3 nodes) Wed Sep 23 03:17:24 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:17:25 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:17:25 2026 * Verifying configuration file consistency Wed Sep 23 03:17:25 2026 * Verifying node status Wed Sep 23 03:17:25 2026 * Verifying instance status Wed Sep 23 03:17:25 2026 * Verifying orphan volumes Wed Sep 23 03:17:25 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:17:25 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:17:25 2026 * Other Notes Wed Sep 23 03:17:25 2026 * Hooks Results Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' a92d5b4ffb2eab6d8ef112bcd20ce5be0ffac5bc /var/lib/ganeti/config.data ---- PASSED [TestClusterReservedLvs] gnt-cluster reserved lvs ---------- >>>> 2026-09-23 03:17:25.992699 time=0:00:33.629329 [TestClusterReservedLvs] gnt-cluster reserved lvs **** 2026-09-23 03:17:25.992834 skipping [TestClusterModifyEmpty] gnt-cluster modify, test(s) cluster-modify disabled **** 2026-09-23 03:17:25.992866 skipping [TestClusterModifyIPolicy] gnt-cluster modify --ipolicy-*, test(s) cluster-modify disabled **** 2026-09-23 03:17:25.992885 skipping [TestClusterModifyISpecs] gnt-cluster modify --specs-*, test(s) cluster-modify disabled **** 2026-09-23 03:17:25.992905 skipping [TestClusterModifyBe] gnt-cluster modify -B, test(s) cluster-modify disabled **** 2026-09-23 03:17:25.992923 skipping [TestClusterModifyDisk] gnt-cluster modify -D, test(s) cluster-modify disabled **** 2026-09-23 03:17:25.992948 skipping [TestClusterModifyDiskTemplates] gnt-cluster modify --enabled-disk-templates=, test(s) cluster-modify disabled **** 2026-09-23 03:17:25.992989 skipping [TestClusterModifyFileStorageDir] gnt-cluster modify --file-storage-dir=, test(s) cluster-modify disabled **** 2026-09-23 03:17:25.993007 skipping [TestClusterModifySharedFileStorageDir] gnt-cluster modify --shared-file-storage-dir=, test(s) cluster-modify disabled **** 2026-09-23 03:17:25.993024 skipping [TestClusterModifyInstallImage] gnt-cluster modify --install-image=...', test(s) cluster-modify disabled **** 2026-09-23 03:17:25.993041 skipping [TestClusterModifyUserShutdown] Tests user shutdown cluster wide, test(s) cluster-modify disabled **** 2026-09-23 03:17:25.993059 skipping [TestClusterRename] gnt-cluster rename, test(s) cluster-rename disabled <<<< 2026-09-23 03:17:25.993075 start [TestClusterVersion] gnt-cluster version Command: ssh moe.staging.ganeti.org 'gnt-cluster version' Software version: 3.2.0~alpha1 Internode protocol: 3020000 Configuration format: 3020000 OS api version: 20 Export interface: 0 VCS version: (ganeti) version ---- PASSED [TestClusterVersion] gnt-cluster version ------------------- >>>> 2026-09-23 03:17:26.267690 time=0:00:00.274615 [TestClusterVersion] gnt-cluster version <<<< 2026-09-23 03:17:26.267827 start [TestClusterInfo] gnt-cluster info Command: ssh moe.staging.ganeti.org 'gnt-cluster info' Cluster name: staging-cluster.ganeti.org Cluster UUID: 94d7482d-b9d7-49f4-ae3c-cc0d7f24e66f Creation time: 2026-09-23 03:13:58 Modification time: 2026-09-23 03:17:16 Master node: moe.staging.ganeti.org Architecture (this node): 64bits (x86_64) Tags: (none) Default hypervisor: xen-hvm Enabled hypervisors: xen-hvm Hypervisor parameters: xen-hvm: acpi: True blockdev_prefix: hd boot_order: cd cdrom_image_path: cpu_cap: 0 cpu_mask: all cpu_weight: 256 cpuid: device_model: /usr/libexec/xen-qemu-system-i386 disk_type: paravirtual kernel_path: /usr/lib/xen-4.17/boot/hvmloader migration_mode: non-live migration_port: 8002 nic_type: rtl8139 pae: True pci_pass: reboot_behavior: reboot soundhw: use_localtime: False vif_script: vif_type: ioemu viridian: False vnc_bind_address: 0.0.0.0 vnc_password_file: /etc/ganeti/vnc-cluster-password OS-specific hypervisor parameters: OS parameters: Hidden OSes: Blacklisted OSes: Cluster parameters: candidate pool size: 10 maximal number of jobs running simultaneously: 20 maximal number of jobs simultaneously tracked by the scheduler: 25 mac prefix: aa:00:00 master netdev: virt-bridge master netmask: 24 use external master IP address setup script: False lvm volume group: gnt lvm reserved volumes: (none) drbd usermode helper: /bin/true file storage path: /srv/ganeti/file-storage shared file storage path: /srv/ganeti/shared-file-storage gluster storage path: /var/run/ganeti/gluster maintenance of node health: False uid pool: default instance allocator: hail default instance allocator parameters: primary ip version: 4 preallocation wipe disks: False OS search path: /srv/ganeti/os, /usr/local/lib/ganeti/os, /usr/lib/ganeti/os, /usr/share/ganeti/os ExtStorage Providers search path: /srv/ganeti/extstorage enabled disk templates: plain, file, drbd, sharedfile install image: instance communication network: zeroing image: compression tools: - gzip - gzip-fast - gzip-slow enabled user shutdown: False modify ssh setup: False ssh_key_type: rsa ssh_key_bits: 2048 Default node parameters: cpu_speed: 1 exclusive_storage: False oob_program: ovs: False ovs_link: ovs_name: switch1 spindle_count: 1 ssh_port: 22 Default instance parameters: default: always_failover: False auto_balance: True maxmem: 128 minmem: 128 spindle_use: 1 vcpus: 1 Default nic parameters: default: link: virt-bridge mode: bridged vlan: Default disk parameters: blockdev: diskless: drbd: c-delay-target: 1 c-fill-target: 0 c-max-rate: 1310720 c-min-rate: 10240 c-plan-ahead: 20 data-stripes: 1 disk-barriers: n disk-custom: dynamic-resync: True meta-barriers: False meta-stripes: 1 metavg: gnt net-custom: --max-buffers=16000 --max-epoch-size=16000 protocol: C resync-rate: 61440 ext: access: kernelspace file: gluster: access: kernelspace host: 127.0.0.1 port: 24007 volume: gv0 plain: stripes: 1 rbd: access: kernelspace namespace: pool: rbd user-id: sharedfile: Instance policy - limits for instances: bounds specs: - min/0: cpu-count: 1 disk-count: 0 disk-size: 512 memory-size: 128 nic-count: 0 spindle-use: 0 max/0: cpu-count: 48 disk-count: 8 disk-size: 1048576 memory-size: 1048576 nic-count: 8 spindle-use: 8 std: cpu-count: 1 disk-count: 1 disk-size: 1024 memory-size: 128 nic-count: 1 spindle-use: 1 allowed disk templates: sharedfile, drbd, plain, file vcpu-ratio: 4 spindle-ratio: 32 Data collectors: cpu-avg-load: active: True interval: 5.000s diskstats: active: True interval: 5.000s drbd: active: True interval: 5.000s inst-status-xen: active: True interval: 5.000s lv: active: True interval: 5.000s xen-cpu-avg-load: active: True interval: 5.000s ---- PASSED [TestClusterInfo] gnt-cluster info ------------------------- >>>> 2026-09-23 03:17:26.542696 time=0:00:00.274869 [TestClusterInfo] gnt-cluster info <<<< 2026-09-23 03:17:26.542831 start [TestClusterGetmaster] gnt-cluster getmaster Command: ssh moe.staging.ganeti.org 'gnt-cluster getmaster' moe.staging.ganeti.org ---- PASSED [TestClusterGetmaster] gnt-cluster getmaster --------------- >>>> 2026-09-23 03:17:26.817426 time=0:00:00.274595 [TestClusterGetmaster] gnt-cluster getmaster <<<< 2026-09-23 03:17:26.817576 start [TestClusterRedistConf] gnt-cluster redist-conf Command: ssh moe.staging.ganeti.org 'gnt-cluster redist-conf' ---- PASSED [TestClusterRedistConf] gnt-cluster redist-conf ------------ >>>> 2026-09-23 03:17:29.233960 time=0:00:02.416384 [TestClusterRedistConf] gnt-cluster redist-conf <<<< 2026-09-23 03:17:29.234137 start [TestClusterCopyfile] gnt-cluster copyfile /tmp/gnt.qdWWsh Command: ssh moe.staging.ganeti.org 'gnt-cluster copyfile /tmp/gnt.qdWWsh' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'cat /tmp/gnt.qdWWsh' 1f8612f8-8a37-4614-99d2-d6f3a7fc2886Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.u41n6zn5 -oControlMaster=no bart.staging.ganeti.org 'cat /tmp/gnt.qdWWsh' 1f8612f8-8a37-4614-99d2-d6f3a7fc2886Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.fox6rlvu -oControlMaster=no lisa.staging.ganeti.org 'cat /tmp/gnt.qdWWsh' 1f8612f8-8a37-4614-99d2-d6f3a7fc2886Command: ssh moe.staging.ganeti.org 'rm -f /tmp/gnt.qdWWsh' Command: ssh bart.staging.ganeti.org 'rm -f /tmp/gnt.qdWWsh' Command: ssh lisa.staging.ganeti.org 'rm -f /tmp/gnt.qdWWsh' ---- PASSED [TestClusterCopyfile] gnt-cluster copyfile ----------------- >>>> 2026-09-23 03:17:30.193904 time=0:00:00.959767 [TestClusterCopyfile] gnt-cluster copyfile <<<< 2026-09-23 03:17:30.194009 start [TestClusterCommand] gnt-cluster command Command: ssh moe.staging.ganeti.org 'gnt-cluster command '\''echo -n 8c20d242-6773-43c1-a701-825475e08dab >/tmp/gnt83277041-fe29-4d05-b14a-99fc77ab5ac5'\''' ------------------------------------------------ node: bart.staging.ganeti.org return code = 0 ------------------------------------------------ node: lisa.staging.ganeti.org return code = 0 ------------------------------------------------ node: moe.staging.ganeti.org return code = 0 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'cat /tmp/gnt83277041-fe29-4d05-b14a-99fc77ab5ac5' 8c20d242-6773-43c1-a701-825475e08dabCommand: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.u41n6zn5 -oControlMaster=no bart.staging.ganeti.org 'cat /tmp/gnt83277041-fe29-4d05-b14a-99fc77ab5ac5' 8c20d242-6773-43c1-a701-825475e08dabCommand: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.fox6rlvu -oControlMaster=no lisa.staging.ganeti.org 'cat /tmp/gnt83277041-fe29-4d05-b14a-99fc77ab5ac5' 8c20d242-6773-43c1-a701-825475e08dabCommand: ssh moe.staging.ganeti.org 'rm -f /tmp/gnt83277041-fe29-4d05-b14a-99fc77ab5ac5' Command: ssh bart.staging.ganeti.org 'rm -f /tmp/gnt83277041-fe29-4d05-b14a-99fc77ab5ac5' Command: ssh lisa.staging.ganeti.org 'rm -f /tmp/gnt83277041-fe29-4d05-b14a-99fc77ab5ac5' ---- PASSED [TestClusterCommand] gnt-cluster command ------------------- >>>> 2026-09-23 03:17:31.366756 time=0:00:01.172747 [TestClusterCommand] gnt-cluster command **** 2026-09-23 03:17:31.366909 skipping [TestClusterBurnin] Burnin, test(s) cluster-burnin disabled **** 2026-09-23 03:17:31.366930 skipping [TestClusterMasterFailover] gnt-cluster master-failover, test(s) cluster-master-failover disabled **** 2026-09-23 03:17:31.366949 skipping [TestClusterMasterFailoverWithDrainedQueue] gnt-cluster master-failover with drained queue, test(s) cluster-master-failover disabled <<<< 2026-09-23 03:17:31.366976 start [TestClusterOob] out-of-band framework Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 58, 59 Waiting for job 58 ... Wed Sep 23 03:17:33 2026 * Verifying cluster config Wed Sep 23 03:17:33 2026 * Verifying cluster certificate files Wed Sep 23 03:17:33 2026 * Verifying hypervisor parameters Wed Sep 23 03:17:33 2026 * Verifying all nodes belong to an existing group Waiting for job 59 ... Wed Sep 23 03:17:33 2026 * Verifying group 'default' Wed Sep 23 03:17:33 2026 * Gathering data (3 nodes) Wed Sep 23 03:17:33 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:17:35 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:17:35 2026 * Verifying configuration file consistency Wed Sep 23 03:17:35 2026 * Verifying node status Wed Sep 23 03:17:35 2026 * Verifying instance status Wed Sep 23 03:17:35 2026 * Verifying orphan volumes Wed Sep 23 03:17:35 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:17:35 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:17:35 2026 * Other Notes Wed Sep 23 03:17:35 2026 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-cluster modify --node-parameters oob_program=/tmp/ganeti-qa-oob-does-not-exist-89a63f8c-acc8-44a7-b5f8-7848ff129504' Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 62, 63 Waiting for job 62 ... Wed Sep 23 03:17:39 2026 * Verifying cluster config Wed Sep 23 03:17:39 2026 * Verifying cluster certificate files Wed Sep 23 03:17:39 2026 * Verifying hypervisor parameters Wed Sep 23 03:17:39 2026 * Verifying all nodes belong to an existing group Waiting for job 63 ... Wed Sep 23 03:17:39 2026 * Verifying group 'default' Wed Sep 23 03:17:39 2026 * Gathering data (3 nodes) Wed Sep 23 03:17:39 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:17:41 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:17:41 2026 * Verifying configuration file consistency Wed Sep 23 03:17:41 2026 * Verifying node status Wed Sep 23 03:17:41 2026 - ERROR: node lisa.staging.ganeti.org: error stating out of band helper: [Errno 2] No such file or directory: '/tmp/ganeti-qa-oob-does-not-exist-89a63f8c-acc8-44a7-b5f8-7848ff129504' Wed Sep 23 03:17:41 2026 - ERROR: node moe.staging.ganeti.org: error stating out of band helper: [Errno 2] No such file or directory: '/tmp/ganeti-qa-oob-does-not-exist-89a63f8c-acc8-44a7-b5f8-7848ff129504' Wed Sep 23 03:17:41 2026 - ERROR: node bart.staging.ganeti.org: error stating out of band helper: [Errno 2] No such file or directory: '/tmp/ganeti-qa-oob-does-not-exist-89a63f8c-acc8-44a7-b5f8-7848ff129504' Wed Sep 23 03:17:41 2026 * Verifying instance status Wed Sep 23 03:17:41 2026 * Verifying orphan volumes Wed Sep 23 03:17:41 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:17:41 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:17:41 2026 * Other Notes Wed Sep 23 03:17:41 2026 * Hooks Results Command: ssh moe.staging.ganeti.org 'touch /tmp/ganeti-qa-oob-does-exist-95a43691-fb3e-43b8-96e5-b3a80ed9bc78' Command: ssh moe.staging.ganeti.org 'chmod 0400 /tmp/ganeti-qa-oob-does-exist-95a43691-fb3e-43b8-96e5-b3a80ed9bc78' Command: ssh moe.staging.ganeti.org 'gnt-cluster copyfile /tmp/ganeti-qa-oob-does-exist-95a43691-fb3e-43b8-96e5-b3a80ed9bc78' Command: ssh moe.staging.ganeti.org 'gnt-cluster modify --node-parameters oob_program=/tmp/ganeti-qa-oob-does-exist-95a43691-fb3e-43b8-96e5-b3a80ed9bc78' Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 66, 67 Waiting for job 66 ... Wed Sep 23 03:17:46 2026 * Verifying cluster config Wed Sep 23 03:17:46 2026 * Verifying cluster certificate files Wed Sep 23 03:17:46 2026 * Verifying hypervisor parameters Wed Sep 23 03:17:46 2026 * Verifying all nodes belong to an existing group Waiting for job 67 ... Wed Sep 23 03:17:46 2026 * Verifying group 'default' Wed Sep 23 03:17:46 2026 * Gathering data (3 nodes) Wed Sep 23 03:17:46 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:17:48 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:17:48 2026 * Verifying configuration file consistency Wed Sep 23 03:17:48 2026 * Verifying node status Wed Sep 23 03:17:48 2026 - ERROR: node bart.staging.ganeti.org: out of band helper /tmp/ganeti-qa-oob-does-exist-95a43691-fb3e-43b8-96e5-b3a80ed9bc78 is not executable Wed Sep 23 03:17:48 2026 - ERROR: node lisa.staging.ganeti.org: out of band helper /tmp/ganeti-qa-oob-does-exist-95a43691-fb3e-43b8-96e5-b3a80ed9bc78 is not executable Wed Sep 23 03:17:48 2026 - ERROR: node moe.staging.ganeti.org: out of band helper /tmp/ganeti-qa-oob-does-exist-95a43691-fb3e-43b8-96e5-b3a80ed9bc78 is not executable Wed Sep 23 03:17:48 2026 * Verifying instance status Wed Sep 23 03:17:48 2026 * Verifying orphan volumes Wed Sep 23 03:17:48 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:17:48 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:17:48 2026 * Other Notes Wed Sep 23 03:17:48 2026 * Hooks Results Command: ssh moe.staging.ganeti.org 'chmod 0500 /tmp/ganeti-qa-oob-does-exist-95a43691-fb3e-43b8-96e5-b3a80ed9bc78' Command: ssh moe.staging.ganeti.org 'gnt-cluster copyfile /tmp/ganeti-qa-oob-does-exist-95a43691-fb3e-43b8-96e5-b3a80ed9bc78' Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 69, 70 Waiting for job 69 ... Wed Sep 23 03:17:51 2026 * Verifying cluster config Wed Sep 23 03:17:51 2026 * Verifying cluster certificate files Wed Sep 23 03:17:51 2026 * Verifying hypervisor parameters Wed Sep 23 03:17:51 2026 * Verifying all nodes belong to an existing group Waiting for job 70 ... Wed Sep 23 03:17:52 2026 * Verifying group 'default' Wed Sep 23 03:17:52 2026 * Gathering data (3 nodes) Wed Sep 23 03:17:52 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:17:53 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:17:53 2026 * Verifying configuration file consistency Wed Sep 23 03:17:53 2026 * Verifying node status Wed Sep 23 03:17:53 2026 * Verifying instance status Wed Sep 23 03:17:53 2026 * Verifying orphan volumes Wed Sep 23 03:17:53 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:17:53 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:17:53 2026 * Other Notes Wed Sep 23 03:17:54 2026 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-cluster command rm /tmp/ganeti-qa-oob-does-exist-95a43691-fb3e-43b8-96e5-b3a80ed9bc78' ------------------------------------------------ node: bart.staging.ganeti.org return code = 0 ------------------------------------------------ node: lisa.staging.ganeti.org return code = 0 ------------------------------------------------ node: moe.staging.ganeti.org return code = 0 Command: ssh moe.staging.ganeti.org 'gnt-cluster modify --node-parameters oob_program=' ---- PASSED [TestClusterOob] out-of-band framework --------------------- >>>> 2026-09-23 03:17:56.699014 time=0:00:25.332038 [TestClusterOob] out-of-band framework <<<< 2026-09-23 03:17:56.699168 start [TestInstanceCommunication] Tests instance communication via 'gnt-cluster modify' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group list --no-headers -o name' default Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list --no-headers -o name' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-cluster modify --instance-communication-network=mynetwork' Wed Sep 23 03:17:58 2026 Changing instance communication network to 'mynetwork', only new instances will be affected. Submitted jobs 73 Waiting for job 73 ... Wed Sep 23 03:17:58 2026 Changing instance communication network to 'mynetwork', only new instances will be affected. Submitted jobs 73 Waiting for job 73 ... Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list --no-headers -o name mynetwork' mynetwork Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list --no-headers -o group_list mynetwork' default (routed, communication_rt, ) Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list --no-headers -o gateway mynetwork' - Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list --no-headers -o gateway6 mynetwork' - Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list --no-headers -o network mynetwork' 169.254.0.0/16 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list --no-headers -o network6 mynetwork' fe80::/10 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group add mygroup' Submitted jobs 75 Waiting for job 75 ... Submitted jobs 75 Waiting for job 75 ... Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list --no-headers -o group_list mynetwork' default (routed, communication_rt, ), mygroup (routed, communication_rt, ) Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-cluster modify --instance-communication-network=mynetwork' Wed Sep 23 03:18:05 2026 Instance communication network already is 'mynetwork', nothing to do. Wed Sep 23 03:18:05 2026 Instance communication network already is 'mynetwork', nothing to do. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-cluster modify --instance-communication-network=' Wed Sep 23 03:18:06 2026 Previous instance communication network 'mynetwork' should be removed manually. Wed Sep 23 03:18:06 2026 Disabling instance communication network, only new instances will be affected. Wed Sep 23 03:18:06 2026 Previous instance communication network 'mynetwork' should be removed manually. Wed Sep 23 03:18:06 2026 Disabling instance communication network, only new instances will be affected. Command: ssh moe.staging.ganeti.org 'gnt-network disconnect mynetwork' Command: ssh moe.staging.ganeti.org 'gnt-network remove mynetwork' Command: ssh moe.staging.ganeti.org 'gnt-group remove mygroup' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group list --no-headers -o name' default Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list --no-headers -o name' ---- PASSED [TestInstanceCommunication] Tests instance communication via 'gnt-cluster modify' >>>> 2026-09-23 03:18:13.213984 time=0:00:16.514816 [TestInstanceCommunication] Tests instance communication via 'gnt-cluster modify' <<<< 2026-09-23 03:18:13.214153 start [TestVersion] Testing remote API version GET /version ---- PASSED [TestVersion] Testing remote API version ------------------- >>>> 2026-09-23 03:18:13.294455 time=0:00:00.080302 [TestVersion] Testing remote API version <<<< 2026-09-23 03:18:13.294652 start [TestEmptyCluster] Testing remote API on an empty cluster Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node info moe.staging.ganeti.org' - Node name: moe.staging.ganeti.org primary ip: 192.168.1.5 secondary ip: 192.168.1.5 master candidate: True drained: False offline: False master_capable: True vm_capable: True primary for instances: secondary for instances: node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) GET / GET /2/info GET /2/tags GET /2/nodes GET /2/nodes?bulk=1 GET /2/groups GET /2/groups?bulk=1 GET /2/instances GET /2/instances?bulk=1 GET /2/os GET /2/filters GET /2/filters?bulk=1 GET /99/resource/not/here/99 PUT /99/resource/not/here/99 POST /99/resource/not/here/99 DELETE /99/resource/not/here/99 PUT /version POST /version DELETE /version Testing get/modify symmetry of /2/info and /2/modify GET successful at /2/info PUT successful at /2/modify ---- PASSED [TestEmptyCluster] Testing remote API on an empty cluster -- >>>> 2026-09-23 03:18:16.745416 time=0:00:03.450764 [TestEmptyCluster] Testing remote API on an empty cluster <<<< 2026-09-23 03:18:16.745601 start [TestRapiUserPermissions] Verify the role-based access control enforces correctly Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'cat /var/lib/ganeti/rapi/users' ganeti-qa ganeti-qa write/tmp/gnt.O3z1VJ Command: ssh moe.staging.ganeti.org 'mkdir -p /var/lib/ganeti/rapi' Command: ssh moe.staging.ganeti.org 'mv /tmp/gnt.O3z1VJ /var/lib/ganeti/rapi/users' Command: ssh moe.staging.ganeti.org 'rm -f /tmp/gnt.O3z1VJ' Command: ssh moe.staging.ganeti.org 'kill -HUP $(cat /var/run/ganeti/ganeti-rapi.pid)' /tmp/gnt.VDZkk0 Command: ssh moe.staging.ganeti.org 'mkdir -p /var/lib/ganeti/rapi' Command: ssh moe.staging.ganeti.org 'mv /tmp/gnt.VDZkk0 /var/lib/ganeti/rapi/users' Command: ssh moe.staging.ganeti.org 'rm -f /tmp/gnt.VDZkk0' Command: ssh moe.staging.ganeti.org 'kill -HUP $(cat /var/run/ganeti/ganeti-rapi.pid)' ---- PASSED [TestRapiUserPermissions] Verify the role-based access control enforces correctly >>>> 2026-09-23 03:18:18.066605 time=0:00:01.321004 [TestRapiUserPermissions] Verify the role-based access control enforces correctly <<<< 2026-09-23 03:18:18.066825 start [TestRapiQuery] Testing resource queries via remote API Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node info moe.staging.ganeti.org' - Node name: moe.staging.ganeti.org primary ip: 192.168.1.5 secondary ip: 192.168.1.5 master candidate: True drained: False offline: False master_capable: True vm_capable: True primary for instances: secondary for instances: node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) GET /2/query/group/fields GET /2/query/group/fields?fields=name,name,ndp/ovs_link GET /2/query/group GET /2/query/group?fields=ndp/ovs_link,diskparams,node_cnt,pinst_list,ndp/ovs,ndparams,ndp/oob_program,ndp/ssh_port,name,serial_no,custom_ipolicy,custom_diskparams,ndp/spindle_count,ndp/exclusive_storage,uuid,ctime,ndp/ovs_name,tags,ndp/cpu_speed,pinst_cnt,alloc_policy,ipolicy,custom_ndparams,node_list,mtime GET /2/query/group?fields=name GET /2/query/group?fields=name,%20name%09,name%20 GET /2/query/network/fields GET /2/query/network/fields?fields=name,name,tags GET /2/query/network GET /2/query/network?fields=tags,group_list,serial_no,network6,map,uuid,gateway,external_reservations,free_count,name,mtime,gateway6,group_cnt,network,inst_cnt,inst_list,ctime,reserved_count,mac_prefix GET /2/query/network?fields=name GET /2/query/network?fields=name,%20name%09,name%20 GET /2/query/filter/fields GET /2/query/filter/fields?fields=uuid,uuid,priority GET /2/query/filter GET /2/query/filter?fields=priority,predicates,uuid,action,reason_trail,watermark GET /2/query/filter?fields=uuid GET /2/query/filter?fields=uuid,%20uuid%09,uuid%20 PUT /2/query/filter?fields=uuid PUT /2/query/filter PUT /2/query/filter PUT /2/query/filter PUT /2/query/filter GET /2/query/lock/fields GET /2/query/lock/fields?fields=name,name,pending GET /2/query/lock GET /2/query/lock?fields=pending,owner,mode,name GET /2/query/lock?fields=name GET /2/query/lock?fields=name,%20name%09,name%20 PUT /2/query/lock?fields=name PUT /2/query/lock PUT /2/query/lock PUT /2/query/lock PUT /2/query/lock GET /2/query/export/fields GET /2/query/export/fields?fields=export,export,node GET /2/query/export GET /2/query/export?fields=node,export GET /2/query/export?fields=export GET /2/query/export?fields=export,%20export%09,export%20 GET /2/query/instance/fields GET /2/query/instance/fields?fields=name,name,hv/scsi_controller_type GET /2/query/instance GET /2/query/instance?fields=hv/scsi_controller_type,disk.spindles/7,hv/vnc_bind_address,disk.spindles,nic.mode/7,disk.name/14,hv/kernel_args,hv/boot_order,nic.name/7,hv/vnc_x509_verify,hv/cpu_weight,nic.networks.names,mac,nic.mac/0,disk.spindles/13,hv/machine_version,nic.mac/2,disk.size/2,nic.ip/6,uuid,nic_mode,hv/disk_discard,nic.vlan/0,snodes.group.uuid,hv/serial_speed,hv/cpu_cores,hv/virtio_net_queues,disk.size/6,nic.bridge/6,hv/vnc_password_file,nic.vlan/7,console,sdb_size,disk.uuid/1,hv/spice_ip_version,hv/pci_pass,disk.uuid/15,be/memory,nic.network.name/0,oper_ram,nic.network/5,nic.bridge/5,nic.link/5,hv/pae,hv/reboot_behavior,nic.bridge/7,hv/virtio_disk_iothreads,nic.uuid/7,disk.size/11,hv/disk_type,nic_network,hv/num_ttys,hv/migration_downtime,hv/cdrom_image_path,disk.uuid/13,nic.mac/4,disk.spindles/11,disk.uuid/14,disk.count,disk.uuid/10,disk.name/5,hv/spice_zlib_glz_wan_compression,nic.name/1,hv/migration_caps,nic.vlan/1,hv/use_bootloader,be/vcpus,disk.name/9,disks_active,disk.spindles/15,sda_size,nic.mode/3,nic.name/6,tags,nic.bridge/4,nic.vlans,hv/cpu_mask,nic.mode/5,nic.name/5,hv/extra_config,nic.vlan/6,nic.link/4,disk.size/8,hv/kernel_path,nic.bridge/1,admin_state_source,nic.count,disk.size/0,disk_template,hv/spice_image_compression,hv/cpu_threads,hv/kvm_flag,nic.mode/1,nic.link/2,nic.network/0,hv/spice_jpeg_wan_compression,disk.uuid/12,disk.size/3,admin_up,hv/drop_capabilities,hv/usb_devices,pnode.group,disk.uuid/9,nic.name/3,pnode,hv/kvm_pci_reservations,hv/cpu_cap,nic_link,disk.spindles/10,disk.uuid/3,hv/extra_cgroups,nic.ip/5,be/auto_balance,disk.uuid/5,hv/use_chroot,nic.mac/6,hv/spice_bind,network_port,nic.network.name/6,hv/spice_tls_ciphers,disk.spindles/4,disk.uuid/6,hv/vnc_tls,hv/spice_streaming_video,hv/cpuid,hv/blockdev_prefix,nic.uuid/6,custom_osparams,nic.ip/3,nic.uuid/0,be/always_failover,hv/cdrom2_image_path,hv/vnc_x509_path,hv/vhost_net,hv/mem_path,disk.name/0,nic.network/4,nic.mac/5,ip,admin_state,hv/security_domain,disk.name/15,hv/vga,hv/bootloader_path,disk.uuid/4,disk.name/3,hypervisor,nic.vlan/3,hv/disk_aio,hv/startup_timeout,hv/spice_use_tls,nic.modes,hv/spice_playback_compression,hv/viridian,nic.ip/1,disk.uuids,hv/use_guest_agent,disk.name/6,disk.spindles/1,hv/kvm_extra,oper_vcpus,nic.uuids,nic.network/3,serial_no,nic.network/1,be/minmem,hv/nic_type,nic.network/7,disk.name/8,nic.link/6,disk.size/12,oper_state,nic.link/3,disk.spindles/3,disk.size/15,disk.name/2,nic.ip/4,hv/device_model,hv/disk_cache,nic.ips,nic.uuid/5,disk.size/5,hv/keymap,disk.uuid/8,nic.network/2,hv/use_localtime,hv/initrd_path,hv/serial_console,custom_hvparams,disk.name/1,disk.size/9,nic.vlan/4,disk.size/4,disk.spindles/9,nic.uuid/3,nic.network.name/2,nic.network.name/7,nic.mac/3,nic.ip/7,nic.bridge/3,nic.name/2,disk.size/7,nic.networks,snodes,disk.name/7,hv/usb_mouse,hv/user_shutdown,disk.uuid/7,pnode.group.uuid,nic.link/1,hv/cpu_type,hvparams,nic.network.name/4,ctime,nic.mode/0,hv/vif_type,hv/vif_script,disk.size/14,be/maxmem,nic.ip/0,disk.name/11,nic.network.name/5,nic.vlan/5,mtime,hv/cdrom_disk_type,disk.spindles/2,disk.uuid/11,hv/security_model,disk.uuid/0,nic.mac/1,beparams,disk.size/10,nic.link/7,disk_usage,hv/devices,hv/kvm_path,hv/cpu_sockets,nic.network.name/3,nic.uuid/2,nic.network.name/1,hv/init_script,disk.name/10,custom_beparams,hv/root_path,name,disk.size/1,nic.names,bridge,nic.bridge/0,nic.ip/2,disk.name/12,nic.uuid/1,forthcoming,nic.bridges,nic.mode/6,disk.uuid/2,disk.names,disk.size/13,nic.vlan/2,status,hv/spice_password_file,hv/spice_use_vdagent,nic.uuid/4,nic.macs,nic.link/0,be/spindle_use,disk.name/13,hv/vnet_hdr,snodes.group,custom_nicparams,nic.network/6,disk.spindles/8,disk.spindles/14,os,hv/floppy_image_path,disk.name/4,hv/bootloader_args,hv/acpi,osparams,nic.mac/7,nic.mode/2,disk.spindles/12,disk.spindles/5,disk.spindles/6,nic.links,disk.sizes,disk.spindles/0,nic.name/4,vcpus,nic.name/0,hv/soundhw,nic.bridge/2,nic.mode/4 GET /2/query/instance?fields=name GET /2/query/instance?fields=name,%20name%09,name%20 GET /2/query/node/fields GET /2/query/node/fields?fields=name,name,hv_state GET /2/query/node GET /2/query/node?fields=hv_state,mtime,master_candidate,role,pinst_cnt,cnos,powered,sinst_list,ctime,uuid,cnodes,offline,spfree,group,tags,pip,custom_ndparams,drained,ndp/spindle_count,name,vm_capable,ndp/ovs_link,ndp/oob_program,dtotal,bootid,ndp/ssh_port,sinst_cnt,ctotal,csockets,ndp/cpu_speed,sip,serial_no,ndp/exclusive_storage,dfree,pinst_list,mnode,master_capable,mtotal,disk_state,sptotal,mfree,group.uuid,master,ndp/ovs,ndparams,ndp/ovs_name GET /2/query/node?fields=name GET /2/query/node?fields=name,%20name%09,name%20 PUT /2/query/node GET /2/query/job/fields GET /2/query/job/fields?fields=id,id,start_ts GET /2/query/job GET /2/query/job?fields=start_ts,archived,opresult,received_ts,opstatus,priority,opexec,ops,opend,oplog,summary,status,id,oppriority,end_ts,opstart GET /2/query/job?fields=id GET /2/query/job?fields=id,%20id%09,id%20 PUT /2/query/job?fields=id PUT /2/query/job PUT /2/query/job PUT /2/query/job PUT /2/query/job ---- PASSED [TestRapiQuery] Testing resource queries via remote API ---- >>>> 2026-09-23 03:18:26.518562 time=0:00:08.451737 [TestRapiQuery] Testing resource queries via remote API ^^^^ BLOCK 2026-09-23 03:18:26.518732 time=0:03:07.069271 [RunClusterTests] Runs tests related to gnt-cluster vvvv BLOCK 2026-09-23 03:18:26.518819 start [RunOsTests] Runs all tests related to gnt-os **** 2026-09-23 03:18:26.518921 skipping [TestOsList] gnt-os list, test(s) ['os', >] disabled **** 2026-09-23 03:18:26.518949 skipping [TestOsDiagnose] gnt-os diagnose, test(s) ['os', >] disabled **** 2026-09-23 03:18:26.518973 skipping [TestOsValid] Testing valid OS definition, test(s) ['os', >] disabled **** 2026-09-23 03:18:26.518992 skipping [TestOsInvalid] Testing invalid OS definition, test(s) ['os', >] disabled **** 2026-09-23 03:18:26.519011 skipping [TestOsPartiallyValid] Testing partially valid OS definition, test(s) ['os', >] disabled **** 2026-09-23 03:18:26.519032 skipping [TestOsModifyValid] Testing a valid os modify invocation, test(s) ['os', >] disabled **** 2026-09-23 03:18:26.519050 skipping [TestOsModifyInvalid] Testing an invalid os modify invocation, test(s) ['os', >] disabled **** 2026-09-23 03:18:26.519070 skipping [TestOsStatesNonExisting] Testing OS states with non-existing OS, test(s) ['os', >] disabled ^^^^ BLOCK 2026-09-23 03:18:26.519085 time=0:00:00.000266 [RunOsTests] Runs all tests related to gnt-os <<<< 2026-09-23 03:18:26.519161 start [TestClusterTags] gnt-cluster tags Command: ssh moe.staging.ganeti.org 'gnt-cluster add-tags TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2' Command: ssh moe.staging.ganeti.org 'gnt-cluster list-tags' TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2 Command: ssh moe.staging.ganeti.org 'gnt-cluster search-tags '\''^TEMP-Ganeti-QA-Tag\d+$'\''' /cluster TEMP-Ganeti-QA-Tag0 /cluster TEMP-Ganeti-QA-Tag1 /cluster TEMP-Ganeti-QA-Tag2 Command: ssh moe.staging.ganeti.org 'gnt-cluster remove-tags TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2' PUT /2/tags?tag=TEMP-Ganeti-QA-Tag0&tag=TEMP-Ganeti-QA-Tag1&tag=TEMP-Ganeti-QA-Tag2 GET /2/jobs/88 GET /2/tags DELETE /2/tags?tag=TEMP-Ganeti-QA-Tag0&tag=TEMP-Ganeti-QA-Tag1&tag=TEMP-Ganeti-QA-Tag2 GET /2/jobs/89 ---- PASSED [TestClusterTags] gnt-cluster tags ------------------------- >>>> 2026-09-23 03:18:32.962702 time=0:00:06.443541 [TestClusterTags] gnt-cluster tags vvvv BLOCK 2026-09-23 03:18:32.962862 start [RunCommonNodeTests] Run a few common node tests <<<< 2026-09-23 03:18:32.962964 start [TestNodeVolumes] gnt-node volumes Command: ssh moe.staging.ganeti.org 'gnt-node volumes' Node PhysDev VG Name Size Instance ---- PASSED [TestNodeVolumes] gnt-node volumes ------------------------- >>>> 2026-09-23 03:18:34.287041 time=0:00:01.324077 [TestNodeVolumes] gnt-node volumes <<<< 2026-09-23 03:18:34.287181 start [TestNodeStorage] gnt-node storage Command: ssh moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-vg' Node Type Name Size Used Free Allocatable moe.staging.ganeti.org lvm-vg gnt 22.0G 0M 22.0G Y lisa.staging.ganeti.org lvm-vg gnt 22.0G 0M 22.0G Y bart.staging.ganeti.org lvm-vg gnt 22.0G 0M 22.0G Y Command: ssh moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-vg --output=name,allocatable,used,type,free,node,size' Name Allocatable Used Type Free Node Size gnt Y 0M lvm-vg 22.0G moe.staging.ganeti.org 22.0G gnt Y 0M lvm-vg 22.0G lisa.staging.ganeti.org 22.0G gnt Y 0M lvm-vg 22.0G bart.staging.ganeti.org 22.0G Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-vg --output=node,name,allocatable '\''--separator=|'\'' --no-headers' moe.staging.ganeti.org|gnt|Y lisa.staging.ganeti.org|gnt|Y bart.staging.ganeti.org|gnt|Y Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage moe.staging.ganeti.org lvm-vg gnt' Stderr was: No changes to perform, exiting. Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable no moe.staging.ganeti.org lvm-vg gnt' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-vg --output=name,allocatable '\''--separator=|'\'' --no-headers moe.staging.ganeti.org' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'lvm-vg' can not be modified gnt|Y Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable yes moe.staging.ganeti.org lvm-vg gnt' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-vg --output=name,allocatable '\''--separator=|'\'' --no-headers moe.staging.ganeti.org' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'lvm-vg' can not be modified gnt|Y Command: ssh moe.staging.ganeti.org 'gnt-node repair-storage moe.staging.ganeti.org lvm-vg gnt' Wed Sep 23 03:18:44 2026 Repairing storage unit 'gnt' on moe.staging.ganeti.org ... Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage lisa.staging.ganeti.org lvm-vg gnt' Stderr was: Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable no lisa.staging.ganeti.org lvm-vg gnt' No changes to perform, exiting. Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-vg --output=name,allocatable '\''--separator=|'\'' --no-headers lisa.staging.ganeti.org' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'lvm-vg' can not be modified gnt|Y Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable yes lisa.staging.ganeti.org lvm-vg gnt' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-vg --output=name,allocatable '\''--separator=|'\'' --no-headers lisa.staging.ganeti.org' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'lvm-vg' can not be modified gnt|Y Command: ssh moe.staging.ganeti.org 'gnt-node repair-storage lisa.staging.ganeti.org lvm-vg gnt' Wed Sep 23 03:18:50 2026 Repairing storage unit 'gnt' on lisa.staging.ganeti.org ... Command: ssh moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-pv' Node Type Name Size Used Free Allocatable moe.staging.ganeti.org lvm-pv /dev/vdb 22.0G 0M 22.0G Y lisa.staging.ganeti.org lvm-pv /dev/vdb 22.0G 0M 22.0G Y bart.staging.ganeti.org lvm-pv /dev/vdb 22.0G 0M 22.0G Y Command: ssh moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-pv --output=name,allocatable,used,type,free,node,size' Name Allocatable Used Type Free Node Size /dev/vdb Y 0M lvm-pv 22.0G moe.staging.ganeti.org 22.0G /dev/vdb Y 0M lvm-pv 22.0G lisa.staging.ganeti.org 22.0G /dev/vdb Y 0M lvm-pv 22.0G bart.staging.ganeti.org 22.0G Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-pv --output=node,name,allocatable '\''--separator=|'\'' --no-headers' moe.staging.ganeti.org|/dev/vdb|Y lisa.staging.ganeti.org|/dev/vdb|Y bart.staging.ganeti.org|/dev/vdb|Y Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage moe.staging.ganeti.org lvm-pv /dev/vdb' Stderr was: Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable no moe.staging.ganeti.org lvm-pv /dev/vdb' No changes to perform, exiting. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-pv --output=name,allocatable '\''--separator=|'\'' --no-headers moe.staging.ganeti.org' /dev/vdb|N Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable yes moe.staging.ganeti.org lvm-pv /dev/vdb' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-pv --output=name,allocatable '\''--separator=|'\'' --no-headers moe.staging.ganeti.org' /dev/vdb|Y Command: ssh moe.staging.ganeti.org 'gnt-node repair-storage moe.staging.ganeti.org lvm-pv /dev/vdb' Stderr was: Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage lisa.staging.ganeti.org lvm-pv /dev/vdb' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'lvm-pv' can not be repaired Stderr was: Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable no lisa.staging.ganeti.org lvm-pv /dev/vdb' No changes to perform, exiting. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-pv --output=name,allocatable '\''--separator=|'\'' --no-headers lisa.staging.ganeti.org' /dev/vdb|N Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable yes lisa.staging.ganeti.org lvm-pv /dev/vdb' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-pv --output=name,allocatable '\''--separator=|'\'' --no-headers lisa.staging.ganeti.org' /dev/vdb|Y Command: ssh moe.staging.ganeti.org 'gnt-node repair-storage lisa.staging.ganeti.org lvm-pv /dev/vdb' Stderr was: Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'lvm-pv' can not be repaired Command: ssh moe.staging.ganeti.org 'gnt-node list-storage --storage-type file' Node Type Name Size Used Free Allocatable moe.staging.ganeti.org file /srv/ganeti/file-storage 12.7G 0M 8.3G Y lisa.staging.ganeti.org file /srv/ganeti/file-storage 12.7G 0M 8.3G Y bart.staging.ganeti.org file /srv/ganeti/file-storage 12.7G 0M 8.3G Y Command: ssh moe.staging.ganeti.org 'gnt-node list-storage --storage-type file --output=name,allocatable,used,type,free,node,size' Name Allocatable Used Type Free Node Size /srv/ganeti/file-storage Y 0M file 8.3G moe.staging.ganeti.org 12.7G /srv/ganeti/file-storage Y 0M file 8.3G lisa.staging.ganeti.org 12.7G /srv/ganeti/file-storage Y 0M file 8.3G bart.staging.ganeti.org 12.7G Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type file --output=node,name,allocatable '\''--separator=|'\'' --no-headers' moe.staging.ganeti.org|/srv/ganeti/file-storage|Y lisa.staging.ganeti.org|/srv/ganeti/file-storage|Y bart.staging.ganeti.org|/srv/ganeti/file-storage|Y Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage moe.staging.ganeti.org file /srv/ganeti/file-storage' Stderr was: Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable no moe.staging.ganeti.org file /srv/ganeti/file-storage' No changes to perform, exiting. Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type file --output=name,allocatable '\''--separator=|'\'' --no-headers moe.staging.ganeti.org' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'file' can not be modified /srv/ganeti/file-storage|Y Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable yes moe.staging.ganeti.org file /srv/ganeti/file-storage' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type file --output=name,allocatable '\''--separator=|'\'' --no-headers moe.staging.ganeti.org' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'file' can not be modified /srv/ganeti/file-storage|Y Command: ssh moe.staging.ganeti.org 'gnt-node repair-storage moe.staging.ganeti.org file /srv/ganeti/file-storage' Stderr was: Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'file' can not be repaired Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage lisa.staging.ganeti.org file /srv/ganeti/file-storage' Stderr was: Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable no lisa.staging.ganeti.org file /srv/ganeti/file-storage' No changes to perform, exiting. Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type file --output=name,allocatable '\''--separator=|'\'' --no-headers lisa.staging.ganeti.org' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'file' can not be modified /srv/ganeti/file-storage|Y Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable yes lisa.staging.ganeti.org file /srv/ganeti/file-storage' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type file --output=name,allocatable '\''--separator=|'\'' --no-headers lisa.staging.ganeti.org' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'file' can not be modified /srv/ganeti/file-storage|Y Command: ssh moe.staging.ganeti.org 'gnt-node repair-storage lisa.staging.ganeti.org file /srv/ganeti/file-storage' Stderr was: ---- PASSED [TestNodeStorage] gnt-node storage ------------------------- >>>> 2026-09-23 03:19:22.728526 time=0:00:48.441345 [TestNodeStorage] gnt-node storage Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'file' can not be repaired **** 2026-09-23 03:19:22.728679 skipping [TestOutOfBand] gnt-node power, test(s) ['node-oob', >] disabled ^^^^ BLOCK 2026-09-23 03:19:22.728702 time=0:00:49.765840 [RunCommonNodeTests] Run a few common node tests vvvv BLOCK 2026-09-23 03:19:22.728815 start [RunGroupListTests] Run tests for listing node groups <<<< 2026-09-23 03:19:22.728913 start [TestGroupList] gnt-group list --- Command: ssh moe.staging.ganeti.org 'gnt-group list --output ndp/exclusive_storage,diskparams,tags,ctime,ndparams,custom_ipolicy,pinst_cnt,custom_ndparams,ipolicy,ndp/ovs_link,serial_no,ndp/cpu_speed,ndp/ovs_name,custom_diskparams,ndp/spindle_count,ndp/ovs,node_cnt,mtime,alloc_policy,name,uuid,node_list,ndp/ssh_port,ndp/oob_program,pinst_list >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-group list --output alloc_policy,ctime,custom_diskparams,custom_ipolicy,custom_ndparams,diskparams,ipolicy,mtime,name,ndp/cpu_speed,ndp/exclusive_storage,ndp/oob_program,ndp/ovs,ndp/ovs_link,ndp/ovs_name,ndp/spindle_count,ndp/ssh_port,ndparams,node_cnt,node_list,pinst_cnt,pinst_list,serial_no,tags,uuid >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-group list --output ndp/exclusive_storage,diskparams,tags,ctime,ndparams,custom_ipolicy,pinst_cnt,custom_ndparams,ipolicy,ndp/ovs_link,serial_no,ndp/cpu_speed,ndp/ovs_name,custom_diskparams,ndp/spindle_count,ndp/ovs,node_cnt,mtime,alloc_policy,name,uuid,node_list,ndp/ssh_port,ndp/oob_program,pinst_list,ndp/exclusive_storage,diskparams,tags,ctime,ndparams,custom_ipolicy,pinst_cnt,custom_ndparams,ipolicy,ndp/ovs_link,serial_no,ndp/cpu_speed,ndp/ovs_name,custom_diskparams,ndp/spindle_count,ndp/ovs,node_cnt,mtime,alloc_policy,name,uuid,node_list,ndp/ssh_port,ndp/oob_program,pinst_list >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-group list --output pinst_list,ndp/oob_program,ndp/ssh_port,node_list,uuid,name,alloc_policy >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-group list --output mtime,node_cnt,ndp/ovs >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-group list --output ndp/spindle_count,custom_diskparams,ndp/ovs_name >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-group list --output ndp/cpu_speed,serial_no,ndp/ovs_link,ipolicy,custom_ndparams,pinst_cnt >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-group list --output custom_ipolicy,ndparams,ctime,tags,diskparams >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-group list --output ndp/exclusive_storage >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group list '\''--separator=|'\'' --no-headers --output name' default Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group list '\''--separator=|'\'' --no-headers --output name default' default Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group list '\''--separator=|'\'' --no-headers --output name default' default Command: ssh moe.staging.ganeti.org 'gnt-group list this.name.certainly.does.not.exist' Stderr was: Failure: prerequisites not met for this operation: error type: unknown_entity, error details: NodeGroup name this.name.certainly.does.not.exist not found Command: ssh moe.staging.ganeti.org 'gnt-group list --output=field/does/not/exist >> /var/log/ganeti/qa-output.log' Stderr was: ---- PASSED [TestGroupList] gnt-group list ----------------------------- Warning: Queried for unknown fields field/does/not/exist >>>> 2026-09-23 03:19:25.607189 time=0:00:02.878276 [TestGroupList] gnt-group list <<<< 2026-09-23 03:19:25.607378 start [TestGroupListFields] gnt-group list-fields Command: ssh moe.staging.ganeti.org 'gnt-group list-fields >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-group list-fields alloc_policy name serial_no uuid node_cnt node_list pinst_cnt pinst_list tags ipolicy custom_ipolicy custom_ndparams ndparams diskparams custom_diskparams ndp/cpu_speed ndp/exclusive_storage ndp/oob_program ndp/ovs ndp/ovs_link ndp/ovs_name ndp/spindle_count ndp/ssh_port ctime mtime >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group list-fields '\''--separator=|'\'' --no-headers' alloc_policy|Text|AllocPolicy|Allocation policy for group ctime|Timestamp|CTime|Creation timestamp custom_diskparams|Custom|CustomDiskParameters|Custom disk parameters custom_ipolicy|Custom|CustomInstancePolicy|Custom instance policy limitations custom_ndparams|Custom|CustomNDParams|Custom node parameters diskparams|Custom|DiskParameters|Disk parameters (merged) ipolicy|Custom|InstancePolicy|Instance policy limitations (merged) mtime|Timestamp|MTime|Modification timestamp name|Text|Group|Group name ndp/cpu_speed|Floating-point number|ndp/cpu_speed|The "cpu_speed" node parameter ndp/exclusive_storage|Boolean|ExclusiveStorage|The "exclusive_storage" node parameter ndp/oob_program|Custom|OutOfBandProgram|The "oob_program" node parameter ndp/ovs|Boolean|OpenvSwitch|The "ovs" node parameter ndp/ovs_link|Custom|OpenvSwitchLink|The "ovs_link" node parameter ndp/ovs_name|Custom|OpenvSwitchName|The "ovs_name" node parameter ndp/spindle_count|Number|SpindleCount|The "spindle_count" node parameter ndp/ssh_port|Number|ndp/ssh_port|The "ssh_port" node parameter ndparams|Custom|NDParams|Node parameters node_cnt|Number|Nodes|Number of nodes node_list|Custom|NodeList|List of nodes pinst_cnt|Number|Instances|Number of primary instances pinst_list|Custom|InstanceList|List of primary instances serial_no|Number|SerialNo|Group object serial number, incremented on each modification tags|Custom|Tags|Tags uuid|Text|UUID|Group UUID Command: ssh moe.staging.ganeti.org 'gnt-group list-fields field/does/not/exist' Stdout was: Name Type Title Description field/does/not/exist Unknown field/does/not/exist Unknown field 'field/does/not/exist' Stderr was: ---- PASSED [TestGroupListFields] gnt-group list-fields ---------------- Warning: Queried for unknown fields field/does/not/exist >>>> 2026-09-23 03:19:26.409637 time=0:00:00.802259 [TestGroupListFields] gnt-group list-fields ^^^^ BLOCK 2026-09-23 03:19:26.409783 time=0:00:03.680968 [RunGroupListTests] Run tests for listing node groups vvvv BLOCK 2026-09-23 03:19:26.409864 start [RunGroupRwTests] Run tests for adding/removing/renaming groups <<<< 2026-09-23 03:19:26.409956 start [TestGroupAddRemoveRename] gnt-group add/remove/rename Command: ssh moe.staging.ganeti.org 'gnt-group add group1' Command: ssh moe.staging.ganeti.org 'gnt-group add group2' Command: ssh moe.staging.ganeti.org 'gnt-group add group2' Stderr was: Failure: prerequisites not met for this operation: error type: already_exists, error details: Desired group name 'group2' already exists as a node group (UUID: 34051fac-3452-4dc2-b38e-c3d1d16fd2dc) Command: ssh moe.staging.ganeti.org 'gnt-group add default' Stderr was: Failure: prerequisites not met for this operation: error type: already_exists, error details: Desired group name 'default' already exists as a node group (UUID: 28a33975-36e9-4bb8-9360-d9ceb6dd8f1b) Command: ssh moe.staging.ganeti.org 'gnt-group rename group1 group2' Stderr was: Failure: prerequisites not met for this operation: error type: already_exists, error details: Desired new name 'group2' clashes with existing node group (UUID: 34051fac-3452-4dc2-b38e-c3d1d16fd2dc) Command: ssh moe.staging.ganeti.org 'gnt-group rename group1 group3' Command: ssh moe.staging.ganeti.org 'gnt-group rename default group1' Command: ssh moe.staging.ganeti.org 'gnt-group remove group2' Command: ssh moe.staging.ganeti.org 'gnt-group remove group3' Command: ssh moe.staging.ganeti.org 'gnt-group remove group1' Stderr was: Failure: prerequisites not met for this operation: error type: wrong_state, error details: Group 'group1' not empty, has the following nodes: 225a8154-f533-4482-b346-f97aa50aef2d, 542e16dc-eb39-4063-aade-f655d965140f, 2395f0f3-a73f-4e1a-9029-3ea40cbccbc6 Command: ssh moe.staging.ganeti.org 'gnt-group rename group1 default' ---- PASSED [TestGroupAddRemoveRename] gnt-group add/remove/rename ----- >>>> 2026-09-23 03:19:40.295078 time=0:00:13.885122 [TestGroupAddRemoveRename] gnt-group add/remove/rename <<<< 2026-09-23 03:19:40.295203 start [TestGroupAddWithOptions] gnt-group add with options Command: ssh moe.staging.ganeti.org 'gnt-group add --alloc-policy notvalid group1' Stderr was: Unhandled protocol error while talking to the master daemon: Failed to parse request: SubmitJob: Can't parse value for 'alloc_policy': Invalid string value for type AllocPolicy: "notvalid" Command: ssh moe.staging.ganeti.org 'gnt-group add --alloc-policy last_resort --node-parameters oob_program=/bin/true group1' Command: ssh moe.staging.ganeti.org 'gnt-group remove group1' ---- PASSED [TestGroupAddWithOptions] gnt-group add with options ------- >>>> 2026-09-23 03:19:43.198305 time=0:00:02.903102 [TestGroupAddWithOptions] gnt-group add with options <<<< 2026-09-23 03:19:43.198432 start [TestGroupModify] gnt-group modify Command: ssh moe.staging.ganeti.org 'gnt-group add group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: default (48) disk-count: default (8) disk-size: default (1048576) memory-size: default (1048576) nic-count: default (8) spindle-use: default (8) min/0: cpu-count: default (1) disk-count: default (0) disk-size: default (512) memory-size: default (128) nic-count: default (0) spindle-use: default (0) allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=4,memory-size=4,disk-size=4,spindle-use=4,nic-count=4,disk-count=4/max:cpu-count=4,memory-size=4,disk-size=4,spindle-use=4,nic-count=4,disk-count=4 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: 4 disk-count: 4 disk-size: 4 memory-size: 4 nic-count: 4 spindle-use: 4 min/0: cpu-count: 4 disk-count: 4 disk-size: 4 memory-size: 4 nic-count: 4 spindle-use: 4 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=8,disk-count=4,disk-size=4,memory-size=4,nic-count=4,spindle-use=4/max:cpu-count=8,disk-count=4,disk-size=4,memory-size=4,nic-count=4,spindle-use=4 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: 8 disk-count: 4 disk-size: 4 memory-size: 4 nic-count: 4 spindle-use: 4 min/0: cpu-count: 8 disk-count: 4 disk-size: 4 memory-size: 4 nic-count: 4 spindle-use: 4 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=8,disk-count=4,disk-size=4,memory-size=4,nic-count=4,spindle-use=4/max:cpu-count=4,disk-count=4,disk-size=4,memory-size=4,nic-count=4,spindle-use=4 group1' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Invalid instance policy: Invalid specification of min/max values for cpu-count: 8/4 - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 8 disk-count: 4 disk-size: 4 memory-size: 4 nic-count: 4 spindle-use: 4 max/0: cpu-count: 8 disk-count: 4 disk-size: 4 memory-size: 4 nic-count: 4 spindle-use: 4 allowed disk templates: default (sharedfile, drbd, plain, file) vcpu-ratio: default (4) spindle-ratio: default (32) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=8,disk-count=4,disk-size=4,memory-size=8,nic-count=4,spindle-use=4/max:cpu-count=8,disk-count=4,disk-size=4,memory-size=8,nic-count=4,spindle-use=4 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 8 disk-count: 4 disk-size: 4 memory-size: 8 nic-count: 4 spindle-use: 4 max/0: cpu-count: 8 disk-count: 4 disk-size: 4 memory-size: 8 nic-count: 4 spindle-use: 4 allowed disk templates: default (sharedfile, drbd, plain, file) vcpu-ratio: default (4) spindle-ratio: default (32) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=8,disk-count=4,disk-size=4,memory-size=8,nic-count=4,spindle-use=4/max:cpu-count=8,disk-count=4,disk-size=4,memory-size=4,nic-count=4,spindle-use=4 group1' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Invalid instance policy: Invalid specification of min/max values for memory-size: 8/4 - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: 8 disk-count: 4 disk-size: 4 memory-size: 8 nic-count: 4 spindle-use: 4 min/0: cpu-count: 8 disk-count: 4 disk-size: 4 memory-size: 8 nic-count: 4 spindle-use: 4 allowed disk templates: default (sharedfile, drbd, plain, file) vcpu-ratio: default (4) spindle-ratio: default (32) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=8,disk-count=4,disk-size=8,memory-size=8,nic-count=4,spindle-use=4/max:cpu-count=8,disk-count=4,disk-size=8,memory-size=8,nic-count=4,spindle-use=4 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: 8 disk-count: 4 disk-size: 8 memory-size: 8 nic-count: 4 spindle-use: 4 min/0: cpu-count: 8 disk-count: 4 disk-size: 8 memory-size: 8 nic-count: 4 spindle-use: 4 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=8,disk-count=4,disk-size=8,memory-size=8,nic-count=4,spindle-use=4/max:cpu-count=8,disk-count=4,disk-size=4,memory-size=8,nic-count=4,spindle-use=4 group1' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Invalid instance policy: Invalid specification of min/max values for disk-size: 8/4 - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 8 disk-count: 4 disk-size: 8 memory-size: 8 nic-count: 4 spindle-use: 4 max/0: cpu-count: 8 disk-count: 4 disk-size: 8 memory-size: 8 nic-count: 4 spindle-use: 4 allowed disk templates: default (sharedfile, drbd, plain, file) vcpu-ratio: default (4) spindle-ratio: default (32) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=8,disk-count=4,disk-size=8,memory-size=8,nic-count=4,spindle-use=8/max:cpu-count=8,disk-count=4,disk-size=8,memory-size=8,nic-count=4,spindle-use=8 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 8 disk-count: 4 disk-size: 8 memory-size: 8 nic-count: 4 spindle-use: 8 max/0: cpu-count: 8 disk-count: 4 disk-size: 8 memory-size: 8 nic-count: 4 spindle-use: 8 allowed disk templates: default (sharedfile, drbd, plain, file) vcpu-ratio: default (4) spindle-ratio: default (32) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=8,disk-count=4,disk-size=8,memory-size=8,nic-count=4,spindle-use=8/max:cpu-count=8,disk-count=4,disk-size=8,memory-size=8,nic-count=4,spindle-use=4 group1' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Invalid instance policy: Invalid specification of min/max values for spindle-use: 8/4 - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: 8 disk-count: 4 disk-size: 8 memory-size: 8 nic-count: 4 spindle-use: 8 min/0: cpu-count: 8 disk-count: 4 disk-size: 8 memory-size: 8 nic-count: 4 spindle-use: 8 allowed disk templates: default (sharedfile, drbd, plain, file) vcpu-ratio: default (4) spindle-ratio: default (32) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=8,disk-count=4,disk-size=8,memory-size=8,nic-count=8,spindle-use=8/max:cpu-count=8,disk-count=4,disk-size=8,memory-size=8,nic-count=8,spindle-use=8 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: 8 disk-count: 4 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 8 min/0: cpu-count: 8 disk-count: 4 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 8 allowed disk templates: default (sharedfile, drbd, plain, file) vcpu-ratio: default (4) spindle-ratio: default (32) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=8,disk-count=4,disk-size=8,memory-size=8,nic-count=8,spindle-use=8/max:cpu-count=8,disk-count=4,disk-size=8,memory-size=8,nic-count=4,spindle-use=8 group1' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Invalid instance policy: Invalid specification of min/max values for nic-count: 8/4 - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 8 disk-count: 4 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 8 max/0: cpu-count: 8 disk-count: 4 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 8 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=8,disk-count=8,disk-size=8,memory-size=8,nic-count=8,spindle-use=8/max:cpu-count=8,disk-count=8,disk-size=8,memory-size=8,nic-count=8,spindle-use=8 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 8 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 8 max/0: cpu-count: 8 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 8 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=8,disk-count=8,disk-size=8,memory-size=8,nic-count=8,spindle-use=8/max:cpu-count=8,disk-count=4,disk-size=8,memory-size=8,nic-count=8,spindle-use=8 group1' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Invalid instance policy: Invalid specification of min/max values for disk-count: 8/4 - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: 8 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 8 min/0: cpu-count: 8 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 8 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs default group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: default (1) disk-count: default (0) disk-size: default (512) memory-size: default (128) nic-count: default (0) spindle-use: default (0) max/0: cpu-count: default (48) disk-count: default (8) disk-size: default (1048576) memory-size: default (1048576) nic-count: default (8) spindle-use: default (8) allowed disk templates: default (sharedfile, drbd, plain, file) vcpu-ratio: default (4) spindle-ratio: default (32) Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group show-ispecs-cmd --include-defaults group1' gnt-group add --ipolicy-bounds-specs min:cpu-count=1,disk-count=0,disk-size=512,memory-size=128,nic-count=0,spindle-use=0/max:cpu-count=48,disk-count=8,disk-size=1048576,memory-size=1048576,nic-count=8,spindle-use=8 group1 Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=1,disk-count=0,disk-size=512,memory-size=128,nic-count=0,spindle-use=0/max:cpu-count=48,disk-count=8,disk-size=1048576,memory-size=1048576,nic-count=8,spindle-use=8 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group show-ispecs-cmd group1' gnt-group add --ipolicy-bounds-specs min:cpu-count=1,disk-count=0,disk-size=512,memory-size=128,nic-count=0,spindle-use=0/max:cpu-count=48,disk-count=8,disk-size=1048576,memory-size=1048576,nic-count=8,spindle-use=8 group1 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 1 disk-count: 0 disk-size: 512 memory-size: 128 nic-count: 0 spindle-use: 0 max/0: cpu-count: 48 disk-count: 8 disk-size: 1048576 memory-size: 1048576 nic-count: 8 spindle-use: 8 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-vcpu-ratio 1.5 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: 48 disk-count: 8 disk-size: 1048576 memory-size: 1048576 nic-count: 8 spindle-use: 8 min/0: cpu-count: 1 disk-count: 0 disk-size: 512 memory-size: 128 nic-count: 0 spindle-use: 0 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: 1.5 Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-vcpu-ratio default group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: 48 disk-count: 8 disk-size: 1048576 memory-size: 1048576 nic-count: 8 spindle-use: 8 min/0: cpu-count: 1 disk-count: 0 disk-size: 512 memory-size: 128 nic-count: 0 spindle-use: 0 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-spindle-ratio 1.5 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: 48 disk-count: 8 disk-size: 1048576 memory-size: 1048576 nic-count: 8 spindle-use: 8 min/0: cpu-count: 1 disk-count: 0 disk-size: 512 memory-size: 128 nic-count: 0 spindle-use: 0 allowed disk templates: default (sharedfile, drbd, plain, file) vcpu-ratio: default (4) spindle-ratio: 1.5 Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-spindle-ratio default group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 1 disk-count: 0 disk-size: 512 memory-size: 128 nic-count: 0 spindle-use: 0 max/0: cpu-count: 48 disk-count: 8 disk-size: 1048576 memory-size: 1048576 nic-count: 8 spindle-use: 8 allowed disk templates: default (sharedfile, drbd, plain, file) vcpu-ratio: default (4) spindle-ratio: default (32) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-disk-templates plain group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: 48 disk-count: 8 disk-size: 1048576 memory-size: 1048576 nic-count: 8 spindle-use: 8 min/0: cpu-count: 1 disk-count: 0 disk-size: 512 memory-size: 128 nic-count: 0 spindle-use: 0 allowed disk templates: plain spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-disk-templates default group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) namespace: default () pool: default (rbd) user-id: default () sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 1 disk-count: 0 disk-size: 512 memory-size: 128 nic-count: 0 spindle-use: 0 max/0: cpu-count: 48 disk-count: 8 disk-size: 1048576 memory-size: 1048576 nic-count: 8 spindle-use: 8 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --alloc-policy unallocable --node-parameters oob_program=/bin/false group1' Modified node group group1 - ndparams -> {'oob_program': '/bin/false'} Command: ssh moe.staging.ganeti.org 'gnt-group modify --alloc-policy notvalid group1' Stderr was: Unhandled protocol error while talking to the master daemon: Failed to parse request: SubmitJob: Can't parse value for 'alloc_policy': Invalid string value for type AllocPolicy: "notvalid" Command: ssh moe.staging.ganeti.org 'gnt-group modify --node-parameters spindle_count=10 group1' Modified node group group1 - ndparams -> {'oob_program': '/bin/false', 'spindle_count': 10} Command: ssh moe.staging.ganeti.org 'hbal -L -G group1' Cluster is empty, exiting. Command: ssh moe.staging.ganeti.org 'gnt-group modify --node-parameters spindle_count=default group1' Modified node group group1 - ndparams -> {'oob_program': '/bin/false'} Command: ssh moe.staging.ganeti.org 'gnt-group remove group1' ---- PASSED [TestGroupModify] gnt-group modify ------------------------- >>>> 2026-09-23 03:20:20.003693 time=0:00:36.805261 [TestGroupModify] gnt-group modify <<<< 2026-09-23 03:20:20.003867 start [TestRapiNodeGroups] Test several node group operations using RAPI POST /2/groups GET /2/jobs/169 POST /2/groups GET /2/jobs/170 PUT /2/groups/group1/modify GET /2/jobs/171 PUT /2/groups/group2/rename GET /2/jobs/172 Testing get/modify symmetry of /2/groups/group3 and /2/groups/group3/modify GET successful at /2/groups/group3 PUT successful at /2/groups/group3/modify DELETE /2/groups/group1 GET /2/jobs/174 DELETE /2/groups/group3 GET /2/jobs/175 ---- PASSED [TestRapiNodeGroups] Test several node group operations using RAPI >>>> 2026-09-23 03:20:28.518183 time=0:00:08.514316 [TestRapiNodeGroups] Test several node group operations using RAPI <<<< 2026-09-23 03:20:28.518331 start [TestGroupTags] gnt-group tags --- Command: ssh moe.staging.ganeti.org 'gnt-group add-tags default TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2' Command: ssh moe.staging.ganeti.org 'gnt-group list-tags default' TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2 Command: ssh moe.staging.ganeti.org 'gnt-cluster search-tags '\''^TEMP-Ganeti-QA-Tag\d+$'\''' /nodegroup/default TEMP-Ganeti-QA-Tag0 /nodegroup/default TEMP-Ganeti-QA-Tag1 /nodegroup/default TEMP-Ganeti-QA-Tag2 Command: ssh moe.staging.ganeti.org 'gnt-group remove-tags default TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2' PUT /2/groups/default/tags?tag=TEMP-Ganeti-QA-Tag0&tag=TEMP-Ganeti-QA-Tag1&tag=TEMP-Ganeti-QA-Tag2 GET /2/jobs/179 GET /2/groups/default/tags DELETE /2/groups/default/tags?tag=TEMP-Ganeti-QA-Tag0&tag=TEMP-Ganeti-QA-Tag1&tag=TEMP-Ganeti-QA-Tag2 GET /2/jobs/180 ---- PASSED [TestGroupTags] gnt-group tags ----------------------------- >>>> 2026-09-23 03:20:34.335725 time=0:00:05.817394 [TestGroupTags] gnt-group tags ^^^^ BLOCK 2026-09-23 03:20:34.335868 time=0:01:07.926004 [RunGroupRwTests] Run tests for adding/removing/renaming groups vvvv BLOCK 2026-09-23 03:20:34.335958 start [RunNetworkTests] Run tests for network management <<<< 2026-09-23 03:20:34.336050 start [TestNetworkAddRemove] gnt-network add/remove Command: ssh moe.staging.ganeti.org 'gnt-network add --network 192.0.2.0/30 network1' Command: ssh moe.staging.ganeti.org 'gnt-network add --network 198.51.100.0/24 network2' Command: ssh moe.staging.ganeti.org 'gnt-network add --network 203.0.133.0/24 network2' Stderr was: Failure: prerequisites not met for this operation: error type: already_exists, error details: Desired network name 'network2' already exists as a network (UUID: be4e5dc5-02a9-4f65-9bd7-6c98843befb3) Command: ssh moe.staging.ganeti.org 'gnt-network list --output group_cnt,inst_list,serial_no,mac_prefix,free_count,reserved_count,gateway6,name,uuid,group_list,network,map,inst_cnt,tags,ctime,network6,gateway,mtime,external_reservations >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output ctime,external_reservations,free_count,gateway,gateway6,group_cnt,group_list,inst_cnt,inst_list,mac_prefix,map,mtime,name,network,network6,reserved_count,serial_no,tags,uuid >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output group_cnt,inst_list,serial_no,mac_prefix,free_count,reserved_count,gateway6,name,uuid,group_list,network,map,inst_cnt,tags,ctime,network6,gateway,mtime,external_reservations,group_cnt,inst_list,serial_no,mac_prefix,free_count,reserved_count,gateway6,name,uuid,group_list,network,map,inst_cnt,tags,ctime,network6,gateway,mtime,external_reservations >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output external_reservations,mtime,gateway,network6,ctime,tags,inst_cnt >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output map,network,group_list >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output uuid,name,gateway6 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output reserved_count,free_count,mac_prefix >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output serial_no,inst_list,group_cnt >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list '\''--separator=|'\'' --no-headers --output name' network1 network2 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list '\''--separator=|'\'' --no-headers --output name network2 network1' network2 network1 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list '\''--separator=|'\'' --no-headers --output name network2 network1' network2 network1 Command: ssh moe.staging.ganeti.org 'gnt-network list this.name.certainly.does.not.exist' Stderr was: Failure: prerequisites not met for this operation: error type: unknown_entity, error details: Network name this.name.certainly.does.not.exist not found Command: ssh moe.staging.ganeti.org 'gnt-network list --output=field/does/not/exist >> /var/log/ganeti/qa-output.log' Stderr was: Warning: Queried for unknown fields field/does/not/exist Command: ssh moe.staging.ganeti.org 'gnt-network list-fields >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list-fields tags name network gateway network6 gateway6 mac_prefix serial_no uuid group_cnt group_list inst_cnt inst_list free_count reserved_count map external_reservations ctime mtime >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list-fields '\''--separator=|'\'' --no-headers' ctime|Timestamp|CTime|Creation timestamp external_reservations|Text|ExternalReservations|External reservations free_count|Number|FreeCount|Number of available addresses gateway|Custom|Gateway|IPv4 gateway gateway6|Custom|IPv6Gateway|IPv6 gateway group_cnt|Number|NodeGroups|Number of nodegroups group_list|Custom|GroupList|List of nodegroups (group name, NIC mode, NIC link) inst_cnt|Number|Instances|Number of instances inst_list|Custom|InstanceList|List of instances mac_prefix|Custom|MacPrefix|MAC address prefix map|Text|Map|Actual mapping mtime|Timestamp|MTime|Modification timestamp name|Text|Network|Name network|Text|Subnet|IPv4 subnet network6|Custom|IPv6Subnet|IPv6 subnet reserved_count|Number|ReservedCount|Number of reserved addresses serial_no|Number|SerialNo|Network object serial number, incremented on each modification tags|Custom|Tags|Tags uuid|Text|UUID|Network UUID Command: ssh moe.staging.ganeti.org 'gnt-network list-fields field/does/not/exist' Stdout was: Name Type Title Description field/does/not/exist Unknown field/does/not/exist Unknown field 'field/does/not/exist' Stderr was: Command: ssh moe.staging.ganeti.org 'gnt-network remove network1' Warning: Queried for unknown fields field/does/not/exist Command: ssh moe.staging.ganeti.org 'gnt-network remove network2' Command: ssh moe.staging.ganeti.org 'gnt-network list --output group_cnt,inst_list,serial_no,mac_prefix,free_count,reserved_count,gateway6,name,uuid,group_list,network,map,inst_cnt,tags,ctime,network6,gateway,mtime,external_reservations >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output ctime,external_reservations,free_count,gateway,gateway6,group_cnt,group_list,inst_cnt,inst_list,mac_prefix,map,mtime,name,network,network6,reserved_count,serial_no,tags,uuid >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output group_cnt,inst_list,serial_no,mac_prefix,free_count,reserved_count,gateway6,name,uuid,group_list,network,map,inst_cnt,tags,ctime,network6,gateway,mtime,external_reservations,group_cnt,inst_list,serial_no,mac_prefix,free_count,reserved_count,gateway6,name,uuid,group_list,network,map,inst_cnt,tags,ctime,network6,gateway,mtime,external_reservations >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output external_reservations,mtime,gateway,network6,ctime,tags,inst_cnt >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output map,network,group_list >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output uuid,name,gateway6 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output reserved_count,free_count,mac_prefix >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output serial_no,inst_list,group_cnt >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list '\''--separator=|'\'' --no-headers --output name' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list '\''--separator=|'\'' --no-headers --output name' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list '\''--separator=|'\'' --no-headers --output name' Command: ssh moe.staging.ganeti.org 'gnt-network list this.name.certainly.does.not.exist' Stderr was: Failure: prerequisites not met for this operation: error type: unknown_entity, error details: Network name this.name.certainly.does.not.exist not found Command: ssh moe.staging.ganeti.org 'gnt-network list --output=field/does/not/exist >> /var/log/ganeti/qa-output.log' Stderr was: ---- PASSED [TestNetworkAddRemove] gnt-network add/remove -------------- Warning: Queried for unknown fields field/does/not/exist >>>> 2026-09-23 03:20:46.858117 time=0:00:12.522067 [TestNetworkAddRemove] gnt-network add/remove <<<< 2026-09-23 03:20:46.858281 start [TestNetworkConnect] gnt-network connect/disconnect Command: ssh moe.staging.ganeti.org 'gnt-group add group1' Command: ssh moe.staging.ganeti.org 'gnt-network add --network 192.0.2.0/24 network1' Command: ssh moe.staging.ganeti.org 'gnt-network connect --nic-parameters mode=bridged,link=xen-br0 network1 group1' Command: ssh moe.staging.ganeti.org 'gnt-network list --output group_cnt,inst_list,serial_no,mac_prefix,free_count,reserved_count,gateway6,name,uuid,group_list,network,map,inst_cnt,tags,ctime,network6,gateway,mtime,external_reservations >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output ctime,external_reservations,free_count,gateway,gateway6,group_cnt,group_list,inst_cnt,inst_list,mac_prefix,map,mtime,name,network,network6,reserved_count,serial_no,tags,uuid >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output group_cnt,inst_list,serial_no,mac_prefix,free_count,reserved_count,gateway6,name,uuid,group_list,network,map,inst_cnt,tags,ctime,network6,gateway,mtime,external_reservations,group_cnt,inst_list,serial_no,mac_prefix,free_count,reserved_count,gateway6,name,uuid,group_list,network,map,inst_cnt,tags,ctime,network6,gateway,mtime,external_reservations >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output external_reservations,mtime,gateway,network6,ctime,tags,inst_cnt >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output map,network,group_list >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output uuid,name,gateway6 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output reserved_count,free_count,mac_prefix >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output serial_no,inst_list,group_cnt >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list '\''--separator=|'\'' --no-headers --output name' network1 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list '\''--separator=|'\'' --no-headers --output name network1' network1 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'gnt-network list '\''--separator=|'\'' --no-headers --output name network1' network1 Command: ssh moe.staging.ganeti.org 'gnt-network list this.name.certainly.does.not.exist' Stderr was: Failure: prerequisites not met for this operation: error type: unknown_entity, error details: Network name this.name.certainly.does.not.exist not found Command: ssh moe.staging.ganeti.org 'gnt-network list --output=field/does/not/exist >> /var/log/ganeti/qa-output.log' Stderr was: Warning: Queried for unknown fields field/does/not/exist Command: ssh moe.staging.ganeti.org 'gnt-network disconnect network1 group1' Command: ssh moe.staging.ganeti.org 'gnt-group remove group1' Command: ssh moe.staging.ganeti.org 'gnt-network remove network1' ---- PASSED [TestNetworkConnect] gnt-network connect/disconnect -------- >>>> 2026-09-23 03:20:57.834261 time=0:00:10.975980 [TestNetworkConnect] gnt-network connect/disconnect <<<< 2026-09-23 03:20:57.834418 start [TestNetworkTags] gnt-network tags Command: ssh moe.staging.ganeti.org 'gnt-network add --network 192.0.2.0/30 network1' Command: ssh moe.staging.ganeti.org 'gnt-network add-tags network1 TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2' Command: ssh moe.staging.ganeti.org 'gnt-network list-tags network1' TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2 Command: ssh moe.staging.ganeti.org 'gnt-cluster search-tags '\''^TEMP-Ganeti-QA-Tag\d+$'\''' /network/network1 TEMP-Ganeti-QA-Tag0 /network/network1 TEMP-Ganeti-QA-Tag1 /network/network1 TEMP-Ganeti-QA-Tag2 Command: ssh moe.staging.ganeti.org 'gnt-network remove-tags network1 TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2' PUT /2/networks/network1/tags?tag=TEMP-Ganeti-QA-Tag0&tag=TEMP-Ganeti-QA-Tag1&tag=TEMP-Ganeti-QA-Tag2 GET /2/jobs/196 GET /2/networks/network1/tags DELETE /2/networks/network1/tags?tag=TEMP-Ganeti-QA-Tag0&tag=TEMP-Ganeti-QA-Tag1&tag=TEMP-Ganeti-QA-Tag2 GET /2/jobs/197 Command: ssh moe.staging.ganeti.org 'gnt-network remove network1' ---- PASSED [TestNetworkTags] gnt-network tags ------------------------- >>>> 2026-09-23 03:21:08.352572 time=0:00:10.518154 [TestNetworkTags] gnt-network tags ^^^^ BLOCK 2026-09-23 03:21:08.352685 time=0:00:34.016727 [RunNetworkTests] Run tests for network management vvvv BLOCK 2026-09-23 03:21:08.352762 start [RunFilterTests] Run tests for job filter management **** 2026-09-23 03:21:08.352857 skipping [TestFilterList] gnt-filter list, test(s) filters disabled **** 2026-09-23 03:21:08.352887 skipping [TestFilterListFields] gnt-filter list-fields, test(s) filters disabled **** 2026-09-23 03:21:08.352905 skipping [TestFilterAddRemove] gnt-filter add/delete, test(s) filters disabled **** 2026-09-23 03:21:08.352923 skipping [TestFilterReject] Tests that the REJECT filter does reject new jobs and that the, test(s) filters disabled **** 2026-09-23 03:21:08.352947 skipping [TestFilterOpCode] Tests that filtering with the "opcode" predicate works, test(s) filters disabled **** 2026-09-23 03:21:08.352989 skipping [TestFilterReasonChain] Tests that filters are processed in the right order and that the, test(s) filters disabled **** 2026-09-23 03:21:08.353007 skipping [TestFilterContinue] Tests that the CONTINUE filter has no effect, test(s) filters disabled **** 2026-09-23 03:21:08.353024 skipping [TestFilterAcceptPause] Tests that the PAUSE filter allows scheduling, but prevents starting,, test(s) filters disabled **** 2026-09-23 03:21:08.353041 skipping [TestFilterWatermark] Tests that the filter watermark is set correctly, test(s) filters disabled **** 2026-09-23 03:21:08.353058 skipping [TestFilterRateLimit] Tests that the RATE_LIMIT filter does reject new jobs when all, test(s) filters disabled **** 2026-09-23 03:21:08.353075 skipping [TestAdHocReasonRateLimit] Tests that ad-hoc rate limiting using --reason="rate-limit:n:..." works, test(s) filters disabled ^^^^ BLOCK 2026-09-23 03:21:08.353089 time=0:00:00.000327 [RunFilterTests] Run tests for job filter management <<<< 2026-09-23 03:21:08.353224 start [TestNodeReadd] gnt-node add --readd Command: ssh moe.staging.ganeti.org 'gnt-node add --no-ssh-key-check --secondary-ip=192.168.1.6 --readd --no-node-setup bart.staging.ganeti.org' Stdout was: -- WARNING -- The option --no-node-setup is disabled. Whether or not the SSH setup is manipulated while adding a node is determined by the 'modify_ssh_setup' value in the cluster-wide configuration instead. Wed Sep 23 03:21:11 2026 - INFO: Readding a node, the offline/drained flags were reset Wed Sep 23 03:21:11 2026 - INFO: Node will be a master candidate Stderr was: ALERT: ganeti-noded started in debug mode. Private and secret parameters WILL be logged! Command: ssh moe.staging.ganeti.org 'gnt-cluster verify >> /var/log/ganeti/qa-output.log' ---- PASSED [TestNodeReadd] gnt-node add --readd ----------------------- >>>> 2026-09-23 03:21:18.513742 time=0:00:10.160518 [TestNodeReadd] gnt-node add --readd <<<< 2026-09-23 03:21:18.513899 start [TestNodeModify] gnt-node modify - Command: ssh moe.staging.ganeti.org 'gnt-cluster modify --candidate-pool-size=2' Command: ssh moe.staging.ganeti.org 'gnt-node modify --master-candidate=no --auto-promote bart.staging.ganeti.org' Modified node bart.staging.ganeti.org - master_candidate -> False Command: ssh moe.staging.ganeti.org 'gnt-node modify --force --master-candidate=yes bart.staging.ganeti.org' Modified node bart.staging.ganeti.org - master_candidate -> True Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 207, 208 Waiting for job 207 ... Wed Sep 23 03:21:26 2026 * Verifying cluster config Wed Sep 23 03:21:26 2026 * Verifying cluster certificate files Wed Sep 23 03:21:26 2026 * Verifying hypervisor parameters Wed Sep 23 03:21:26 2026 * Verifying all nodes belong to an existing group Waiting for job 208 ... Wed Sep 23 03:21:27 2026 * Verifying group 'default' Wed Sep 23 03:21:27 2026 * Gathering data (3 nodes) Wed Sep 23 03:21:27 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:21:28 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:21:28 2026 * Verifying configuration file consistency Wed Sep 23 03:21:28 2026 * Verifying node status Wed Sep 23 03:21:28 2026 * Verifying instance status Wed Sep 23 03:21:28 2026 * Verifying orphan volumes Wed Sep 23 03:21:28 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:21:28 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:21:28 2026 * Other Notes Wed Sep 23 03:21:28 2026 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-node modify --force --master-candidate=no bart.staging.ganeti.org' Modified node bart.staging.ganeti.org - master_candidate -> False Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 211, 212 Waiting for job 211 ... Wed Sep 23 03:21:33 2026 * Verifying cluster config Wed Sep 23 03:21:33 2026 * Verifying cluster certificate files Wed Sep 23 03:21:33 2026 * Verifying hypervisor parameters Wed Sep 23 03:21:33 2026 * Verifying all nodes belong to an existing group Waiting for job 212 ... Wed Sep 23 03:21:33 2026 * Verifying group 'default' Wed Sep 23 03:21:33 2026 * Gathering data (3 nodes) Wed Sep 23 03:21:33 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:21:34 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:21:34 2026 * Verifying configuration file consistency Wed Sep 23 03:21:34 2026 * Verifying node status Wed Sep 23 03:21:34 2026 * Verifying instance status Wed Sep 23 03:21:34 2026 * Verifying orphan volumes Wed Sep 23 03:21:34 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:21:35 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:21:35 2026 * Other Notes Wed Sep 23 03:21:35 2026 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-node modify --force --drained=yes bart.staging.ganeti.org' Modified node bart.staging.ganeti.org - drained -> True Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 215, 216 Waiting for job 215 ... Wed Sep 23 03:21:38 2026 * Verifying cluster config Wed Sep 23 03:21:38 2026 * Verifying cluster certificate files Wed Sep 23 03:21:38 2026 * Verifying hypervisor parameters Wed Sep 23 03:21:38 2026 * Verifying all nodes belong to an existing group Waiting for job 216 ... Wed Sep 23 03:21:38 2026 * Verifying group 'default' Wed Sep 23 03:21:38 2026 * Gathering data (3 nodes) Wed Sep 23 03:21:38 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:21:40 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:21:40 2026 * Verifying configuration file consistency Wed Sep 23 03:21:40 2026 * Verifying node status Wed Sep 23 03:21:40 2026 * Verifying instance status Wed Sep 23 03:21:40 2026 * Verifying orphan volumes Wed Sep 23 03:21:40 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:21:40 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:21:40 2026 * Other Notes Wed Sep 23 03:21:40 2026 - NOTICE: 1 drained node(s) found. Wed Sep 23 03:21:40 2026 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-node modify --force --drained=no bart.staging.ganeti.org' Modified node bart.staging.ganeti.org - drained -> False Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 219, 220 Waiting for job 219 ... Wed Sep 23 03:21:43 2026 * Verifying cluster config Wed Sep 23 03:21:43 2026 * Verifying cluster certificate files Wed Sep 23 03:21:43 2026 * Verifying hypervisor parameters Wed Sep 23 03:21:43 2026 * Verifying all nodes belong to an existing group Waiting for job 220 ... Wed Sep 23 03:21:44 2026 * Verifying group 'default' Wed Sep 23 03:21:44 2026 * Gathering data (3 nodes) Wed Sep 23 03:21:44 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:21:45 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:21:45 2026 * Verifying configuration file consistency Wed Sep 23 03:21:45 2026 * Verifying node status Wed Sep 23 03:21:45 2026 * Verifying instance status Wed Sep 23 03:21:45 2026 * Verifying orphan volumes Wed Sep 23 03:21:45 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:21:45 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:21:45 2026 * Other Notes Wed Sep 23 03:21:46 2026 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-node modify --force --offline=yes bart.staging.ganeti.org' Modified node bart.staging.ganeti.org - offline -> True Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 223, 224 Waiting for job 223 ... Wed Sep 23 03:21:49 2026 * Verifying cluster config Wed Sep 23 03:21:49 2026 * Verifying cluster certificate files Wed Sep 23 03:21:49 2026 * Verifying hypervisor parameters Wed Sep 23 03:21:49 2026 * Verifying all nodes belong to an existing group Waiting for job 224 ... Wed Sep 23 03:21:49 2026 * Verifying group 'default' Wed Sep 23 03:21:49 2026 * Gathering data (3 nodes) Wed Sep 23 03:21:49 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:21:50 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:21:50 2026 * Verifying configuration file consistency Wed Sep 23 03:21:50 2026 * Verifying node status Wed Sep 23 03:21:50 2026 * Verifying instance status Wed Sep 23 03:21:50 2026 * Verifying orphan volumes Wed Sep 23 03:21:50 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:21:50 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:21:50 2026 * Other Notes Wed Sep 23 03:21:50 2026 - NOTICE: 1 offline node(s) found. Wed Sep 23 03:21:51 2026 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-node modify --force --offline=no bart.staging.ganeti.org' Wed Sep 23 03:21:52 2026 - WARNING: Transitioning node from offline to online state without using re-add. Please make sure the node is healthy! Modified node bart.staging.ganeti.org - offline -> False Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 227, 228 Waiting for job 227 ... Wed Sep 23 03:21:54 2026 * Verifying cluster config Wed Sep 23 03:21:54 2026 * Verifying cluster certificate files Wed Sep 23 03:21:54 2026 * Verifying hypervisor parameters Wed Sep 23 03:21:54 2026 * Verifying all nodes belong to an existing group Waiting for job 228 ... Wed Sep 23 03:21:54 2026 * Verifying group 'default' Wed Sep 23 03:21:54 2026 * Gathering data (3 nodes) Wed Sep 23 03:21:54 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:21:56 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:21:56 2026 * Verifying configuration file consistency Wed Sep 23 03:21:56 2026 * Verifying node status Wed Sep 23 03:21:56 2026 * Verifying instance status Wed Sep 23 03:21:56 2026 * Verifying orphan volumes Wed Sep 23 03:21:56 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:21:56 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:21:56 2026 * Other Notes Wed Sep 23 03:21:56 2026 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-node modify --master-candidate=yes bart.staging.ganeti.org' Modified node bart.staging.ganeti.org - master_candidate -> True Command: ssh moe.staging.ganeti.org 'gnt-node modify --secondary-ip=192.168.1.6 bart.staging.ganeti.org' Modified node bart.staging.ganeti.org - secondary_ip -> 192.168.1.6 Command: ssh moe.staging.ganeti.org 'gnt-cluster verify >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-cluster modify --candidate-pool-size=10' Wed Sep 23 03:22:06 2026 - INFO: Note: more nodes are candidates (3) than desired (2) ---- PASSED [TestNodeModify] gnt-node modify --------------------------- >>>> 2026-09-23 03:22:06.791393 time=0:00:48.277494 [TestNodeModify] gnt-node modify <<<< 2026-09-23 03:22:06.791520 start [TestDelay] gnt-debug delay ------ Command: ssh moe.staging.ganeti.org 'gnt-debug delay 1' Command: ssh moe.staging.ganeti.org 'gnt-debug delay --no-master 1' Command: ssh moe.staging.ganeti.org 'gnt-debug delay --no-master -n bart.staging.ganeti.org 1' ---- PASSED [TestDelay] gnt-debug delay -------------------------------- >>>> 2026-09-23 03:22:13.107385 time=0:00:06.315865 [TestDelay] gnt-debug delay Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' bc27ecdc4edeec7d1dc7e1ebb986f4c0d1356c6a /var/lib/ganeti/config.data Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 239, 240 Waiting for job 239 ... Wed Sep 23 03:22:15 2026 * Verifying cluster config Wed Sep 23 03:22:15 2026 * Verifying cluster certificate files Wed Sep 23 03:22:15 2026 * Verifying hypervisor parameters Wed Sep 23 03:22:15 2026 * Verifying all nodes belong to an existing group Waiting for job 240 ... Wed Sep 23 03:22:15 2026 * Verifying group 'default' Wed Sep 23 03:22:15 2026 * Gathering data (3 nodes) Wed Sep 23 03:22:15 2026 * Gathering information about nodes (3 nodes) Wed Sep 23 03:22:17 2026 * Gathering disk information (3 nodes) Wed Sep 23 03:22:17 2026 * Verifying configuration file consistency Wed Sep 23 03:22:17 2026 * Verifying node status Wed Sep 23 03:22:17 2026 * Verifying instance status Wed Sep 23 03:22:17 2026 * Verifying orphan volumes Wed Sep 23 03:22:17 2026 * Verifying N+1 Memory redundancy Wed Sep 23 03:22:17 2026 * Assessing cluster hypervisor parameters Wed Sep 23 03:22:17 2026 * Other Notes Wed Sep 23 03:22:17 2026 * Hooks Results Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.33pf3v6i -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' bc27ecdc4edeec7d1dc7e1ebb986f4c0d1356c6a /var/lib/ganeti/config.data <<<< 2026-09-23 03:22:17.650513 start [TestNodeTags] gnt-node tags ----- Command: ssh moe.staging.ganeti.org 'gnt-node add-tags bart.staging.ganeti.org TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2' Command: ssh moe.staging.ganeti.org 'gnt-node list-tags bart.staging.ganeti.org' TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2 Command: ssh moe.staging.ganeti.org 'gnt-cluster search-tags '\''^TEMP-Ganeti-QA-Tag\d+$'\''' /nodes/bart.staging.ganeti.org TEMP-Ganeti-QA-Tag0 /nodes/bart.staging.ganeti.org TEMP-Ganeti-QA-Tag1 /nodes/bart.staging.ganeti.org TEMP-Ganeti-QA-Tag2 Command: ssh moe.staging.ganeti.org 'gnt-node remove-tags bart.staging.ganeti.org TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2' PUT /2/nodes/bart.staging.ganeti.org/tags?tag=TEMP-Ganeti-QA-Tag0&tag=TEMP-Ganeti-QA-Tag1&tag=TEMP-Ganeti-QA-Tag2 GET /2/jobs/244 GET /2/nodes/bart.staging.ganeti.org/tags DELETE /2/nodes/bart.staging.ganeti.org/tags?tag=TEMP-Ganeti-QA-Tag0&tag=TEMP-Ganeti-QA-Tag1&tag=TEMP-Ganeti-QA-Tag2 GET /2/jobs/245 ---- PASSED [TestNodeTags] gnt-node tags ------------------------------- >>>> 2026-09-23 03:22:24.090572 time=0:00:06.440059 [TestNodeTags] gnt-node tags <<<< 2026-09-23 03:22:24.090733 start [TestNode] Testing getting node(s) info via remote API GET /2/nodes/bart.staging.ganeti.org GET /2/nodes GET /2/nodes?bulk=1 Testing get/modify symmetry of /2/nodes/bart.staging.ganeti.org and /2/nodes/bart.staging.ganeti.org/modify GET successful at /2/nodes/bart.staging.ganeti.org POST successful at /2/nodes/bart.staging.ganeti.org/modify ---- PASSED [TestNode] Testing getting node(s) info via remote API ----- >>>> 2026-09-23 03:22:25.143959 time=0:00:01.053226 [TestNode] Testing getting node(s) info via remote API <<<< 2026-09-23 03:22:25.144185 start [TestRapiInstanceAdd] Test adding a new instance via RAPI GET /2/jobs/247 Wed Sep 23 03:22:26 2026 * disk 0, size 768M Wed Sep 23 03:22:26 2026 * disk 1, size 512M Wed Sep 23 03:22:26 2026 * creating instance disks... Wed Sep 23 03:22:27 2026 adding instance kvm-test-instance01.staging.ganeti.org to cluster config Wed Sep 23 03:22:27 2026 adding disks to cluster config Wed Sep 23 03:22:27 2026 - INFO: Waiting for instance kvm-test-instance01.staging.ganeti.org to sync disks Wed Sep 23 03:22:27 2026 - INFO: Instance kvm-test-instance01.staging.ganeti.org's disks are in sync Wed Sep 23 03:22:27 2026 - INFO: Waiting for instance kvm-test-instance01.staging.ganeti.org to sync disks Wed Sep 23 03:22:28 2026 - INFO: Instance kvm-test-instance01.staging.ganeti.org's disks are in sync Wed Sep 23 03:22:28 2026 * running the instance OS create scripts... Wed Sep 23 03:22:28 2026 * starting instance... ---- FAILED [TestRapiInstanceAdd] Test adding a new instance via RAPI: Could not start instance: Hypervisor error: Failed to start instance kvm-test-instance01.staging.ganeti.org: exited with exit code 3 (Parsing config from /etc/xen/kvm-test-instance01.staging.ganeti.org WARNING: you seem to be using "kernel" directive to override HVM guest firmware. Ignore that. Use "firmware_override" instead if you really want a non-default firmware WARNING: ignoring device_model directive. WARNING: Use "device_model_override" instead if you really want a non-default device_model libxl: error: libxl_qmp.c:1401:qmp_ev_fd_callback: Domain 1:received POLLHUP|POLLERR from QMP socket libxl: error: libxl_qmp.c:1438:qmp_ev_fd_callback: Domain 1:Error happened with the QMP connection to QEMU libxl: error: libxl_dm.c:3381:device_model_postconfig_done: Domain 1:Post DM startup configs failed, rc=-26 libxl: error: libxl_create.c:1896:domcreate_devmodel_started: Domain 1:device model did not start: -26 libxl: error: libxl_aoutils.c:646:libxl__kill_xs_path: Device Model already exited libxl: error: libxl_domain.c:1183:libxl__destroy_domid: Domain 1:Non-existant domain libxl: error: libxl_domain.c:1137:domain_destroy_callback: Domain 1:Unable to destroy guest libxl: error: libxl_domain.c:1064:domain_destroy_cb: Domain 1:Destruction of domain failed ). Moved config file to /var/log/ganeti/xen/kvm-test-instance01.staging.ganeti.org-2026-09-23_03_22_31 >>>> 2026-09-23 03:22:31.158128 time=0:00:06.013943 [TestRapiInstanceAdd] Test adding a new instance via RAPI Traceback (most recent call last): File "/usr/src/ganeti/qa/ganeti-qa.py", line 1216, in main() File "/usr/src/ganeti/ganeti/rapi/client.py", line 274, in wrapper return fn(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^ File "/usr/src/ganeti/qa/ganeti-qa.py", line 1211, in main RunQa() File "/usr/src/ganeti/qa/ganeti-qa.py", line 1074, in RunQa rapi_instance = RunTest(qa_rapi.TestRapiInstanceAdd, pnode, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/src/ganeti/qa/ganeti-qa.py", line 119, in RunTest retval = fn(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^ File "/usr/src/ganeti/qa/qa_rapi.py", line 1114, in TestRapiInstanceAdd _WaitForRapiJob(job_id) File "/usr/src/ganeti/qa/qa_rapi.py", line 984, in _WaitForRapiJob return rapi.client_utils.PollJob(_rapi_client, job_id, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/src/ganeti/ganeti/rapi/client_utils.py", line 120, in PollJob return cli.GenericPollJob(job_id, RapiJobPollCb(rapi_client), reporter) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/src/ganeti/ganeti/cli.py", line 787, in GenericPollJob errors.MaybeRaise(msg) File "/usr/src/ganeti/ganeti/errors.py", line 550, in MaybeRaise raise errcls(*args) ganeti.errors.OpExecError: Could not start instance: Hypervisor error: Failed to start instance kvm-test-instance01.staging.ganeti.org: exited with exit code 3 (Parsing config from /etc/xen/kvm-test-instance01.staging.ganeti.org WARNING: you seem to be using "kernel" directive to override HVM guest firmware. Ignore that. Use "firmware_override" instead if you really want a non-default firmware WARNING: ignoring device_model directive.