Created socket at /tmp/ganeti-qa-multiplexer.85qz_rhs Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -N -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=yes moe.staging.ganeti.org SSH command for node moe.staging.ganeti.org: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org Created socket at /tmp/ganeti-qa-multiplexer.8r8q52y4 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -N -oControlPath=/tmp/ganeti-qa-multiplexer.8r8q52y4 -oControlMaster=yes krusty.staging.ganeti.org SSH command for node krusty.staging.ganeti.org: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.8r8q52y4 -oControlMaster=no krusty.staging.ganeti.org Created socket at /tmp/ganeti-qa-multiplexer.6hfmr6kt Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -N -oControlPath=/tmp/ganeti-qa-multiplexer.6hfmr6kt -oControlMaster=yes herman.staging.ganeti.org SSH command for node herman.staging.ganeti.org: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.6hfmr6kt -oControlMaster=no herman.staging.ganeti.org vvvv BLOCK 2025-06-18 03:14:07.660006 start [RunEnvTests] Run several environment tests <<<< 2025-06-18 03:14:07.660373 start [TestSshConnection] Test SSH connection Command: ssh moe.staging.ganeti.org exit Command: ssh krusty.staging.ganeti.org exit Command: ssh herman.staging.ganeti.org exit ---- PASSED [TestSshConnection] Test SSH connection -------------------- >>>> 2025-06-18 03:14:07.960623 time=0:00:00.300250 [TestSshConnection] Test SSH connection <<<< 2025-06-18 03:14:07.960793 start [TestIcmpPing] ICMP ping each node Command: ssh moe.staging.ganeti.org 'fping -e moe.staging.ganeti.org krusty.staging.ganeti.org herman.staging.ganeti.org && fping -e 192.168.1.8 192.168.1.9 192.168.1.10' moe.staging.ganeti.org is alive (0.017 ms) krusty.staging.ganeti.org is alive (0.116 ms) herman.staging.ganeti.org is alive (0.134 ms) 192.168.1.8 is alive (0.023 ms) 192.168.1.9 is alive (0.844 ms) 192.168.1.10 is alive (0.239 ms) Command: ssh krusty.staging.ganeti.org 'fping -e moe.staging.ganeti.org krusty.staging.ganeti.org herman.staging.ganeti.org && fping -e 192.168.1.8 192.168.1.9 192.168.1.10' moe.staging.ganeti.org is alive (0.128 ms) krusty.staging.ganeti.org is alive (0.027 ms) herman.staging.ganeti.org is alive (0.404 ms) 192.168.1.8 is alive (0.165 ms) 192.168.1.9 is alive (0.057 ms) 192.168.1.10 is alive (0.159 ms) Command: ssh herman.staging.ganeti.org 'fping -e moe.staging.ganeti.org krusty.staging.ganeti.org herman.staging.ganeti.org && fping -e 192.168.1.8 192.168.1.9 192.168.1.10' moe.staging.ganeti.org is alive (0.122 ms) krusty.staging.ganeti.org is alive (0.142 ms) herman.staging.ganeti.org is alive (0.023 ms) 192.168.1.8 is alive (0.090 ms) 192.168.1.9 is alive (0.123 ms) 192.168.1.10 is alive (0.026 ms) ---- PASSED [TestIcmpPing] ICMP ping each node ------------------------- >>>> 2025-06-18 03:14:08.159789 time=0:00:00.198996 [TestIcmpPing] ICMP ping each node <<<< 2025-06-18 03:14:08.159948 start [TestGanetiCommands] Test availibility of Ganeti commands Command: ssh moe.staging.ganeti.org 'gnt-backup --version && gnt-cluster --version && gnt-debug --version && gnt-instance --version && gnt-job --version && gnt-network --version && gnt-node --version && gnt-os --version && gnt-storage --version && gnt-filter --version && ganeti-noded --version && ganeti-rapi --version && ganeti-watcher --version && ganeti-confd --version && ganeti-luxid --version && ganeti-wconfd --version' gnt-backup (ganeti ) 3.1.0~rc2 gnt-cluster (ganeti ) 3.1.0~rc2 gnt-debug (ganeti ) 3.1.0~rc2 gnt-instance (ganeti ) 3.1.0~rc2 gnt-job (ganeti ) 3.1.0~rc2 gnt-network (ganeti ) 3.1.0~rc2 gnt-node (ganeti ) 3.1.0~rc2 gnt-os (ganeti ) 3.1.0~rc2 gnt-storage (ganeti ) 3.1.0~rc2 gnt-filter (ganeti ) 3.1.0~rc2 ganeti-noded (ganeti) 3.1.0~rc2 ganeti-rapi (ganeti) 3.1.0~rc2 ganeti-watcher (ganeti) 3.1.0~rc2 ganeti-confd (ganeti) version compiled with ghc 9.0 running on linux x86_64 ganeti-luxid (ganeti) version compiled with ghc 9.0 running on linux x86_64 ganeti-wconfd (ganeti) version compiled with ghc 9.0 running on linux x86_64 Command: ssh krusty.staging.ganeti.org 'gnt-backup --version && gnt-cluster --version && gnt-debug --version && gnt-instance --version && gnt-job --version && gnt-network --version && gnt-node --version && gnt-os --version && gnt-storage --version && gnt-filter --version && ganeti-noded --version && ganeti-rapi --version && ganeti-watcher --version && ganeti-confd --version && ganeti-luxid --version && ganeti-wconfd --version' gnt-backup (ganeti ) 3.1.0~rc2 gnt-cluster (ganeti ) 3.1.0~rc2 gnt-debug (ganeti ) 3.1.0~rc2 gnt-instance (ganeti ) 3.1.0~rc2 gnt-job (ganeti ) 3.1.0~rc2 gnt-network (ganeti ) 3.1.0~rc2 gnt-node (ganeti ) 3.1.0~rc2 gnt-os (ganeti ) 3.1.0~rc2 gnt-storage (ganeti ) 3.1.0~rc2 gnt-filter (ganeti ) 3.1.0~rc2 ganeti-noded (ganeti) 3.1.0~rc2 ganeti-rapi (ganeti) 3.1.0~rc2 ganeti-watcher (ganeti) 3.1.0~rc2 ganeti-confd (ganeti) version compiled with ghc 9.0 running on linux x86_64 ganeti-luxid (ganeti) version compiled with ghc 9.0 running on linux x86_64 ganeti-wconfd (ganeti) version compiled with ghc 9.0 running on linux x86_64 Command: ssh herman.staging.ganeti.org 'gnt-backup --version && gnt-cluster --version && gnt-debug --version && gnt-instance --version && gnt-job --version && gnt-network --version && gnt-node --version && gnt-os --version && gnt-storage --version && gnt-filter --version && ganeti-noded --version && ganeti-rapi --version && ganeti-watcher --version && ganeti-confd --version && ganeti-luxid --version && ganeti-wconfd --version' gnt-backup (ganeti ) 3.1.0~rc2 gnt-cluster (ganeti ) 3.1.0~rc2 gnt-debug (ganeti ) 3.1.0~rc2 gnt-instance (ganeti ) 3.1.0~rc2 gnt-job (ganeti ) 3.1.0~rc2 gnt-network (ganeti ) 3.1.0~rc2 gnt-node (ganeti ) 3.1.0~rc2 gnt-os (ganeti ) 3.1.0~rc2 gnt-storage (ganeti ) 3.1.0~rc2 gnt-filter (ganeti ) 3.1.0~rc2 ganeti-noded (ganeti) 3.1.0~rc2 ganeti-rapi (ganeti) 3.1.0~rc2 ganeti-watcher (ganeti) 3.1.0~rc2 ganeti-confd (ganeti) version compiled with ghc 9.0 running on linux x86_64 ganeti-luxid (ganeti) version compiled with ghc 9.0 running on linux x86_64 ganeti-wconfd (ganeti) version compiled with ghc 9.0 running on linux x86_64 ---- PASSED [TestGanetiCommands] Test availibility of Ganeti commands -- >>>> 2025-06-18 03:14:16.276890 time=0:00:08.116942 [TestGanetiCommands] Test availibility of Ganeti commands ^^^^ BLOCK 2025-06-18 03:14:16.277029 time=0:00:08.617023 [RunEnvTests] Run several environment tests **** 2025-06-18 03:14:16.277130 skipping [TestClusterInit] gnt-cluster init, test(s) create-cluster disabled Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'cat /var/lib/ganeti/rapi/users' ganeti-qa ganeti-qa writeCommand: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'openssl x509 -in /var/lib/ganeti/rapi.pem' -----BEGIN CERTIFICATE----- MIICrjCCAZYCAQEwDQYJKoZIhvcNAQELBQAwHTEbMBkGA1UEAwwSZ2FuZXRpLmV4 YW1wbGUuY29tMB4XDTI1MDYxODAxMTM1NFoXDTMwMDYxNzAxMTM1NFowHTEbMBkG A1UEAwwSZ2FuZXRpLmV4YW1wbGUuY29tMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8A MIIBCgKCAQEAyMuhqvWYffGCi4ZgiYp8DlPHmlV59JUb1nb/iUx5if6/0vCYaWb/ +tGjCnCPDNSaDrNYejtno8cnG7lnn936KSORHTjelyyDjQFbhZTvHblv/ZGSv1LL h8Bu6LavAngmBO6YuChQBjhdk1qJP+rcxKN8rpbgOHkB4rGZFaNmeH4h+AHFEt4f rbhlAQrAuBsS+oMUySekdHtiDkkcmsn3tE9dFTb+B0laJTyCTsVCz1poCDYFxf21 cJDsPMwv1O+uUUTU1CnrAJwFPPClNZ6NmSkpflauHMzl1lmSpHPJuacMUfWT9NHJ yg3r2HOm0tEApC4XUjsVTymy1oDmbESZdQIDAQABMA0GCSqGSIb3DQEBCwUAA4IB AQCgkHpUrFlKZ+g9zrXWdwasU9+mvuFuQQ4OKxtxwzDJhwQAfbKSZXY+W0p2HMnM XEnZs4nCnh4i90ViQHVrvpM0gkZkTT3PVOCQo4raGt0rF6LAX3qyStZnCr8ec8XP p/yag1AQsgbdJTLcvx7T2hTJXXf7zrqT47ytYX7IKeHXpeZovAfX8Y7w+BTSCd0/ t1AZoDwf7PVKQW5Guo67z3x1w+yEDGOOpGajP5axaD36c3e7IpkOB/gxXieGe8WF o5E7GhjWbZzSq6GpEbg/AtyPOzgAroF417IWk97Pa/ctWe4Sdu1/ZG83VCI+I1TT njAS2RwtMYK3+McQffWmBXfM -----END CERTIFICATE----- RAPI protocol version: 2 Command: ssh moe.staging.ganeti.org 'iptables-save | grep -v '\''ganeti_qa_script'\'' | iptables-restore' Command: ssh krusty.staging.ganeti.org 'iptables-save | grep -v '\''ganeti_qa_script'\'' | iptables-restore' Command: ssh herman.staging.ganeti.org 'iptables-save | grep -v '\''ganeti_qa_script'\'' | iptables-restore' <<<< 2025-06-18 03:14:16.539908 start [TestNodeList] gnt-node list ----- Command: ssh moe.staging.ganeti.org 'gnt-node list --output ndp/ovs,master_capable,custom_ndparams,sinst_cnt,ndp/spindle_count,offline,name,ndp/ovs_name,hv_state,serial_no,role,master_candidate,tags,dtotal,ctime,sip,group,ctotal,csockets,spfree,disk_state,group.uuid,mnode,mtotal,ndp/exclusive_storage,cnos,ndp/ovs_link,ndp/ssh_port,ndp/oob_program,sptotal,ndp/cpu_speed,pip,sinst_list,master,mfree,drained,uuid,bootid,pinst_list,pinst_cnt,cnodes,dfree,powered,ndparams,vm_capable,mtime >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output bootid,cnodes,cnos,csockets,ctime,ctotal,custom_ndparams,dfree,disk_state,drained,dtotal,group,group.uuid,hv_state,master,master_candidate,master_capable,mfree,mnode,mtime,mtotal,name,ndp/cpu_speed,ndp/exclusive_storage,ndp/oob_program,ndp/ovs,ndp/ovs_link,ndp/ovs_name,ndp/spindle_count,ndp/ssh_port,ndparams,offline,pinst_cnt,pinst_list,pip,powered,role,serial_no,sinst_cnt,sinst_list,sip,spfree,sptotal,tags,uuid,vm_capable >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output ndp/ovs,master_capable,custom_ndparams,sinst_cnt,ndp/spindle_count,offline,name,ndp/ovs_name,hv_state,serial_no,role,master_candidate,tags,dtotal,ctime,sip,group,ctotal,csockets,spfree,disk_state,group.uuid,mnode,mtotal,ndp/exclusive_storage,cnos,ndp/ovs_link,ndp/ssh_port,ndp/oob_program,sptotal,ndp/cpu_speed,pip,sinst_list,master,mfree,drained,uuid,bootid,pinst_list,pinst_cnt,cnodes,dfree,powered,ndparams,vm_capable,mtime,ndp/ovs,master_capable,custom_ndparams,sinst_cnt,ndp/spindle_count,offline,name,ndp/ovs_name,hv_state,serial_no,role,master_candidate,tags,dtotal,ctime,sip,group,ctotal,csockets,spfree,disk_state,group.uuid,mnode,mtotal,ndp/exclusive_storage,cnos,ndp/ovs_link,ndp/ssh_port,ndp/oob_program,sptotal,ndp/cpu_speed,pip,sinst_list,master,mfree,drained,uuid,bootid,pinst_list,pinst_cnt,cnodes,dfree,powered,ndparams,vm_capable,mtime >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output mtime,vm_capable,ndparams,powered,dfree,cnodes,pinst_cnt,pinst_list,bootid,uuid >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output drained,mfree,master,sinst_list,pip,ndp/cpu_speed,sptotal >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output ndp/oob_program,ndp/ssh_port >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output ndp/ovs_link,cnos >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output ndp/exclusive_storage,mtotal,mnode,group.uuid,disk_state,spfree >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output csockets,ctotal,group,sip,ctime,dtotal,tags >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output master_candidate,role,serial_no,hv_state >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output ndp/ovs_name,name,offline >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output ndp/spindle_count,sinst_cnt,custom_ndparams,master_capable >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output ndp/ovs >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list '\''--separator=|'\'' --no-headers --output name' herman.staging.ganeti.org krusty.staging.ganeti.org moe.staging.ganeti.org Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list '\''--separator=|'\'' --no-headers --output name moe.staging.ganeti.org krusty.staging.ganeti.org herman.staging.ganeti.org' moe.staging.ganeti.org krusty.staging.ganeti.org herman.staging.ganeti.org Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list '\''--separator=|'\'' --no-headers --output name krusty.staging.ganeti.org moe.staging.ganeti.org herman.staging.ganeti.org' krusty.staging.ganeti.org moe.staging.ganeti.org herman.staging.ganeti.org Command: ssh moe.staging.ganeti.org 'gnt-node list this.name.certainly.does.not.exist' Stderr was: Failure: prerequisites not met for this operation: error type: unknown_entity, error details: Node name this.name.certainly.does.not.exist not found Command: ssh moe.staging.ganeti.org 'gnt-node list --output=field/does/not/exist >> /var/log/ganeti/qa-output.log' Stderr was: ---- PASSED [TestNodeList] gnt-node list ------------------------------- >>>> 2025-06-18 03:14:23.340291 time=0:00:06.800383 [TestNodeList] gnt-node list Warning: Queried for unknown fields field/does/not/exist <<<< 2025-06-18 03:14:23.340449 start [TestInstanceList] gnt-instance list Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/root_path,nic.ips,hv/scsi_controller_type,be/memory,nic.network.name/3,nic.link/2,snodes.group.uuid,be/spindle_use,hv/cpuid,disk.name/2,disk.size/4,disk.spindles/0,oper_vcpus,disk.spindles/11,hv/use_bootloader,hv/cpu_cores,hv/boot_order,admin_up,nic.network.name/6,hv/cpu_mask,nic.networks.names,disk.uuid/15,disk.uuid/9,disk.name/6,nic_link,oper_ram,disk.spindles/4,disk.size/0,hv/usb_mouse,hv/cpu_threads,hv/pci_pass,hv/pae,disk.size/3,disk.uuid/7,disk.size/12,nic.ip/6,disk_template,nic.link/6,hv/cdrom_image_path,hv/kvm_path,oper_state,hv/num_ttys,disk.size/6,be/always_failover,be/vcpus,disk.spindles/10,hv/vnc_x509_verify,ctime,disk.spindles/15,disk.spindles/2,nic.network/6,mtime,nic.name/1,hv/soundhw,hv/nic_type,disk.uuid/6,disk.size/8,disk.uuid/3,nic.link/0,disk.name/10,hv/device_model,disk.size/11,nic.bridge/4,disk.name/14,tags,hv/spice_jpeg_wan_compression,hv/disk_discard,beparams,nic.link/3,disk.spindles/8,disk.spindles/5,nic.vlan/6,nic.uuid/3,nic.mode/0,nic.network.name/7,hv/blockdev_prefix,disk.uuid/13,custom_hvparams,hv/use_guest_agent,nic.ip/5,disk.spindles/3,disk.spindles/9,hv/security_domain,nic.mac/5,nic.name/5,disk.uuid/8,disk.uuid/5,nic.mode/3,hv/migration_downtime,nic.mode/4,name,hv/cdrom2_image_path,hv/acpi,disk.uuid/10,admin_state_source,disk.size/15,nic.name/4,nic.ip/3,bridge,uuid,disk.uuid/12,hv/extra_cgroups,disk.uuid/11,nic.uuid/2,nic.links,nic.networks,hv/serial_speed,nic.ip/0,nic.uuids,nic.ip/2,disk.name/5,hv/spice_tls_ciphers,disk.spindles/1,disk.size/1,disk.size/7,hv/vnc_password_file,hv/kvm_pci_reservations,nic.vlan/2,hv/init_script,disk.names,hv/serial_console,disk.uuids,nic.vlan/0,hv/cpu_weight,nic.link/4,admin_state,hv/cpu_cap,nic.mode/1,nic.ip/7,pnode.group,nic.uuid/7,hv/vnc_x509_path,nic.mac/3,disk.name/13,nic.network/7,disk.name/15,nic.bridge/7,serial_no,hv/extra_config,nic.mode/7,hvparams,disk.size/9,nic.uuid/1,disk.name/8,nic.mac/1,disk.spindles/6,sda_size,nic.vlan/1,hv/migration_caps,nic.bridge/3,disk.spindles/14,disk.uuid/0,hv/spice_zlib_glz_wan_compression,hv/disk_aio,hv/use_localtime,hv/reboot_behavior,console,nic.bridges,hv/spice_bind,nic_network,nic.uuid/0,nic.mode/6,nic.network/4,hv/viridian,nic.names,hv/cpu_sockets,nic.name/3,nic.mac/7,hv/spice_use_tls,nic.name/2,hv/mem_path,disk.uuid/1,hv/kernel_path,nic.network/5,nic.count,hv/vnc_bind_address,disk.size/2,nic.ip/1,disk.name/7,nic.mac/2,hv/vhost_net,nic.mac/4,nic.vlan/3,disk.size/10,disk.name/0,nic_mode,hv/bootloader_args,nic.network/1,disk.spindles/7,nic.link/1,nic.bridge/5,network_port,nic.link/5,nic.network.name/5,hv/vnet_hdr,hv/kvm_flag,hv/startup_timeout,disk.spindles/12,hv/floppy_image_path,nic.vlans,hv/keymap,nic.modes,nic.bridge/0,hypervisor,disk.uuid/14,hv/security_model,snodes.group,nic.name/7,disk.name/3,hv/spice_playback_compression,disk.size/5,disk.uuid/2,nic.bridge/1,disk.name/9,be/auto_balance,hv/cpu_type,nic.network.name/1,hv/user_shutdown,hv/vif_script,hv/vif_type,os,hv/spice_ip_version,nic.link/7,nic.uuid/5,mac,disk.size/13,pnode,nic.name/6,be/maxmem,disk.name/11,nic.uuid/4,disk.size/14,hv/machine_version,custom_nicparams,hv/spice_use_vdagent,hv/cdrom_disk_type,disk.spindles,hv/vga,hv/disk_type,hv/usb_devices,be/minmem,nic.network.name/0,nic.macs,disks_active,disk.spindles/13,nic.vlan/4,hv/vnc_tls,ip,disk.sizes,nic.network/2,nic.network/3,hv/disk_cache,hv/kernel_args,hv/drop_capabilities,nic.bridge/2,nic.network.name/4,sdb_size,nic.network.name/2,nic.network/0,hv/use_chroot,disk.name/1,hv/bootloader_path,custom_beparams,hv/spice_password_file,nic.ip/4,hv/initrd_path,status,hv/virtio_net_queues,snodes,hv/spice_image_compression,nic.bridge/6,custom_osparams,vcpus,hv/spice_streaming_video,disk_usage,forthcoming,osparams,hv/devices,nic.mac/6,nic.vlan/5,disk.count,disk.name/12,pnode.group.uuid,disk.name/4,nic.name/0,nic.vlan/7,hv/kvm_extra,nic.mac/0,nic.mode/2,disk.uuid/4,nic.uuid/6,nic.mode/5 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output admin_state,admin_state_source,admin_up,be/always_failover,be/auto_balance,be/maxmem,be/memory,be/minmem,be/spindle_use,be/vcpus,beparams,bridge,console,ctime,custom_beparams,custom_hvparams,custom_nicparams,custom_osparams,disk.count,disk.name/0,disk.name/1,disk.name/10,disk.name/11,disk.name/12,disk.name/13,disk.name/14,disk.name/15,disk.name/2,disk.name/3,disk.name/4,disk.name/5,disk.name/6,disk.name/7,disk.name/8,disk.name/9,disk.names,disk.size/0,disk.size/1,disk.size/10,disk.size/11,disk.size/12,disk.size/13,disk.size/14,disk.size/15,disk.size/2,disk.size/3,disk.size/4,disk.size/5,disk.size/6,disk.size/7,disk.size/8,disk.size/9,disk.sizes,disk.spindles,disk.spindles/0,disk.spindles/1,disk.spindles/10,disk.spindles/11,disk.spindles/12,disk.spindles/13,disk.spindles/14,disk.spindles/15,disk.spindles/2,disk.spindles/3,disk.spindles/4,disk.spindles/5,disk.spindles/6,disk.spindles/7,disk.spindles/8,disk.spindles/9,disk.uuid/0,disk.uuid/1,disk.uuid/10,disk.uuid/11,disk.uuid/12,disk.uuid/13,disk.uuid/14,disk.uuid/15,disk.uuid/2,disk.uuid/3,disk.uuid/4,disk.uuid/5,disk.uuid/6,disk.uuid/7,disk.uuid/8,disk.uuid/9,disk.uuids,disk_template,disk_usage,disks_active,forthcoming,hv/acpi,hv/blockdev_prefix,hv/boot_order,hv/bootloader_args,hv/bootloader_path,hv/cdrom2_image_path,hv/cdrom_disk_type,hv/cdrom_image_path,hv/cpu_cap,hv/cpu_cores,hv/cpu_mask,hv/cpu_sockets,hv/cpu_threads,hv/cpu_type,hv/cpu_weight,hv/cpuid,hv/device_model,hv/devices,hv/disk_aio,hv/disk_cache,hv/disk_discard,hv/disk_type,hv/drop_capabilities,hv/extra_cgroups,hv/extra_config,hv/floppy_image_path,hv/init_script,hv/initrd_path,hv/kernel_args,hv/kernel_path,hv/keymap,hv/kvm_extra,hv/kvm_flag,hv/kvm_path,hv/kvm_pci_reservations,hv/machine_version,hv/mem_path,hv/migration_caps,hv/migration_downtime,hv/nic_type,hv/num_ttys,hv/pae,hv/pci_pass,hv/reboot_behavior,hv/root_path,hv/scsi_controller_type,hv/security_domain,hv/security_model,hv/serial_console,hv/serial_speed,hv/soundhw,hv/spice_bind,hv/spice_image_compression,hv/spice_ip_version,hv/spice_jpeg_wan_compression,hv/spice_password_file,hv/spice_playback_compression,hv/spice_streaming_video,hv/spice_tls_ciphers,hv/spice_use_tls,hv/spice_use_vdagent,hv/spice_zlib_glz_wan_compression,hv/startup_timeout,hv/usb_devices,hv/usb_mouse,hv/use_bootloader,hv/use_chroot,hv/use_guest_agent,hv/use_localtime,hv/user_shutdown,hv/vga,hv/vhost_net,hv/vif_script,hv/vif_type,hv/viridian,hv/virtio_net_queues,hv/vnc_bind_address,hv/vnc_password_file,hv/vnc_tls,hv/vnc_x509_path,hv/vnc_x509_verify,hv/vnet_hdr,hvparams,hypervisor,ip,mac,mtime,name,network_port,nic.bridge/0,nic.bridge/1,nic.bridge/2,nic.bridge/3,nic.bridge/4,nic.bridge/5,nic.bridge/6,nic.bridge/7,nic.bridges,nic.count,nic.ip/0,nic.ip/1,nic.ip/2,nic.ip/3,nic.ip/4,nic.ip/5,nic.ip/6,nic.ip/7,nic.ips,nic.link/0,nic.link/1,nic.link/2,nic.link/3,nic.link/4,nic.link/5,nic.link/6,nic.link/7,nic.links,nic.mac/0,nic.mac/1,nic.mac/2,nic.mac/3,nic.mac/4,nic.mac/5,nic.mac/6,nic.mac/7,nic.macs,nic.mode/0,nic.mode/1,nic.mode/2,nic.mode/3,nic.mode/4,nic.mode/5,nic.mode/6,nic.mode/7,nic.modes,nic.name/0,nic.name/1,nic.name/2,nic.name/3,nic.name/4,nic.name/5,nic.name/6,nic.name/7,nic.names,nic.network.name/0,nic.network.name/1,nic.network.name/2,nic.network.name/3,nic.network.name/4,nic.network.name/5,nic.network.name/6,nic.network.name/7,nic.network/0,nic.network/1,nic.network/2,nic.network/3,nic.network/4,nic.network/5,nic.network/6,nic.network/7,nic.networks,nic.networks.names,nic.uuid/0,nic.uuid/1,nic.uuid/2,nic.uuid/3,nic.uuid/4,nic.uuid/5,nic.uuid/6,nic.uuid/7,nic.uuids,nic.vlan/0,nic.vlan/1,nic.vlan/2,nic.vlan/3,nic.vlan/4,nic.vlan/5,nic.vlan/6,nic.vlan/7,nic.vlans,nic_link,nic_mode,nic_network,oper_ram,oper_state,oper_vcpus,os,osparams,pnode,pnode.group,pnode.group.uuid,sda_size,sdb_size,serial_no,snodes,snodes.group,snodes.group.uuid,status,tags,uuid,vcpus >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/root_path,nic.ips,hv/scsi_controller_type,be/memory,nic.network.name/3,nic.link/2,snodes.group.uuid,be/spindle_use,hv/cpuid,disk.name/2,disk.size/4,disk.spindles/0,oper_vcpus,disk.spindles/11,hv/use_bootloader,hv/cpu_cores,hv/boot_order,admin_up,nic.network.name/6,hv/cpu_mask,nic.networks.names,disk.uuid/15,disk.uuid/9,disk.name/6,nic_link,oper_ram,disk.spindles/4,disk.size/0,hv/usb_mouse,hv/cpu_threads,hv/pci_pass,hv/pae,disk.size/3,disk.uuid/7,disk.size/12,nic.ip/6,disk_template,nic.link/6,hv/cdrom_image_path,hv/kvm_path,oper_state,hv/num_ttys,disk.size/6,be/always_failover,be/vcpus,disk.spindles/10,hv/vnc_x509_verify,ctime,disk.spindles/15,disk.spindles/2,nic.network/6,mtime,nic.name/1,hv/soundhw,hv/nic_type,disk.uuid/6,disk.size/8,disk.uuid/3,nic.link/0,disk.name/10,hv/device_model,disk.size/11,nic.bridge/4,disk.name/14,tags,hv/spice_jpeg_wan_compression,hv/disk_discard,beparams,nic.link/3,disk.spindles/8,disk.spindles/5,nic.vlan/6,nic.uuid/3,nic.mode/0,nic.network.name/7,hv/blockdev_prefix,disk.uuid/13,custom_hvparams,hv/use_guest_agent,nic.ip/5,disk.spindles/3,disk.spindles/9,hv/security_domain,nic.mac/5,nic.name/5,disk.uuid/8,disk.uuid/5,nic.mode/3,hv/migration_downtime,nic.mode/4,name,hv/cdrom2_image_path,hv/acpi,disk.uuid/10,admin_state_source,disk.size/15,nic.name/4,nic.ip/3,bridge,uuid,disk.uuid/12,hv/extra_cgroups,disk.uuid/11,nic.uuid/2,nic.links,nic.networks,hv/serial_speed,nic.ip/0,nic.uuids,nic.ip/2,disk.name/5,hv/spice_tls_ciphers,disk.spindles/1,disk.size/1,disk.size/7,hv/vnc_password_file,hv/kvm_pci_reservations,nic.vlan/2,hv/init_script,disk.names,hv/serial_console,disk.uuids,nic.vlan/0,hv/cpu_weight,nic.link/4,admin_state,hv/cpu_cap,nic.mode/1,nic.ip/7,pnode.group,nic.uuid/7,hv/vnc_x509_path,nic.mac/3,disk.name/13,nic.network/7,disk.name/15,nic.bridge/7,serial_no,hv/extra_config,nic.mode/7,hvparams,disk.size/9,nic.uuid/1,disk.name/8,nic.mac/1,disk.spindles/6,sda_size,nic.vlan/1,hv/migration_caps,nic.bridge/3,disk.spindles/14,disk.uuid/0,hv/spice_zlib_glz_wan_compression,hv/disk_aio,hv/use_localtime,hv/reboot_behavior,console,nic.bridges,hv/spice_bind,nic_network,nic.uuid/0,nic.mode/6,nic.network/4,hv/viridian,nic.names,hv/cpu_sockets,nic.name/3,nic.mac/7,hv/spice_use_tls,nic.name/2,hv/mem_path,disk.uuid/1,hv/kernel_path,nic.network/5,nic.count,hv/vnc_bind_address,disk.size/2,nic.ip/1,disk.name/7,nic.mac/2,hv/vhost_net,nic.mac/4,nic.vlan/3,disk.size/10,disk.name/0,nic_mode,hv/bootloader_args,nic.network/1,disk.spindles/7,nic.link/1,nic.bridge/5,network_port,nic.link/5,nic.network.name/5,hv/vnet_hdr,hv/kvm_flag,hv/startup_timeout,disk.spindles/12,hv/floppy_image_path,nic.vlans,hv/keymap,nic.modes,nic.bridge/0,hypervisor,disk.uuid/14,hv/security_model,snodes.group,nic.name/7,disk.name/3,hv/spice_playback_compression,disk.size/5,disk.uuid/2,nic.bridge/1,disk.name/9,be/auto_balance,hv/cpu_type,nic.network.name/1,hv/user_shutdown,hv/vif_script,hv/vif_type,os,hv/spice_ip_version,nic.link/7,nic.uuid/5,mac,disk.size/13,pnode,nic.name/6,be/maxmem,disk.name/11,nic.uuid/4,disk.size/14,hv/machine_version,custom_nicparams,hv/spice_use_vdagent,hv/cdrom_disk_type,disk.spindles,hv/vga,hv/disk_type,hv/usb_devices,be/minmem,nic.network.name/0,nic.macs,disks_active,disk.spindles/13,nic.vlan/4,hv/vnc_tls,ip,disk.sizes,nic.network/2,nic.network/3,hv/disk_cache,hv/kernel_args,hv/drop_capabilities,nic.bridge/2,nic.network.name/4,sdb_size,nic.network.name/2,nic.network/0,hv/use_chroot,disk.name/1,hv/bootloader_path,custom_beparams,hv/spice_password_file,nic.ip/4,hv/initrd_path,status,hv/virtio_net_queues,snodes,hv/spice_image_compression,nic.bridge/6,custom_osparams,vcpus,hv/spice_streaming_video,disk_usage,forthcoming,osparams,hv/devices,nic.mac/6,nic.vlan/5,disk.count,disk.name/12,pnode.group.uuid,disk.name/4,nic.name/0,nic.vlan/7,hv/kvm_extra,nic.mac/0,nic.mode/2,disk.uuid/4,nic.uuid/6,nic.mode/5,hv/root_path,nic.ips,hv/scsi_controller_type,be/memory,nic.network.name/3,nic.link/2,snodes.group.uuid,be/spindle_use,hv/cpuid,disk.name/2,disk.size/4,disk.spindles/0,oper_vcpus,disk.spindles/11,hv/use_bootloader,hv/cpu_cores,hv/boot_order,admin_up,nic.network.name/6,hv/cpu_mask,nic.networks.names,disk.uuid/15,disk.uuid/9,disk.name/6,nic_link,oper_ram,disk.spindles/4,disk.size/0,hv/usb_mouse,hv/cpu_threads,hv/pci_pass,hv/pae,disk.size/3,disk.uuid/7,disk.size/12,nic.ip/6,disk_template,nic.link/6,hv/cdrom_image_path,hv/kvm_path,oper_state,hv/num_ttys,disk.size/6,be/always_failover,be/vcpus,disk.spindles/10,hv/vnc_x509_verify,ctime,disk.spindles/15,disk.spindles/2,nic.network/6,mtime,nic.name/1,hv/soundhw,hv/nic_type,disk.uuid/6,disk.size/8,disk.uuid/3,nic.link/0,disk.name/10,hv/device_model,disk.size/11,nic.bridge/4,disk.name/14,tags,hv/spice_jpeg_wan_compression,hv/disk_discard,beparams,nic.link/3,disk.spindles/8,disk.spindles/5,nic.vlan/6,nic.uuid/3,nic.mode/0,nic.network.name/7,hv/blockdev_prefix,disk.uuid/13,custom_hvparams,hv/use_guest_agent,nic.ip/5,disk.spindles/3,disk.spindles/9,hv/security_domain,nic.mac/5,nic.name/5,disk.uuid/8,disk.uuid/5,nic.mode/3,hv/migration_downtime,nic.mode/4,name,hv/cdrom2_image_path,hv/acpi,disk.uuid/10,admin_state_source,disk.size/15,nic.name/4,nic.ip/3,bridge,uuid,disk.uuid/12,hv/extra_cgroups,disk.uuid/11,nic.uuid/2,nic.links,nic.networks,hv/serial_speed,nic.ip/0,nic.uuids,nic.ip/2,disk.name/5,hv/spice_tls_ciphers,disk.spindles/1,disk.size/1,disk.size/7,hv/vnc_password_file,hv/kvm_pci_reservations,nic.vlan/2,hv/init_script,disk.names,hv/serial_console,disk.uuids,nic.vlan/0,hv/cpu_weight,nic.link/4,admin_state,hv/cpu_cap,nic.mode/1,nic.ip/7,pnode.group,nic.uuid/7,hv/vnc_x509_path,nic.mac/3,disk.name/13,nic.network/7,disk.name/15,nic.bridge/7,serial_no,hv/extra_config,nic.mode/7,hvparams,disk.size/9,nic.uuid/1,disk.name/8,nic.mac/1,disk.spindles/6,sda_size,nic.vlan/1,hv/migration_caps,nic.bridge/3,disk.spindles/14,disk.uuid/0,hv/spice_zlib_glz_wan_compression,hv/disk_aio,hv/use_localtime,hv/reboot_behavior,console,nic.bridges,hv/spice_bind,nic_network,nic.uuid/0,nic.mode/6,nic.network/4,hv/viridian,nic.names,hv/cpu_sockets,nic.name/3,nic.mac/7,hv/spice_use_tls,nic.name/2,hv/mem_path,disk.uuid/1,hv/kernel_path,nic.network/5,nic.count,hv/vnc_bind_address,disk.size/2,nic.ip/1,disk.name/7,nic.mac/2,hv/vhost_net,nic.mac/4,nic.vlan/3,disk.size/10,disk.name/0,nic_mode,hv/bootloader_args,nic.network/1,disk.spindles/7,nic.link/1,nic.bridge/5,network_port,nic.link/5,nic.network.name/5,hv/vnet_hdr,hv/kvm_flag,hv/startup_timeout,disk.spindles/12,hv/floppy_image_path,nic.vlans,hv/keymap,nic.modes,nic.bridge/0,hypervisor,disk.uuid/14,hv/security_model,snodes.group,nic.name/7,disk.name/3,hv/spice_playback_compression,disk.size/5,disk.uuid/2,nic.bridge/1,disk.name/9,be/auto_balance,hv/cpu_type,nic.network.name/1,hv/user_shutdown,hv/vif_script,hv/vif_type,os,hv/spice_ip_version,nic.link/7,nic.uuid/5,mac,disk.size/13,pnode,nic.name/6,be/maxmem,disk.name/11,nic.uuid/4,disk.size/14,hv/machine_version,custom_nicparams,hv/spice_use_vdagent,hv/cdrom_disk_type,disk.spindles,hv/vga,hv/disk_type,hv/usb_devices,be/minmem,nic.network.name/0,nic.macs,disks_active,disk.spindles/13,nic.vlan/4,hv/vnc_tls,ip,disk.sizes,nic.network/2,nic.network/3,hv/disk_cache,hv/kernel_args,hv/drop_capabilities,nic.bridge/2,nic.network.name/4,sdb_size,nic.network.name/2,nic.network/0,hv/use_chroot,disk.name/1,hv/bootloader_path,custom_beparams,hv/spice_password_file,nic.ip/4,hv/initrd_path,status,hv/virtio_net_queues,snodes,hv/spice_image_compression,nic.bridge/6,custom_osparams,vcpus,hv/spice_streaming_video,disk_usage,forthcoming,osparams,hv/devices,nic.mac/6,nic.vlan/5,disk.count,disk.name/12,pnode.group.uuid,disk.name/4,nic.name/0,nic.vlan/7,hv/kvm_extra,nic.mac/0,nic.mode/2,disk.uuid/4,nic.uuid/6,nic.mode/5 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.mode/5,nic.uuid/6,disk.uuid/4,nic.mode/2,nic.mac/0,hv/kvm_extra,nic.vlan/7,nic.name/0,disk.name/4,pnode.group.uuid >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.name/12,disk.count,nic.vlan/5,nic.mac/6,hv/devices,osparams >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output forthcoming,disk_usage,hv/spice_streaming_video,vcpus,custom_osparams,nic.bridge/6,hv/spice_image_compression,snodes,hv/virtio_net_queues >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output status,hv/initrd_path >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.ip/4,hv/spice_password_file,custom_beparams,hv/bootloader_path,disk.name/1,hv/use_chroot,nic.network/0 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.network.name/2,sdb_size,nic.network.name/4,nic.bridge/2,hv/drop_capabilities,hv/kernel_args,hv/disk_cache >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.network/3,nic.network/2,disk.sizes,ip,hv/vnc_tls,nic.vlan/4,disk.spindles/13 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disks_active,nic.macs,nic.network.name/0 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output be/minmem,hv/usb_devices,hv/disk_type,hv/vga,disk.spindles,hv/cdrom_disk_type,hv/spice_use_vdagent >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output custom_nicparams,hv/machine_version,disk.size/14 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.uuid/4,disk.name/11,be/maxmem,nic.name/6,pnode,disk.size/13,mac,nic.uuid/5,nic.link/7 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/spice_ip_version,os,hv/vif_type,hv/vif_script,hv/user_shutdown,nic.network.name/1,hv/cpu_type,be/auto_balance,disk.name/9 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.bridge/1,disk.uuid/2,disk.size/5 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/spice_playback_compression,disk.name/3,nic.name/7,snodes.group,hv/security_model,disk.uuid/14,hypervisor,nic.bridge/0 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.modes,hv/keymap >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.vlans,hv/floppy_image_path,disk.spindles/12,hv/startup_timeout,hv/kvm_flag,hv/vnet_hdr,nic.network.name/5,nic.link/5,network_port >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.bridge/5,nic.link/1,disk.spindles/7,nic.network/1,hv/bootloader_args,nic_mode,disk.name/0,disk.size/10 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.vlan/3,nic.mac/4,hv/vhost_net,nic.mac/2,disk.name/7,nic.ip/1,disk.size/2,hv/vnc_bind_address,nic.count,nic.network/5 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/kernel_path,disk.uuid/1,hv/mem_path,nic.name/2,hv/spice_use_tls,nic.mac/7,nic.name/3,hv/cpu_sockets >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.names,hv/viridian,nic.network/4,nic.mode/6,nic.uuid/0,nic_network,hv/spice_bind,nic.bridges,console,hv/reboot_behavior >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/use_localtime,hv/disk_aio,hv/spice_zlib_glz_wan_compression,disk.uuid/0,disk.spindles/14,nic.bridge/3 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/migration_caps,nic.vlan/1,sda_size,disk.spindles/6,nic.mac/1,disk.name/8,nic.uuid/1 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.size/9,hvparams >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.mode/7,hv/extra_config,serial_no >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.bridge/7,disk.name/15,nic.network/7,disk.name/13,nic.mac/3 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/vnc_x509_path,nic.uuid/7,pnode.group,nic.ip/7,nic.mode/1,hv/cpu_cap,admin_state,nic.link/4 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/cpu_weight,nic.vlan/0 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.uuids,hv/serial_console,disk.names,hv/init_script,nic.vlan/2 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/kvm_pci_reservations,hv/vnc_password_file >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.size/7,disk.size/1,disk.spindles/1,hv/spice_tls_ciphers,disk.name/5,nic.ip/2,nic.uuids,nic.ip/0 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/serial_speed,nic.networks,nic.links,nic.uuid/2,disk.uuid/11,hv/extra_cgroups,disk.uuid/12,uuid,bridge,nic.ip/3 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.name/4,disk.size/15,admin_state_source,disk.uuid/10,hv/acpi,hv/cdrom2_image_path,name >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.mode/4,hv/migration_downtime,nic.mode/3,disk.uuid/5 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.uuid/8,nic.name/5,nic.mac/5,hv/security_domain,disk.spindles/9,disk.spindles/3,nic.ip/5,hv/use_guest_agent,custom_hvparams,disk.uuid/13 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/blockdev_prefix,nic.network.name/7,nic.mode/0,nic.uuid/3,nic.vlan/6,disk.spindles/5,disk.spindles/8,nic.link/3 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output beparams,hv/disk_discard,hv/spice_jpeg_wan_compression,tags,disk.name/14,nic.bridge/4,disk.size/11 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/device_model,disk.name/10,nic.link/0,disk.uuid/3,disk.size/8 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.uuid/6,hv/nic_type,hv/soundhw >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.name/1,mtime >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.network/6,disk.spindles/2,disk.spindles/15,ctime,hv/vnc_x509_verify,disk.spindles/10,be/vcpus,be/always_failover,disk.size/6,hv/num_ttys >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output oper_state,hv/kvm_path,hv/cdrom_image_path,nic.link/6,disk_template,nic.ip/6 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.size/12,disk.uuid/7,disk.size/3 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/pae,hv/pci_pass,hv/cpu_threads,hv/usb_mouse,disk.size/0,disk.spindles/4,oper_ram >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic_link,disk.name/6,disk.uuid/9,disk.uuid/15,nic.networks.names,hv/cpu_mask,nic.network.name/6,admin_up,hv/boot_order >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output hv/cpu_cores,hv/use_bootloader >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.spindles/11,oper_vcpus >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output disk.spindles/0,disk.size/4,disk.name/2,hv/cpuid,be/spindle_use,snodes.group.uuid,nic.link/2,nic.network.name/3,be/memory,hv/scsi_controller_type >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list --output nic.ips,hv/root_path >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-instance list '\''--separator=|'\'' --no-headers --output name' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-instance list '\''--separator=|'\'' --no-headers --output name' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-instance list '\''--separator=|'\'' --no-headers --output name' Command: ssh moe.staging.ganeti.org 'gnt-instance list this.name.certainly.does.not.exist' Stderr was: Failure: prerequisites not met for this operation: error type: unknown_entity, error details: Instance name this.name.certainly.does.not.exist not found Command: ssh moe.staging.ganeti.org 'gnt-instance list --output=field/does/not/exist >> /var/log/ganeti/qa-output.log' Stderr was: ---- PASSED [TestInstanceList] gnt-instance list ----------------------- >>>> 2025-06-18 03:14:35.205013 time=0:00:11.864564 [TestInstanceList] gnt-instance list Warning: Queried for unknown fields field/does/not/exist <<<< 2025-06-18 03:14:35.205158 start [TestJobList] gnt-job list ------- Command: ssh moe.staging.ganeti.org 'gnt-job list --output opend,id,received_ts,summary,opstatus,opstart,priority,oppriority,status,ops,end_ts,archived,oplog,start_ts,opresult,opexec >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-job list --output archived,end_ts,id,opend,opexec,oplog,oppriority,opresult,ops,opstart,opstatus,priority,received_ts,start_ts,status,summary >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-job list --output opend,id,received_ts,summary,opstatus,opstart,priority,oppriority,status,ops,end_ts,archived,oplog,start_ts,opresult,opexec,opend,id,received_ts,summary,opstatus,opstart,priority,oppriority,status,ops,end_ts,archived,oplog,start_ts,opresult,opexec >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-job list --output opexec,opresult,start_ts,oplog,archived,end_ts,ops,status,oppriority,priority >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-job list --output opstart,opstatus,summary,received_ts,id,opend >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-job list '\''--separator=|'\'' --no-headers --output id' 1 2 3 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-job list '\''--separator=|'\'' --no-headers --output id 3 2 1' 3 2 1 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-job list '\''--separator=|'\'' --no-headers --output id 2 1 3' 2 1 3 Command: ssh moe.staging.ganeti.org 'gnt-job list --output=field/does/not/exist >> /var/log/ganeti/qa-output.log' Stderr was: ---- PASSED [TestJobList] gnt-job list --------------------------------- Warning: Queried for unknown fields field/does/not/exist >>>> 2025-06-18 03:14:37.035105 time=0:00:01.829947 [TestJobList] gnt-job list **** 2025-06-18 03:14:37.035260 skipping [TestNodeAddAll] Adding all nodes to cluster, test(s) create-cluster disabled <<<< 2025-06-18 03:14:37.035300 start [TestJobqueue] gnt-debug test-jobqueue Command: ssh moe.staging.ganeti.org 'gnt-debug test-jobqueue' Testing job submission Job submission tests were successful Testing job dependencies Submitted jobs 4, 5, 6, 7, 8 Waiting for job 4 ... Waiting for job 7 ... Waiting for job 5 ... Waiting for job 6 ... Waiting for job 8 ... Job dependency tests were successful Testing job success Wed Jun 18 03:14:45 2025 - INFO: Expanding names Wed Jun 18 03:14:45 2025 - INFO: Executing Wed Jun 18 03:14:45 2025 - INFO: Sending log message 1 Wed Jun 18 03:14:45 2025 - INFO: Sending log message 2 Wed Jun 18 03:14:45 2025 - INFO: Sending log message 3 Wed Jun 18 03:14:45 2025 - INFO: Sending log message 4 Wed Jun 18 03:14:45 2025 - INFO: Sending log message 5 Wed Jun 18 03:14:45 2025 - INFO: Sending log message 6 Wed Jun 18 03:14:46 2025 - INFO: Sending log message 7 Testing multiple successful opcodes Wed Jun 18 03:14:46 2025 - INFO: Expanding names Wed Jun 18 03:14:47 2025 - INFO: Executing Wed Jun 18 03:14:47 2025 - INFO: Sending log message 1 Wed Jun 18 03:14:47 2025 - INFO: Sending log message 2 Wed Jun 18 03:14:47 2025 - INFO: Sending log message 3 Wed Jun 18 03:14:47 2025 - INFO: Sending log message 4 Wed Jun 18 03:14:47 2025 - INFO: Sending log message 5 Wed Jun 18 03:14:47 2025 - INFO: Sending log message 6 Wed Jun 18 03:14:47 2025 - INFO: Sending log message 7 Wed Jun 18 03:14:48 2025 - INFO: Expanding names Wed Jun 18 03:14:48 2025 - INFO: Executing Wed Jun 18 03:14:48 2025 - INFO: Sending log message 1 Wed Jun 18 03:14:48 2025 - INFO: Sending log message 2 Wed Jun 18 03:14:48 2025 - INFO: Sending log message 3 Wed Jun 18 03:14:48 2025 - INFO: Sending log message 4 Wed Jun 18 03:14:48 2025 - INFO: Sending log message 5 Wed Jun 18 03:14:48 2025 - INFO: Sending log message 6 Wed Jun 18 03:14:48 2025 - INFO: Sending log message 7 Testing job failure Wed Jun 18 03:14:49 2025 - INFO: Expanding names Wed Jun 18 03:14:49 2025 - INFO: Executing Wed Jun 18 03:14:50 2025 - INFO: Sending log message 1 Wed Jun 18 03:14:50 2025 - INFO: Sending log message 2 Wed Jun 18 03:14:50 2025 - INFO: Sending log message 3 Wed Jun 18 03:14:50 2025 - INFO: Sending log message 4 Wed Jun 18 03:14:50 2025 - INFO: Sending log message 5 Wed Jun 18 03:14:50 2025 - INFO: Sending log message 6 Wed Jun 18 03:14:50 2025 - INFO: Sending log message 7 Ignoring error for 'job fail' test: Opcode failure was requested Testing partial job failure Wed Jun 18 03:14:51 2025 - INFO: Expanding names Wed Jun 18 03:14:51 2025 - INFO: Executing Wed Jun 18 03:14:51 2025 - INFO: Sending log message 1 Wed Jun 18 03:14:51 2025 - INFO: Sending log message 2 Wed Jun 18 03:14:51 2025 - INFO: Sending log message 3 Wed Jun 18 03:14:51 2025 - INFO: Sending log message 4 Wed Jun 18 03:14:52 2025 - INFO: Sending log message 5 Wed Jun 18 03:14:52 2025 - INFO: Sending log message 6 Wed Jun 18 03:14:52 2025 - INFO: Sending log message 7 Wed Jun 18 03:14:52 2025 - INFO: Expanding names Wed Jun 18 03:14:52 2025 - INFO: Executing Wed Jun 18 03:14:52 2025 - INFO: Sending log message 1 Wed Jun 18 03:14:52 2025 - INFO: Sending log message 2 Wed Jun 18 03:14:52 2025 - INFO: Sending log message 3 Wed Jun 18 03:14:53 2025 - INFO: Sending log message 4 Wed Jun 18 03:14:53 2025 - INFO: Sending log message 5 Wed Jun 18 03:14:53 2025 - INFO: Sending log message 6 Wed Jun 18 03:14:53 2025 - INFO: Sending log message 7 Wed Jun 18 03:14:53 2025 - INFO: Expanding names Wed Jun 18 03:14:53 2025 - INFO: Executing Wed Jun 18 03:14:53 2025 - INFO: Sending log message 1 Wed Jun 18 03:14:53 2025 - INFO: Sending log message 2 Wed Jun 18 03:14:54 2025 - INFO: Sending log message 3 Wed Jun 18 03:14:54 2025 - INFO: Sending log message 4 Wed Jun 18 03:14:54 2025 - INFO: Sending log message 5 Wed Jun 18 03:14:54 2025 - INFO: Sending log message 6 Wed Jun 18 03:14:54 2025 - INFO: Sending log message 7 Ignoring error for 'job fail' test: Opcode failure was requested Job queue test successful ---- PASSED [TestJobqueue] gnt-debug test-jobqueue --------------------- >>>> 2025-06-18 03:14:54.715874 time=0:00:17.680574 [TestJobqueue] gnt-debug test-jobqueue <<<< 2025-06-18 03:14:54.716026 start [TestJobCancellation] gnt-job cancel Command: ssh moe.staging.ganeti.org 'gnt-debug delay --submit 10.0' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-debug delay --submit 3.0 2>&1' JobID: 13 JobID: 14 Command: ssh moe.staging.ganeti.org 'gnt-job cancel 14' Job successfully cancelled Command: ssh moe.staging.ganeti.org 'gnt-job watch 14' Stdout was: Output from job 14 follows -------------------------- Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-job list --no-headers --output=id,status 14 2>&1'Job 14 failed: Unhandled Ganeti error: Job was canceled 14 canceled ---- PASSED [TestJobCancellation] gnt-job cancel ----------------------- >>>> 2025-06-18 03:15:02.469747 time=0:00:07.753721 [TestJobCancellation] gnt-job cancel <<<< 2025-06-18 03:15:02.469849 start [TestResumeWatcher] Tests and unpauses the watcher Command: ssh moe.staging.ganeti.org 'gnt-cluster watcher continue' The watcher is no longer paused. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-cluster watcher info' The watcher is not paused. ---- PASSED [TestResumeWatcher] Tests and unpauses the watcher --------- >>>> 2025-06-18 03:15:03.157673 time=0:00:00.687824 [TestResumeWatcher] Tests and unpauses the watcher <<<< 2025-06-18 03:15:03.157803 start [TestNodeList] gnt-node list ----- Command: ssh moe.staging.ganeti.org 'gnt-node list --output ndp/ovs,master_capable,custom_ndparams,sinst_cnt,ndp/spindle_count,offline,name,ndp/ovs_name,hv_state,serial_no,role,master_candidate,tags,dtotal,ctime,sip,group,ctotal,csockets,spfree,disk_state,group.uuid,mnode,mtotal,ndp/exclusive_storage,cnos,ndp/ovs_link,ndp/ssh_port,ndp/oob_program,sptotal,ndp/cpu_speed,pip,sinst_list,master,mfree,drained,uuid,bootid,pinst_list,pinst_cnt,cnodes,dfree,powered,ndparams,vm_capable,mtime >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output bootid,cnodes,cnos,csockets,ctime,ctotal,custom_ndparams,dfree,disk_state,drained,dtotal,group,group.uuid,hv_state,master,master_candidate,master_capable,mfree,mnode,mtime,mtotal,name,ndp/cpu_speed,ndp/exclusive_storage,ndp/oob_program,ndp/ovs,ndp/ovs_link,ndp/ovs_name,ndp/spindle_count,ndp/ssh_port,ndparams,offline,pinst_cnt,pinst_list,pip,powered,role,serial_no,sinst_cnt,sinst_list,sip,spfree,sptotal,tags,uuid,vm_capable >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output ndp/ovs,master_capable,custom_ndparams,sinst_cnt,ndp/spindle_count,offline,name,ndp/ovs_name,hv_state,serial_no,role,master_candidate,tags,dtotal,ctime,sip,group,ctotal,csockets,spfree,disk_state,group.uuid,mnode,mtotal,ndp/exclusive_storage,cnos,ndp/ovs_link,ndp/ssh_port,ndp/oob_program,sptotal,ndp/cpu_speed,pip,sinst_list,master,mfree,drained,uuid,bootid,pinst_list,pinst_cnt,cnodes,dfree,powered,ndparams,vm_capable,mtime,ndp/ovs,master_capable,custom_ndparams,sinst_cnt,ndp/spindle_count,offline,name,ndp/ovs_name,hv_state,serial_no,role,master_candidate,tags,dtotal,ctime,sip,group,ctotal,csockets,spfree,disk_state,group.uuid,mnode,mtotal,ndp/exclusive_storage,cnos,ndp/ovs_link,ndp/ssh_port,ndp/oob_program,sptotal,ndp/cpu_speed,pip,sinst_list,master,mfree,drained,uuid,bootid,pinst_list,pinst_cnt,cnodes,dfree,powered,ndparams,vm_capable,mtime >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output mtime,vm_capable,ndparams,powered,dfree,cnodes,pinst_cnt,pinst_list,bootid,uuid >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output drained,mfree,master,sinst_list,pip,ndp/cpu_speed,sptotal >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output ndp/oob_program,ndp/ssh_port >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output ndp/ovs_link,cnos >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output ndp/exclusive_storage,mtotal,mnode,group.uuid,disk_state,spfree >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output csockets,ctotal,group,sip,ctime,dtotal,tags >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output master_candidate,role,serial_no,hv_state >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output ndp/ovs_name,name,offline >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output ndp/spindle_count,sinst_cnt,custom_ndparams,master_capable >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list --output ndp/ovs >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list '\''--separator=|'\'' --no-headers --output name' herman.staging.ganeti.org krusty.staging.ganeti.org moe.staging.ganeti.org Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list '\''--separator=|'\'' --no-headers --output name moe.staging.ganeti.org krusty.staging.ganeti.org herman.staging.ganeti.org' moe.staging.ganeti.org krusty.staging.ganeti.org herman.staging.ganeti.org Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list '\''--separator=|'\'' --no-headers --output name krusty.staging.ganeti.org moe.staging.ganeti.org herman.staging.ganeti.org' krusty.staging.ganeti.org moe.staging.ganeti.org herman.staging.ganeti.org Command: ssh moe.staging.ganeti.org 'gnt-node list this.name.certainly.does.not.exist' Stderr was: Failure: prerequisites not met for this operation: error type: unknown_entity, error details: Node name this.name.certainly.does.not.exist not found Command: ssh moe.staging.ganeti.org 'gnt-node list --output=field/does/not/exist >> /var/log/ganeti/qa-output.log' Stderr was: ---- PASSED [TestNodeList] gnt-node list ------------------------------- Warning: Queried for unknown fields field/does/not/exist >>>> 2025-06-18 03:15:09.911483 time=0:00:06.753680 [TestNodeList] gnt-node list <<<< 2025-06-18 03:15:09.911642 start [TestNodeListFields] gnt-node list-fields Command: ssh moe.staging.ganeti.org 'gnt-node list-fields >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-node list-fields pip sip tags master group group.uuid powered ndparams custom_ndparams hv_state disk_state ndp/cpu_speed ndp/exclusive_storage ndp/oob_program ndp/ovs ndp/ovs_link ndp/ovs_name ndp/spindle_count ndp/ssh_port role pinst_cnt pinst_list sinst_cnt sinst_list drained master_candidate master_capable name offline serial_no uuid vm_capable bootid cnodes cnos csockets ctotal dfree dtotal spfree sptotal mfree mnode mtotal ctime mtime >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-fields '\''--separator=|'\'' --no-headers' bootid|Text|BootID|Random UUID renewed for each system reboot, can be used for detecting reboots by tracking changes cnodes|Number|CNodes|Number of NUMA domains on node (if exported by hypervisor) cnos|Number|CNOs|Number of logical processors used by the node OS (dom0 for Xen) csockets|Number|CSockets|Number of physical CPU sockets (if exported by hypervisor) ctime|Timestamp|CTime|Creation timestamp ctotal|Number|CTotal|Number of logical processors custom_ndparams|Custom|CustomNodeParameters|Custom node parameters dfree|Storage size|DFree|Available storage space on storage unit disk_state|Custom|DiskState|Disk state drained|Boolean|Drained|Whether node is drained dtotal|Storage size|DTotal|Total storage space on storage unit for instance disk allocation group|Text|Group|Node group group.uuid|Text|GroupUUID|UUID of node group hv_state|Custom|HypervisorState|Hypervisor state master|Boolean|IsMaster|Whether node is master master_candidate|Boolean|MasterC|Whether node is a master candidate master_capable|Boolean|MasterCapable|Whether node can become a master candidate mfree|Storage size|MFree|Memory available for instance allocations mnode|Storage size|MNode|Amount of memory used by node (dom0 for Xen) mtime|Timestamp|MTime|Modification timestamp mtotal|Storage size|MTotal|Total amount of memory of physical machine name|Text|Node|Node name ndp/cpu_speed|Floating-point number|ndp/cpu_speed|The "cpu_speed" node parameter ndp/exclusive_storage|Boolean|ExclusiveStorage|The "exclusive_storage" node parameter ndp/oob_program|Custom|OutOfBandProgram|The "oob_program" node parameter ndp/ovs|Boolean|OpenvSwitch|The "ovs" node parameter ndp/ovs_link|Custom|OpenvSwitchLink|The "ovs_link" node parameter ndp/ovs_name|Custom|OpenvSwitchName|The "ovs_name" node parameter ndp/spindle_count|Number|SpindleCount|The "spindle_count" node parameter ndp/ssh_port|Number|ndp/ssh_port|The "ssh_port" node parameter ndparams|Custom|NodeParameters|Merged node parameters offline|Boolean|Offline|Whether node is marked offline pinst_cnt|Number|Pinst|Number of instances with this node as primary pinst_list|Custom|PriInstances|List of instances with this node as primary pip|Text|PrimaryIP|Primary IP address powered|Boolean|Powered|Whether node is thought to be powered on role|Text|Role|Node role; "M" for master, "C" for master candidate, "R" for regular, "D" for drained, "O" for offline serial_no|Number|SerialNo|Node object serial number, incremented on each modification sinst_cnt|Number|Sinst|Number of instances with this node as secondary sinst_list|Custom|SecInstances|List of instances with this node as secondary sip|Text|SecondaryIP|Secondary IP address spfree|Number|SpFree|Available spindles in volume group (exclusive storage only) sptotal|Number|SpTotal|Total spindles in volume group (exclusive storage only) tags|Custom|Tags|Tags uuid|Text|UUID|Node UUID vm_capable|Boolean|VMCapable|Whether node can host instances Command: ssh moe.staging.ganeti.org 'gnt-node list-fields field/does/not/exist' Stdout was: Name Type Title Description field/does/not/exist Unknown field/does/not/exist Unknown field 'field/does/not/exist' Stderr was: Warning: Queried for unknown fields field/does/not/exist ---- PASSED [TestNodeListFields] gnt-node list-fields ------------------ >>>> 2025-06-18 03:15:11.004459 time=0:00:01.092817 [TestNodeListFields] gnt-node list-fields <<<< 2025-06-18 03:15:11.004621 start [TestInstanceListFields] gnt-instance list-fields Command: ssh moe.staging.ganeti.org 'gnt-instance list-fields >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-instance list-fields pnode pnode.group pnode.group.uuid snodes snodes.group snodes.group.uuid admin_state admin_up admin_state_source disks_active tags console forthcoming disk_template hypervisor name network_port os serial_no uuid oper_state oper_ram oper_vcpus status nic.count nic.macs nic.ips nic.names nic.uuids nic.modes nic.links nic.vlans nic.bridges nic.networks nic.networks.names nic.ip/0 nic.mac/0 nic.name/0 nic.uuid/0 nic.mode/0 nic.link/0 nic.bridge/0 nic.vlan/0 nic.network/0 nic.network.name/0 nic.ip/1 nic.mac/1 nic.name/1 nic.uuid/1 nic.mode/1 nic.link/1 nic.bridge/1 nic.vlan/1 nic.network/1 nic.network.name/1 nic.ip/2 nic.mac/2 nic.name/2 nic.uuid/2 nic.mode/2 nic.link/2 nic.bridge/2 nic.vlan/2 nic.network/2 nic.network.name/2 nic.ip/3 nic.mac/3 nic.name/3 nic.uuid/3 nic.mode/3 nic.link/3 nic.bridge/3 nic.vlan/3 nic.network/3 nic.network.name/3 nic.ip/4 nic.mac/4 nic.name/4 nic.uuid/4 nic.mode/4 nic.link/4 nic.bridge/4 nic.vlan/4 nic.network/4 nic.network.name/4 nic.ip/5 nic.mac/5 nic.name/5 nic.uuid/5 nic.mode/5 nic.link/5 nic.bridge/5 nic.vlan/5 nic.network/5 nic.network.name/5 nic.ip/6 nic.mac/6 nic.name/6 nic.uuid/6 nic.mode/6 nic.link/6 nic.bridge/6 nic.vlan/6 nic.network/6 nic.network.name/6 nic.ip/7 nic.mac/7 nic.name/7 nic.uuid/7 nic.mode/7 nic.link/7 nic.bridge/7 nic.vlan/7 nic.network/7 nic.network.name/7 hvparams beparams osparams custom_hvparams custom_beparams custom_osparams custom_nicparams hv/acpi hv/blockdev_prefix hv/boot_order hv/bootloader_args hv/bootloader_path hv/cdrom2_image_path hv/cdrom_disk_type hv/cdrom_image_path hv/cpu_cap hv/cpu_cores hv/cpu_mask hv/cpu_sockets hv/cpu_threads hv/cpu_type hv/cpu_weight hv/cpuid hv/device_model hv/devices hv/disk_aio hv/disk_cache hv/disk_discard hv/disk_type hv/drop_capabilities hv/extra_cgroups hv/extra_config hv/floppy_image_path hv/init_script hv/initrd_path hv/kernel_args hv/kernel_path hv/keymap hv/kvm_extra hv/kvm_flag hv/kvm_path hv/kvm_pci_reservations hv/machine_version hv/mem_path hv/migration_caps hv/migration_downtime hv/nic_type hv/num_ttys hv/pae hv/pci_pass hv/reboot_behavior hv/root_path hv/scsi_controller_type hv/security_domain hv/security_model hv/serial_console hv/serial_speed hv/soundhw hv/spice_bind hv/spice_image_compression hv/spice_ip_version hv/spice_jpeg_wan_compression hv/spice_password_file hv/spice_playback_compression hv/spice_streaming_video hv/spice_tls_ciphers hv/spice_use_tls hv/spice_use_vdagent hv/spice_zlib_glz_wan_compression hv/startup_timeout hv/usb_devices hv/usb_mouse hv/use_bootloader hv/use_chroot hv/use_guest_agent hv/use_localtime hv/user_shutdown hv/vga hv/vhost_net hv/vif_script hv/vif_type hv/viridian hv/virtio_net_queues hv/vnc_bind_address hv/vnc_password_file hv/vnc_tls hv/vnc_x509_path hv/vnc_x509_verify hv/vnet_hdr be/always_failover be/auto_balance be/maxmem be/minmem be/spindle_use be/vcpus disk_usage disk.count disk.sizes disk.spindles disk.names disk.uuids disk.size/0 disk.spindles/0 disk.name/0 disk.uuid/0 disk.size/1 disk.spindles/1 disk.name/1 disk.uuid/1 disk.size/2 disk.spindles/2 disk.name/2 disk.uuid/2 disk.size/3 disk.spindles/3 disk.name/3 disk.uuid/3 disk.size/4 disk.spindles/4 disk.name/4 disk.uuid/4 disk.size/5 disk.spindles/5 disk.name/5 disk.uuid/5 disk.size/6 disk.spindles/6 disk.name/6 disk.uuid/6 disk.size/7 disk.spindles/7 disk.name/7 disk.uuid/7 disk.size/8 disk.spindles/8 disk.name/8 disk.uuid/8 disk.size/9 disk.spindles/9 disk.name/9 disk.uuid/9 disk.size/10 disk.spindles/10 disk.name/10 disk.uuid/10 disk.size/11 disk.spindles/11 disk.name/11 disk.uuid/11 disk.size/12 disk.spindles/12 disk.name/12 disk.uuid/12 disk.size/13 disk.spindles/13 disk.name/13 disk.uuid/13 disk.size/14 disk.spindles/14 disk.name/14 disk.uuid/14 disk.size/15 disk.spindles/15 disk.name/15 disk.uuid/15 ctime mtime vcpus be/memory sda_size sdb_size ip mac bridge nic_mode nic_link nic_network >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-instance list-fields '\''--separator=|'\'' --no-headers' admin_state|Text|InstanceState|Desired state of instance admin_state_source|Text|InstanceStateSource|Who last changed the desired state of the instance admin_up|Boolean|Autostart|Desired state of instance be/always_failover|Boolean|be/always_failover|The "always_failover" backend parameter be/auto_balance|Boolean|Auto_balance|The "auto_balance" backend parameter be/maxmem|Storage size|ConfigMaxMem|The "maxmem" backend parameter be/memory|Storage size|ConfigMaxMem|The "maxmem" backend parameter be/minmem|Storage size|ConfigMinMem|The "minmem" backend parameter be/spindle_use|Number|be/spindle_use|The "spindle_use" backend parameter be/vcpus|Number|ConfigVCPUs|The "vcpus" backend parameter beparams|Custom|BackendParameters|Backend parameters (merged) bridge|Text|NicBridge/0|Bridge of 1st network interface console|Custom|Console|Instance console information ctime|Timestamp|CTime|Creation timestamp custom_beparams|Custom|CustomBackendParameters|Custom backend parameters custom_hvparams|Custom|CustomHypervisorParameters|Custom hypervisor parameters custom_nicparams|Custom|CustomNicParameters|Custom network interface parameters custom_osparams|Custom|CustomOpSysParameters|Custom operating system parameters disk.count|Number|Disks|Number of disks disk.name/0|Text|DiskName/0|Name of 1st disk disk.name/1|Text|DiskName/1|Name of 2nd disk disk.name/2|Text|DiskName/2|Name of 3rd disk disk.name/3|Text|DiskName/3|Name of 4th disk disk.name/4|Text|DiskName/4|Name of 5th disk disk.name/5|Text|DiskName/5|Name of 6th disk disk.name/6|Text|DiskName/6|Name of 7th disk disk.name/7|Text|DiskName/7|Name of 8th disk disk.name/8|Text|DiskName/8|Name of 9th disk disk.name/9|Text|DiskName/9|Name of 10th disk disk.name/10|Text|DiskName/10|Name of 11th disk disk.name/11|Text|DiskName/11|Name of 12th disk disk.name/12|Text|DiskName/12|Name of 13th disk disk.name/13|Text|DiskName/13|Name of 14th disk disk.name/14|Text|DiskName/14|Name of 15th disk disk.name/15|Text|DiskName/15|Name of 16th disk disk.names|Custom|Disk_names|List of disk names disk.size/0|Storage size|Disk/0|Disk size of 1st disk disk.size/1|Storage size|Disk/1|Disk size of 2nd disk disk.size/2|Storage size|Disk/2|Disk size of 3rd disk disk.size/3|Storage size|Disk/3|Disk size of 4th disk disk.size/4|Storage size|Disk/4|Disk size of 5th disk disk.size/5|Storage size|Disk/5|Disk size of 6th disk disk.size/6|Storage size|Disk/6|Disk size of 7th disk disk.size/7|Storage size|Disk/7|Disk size of 8th disk disk.size/8|Storage size|Disk/8|Disk size of 9th disk disk.size/9|Storage size|Disk/9|Disk size of 10th disk disk.size/10|Storage size|Disk/10|Disk size of 11th disk disk.size/11|Storage size|Disk/11|Disk size of 12th disk disk.size/12|Storage size|Disk/12|Disk size of 13th disk disk.size/13|Storage size|Disk/13|Disk size of 14th disk disk.size/14|Storage size|Disk/14|Disk size of 15th disk disk.size/15|Storage size|Disk/15|Disk size of 16th disk disk.sizes|Custom|Disk_sizes|List of disk sizes disk.spindles|Custom|Disk_spindles|List of disk spindles disk.spindles/0|Number|DiskSpindles/0|Spindles of 1st disk disk.spindles/1|Number|DiskSpindles/1|Spindles of 2nd disk disk.spindles/2|Number|DiskSpindles/2|Spindles of 3rd disk disk.spindles/3|Number|DiskSpindles/3|Spindles of 4th disk disk.spindles/4|Number|DiskSpindles/4|Spindles of 5th disk disk.spindles/5|Number|DiskSpindles/5|Spindles of 6th disk disk.spindles/6|Number|DiskSpindles/6|Spindles of 7th disk disk.spindles/7|Number|DiskSpindles/7|Spindles of 8th disk disk.spindles/8|Number|DiskSpindles/8|Spindles of 9th disk disk.spindles/9|Number|DiskSpindles/9|Spindles of 10th disk disk.spindles/10|Number|DiskSpindles/10|Spindles of 11th disk disk.spindles/11|Number|DiskSpindles/11|Spindles of 12th disk disk.spindles/12|Number|DiskSpindles/12|Spindles of 13th disk disk.spindles/13|Number|DiskSpindles/13|Spindles of 14th disk disk.spindles/14|Number|DiskSpindles/14|Spindles of 15th disk disk.spindles/15|Number|DiskSpindles/15|Spindles of 16th disk disk.uuid/0|Text|DiskUUID/0|UUID of 1st disk disk.uuid/1|Text|DiskUUID/1|UUID of 2nd disk disk.uuid/2|Text|DiskUUID/2|UUID of 3rd disk disk.uuid/3|Text|DiskUUID/3|UUID of 4th disk disk.uuid/4|Text|DiskUUID/4|UUID of 5th disk disk.uuid/5|Text|DiskUUID/5|UUID of 6th disk disk.uuid/6|Text|DiskUUID/6|UUID of 7th disk disk.uuid/7|Text|DiskUUID/7|UUID of 8th disk disk.uuid/8|Text|DiskUUID/8|UUID of 9th disk disk.uuid/9|Text|DiskUUID/9|UUID of 10th disk disk.uuid/10|Text|DiskUUID/10|UUID of 11th disk disk.uuid/11|Text|DiskUUID/11|UUID of 12th disk disk.uuid/12|Text|DiskUUID/12|UUID of 13th disk disk.uuid/13|Text|DiskUUID/13|UUID of 14th disk disk.uuid/14|Text|DiskUUID/14|UUID of 15th disk disk.uuid/15|Text|DiskUUID/15|UUID of 16th disk disk.uuids|Custom|Disk_UUIDs|List of disk UUIDs disk_template|Text|Disk_template|Instance disk template disk_usage|Storage size|DiskUsage|Total disk space used by instance on each of its nodes; this is not the disk size visible to the instance, but the usage on the node disks_active|Boolean|DisksActive|Desired state of instance disks forthcoming|Boolean|Forthcoming|whether the Instance is forthcoming hv/acpi|Boolean|ACPI|The "acpi" hypervisor parameter hv/blockdev_prefix|Custom|hv/blockdev_prefix|The "blockdev_prefix" hypervisor parameter hv/boot_order|Custom|Boot_order|The "boot_order" hypervisor parameter hv/bootloader_args|Custom|hv/bootloader_args|The "bootloader_args" hypervisor parameter hv/bootloader_path|Custom|hv/bootloader_path|The "bootloader_path" hypervisor parameter hv/cdrom2_image_path|Custom|hv/cdrom2_image_path|The "cdrom2_image_path" hypervisor parameter hv/cdrom_disk_type|Custom|hv/cdrom_disk_type|The "cdrom_disk_type" hypervisor parameter hv/cdrom_image_path|Custom|CDROM_image_path|The "cdrom_image_path" hypervisor parameter hv/cpu_cap|Number|hv/cpu_cap|The "cpu_cap" hypervisor parameter hv/cpu_cores|Number|hv/cpu_cores|The "cpu_cores" hypervisor parameter hv/cpu_mask|Custom|hv/cpu_mask|The "cpu_mask" hypervisor parameter hv/cpu_sockets|Number|hv/cpu_sockets|The "cpu_sockets" hypervisor parameter hv/cpu_threads|Number|hv/cpu_threads|The "cpu_threads" hypervisor parameter hv/cpu_type|Custom|cpu_type|The "cpu_type" hypervisor parameter hv/cpu_weight|Number|hv/cpu_weight|The "cpu_weight" hypervisor parameter hv/cpuid|Custom|hv/cpuid|The "cpuid" hypervisor parameter hv/device_model|Custom|hv/device_model|The "device_model" hypervisor parameter hv/devices|Custom|hv/devices|The "devices" hypervisor parameter hv/disk_aio|Custom|hv/disk_aio|The "disk_aio" hypervisor parameter hv/disk_cache|Custom|hv/disk_cache|The "disk_cache" hypervisor parameter hv/disk_discard|Custom|hv/disk_discard|The "disk_discard" hypervisor parameter hv/disk_type|Custom|Disk_type|The "disk_type" hypervisor parameter hv/drop_capabilities|Custom|hv/drop_capabilities|The "drop_capabilities" hypervisor parameter hv/extra_cgroups|Custom|hv/extra_cgroups|The "extra_cgroups" hypervisor parameter hv/extra_config|Custom|hv/extra_config|The "extra_config" hypervisor parameter hv/floppy_image_path|Custom|hv/floppy_image_path|The "floppy_image_path" hypervisor parameter hv/init_script|Custom|hv/init_script|The "init_script" hypervisor parameter hv/initrd_path|Custom|Initrd_path|The "initrd_path" hypervisor parameter hv/kernel_args|Custom|hv/kernel_args|The "kernel_args" hypervisor parameter hv/kernel_path|Custom|Kernel_path|The "kernel_path" hypervisor parameter hv/keymap|Custom|hv/keymap|The "keymap" hypervisor parameter hv/kvm_extra|Custom|hv/kvm_extra|The "kvm_extra" hypervisor parameter hv/kvm_flag|Custom|hv/kvm_flag|The "kvm_flag" hypervisor parameter hv/kvm_path|Custom|hv/kvm_path|The "kvm_path" hypervisor parameter hv/kvm_pci_reservations|Number|hv/kvm_pci_reservations|The "kvm_pci_reservations" hypervisor parameter hv/machine_version|Custom|hv/machine_version|The "machine_version" hypervisor parameter hv/mem_path|Custom|hv/mem_path|The "mem_path" hypervisor parameter hv/migration_caps|Custom|hv/migration_caps|The "migration_caps" hypervisor parameter hv/migration_downtime|Number|hv/migration_downtime|The "migration_downtime" hypervisor parameter hv/nic_type|Custom|NIC_type|The "nic_type" hypervisor parameter hv/num_ttys|Number|hv/num_ttys|The "num_ttys" hypervisor parameter hv/pae|Boolean|PAE|The "pae" hypervisor parameter hv/pci_pass|Custom|pci_pass|The "pci_pass" hypervisor parameter hv/reboot_behavior|Custom|hv/reboot_behavior|The "reboot_behavior" hypervisor parameter hv/root_path|Custom|hv/root_path|The "root_path" hypervisor parameter hv/scsi_controller_type|Custom|hv/scsi_controller_type|The "scsi_controller_type" hypervisor parameter hv/security_domain|Custom|hv/security_domain|The "security_domain" hypervisor parameter hv/security_model|Custom|hv/security_model|The "security_model" hypervisor parameter hv/serial_console|Boolean|hv/serial_console|The "serial_console" hypervisor parameter hv/serial_speed|Number|hv/serial_speed|The "serial_speed" hypervisor parameter hv/soundhw|Custom|hv/soundhw|The "soundhw" hypervisor parameter hv/spice_bind|Custom|hv/spice_bind|The "spice_bind" hypervisor parameter hv/spice_image_compression|Custom|hv/spice_image_compression|The "spice_image_compression" hypervisor parameter hv/spice_ip_version|Number|hv/spice_ip_version|The "spice_ip_version" hypervisor parameter hv/spice_jpeg_wan_compression|Custom|hv/spice_jpeg_wan_compression|The "spice_jpeg_wan_compression" hypervisor parameter hv/spice_password_file|Custom|hv/spice_password_file|The "spice_password_file" hypervisor parameter hv/spice_playback_compression|Boolean|hv/spice_playback_compression|The "spice_playback_compression" hypervisor parameter hv/spice_streaming_video|Custom|hv/spice_streaming_video|The "spice_streaming_video" hypervisor parameter hv/spice_tls_ciphers|Custom|hv/spice_tls_ciphers|The "spice_tls_ciphers" hypervisor parameter hv/spice_use_tls|Boolean|hv/spice_use_tls|The "spice_use_tls" hypervisor parameter hv/spice_use_vdagent|Boolean|hv/spice_use_vdagent|The "spice_use_vdagent" hypervisor parameter hv/spice_zlib_glz_wan_compression|Custom|hv/spice_zlib_glz_wan_compression|The "spice_zlib_glz_wan_compression" hypervisor parameter hv/startup_timeout|Number|hv/startup_timeout|The "startup_timeout" hypervisor parameter hv/usb_devices|Custom|hv/usb_devices|The "usb_devices" hypervisor parameter hv/usb_mouse|Custom|hv/usb_mouse|The "usb_mouse" hypervisor parameter hv/use_bootloader|Boolean|hv/use_bootloader|The "use_bootloader" hypervisor parameter hv/use_chroot|Boolean|hv/use_chroot|The "use_chroot" hypervisor parameter hv/use_guest_agent|Boolean|hv/use_guest_agent|The "use_guest_agent" hypervisor parameter hv/use_localtime|Boolean|hv/use_localtime|The "use_localtime" hypervisor parameter hv/user_shutdown|Boolean|hv/user_shutdown|The "user_shutdown" hypervisor parameter hv/vga|Custom|hv/vga|The "vga" hypervisor parameter hv/vhost_net|Boolean|hv/vhost_net|The "vhost_net" hypervisor parameter hv/vif_script|Custom|hv/vif_script|The "vif_script" hypervisor parameter hv/vif_type|Custom|hv/vif_type|The "vif_type" hypervisor parameter hv/viridian|Boolean|hv/viridian|The "viridian" hypervisor parameter hv/virtio_net_queues|Number|hv/virtio_net_queues|The "virtio_net_queues" hypervisor parameter hv/vnc_bind_address|Custom|VNC_bind_address|The "vnc_bind_address" hypervisor parameter hv/vnc_password_file|Custom|hv/vnc_password_file|The "vnc_password_file" hypervisor parameter hv/vnc_tls|Boolean|hv/vnc_tls|The "vnc_tls" hypervisor parameter hv/vnc_x509_path|Custom|hv/vnc_x509_path|The "vnc_x509_path" hypervisor parameter hv/vnc_x509_verify|Boolean|hv/vnc_x509_verify|The "vnc_x509_verify" hypervisor parameter hv/vnet_hdr|Boolean|hv/vnet_hdr|The "vnet_hdr" hypervisor parameter hvparams|Custom|HypervisorParameters|Hypervisor parameters (merged) hypervisor|Text|Hypervisor|Hypervisor name ip|Text|NicIP/0|IP address of 1st network interface mac|Text|NicMAC/0|MAC address of 1st network interface mtime|Timestamp|MTime|Modification timestamp name|Text|Instance|Instance name network_port|Custom|Network_port|Instance network port if available (e.g. for VNC console) nic.bridge/0|Text|NicBridge/0|Bridge of 1st network interface nic.bridge/1|Text|NicBridge/1|Bridge of 2nd network interface nic.bridge/2|Text|NicBridge/2|Bridge of 3rd network interface nic.bridge/3|Text|NicBridge/3|Bridge of 4th network interface nic.bridge/4|Text|NicBridge/4|Bridge of 5th network interface nic.bridge/5|Text|NicBridge/5|Bridge of 6th network interface nic.bridge/6|Text|NicBridge/6|Bridge of 7th network interface nic.bridge/7|Text|NicBridge/7|Bridge of 8th network interface nic.bridges|Custom|NIC_bridges|List containing each network interface's bridge nic.count|Number|NICs|Number of network interfaces nic.ip/0|Text|NicIP/0|IP address of 1st network interface nic.ip/1|Text|NicIP/1|IP address of 2nd network interface nic.ip/2|Text|NicIP/2|IP address of 3rd network interface nic.ip/3|Text|NicIP/3|IP address of 4th network interface nic.ip/4|Text|NicIP/4|IP address of 5th network interface nic.ip/5|Text|NicIP/5|IP address of 6th network interface nic.ip/6|Text|NicIP/6|IP address of 7th network interface nic.ip/7|Text|NicIP/7|IP address of 8th network interface nic.ips|Custom|NIC_IPs|List containing each network interface's IP address nic.link/0|Text|NicLink/0|Link of 1st network interface nic.link/1|Text|NicLink/1|Link of 2nd network interface nic.link/2|Text|NicLink/2|Link of 3rd network interface nic.link/3|Text|NicLink/3|Link of 4th network interface nic.link/4|Text|NicLink/4|Link of 5th network interface nic.link/5|Text|NicLink/5|Link of 6th network interface nic.link/6|Text|NicLink/6|Link of 7th network interface nic.link/7|Text|NicLink/7|Link of 8th network interface nic.links|Custom|NIC_links|List containing each network interface's link nic.mac/0|Text|NicMAC/0|MAC address of 1st network interface nic.mac/1|Text|NicMAC/1|MAC address of 2nd network interface nic.mac/2|Text|NicMAC/2|MAC address of 3rd network interface nic.mac/3|Text|NicMAC/3|MAC address of 4th network interface nic.mac/4|Text|NicMAC/4|MAC address of 5th network interface nic.mac/5|Text|NicMAC/5|MAC address of 6th network interface nic.mac/6|Text|NicMAC/6|MAC address of 7th network interface nic.mac/7|Text|NicMAC/7|MAC address of 8th network interface nic.macs|Custom|NIC_MACs|List containing each network interface's MAC address nic.mode/0|Text|NicMode/0|Mode of 1st network interface nic.mode/1|Text|NicMode/1|Mode of 2nd network interface nic.mode/2|Text|NicMode/2|Mode of 3rd network interface nic.mode/3|Text|NicMode/3|Mode of 4th network interface nic.mode/4|Text|NicMode/4|Mode of 5th network interface nic.mode/5|Text|NicMode/5|Mode of 6th network interface nic.mode/6|Text|NicMode/6|Mode of 7th network interface nic.mode/7|Text|NicMode/7|Mode of 8th network interface nic.modes|Custom|NIC_modes|List containing each network interface's mode nic.name/0|Text|NicName/0|Name address of 1st network interface nic.name/1|Text|NicName/1|Name address of 2nd network interface nic.name/2|Text|NicName/2|Name address of 3rd network interface nic.name/3|Text|NicName/3|Name address of 4th network interface nic.name/4|Text|NicName/4|Name address of 5th network interface nic.name/5|Text|NicName/5|Name address of 6th network interface nic.name/6|Text|NicName/6|Name address of 7th network interface nic.name/7|Text|NicName/7|Name address of 8th network interface nic.names|Custom|NIC_Names|List containing each network interface's name nic.network.name/0|Text|NicNetworkName/0|Network name of 1st network interface nic.network.name/1|Text|NicNetworkName/1|Network name of 2nd network interface nic.network.name/2|Text|NicNetworkName/2|Network name of 3rd network interface nic.network.name/3|Text|NicNetworkName/3|Network name of 4th network interface nic.network.name/4|Text|NicNetworkName/4|Network name of 5th network interface nic.network.name/5|Text|NicNetworkName/5|Network name of 6th network interface nic.network.name/6|Text|NicNetworkName/6|Network name of 7th network interface nic.network.name/7|Text|NicNetworkName/7|Network name of 8th network interface nic.network/0|Text|NicNetwork/0|Network of 1st network interface nic.network/1|Text|NicNetwork/1|Network of 2nd network interface nic.network/2|Text|NicNetwork/2|Network of 3rd network interface nic.network/3|Text|NicNetwork/3|Network of 4th network interface nic.network/4|Text|NicNetwork/4|Network of 5th network interface nic.network/5|Text|NicNetwork/5|Network of 6th network interface nic.network/6|Text|NicNetwork/6|Network of 7th network interface nic.network/7|Text|NicNetwork/7|Network of 8th network interface nic.networks|Custom|NIC_networks|List containing each interface's network nic.networks.names|Custom|NIC_networks_names|List containing the name of each interface's network nic.uuid/0|Text|NicUUID/0|UUID address of 1st network interface nic.uuid/1|Text|NicUUID/1|UUID address of 2nd network interface nic.uuid/2|Text|NicUUID/2|UUID address of 3rd network interface nic.uuid/3|Text|NicUUID/3|UUID address of 4th network interface nic.uuid/4|Text|NicUUID/4|UUID address of 5th network interface nic.uuid/5|Text|NicUUID/5|UUID address of 6th network interface nic.uuid/6|Text|NicUUID/6|UUID address of 7th network interface nic.uuid/7|Text|NicUUID/7|UUID address of 8th network interface nic.uuids|Custom|NIC_UUIDs|List containing each network interface's UUID nic.vlan/0|Text|NicVLAN/0|VLAN of 1st network interface nic.vlan/1|Text|NicVLAN/1|VLAN of 2nd network interface nic.vlan/2|Text|NicVLAN/2|VLAN of 3rd network interface nic.vlan/3|Text|NicVLAN/3|VLAN of 4th network interface nic.vlan/4|Text|NicVLAN/4|VLAN of 5th network interface nic.vlan/5|Text|NicVLAN/5|VLAN of 6th network interface nic.vlan/6|Text|NicVLAN/6|VLAN of 7th network interface nic.vlan/7|Text|NicVLAN/7|VLAN of 8th network interface nic.vlans|Custom|NIC_VLANs|List containing each network interface's VLAN nic_link|Text|NicLink/0|Link of 1st network interface nic_mode|Text|NicMode/0|Mode of 1st network interface nic_network|Text|NicNetwork/0|Network of 1st network interface oper_ram|Storage size|Memory|Actual memory usage as seen by hypervisor oper_state|Boolean|Running|Actual state of instance oper_vcpus|Number|VCPUs|Actual number of VCPUs as seen by hypervisor os|Text|OS|Operating system osparams|Custom|OpSysParameters|Operating system parameters (merged) pnode|Text|Primary_node|Primary node pnode.group|Text|PrimaryNodeGroup|Primary node's group pnode.group.uuid|Text|PrimaryNodeGroupUUID|Primary node's group UUID sda_size|Storage size|Disk/0|Disk size of 1st disk sdb_size|Storage size|Disk/1|Disk size of 2nd disk serial_no|Number|SerialNo|Instance object serial number, incremented on each modification snodes|Custom|Secondary_Nodes|Secondary nodes; usually this will just be one node snodes.group|Custom|SecondaryNodesGroups|Node groups of secondary nodes snodes.group.uuid|Custom|SecondaryNodesGroupsUUID|Node group UUIDs of secondary nodes status|Text|Status|Instance status; "running" if instance is set to be running and actually is, "ADMIN_down" if instance is stopped and is not running, "ERROR_wrongnode" if instance running, but not on its designated primary node, "ERROR_up" if instance should be stopped, but is actually running, "ERROR_down" if instance should run, but doesn't, "ERROR_nodedown" if instance's primary node is down, "ERROR_nodeoffline" if instance's primary node is marked offline, "ADMIN_offline" if instance is offline and does not use dynamic resources tags|Custom|Tags|Tags uuid|Text|UUID|Instance UUID vcpus|Number|ConfigVCPUs|The "vcpus" backend parameter Command: ssh moe.staging.ganeti.org 'gnt-instance list-fields field/does/not/exist' Stdout was: Name Type Title Description field/does/not/exist Unknown field/does/not/exist Unknown field 'field/does/not/exist' Stderr was: ---- PASSED [TestInstanceListFields] gnt-instance list-fields ---------- >>>> 2025-06-18 03:15:11.829274 time=0:00:00.824653 [TestInstanceListFields] gnt-instance list-fields Warning: Queried for unknown fields field/does/not/exist <<<< 2025-06-18 03:15:11.829379 start [TestJobListFields] gnt-node list-fields Command: ssh moe.staging.ganeti.org 'gnt-job list-fields >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-job list-fields id status priority archived ops opresult opstatus oplog opstart opexec opend oppriority summary received_ts start_ts end_ts >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-job list-fields '\''--separator=|'\'' --no-headers' archived|Boolean|Archived|Whether job is archived end_ts|Custom|End|Timestamp of job end (tuple containing seconds and microseconds) id|Number|ID|Job ID opend|Custom|OpCode_end|List of opcode execution end timestamps opexec|Custom|OpCode_exec|List of opcode execution start timestamps (after acquiring locks) oplog|Custom|OpCode_log|List of opcode output logs oppriority|Custom|OpCode_prio|List of opcode priorities opresult|Custom|OpCode_result|List of opcodes results ops|Custom|OpCodes|List of all opcodes opstart|Custom|OpCode_start|List of opcode start timestamps (before acquiring locks) opstatus|Custom|OpCode_status|List of opcodes status priority|Number|Priority|Current job priority (19 to -20) received_ts|Custom|Received|Timestamp of when job was received (tuple containing seconds and microseconds) start_ts|Custom|Start|Timestamp of job start (tuple containing seconds and microseconds) status|Text|Status|Job status summary|Custom|Summary|List of per-opcode summaries Command: ssh moe.staging.ganeti.org 'gnt-job list-fields field/does/not/exist' Stdout was: Name Type Title Description field/does/not/exist Unknown field/does/not/exist Unknown field 'field/does/not/exist' Stderr was: ---- PASSED [TestJobListFields] gnt-node list-fields ------------------- >>>> 2025-06-18 03:15:12.623469 time=0:00:00.794090 [TestJobListFields] gnt-node list-fields Warning: Queried for unknown fields field/does/not/exist **** 2025-06-18 03:15:12.623570 skipping [TestBackupListFields] gnt-backup list-fields, test(s) instance-export disabled <<<< 2025-06-18 03:15:12.623589 start [TestNodeInfo] gnt-node info ----- Command: ssh moe.staging.ganeti.org 'gnt-node info' - Node name: herman.staging.ganeti.org primary ip: 192.168.1.10 secondary ip: 192.168.1.10 master candidate: True drained: False offline: False master_capable: True vm_capable: True primary for instances: secondary for instances: node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) - Node name: krusty.staging.ganeti.org primary ip: 192.168.1.9 secondary ip: 192.168.1.9 master candidate: True drained: False offline: False master_capable: True vm_capable: True primary for instances: secondary for instances: node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) - Node name: moe.staging.ganeti.org primary ip: 192.168.1.8 secondary ip: 192.168.1.8 master candidate: True drained: False offline: False master_capable: True vm_capable: True primary for instances: secondary for instances: node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) ---- PASSED [TestNodeInfo] gnt-node info ------------------------------- >>>> 2025-06-18 03:15:12.885589 time=0:00:00.262000 [TestNodeInfo] gnt-node info vvvv BLOCK 2025-06-18 03:15:12.885701 start [RunClusterTests] Runs tests related to gnt-cluster **** 2025-06-18 03:15:12.885795 skipping [TestClusterInitDisk] gnt-cluster init -D, test(s) create-cluster disabled **** 2025-06-18 03:15:12.885823 skipping [TestClusterRenewCrypto] gnt-cluster renew-crypto, test(s) cluster-renew-crypto disabled <<<< 2025-06-18 03:15:12.885855 start [TestClusterVerify] gnt-cluster verify Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 16, 17 Waiting for job 16 ... Wed Jun 18 03:15:14 2025 * Verifying cluster config Wed Jun 18 03:15:14 2025 * Verifying cluster certificate files Wed Jun 18 03:15:14 2025 * Verifying hypervisor parameters Wed Jun 18 03:15:14 2025 * Verifying all nodes belong to an existing group Waiting for job 17 ... Wed Jun 18 03:15:15 2025 * Verifying group 'default' Wed Jun 18 03:15:15 2025 * Gathering data (3 nodes) Wed Jun 18 03:15:15 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:15:16 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:15:16 2025 * Verifying configuration file consistency Wed Jun 18 03:15:16 2025 * Verifying node status Wed Jun 18 03:15:16 2025 * Verifying instance status Wed Jun 18 03:15:16 2025 * Verifying orphan volumes Wed Jun 18 03:15:16 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:15:16 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:15:16 2025 * Other Notes Wed Jun 18 03:15:16 2025 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-cluster verify-disks' ---- PASSED [TestClusterVerify] gnt-cluster verify --------------------- >>>> 2025-06-18 03:15:17.677169 time=0:00:04.791314 [TestClusterVerify] gnt-cluster verify <<<< 2025-06-18 03:15:17.677289 start [TestClusterReservedLvs] gnt-cluster reserved lvs Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' 6add8ccbb34997c138468445070323ae65abe9ca /var/lib/ganeti/config.data Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 20, 21 Waiting for job 20 ... Wed Jun 18 03:15:19 2025 * Verifying cluster config Wed Jun 18 03:15:19 2025 * Verifying cluster certificate files Wed Jun 18 03:15:19 2025 * Verifying hypervisor parameters Wed Jun 18 03:15:19 2025 * Verifying all nodes belong to an existing group Waiting for job 21 ... Wed Jun 18 03:15:19 2025 * Verifying group 'default' Wed Jun 18 03:15:19 2025 * Gathering data (3 nodes) Wed Jun 18 03:15:19 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:15:21 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:15:21 2025 * Verifying configuration file consistency Wed Jun 18 03:15:21 2025 * Verifying node status Wed Jun 18 03:15:21 2025 * Verifying instance status Wed Jun 18 03:15:21 2025 * Verifying orphan volumes Wed Jun 18 03:15:21 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:15:21 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:15:21 2025 * Other Notes Wed Jun 18 03:15:21 2025 * Hooks Results Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' 6add8ccbb34997c138468445070323ae65abe9ca /var/lib/ganeti/config.data Command: ssh moe.staging.ganeti.org 'gnt-cluster modify --reserved-lvs '\'''\''' Command: ssh moe.staging.ganeti.org 'lvcreate -L1G -n qa-test gnt' Logical volume "qa-test" created. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' bff2a8c42c1b85a95e3914bd43951f59dec0ad06 /var/lib/ganeti/config.data Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-cluster verify --error-codes' Submitted jobs 24, 25 Waiting for job 24 ... Wed Jun 18 03:15:24 2025 * Verifying cluster config Wed Jun 18 03:15:24 2025 * Verifying cluster certificate files Wed Jun 18 03:15:24 2025 * Verifying hypervisor parameters Wed Jun 18 03:15:24 2025 * Verifying all nodes belong to an existing group Waiting for job 25 ... Wed Jun 18 03:15:24 2025 * Verifying group 'default' Wed Jun 18 03:15:24 2025 * Gathering data (3 nodes) Wed Jun 18 03:15:24 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:15:26 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:15:26 2025 * Verifying configuration file consistency Wed Jun 18 03:15:26 2025 * Verifying node status Wed Jun 18 03:15:26 2025 * Verifying instance status Wed Jun 18 03:15:26 2025 * Verifying orphan volumes Wed Jun 18 03:15:26 2025 - WARNING:ENODEORPHANLV:node:moe.staging.ganeti.org:volume gnt/qa-test is unknown Wed Jun 18 03:15:26 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:15:26 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:15:26 2025 * Other Notes Wed Jun 18 03:15:26 2025 * Hooks Results Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' bff2a8c42c1b85a95e3914bd43951f59dec0ad06 /var/lib/ganeti/config.data Submitted jobs 24, 25 Waiting for job 24 ... Wed Jun 18 03:15:24 2025 * Verifying cluster config Wed Jun 18 03:15:24 2025 * Verifying cluster certificate files Wed Jun 18 03:15:24 2025 * Verifying hypervisor parameters Wed Jun 18 03:15:24 2025 * Verifying all nodes belong to an existing group Waiting for job 25 ... Wed Jun 18 03:15:24 2025 * Verifying group 'default' Wed Jun 18 03:15:24 2025 * Gathering data (3 nodes) Wed Jun 18 03:15:24 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:15:26 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:15:26 2025 * Verifying configuration file consistency Wed Jun 18 03:15:26 2025 * Verifying node status Wed Jun 18 03:15:26 2025 * Verifying instance status Wed Jun 18 03:15:26 2025 * Verifying orphan volumes Wed Jun 18 03:15:26 2025 - WARNING:ENODEORPHANLV:node:moe.staging.ganeti.org:volume gnt/qa-test is unknown Wed Jun 18 03:15:26 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:15:26 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:15:26 2025 * Other Notes Wed Jun 18 03:15:26 2025 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-cluster modify --reserved-lvs '\''gnt/qa-test,.*/other-test'\''' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' c9f6fe4b0fce5004f93c556d04f2171bf4f5f347 /var/lib/ganeti/config.data Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-cluster verify --error-codes' Submitted jobs 28, 29 Waiting for job 28 ... Wed Jun 18 03:15:29 2025 * Verifying cluster config Wed Jun 18 03:15:29 2025 * Verifying cluster certificate files Wed Jun 18 03:15:29 2025 * Verifying hypervisor parameters Wed Jun 18 03:15:29 2025 * Verifying all nodes belong to an existing group Waiting for job 29 ... Wed Jun 18 03:15:30 2025 * Verifying group 'default' Wed Jun 18 03:15:30 2025 * Gathering data (3 nodes) Wed Jun 18 03:15:30 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:15:31 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:15:31 2025 * Verifying configuration file consistency Wed Jun 18 03:15:31 2025 * Verifying node status Wed Jun 18 03:15:31 2025 * Verifying instance status Wed Jun 18 03:15:31 2025 * Verifying orphan volumes Wed Jun 18 03:15:31 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:15:31 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:15:31 2025 * Other Notes Wed Jun 18 03:15:31 2025 * Hooks Results Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' c9f6fe4b0fce5004f93c556d04f2171bf4f5f347 /var/lib/ganeti/config.data Submitted jobs 28, 29 Waiting for job 28 ... Wed Jun 18 03:15:29 2025 * Verifying cluster config Wed Jun 18 03:15:29 2025 * Verifying cluster certificate files Wed Jun 18 03:15:29 2025 * Verifying hypervisor parameters Wed Jun 18 03:15:29 2025 * Verifying all nodes belong to an existing group Waiting for job 29 ... Wed Jun 18 03:15:30 2025 * Verifying group 'default' Wed Jun 18 03:15:30 2025 * Gathering data (3 nodes) Wed Jun 18 03:15:30 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:15:31 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:15:31 2025 * Verifying configuration file consistency Wed Jun 18 03:15:31 2025 * Verifying node status Wed Jun 18 03:15:31 2025 * Verifying instance status Wed Jun 18 03:15:31 2025 * Verifying orphan volumes Wed Jun 18 03:15:31 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:15:31 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:15:31 2025 * Other Notes Wed Jun 18 03:15:31 2025 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-cluster modify --reserved-lvs '\''.*/qa-.*'\''' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' b969f951159bcbad2bf8afc041619ac02cb70926 /var/lib/ganeti/config.data Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-cluster verify --error-codes' Submitted jobs 32, 33 Waiting for job 32 ... Wed Jun 18 03:15:34 2025 * Verifying cluster config Wed Jun 18 03:15:34 2025 * Verifying cluster certificate files Wed Jun 18 03:15:34 2025 * Verifying hypervisor parameters Wed Jun 18 03:15:34 2025 * Verifying all nodes belong to an existing group Waiting for job 33 ... Wed Jun 18 03:15:35 2025 * Verifying group 'default' Wed Jun 18 03:15:35 2025 * Gathering data (3 nodes) Wed Jun 18 03:15:35 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:15:36 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:15:36 2025 * Verifying configuration file consistency Wed Jun 18 03:15:36 2025 * Verifying node status Wed Jun 18 03:15:36 2025 * Verifying instance status Wed Jun 18 03:15:36 2025 * Verifying orphan volumes Wed Jun 18 03:15:36 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:15:36 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:15:36 2025 * Other Notes Wed Jun 18 03:15:36 2025 * Hooks Results Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' b969f951159bcbad2bf8afc041619ac02cb70926 /var/lib/ganeti/config.data Submitted jobs 32, 33 Waiting for job 32 ... Wed Jun 18 03:15:34 2025 * Verifying cluster config Wed Jun 18 03:15:34 2025 * Verifying cluster certificate files Wed Jun 18 03:15:34 2025 * Verifying hypervisor parameters Wed Jun 18 03:15:34 2025 * Verifying all nodes belong to an existing group Waiting for job 33 ... Wed Jun 18 03:15:35 2025 * Verifying group 'default' Wed Jun 18 03:15:35 2025 * Gathering data (3 nodes) Wed Jun 18 03:15:35 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:15:36 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:15:36 2025 * Verifying configuration file consistency Wed Jun 18 03:15:36 2025 * Verifying node status Wed Jun 18 03:15:36 2025 * Verifying instance status Wed Jun 18 03:15:36 2025 * Verifying orphan volumes Wed Jun 18 03:15:36 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:15:36 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:15:36 2025 * Other Notes Wed Jun 18 03:15:36 2025 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-cluster modify --reserved-lvs '\'''\''' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' bd0d812572fc8b50a94952636aec24020f7a8789 /var/lib/ganeti/config.data Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-cluster verify --error-codes' Submitted jobs 36, 37 Waiting for job 36 ... Wed Jun 18 03:15:39 2025 * Verifying cluster config Wed Jun 18 03:15:40 2025 * Verifying cluster certificate files Wed Jun 18 03:15:40 2025 * Verifying hypervisor parameters Wed Jun 18 03:15:40 2025 * Verifying all nodes belong to an existing group Waiting for job 37 ... Wed Jun 18 03:15:40 2025 * Verifying group 'default' Wed Jun 18 03:15:40 2025 * Gathering data (3 nodes) Wed Jun 18 03:15:40 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:15:41 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:15:41 2025 * Verifying configuration file consistency Wed Jun 18 03:15:41 2025 * Verifying node status Wed Jun 18 03:15:41 2025 * Verifying instance status Wed Jun 18 03:15:41 2025 * Verifying orphan volumes Wed Jun 18 03:15:41 2025 - WARNING:ENODEORPHANLV:node:moe.staging.ganeti.org:volume gnt/qa-test is unknown Wed Jun 18 03:15:41 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:15:41 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:15:41 2025 * Other Notes Wed Jun 18 03:15:41 2025 * Hooks Results Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' bd0d812572fc8b50a94952636aec24020f7a8789 /var/lib/ganeti/config.data Submitted jobs 36, 37 Waiting for job 36 ... Wed Jun 18 03:15:39 2025 * Verifying cluster config Wed Jun 18 03:15:40 2025 * Verifying cluster certificate files Wed Jun 18 03:15:40 2025 * Verifying hypervisor parameters Wed Jun 18 03:15:40 2025 * Verifying all nodes belong to an existing group Waiting for job 37 ... Wed Jun 18 03:15:40 2025 * Verifying group 'default' Wed Jun 18 03:15:40 2025 * Gathering data (3 nodes) Wed Jun 18 03:15:40 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:15:41 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:15:41 2025 * Verifying configuration file consistency Wed Jun 18 03:15:41 2025 * Verifying node status Wed Jun 18 03:15:41 2025 * Verifying instance status Wed Jun 18 03:15:41 2025 * Verifying orphan volumes Wed Jun 18 03:15:41 2025 - WARNING:ENODEORPHANLV:node:moe.staging.ganeti.org:volume gnt/qa-test is unknown Wed Jun 18 03:15:41 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:15:41 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:15:41 2025 * Other Notes Wed Jun 18 03:15:41 2025 * Hooks Results Command: ssh moe.staging.ganeti.org 'lvremove -f gnt/qa-test' Logical volume "qa-test" successfully removed. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' bd0d812572fc8b50a94952636aec24020f7a8789 /var/lib/ganeti/config.data Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 39, 40 Waiting for job 39 ... Wed Jun 18 03:15:43 2025 * Verifying cluster config Wed Jun 18 03:15:43 2025 * Verifying cluster certificate files Wed Jun 18 03:15:43 2025 * Verifying hypervisor parameters Wed Jun 18 03:15:43 2025 * Verifying all nodes belong to an existing group Waiting for job 40 ... Wed Jun 18 03:15:44 2025 * Verifying group 'default' Wed Jun 18 03:15:44 2025 * Gathering data (3 nodes) Wed Jun 18 03:15:44 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:15:45 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:15:45 2025 * Verifying configuration file consistency Wed Jun 18 03:15:45 2025 * Verifying node status Wed Jun 18 03:15:45 2025 * Verifying instance status Wed Jun 18 03:15:45 2025 * Verifying orphan volumes Wed Jun 18 03:15:45 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:15:45 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:15:45 2025 * Other Notes Wed Jun 18 03:15:45 2025 * Hooks Results Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' bd0d812572fc8b50a94952636aec24020f7a8789 /var/lib/ganeti/config.data ---- PASSED [TestClusterReservedLvs] gnt-cluster reserved lvs ---------- >>>> 2025-06-18 03:15:46.045355 time=0:00:28.368066 [TestClusterReservedLvs] gnt-cluster reserved lvs **** 2025-06-18 03:15:46.045485 skipping [TestClusterModifyEmpty] gnt-cluster modify, test(s) cluster-modify disabled **** 2025-06-18 03:15:46.045515 skipping [TestClusterModifyIPolicy] gnt-cluster modify --ipolicy-*, test(s) cluster-modify disabled **** 2025-06-18 03:15:46.045551 skipping [TestClusterModifyISpecs] gnt-cluster modify --specs-*, test(s) cluster-modify disabled **** 2025-06-18 03:15:46.045570 skipping [TestClusterModifyBe] gnt-cluster modify -B, test(s) cluster-modify disabled **** 2025-06-18 03:15:46.045586 skipping [TestClusterModifyDisk] gnt-cluster modify -D, test(s) cluster-modify disabled **** 2025-06-18 03:15:46.045613 skipping [TestClusterModifyDiskTemplates] gnt-cluster modify --enabled-disk-templates=, test(s) cluster-modify disabled **** 2025-06-18 03:15:46.045631 skipping [TestClusterModifyFileStorageDir] gnt-cluster modify --file-storage-dir=, test(s) cluster-modify disabled **** 2025-06-18 03:15:46.045655 skipping [TestClusterModifySharedFileStorageDir] gnt-cluster modify --shared-file-storage-dir=, test(s) cluster-modify disabled **** 2025-06-18 03:15:46.045673 skipping [TestClusterModifyInstallImage] gnt-cluster modify --install-image=...', test(s) cluster-modify disabled **** 2025-06-18 03:15:46.045701 skipping [TestClusterModifyUserShutdown] Tests user shutdown cluster wide, test(s) cluster-modify disabled **** 2025-06-18 03:15:46.045717 skipping [TestClusterRename] gnt-cluster rename, test(s) cluster-rename disabled <<<< 2025-06-18 03:15:46.045733 start [TestClusterVersion] gnt-cluster version Command: ssh moe.staging.ganeti.org 'gnt-cluster version' Software version: 3.1.0~rc2 Internode protocol: 3010000 Configuration format: 3010000 OS api version: 20 Export interface: 0 VCS version: (ganeti) version ---- PASSED [TestClusterVersion] gnt-cluster version ------------------- >>>> 2025-06-18 03:15:46.306698 time=0:00:00.260965 [TestClusterVersion] gnt-cluster version <<<< 2025-06-18 03:15:46.306931 start [TestClusterInfo] gnt-cluster info Command: ssh moe.staging.ganeti.org 'gnt-cluster info' Cluster name: staging-cluster.ganeti.org Cluster UUID: 7f755f82-451c-48ad-9fbf-e32661ce6de2 Creation time: 2025-06-18 03:13:53 Modification time: 2025-06-18 03:15:38 Master node: moe.staging.ganeti.org Architecture (this node): 64bits (x86_64) Tags: (none) Default hypervisor: xen-hvm Enabled hypervisors: xen-hvm Hypervisor parameters: xen-hvm: acpi: True blockdev_prefix: hd boot_order: cd cdrom_image_path: cpu_cap: 0 cpu_mask: all cpu_weight: 256 cpuid: device_model: /usr/bin/qemu-system-x86_64 disk_type: paravirtual kernel_path: /usr/lib/xen-4.17/boot/hvmloader migration_mode: non-live migration_port: 8002 nic_type: rtl8139 pae: True pci_pass: reboot_behavior: reboot soundhw: use_localtime: False vif_script: vif_type: ioemu viridian: False vnc_bind_address: 0.0.0.0 vnc_password_file: /etc/ganeti/vnc-cluster-password OS-specific hypervisor parameters: OS parameters: Hidden OSes: Blacklisted OSes: Cluster parameters: candidate pool size: 10 maximal number of jobs running simultaneously: 20 maximal number of jobs simultaneously tracked by the scheduler: 25 mac prefix: aa:00:00 master netdev: virt-bridge master netmask: 24 use external master IP address setup script: False lvm volume group: gnt lvm reserved volumes: (none) drbd usermode helper: /bin/true file storage path: /srv/ganeti/file-storage shared file storage path: /srv/ganeti/shared-file-storage gluster storage path: /var/run/ganeti/gluster maintenance of node health: False uid pool: default instance allocator: hail default instance allocator parameters: primary ip version: 4 preallocation wipe disks: False OS search path: /srv/ganeti/os, /usr/local/lib/ganeti/os, /usr/lib/ganeti/os, /usr/share/ganeti/os ExtStorage Providers search path: /srv/ganeti/extstorage enabled disk templates: plain, file, drbd, sharedfile install image: instance communication network: zeroing image: compression tools: - gzip - gzip-fast - gzip-slow enabled user shutdown: False modify ssh setup: False ssh_key_type: rsa ssh_key_bits: 2048 Default node parameters: cpu_speed: 1 exclusive_storage: False oob_program: ovs: False ovs_link: ovs_name: switch1 spindle_count: 1 ssh_port: 22 Default instance parameters: default: always_failover: False auto_balance: True maxmem: 128 minmem: 128 spindle_use: 1 vcpus: 1 Default nic parameters: default: link: virt-bridge mode: bridged vlan: Default disk parameters: blockdev: diskless: drbd: c-delay-target: 1 c-fill-target: 0 c-max-rate: 1310720 c-min-rate: 10240 c-plan-ahead: 20 data-stripes: 1 disk-barriers: n disk-custom: dynamic-resync: True meta-barriers: False meta-stripes: 1 metavg: gnt net-custom: --max-buffers=16000 --max-epoch-size=16000 protocol: C resync-rate: 61440 ext: access: kernelspace file: gluster: access: kernelspace host: 127.0.0.1 port: 24007 volume: gv0 plain: stripes: 1 rbd: access: kernelspace pool: rbd sharedfile: Instance policy - limits for instances: bounds specs: - max/0: cpu-count: 48 disk-count: 8 disk-size: 1048576 memory-size: 1048576 nic-count: 8 spindle-use: 8 min/0: cpu-count: 1 disk-count: 0 disk-size: 512 memory-size: 128 nic-count: 0 spindle-use: 0 std: cpu-count: 1 disk-count: 1 disk-size: 1024 memory-size: 128 nic-count: 1 spindle-use: 1 allowed disk templates: sharedfile, drbd, plain, file spindle-ratio: 32 vcpu-ratio: 4 Data collectors: cpu-avg-load: active: True interval: 5.000s diskstats: active: True interval: 5.000s drbd: active: True interval: 5.000s inst-status-xen: active: True interval: 5.000s lv: active: True interval: 5.000s xen-cpu-avg-load: active: True interval: 5.000s ---- PASSED [TestClusterInfo] gnt-cluster info ------------------------- >>>> 2025-06-18 03:15:46.567485 time=0:00:00.260554 [TestClusterInfo] gnt-cluster info <<<< 2025-06-18 03:15:46.567634 start [TestClusterGetmaster] gnt-cluster getmaster Command: ssh moe.staging.ganeti.org 'gnt-cluster getmaster' moe.staging.ganeti.org ---- PASSED [TestClusterGetmaster] gnt-cluster getmaster --------------- >>>> 2025-06-18 03:15:46.827669 time=0:00:00.260035 [TestClusterGetmaster] gnt-cluster getmaster <<<< 2025-06-18 03:15:46.827760 start [TestClusterRedistConf] gnt-cluster redist-conf Command: ssh moe.staging.ganeti.org 'gnt-cluster redist-conf' ---- PASSED [TestClusterRedistConf] gnt-cluster redist-conf ------------ >>>> 2025-06-18 03:15:48.681476 time=0:00:01.853716 [TestClusterRedistConf] gnt-cluster redist-conf <<<< 2025-06-18 03:15:48.681603 start [TestClusterCopyfile] gnt-cluster copyfile /tmp/gnt.VGGwS4 Command: ssh moe.staging.ganeti.org 'gnt-cluster copyfile /tmp/gnt.VGGwS4' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'cat /tmp/gnt.VGGwS4' aee48b05-f425-4e35-9d64-4717924e4748Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.8r8q52y4 -oControlMaster=no krusty.staging.ganeti.org 'cat /tmp/gnt.VGGwS4' aee48b05-f425-4e35-9d64-4717924e4748Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.6hfmr6kt -oControlMaster=no herman.staging.ganeti.org 'cat /tmp/gnt.VGGwS4' aee48b05-f425-4e35-9d64-4717924e4748Command: ssh moe.staging.ganeti.org 'rm -f /tmp/gnt.VGGwS4' Command: ssh krusty.staging.ganeti.org 'rm -f /tmp/gnt.VGGwS4' Command: ssh herman.staging.ganeti.org 'rm -f /tmp/gnt.VGGwS4' ---- PASSED [TestClusterCopyfile] gnt-cluster copyfile ----------------- >>>> 2025-06-18 03:15:49.619952 time=0:00:00.938349 [TestClusterCopyfile] gnt-cluster copyfile <<<< 2025-06-18 03:15:49.620054 start [TestClusterCommand] gnt-cluster command Command: ssh moe.staging.ganeti.org 'gnt-cluster command '\''echo -n de6b84aa-2a5c-4dc2-addf-350d9ffcf6a8 >/tmp/gnt9b6ed6d5-6f9b-429b-bcc8-83460882d4fb'\''' ------------------------------------------------ node: herman.staging.ganeti.org return code = 0 ------------------------------------------------ node: krusty.staging.ganeti.org return code = 0 ------------------------------------------------ node: moe.staging.ganeti.org return code = 0 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'cat /tmp/gnt9b6ed6d5-6f9b-429b-bcc8-83460882d4fb' de6b84aa-2a5c-4dc2-addf-350d9ffcf6a8Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.8r8q52y4 -oControlMaster=no krusty.staging.ganeti.org 'cat /tmp/gnt9b6ed6d5-6f9b-429b-bcc8-83460882d4fb' de6b84aa-2a5c-4dc2-addf-350d9ffcf6a8Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.6hfmr6kt -oControlMaster=no herman.staging.ganeti.org 'cat /tmp/gnt9b6ed6d5-6f9b-429b-bcc8-83460882d4fb' de6b84aa-2a5c-4dc2-addf-350d9ffcf6a8Command: ssh moe.staging.ganeti.org 'rm -f /tmp/gnt9b6ed6d5-6f9b-429b-bcc8-83460882d4fb' Command: ssh krusty.staging.ganeti.org 'rm -f /tmp/gnt9b6ed6d5-6f9b-429b-bcc8-83460882d4fb' Command: ssh herman.staging.ganeti.org 'rm -f /tmp/gnt9b6ed6d5-6f9b-429b-bcc8-83460882d4fb' ---- PASSED [TestClusterCommand] gnt-cluster command ------------------- >>>> 2025-06-18 03:15:50.767936 time=0:00:01.147882 [TestClusterCommand] gnt-cluster command **** 2025-06-18 03:15:50.768056 skipping [TestClusterBurnin] Burnin, test(s) cluster-burnin disabled **** 2025-06-18 03:15:50.768083 skipping [TestClusterMasterFailover] gnt-cluster master-failover, test(s) cluster-master-failover disabled **** 2025-06-18 03:15:50.768100 skipping [TestClusterMasterFailoverWithDrainedQueue] gnt-cluster master-failover with drained queue, test(s) cluster-master-failover disabled <<<< 2025-06-18 03:15:50.768120 start [TestClusterOob] out-of-band framework Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 43, 44 Waiting for job 43 ... Wed Jun 18 03:15:52 2025 * Verifying cluster config Wed Jun 18 03:15:52 2025 * Verifying cluster certificate files Wed Jun 18 03:15:52 2025 * Verifying hypervisor parameters Wed Jun 18 03:15:52 2025 * Verifying all nodes belong to an existing group Waiting for job 44 ... Wed Jun 18 03:15:52 2025 * Verifying group 'default' Wed Jun 18 03:15:52 2025 * Gathering data (3 nodes) Wed Jun 18 03:15:52 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:15:54 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:15:54 2025 * Verifying configuration file consistency Wed Jun 18 03:15:54 2025 * Verifying node status Wed Jun 18 03:15:54 2025 * Verifying instance status Wed Jun 18 03:15:54 2025 * Verifying orphan volumes Wed Jun 18 03:15:54 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:15:54 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:15:54 2025 * Other Notes Wed Jun 18 03:15:54 2025 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-cluster modify --node-parameters oob_program=/tmp/ganeti-qa-oob-does-not-exist-0bc889c2-2f17-49f4-af1a-538e0355f4b9' Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 47, 48 Waiting for job 47 ... Wed Jun 18 03:15:57 2025 * Verifying cluster config Wed Jun 18 03:15:57 2025 * Verifying cluster certificate files Wed Jun 18 03:15:57 2025 * Verifying hypervisor parameters Wed Jun 18 03:15:57 2025 * Verifying all nodes belong to an existing group Waiting for job 48 ... Wed Jun 18 03:15:58 2025 * Verifying group 'default' Wed Jun 18 03:15:58 2025 * Gathering data (3 nodes) Wed Jun 18 03:15:58 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:15:59 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:15:59 2025 * Verifying configuration file consistency Wed Jun 18 03:15:59 2025 * Verifying node status Wed Jun 18 03:15:59 2025 - ERROR: node krusty.staging.ganeti.org: error stating out of band helper: [Errno 2] No such file or directory: '/tmp/ganeti-qa-oob-does-not-exist-0bc889c2-2f17-49f4-af1a-538e0355f4b9' Wed Jun 18 03:15:59 2025 - ERROR: node moe.staging.ganeti.org: error stating out of band helper: [Errno 2] No such file or directory: '/tmp/ganeti-qa-oob-does-not-exist-0bc889c2-2f17-49f4-af1a-538e0355f4b9' Wed Jun 18 03:15:59 2025 - ERROR: node herman.staging.ganeti.org: error stating out of band helper: [Errno 2] No such file or directory: '/tmp/ganeti-qa-oob-does-not-exist-0bc889c2-2f17-49f4-af1a-538e0355f4b9' Wed Jun 18 03:15:59 2025 * Verifying instance status Wed Jun 18 03:15:59 2025 * Verifying orphan volumes Wed Jun 18 03:15:59 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:15:59 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:15:59 2025 * Other Notes Wed Jun 18 03:15:59 2025 * Hooks Results Command: ssh moe.staging.ganeti.org 'touch /tmp/ganeti-qa-oob-does-exist-2fd77591-1198-4d5c-ae8f-31260c82360a' Command: ssh moe.staging.ganeti.org 'chmod 0400 /tmp/ganeti-qa-oob-does-exist-2fd77591-1198-4d5c-ae8f-31260c82360a' Command: ssh moe.staging.ganeti.org 'gnt-cluster copyfile /tmp/ganeti-qa-oob-does-exist-2fd77591-1198-4d5c-ae8f-31260c82360a' Command: ssh moe.staging.ganeti.org 'gnt-cluster modify --node-parameters oob_program=/tmp/ganeti-qa-oob-does-exist-2fd77591-1198-4d5c-ae8f-31260c82360a' Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 51, 52 Waiting for job 51 ... Wed Jun 18 03:16:03 2025 * Verifying cluster config Wed Jun 18 03:16:03 2025 * Verifying cluster certificate files Wed Jun 18 03:16:03 2025 * Verifying hypervisor parameters Wed Jun 18 03:16:03 2025 * Verifying all nodes belong to an existing group Waiting for job 52 ... Wed Jun 18 03:16:04 2025 * Verifying group 'default' Wed Jun 18 03:16:04 2025 * Gathering data (3 nodes) Wed Jun 18 03:16:04 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:16:05 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:16:05 2025 * Verifying configuration file consistency Wed Jun 18 03:16:05 2025 * Verifying node status Wed Jun 18 03:16:05 2025 - ERROR: node herman.staging.ganeti.org: out of band helper /tmp/ganeti-qa-oob-does-exist-2fd77591-1198-4d5c-ae8f-31260c82360a is not executable Wed Jun 18 03:16:05 2025 - ERROR: node krusty.staging.ganeti.org: out of band helper /tmp/ganeti-qa-oob-does-exist-2fd77591-1198-4d5c-ae8f-31260c82360a is not executable Wed Jun 18 03:16:05 2025 - ERROR: node moe.staging.ganeti.org: out of band helper /tmp/ganeti-qa-oob-does-exist-2fd77591-1198-4d5c-ae8f-31260c82360a is not executable Wed Jun 18 03:16:05 2025 * Verifying instance status Wed Jun 18 03:16:05 2025 * Verifying orphan volumes Wed Jun 18 03:16:05 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:16:05 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:16:05 2025 * Other Notes Wed Jun 18 03:16:05 2025 * Hooks Results Command: ssh moe.staging.ganeti.org 'chmod 0500 /tmp/ganeti-qa-oob-does-exist-2fd77591-1198-4d5c-ae8f-31260c82360a' Command: ssh moe.staging.ganeti.org 'gnt-cluster copyfile /tmp/ganeti-qa-oob-does-exist-2fd77591-1198-4d5c-ae8f-31260c82360a' Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 54, 55 Waiting for job 54 ... Wed Jun 18 03:16:08 2025 * Verifying cluster config Wed Jun 18 03:16:08 2025 * Verifying cluster certificate files Wed Jun 18 03:16:08 2025 * Verifying hypervisor parameters Wed Jun 18 03:16:08 2025 * Verifying all nodes belong to an existing group Waiting for job 55 ... Wed Jun 18 03:16:08 2025 * Verifying group 'default' Wed Jun 18 03:16:08 2025 * Gathering data (3 nodes) Wed Jun 18 03:16:08 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:16:10 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:16:10 2025 * Verifying configuration file consistency Wed Jun 18 03:16:10 2025 * Verifying node status Wed Jun 18 03:16:10 2025 * Verifying instance status Wed Jun 18 03:16:10 2025 * Verifying orphan volumes Wed Jun 18 03:16:10 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:16:10 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:16:10 2025 * Other Notes Wed Jun 18 03:16:10 2025 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-cluster command rm /tmp/ganeti-qa-oob-does-exist-2fd77591-1198-4d5c-ae8f-31260c82360a' ------------------------------------------------ node: herman.staging.ganeti.org return code = 0 ------------------------------------------------ node: krusty.staging.ganeti.org return code = 0 ------------------------------------------------ node: moe.staging.ganeti.org return code = 0 Command: ssh moe.staging.ganeti.org 'gnt-cluster modify --node-parameters oob_program=' ---- PASSED [TestClusterOob] out-of-band framework --------------------- >>>> 2025-06-18 03:16:13.598445 time=0:00:22.830325 [TestClusterOob] out-of-band framework <<<< 2025-06-18 03:16:13.598601 start [TestInstanceCommunication] Tests instance communication via 'gnt-cluster modify' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group list --no-headers -o name' default Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list --no-headers -o name' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-cluster modify --instance-communication-network=mynetwork' Wed Jun 18 03:16:15 2025 Changing instance communication network to 'mynetwork', only new instances will be affected. Submitted jobs 58 Waiting for job 58 ... Wed Jun 18 03:16:15 2025 Changing instance communication network to 'mynetwork', only new instances will be affected. Submitted jobs 58 Waiting for job 58 ... Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list --no-headers -o name mynetwork' mynetwork Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list --no-headers -o group_list mynetwork' default (routed, communication_rt, ) Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list --no-headers -o gateway mynetwork' - Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list --no-headers -o gateway6 mynetwork' - Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list --no-headers -o network mynetwork' 169.254.0.0/16 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list --no-headers -o network6 mynetwork' fe80::/10 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group add mygroup' Submitted jobs 60 Waiting for job 60 ... Submitted jobs 60 Waiting for job 60 ... Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list --no-headers -o group_list mynetwork' default (routed, communication_rt, ), mygroup (routed, communication_rt, ) Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-cluster modify --instance-communication-network=mynetwork' Wed Jun 18 03:16:21 2025 Instance communication network already is 'mynetwork', nothing to do. Wed Jun 18 03:16:21 2025 Instance communication network already is 'mynetwork', nothing to do. Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-cluster modify --instance-communication-network=' Wed Jun 18 03:16:23 2025 Previous instance communication network 'mynetwork' should be removed manually. Wed Jun 18 03:16:23 2025 Disabling instance communication network, only new instances will be affected. Wed Jun 18 03:16:23 2025 Previous instance communication network 'mynetwork' should be removed manually. Wed Jun 18 03:16:23 2025 Disabling instance communication network, only new instances will be affected. Command: ssh moe.staging.ganeti.org 'gnt-network disconnect mynetwork' Command: ssh moe.staging.ganeti.org 'gnt-network remove mynetwork' Command: ssh moe.staging.ganeti.org 'gnt-group remove mygroup' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group list --no-headers -o name' default Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list --no-headers -o name' ---- PASSED [TestInstanceCommunication] Tests instance communication via 'gnt-cluster modify' >>>> 2025-06-18 03:16:28.697410 time=0:00:15.098809 [TestInstanceCommunication] Tests instance communication via 'gnt-cluster modify' <<<< 2025-06-18 03:16:28.697543 start [TestVersion] Testing remote API version GET /version ---- PASSED [TestVersion] Testing remote API version ------------------- >>>> 2025-06-18 03:16:28.744199 time=0:00:00.046656 [TestVersion] Testing remote API version <<<< 2025-06-18 03:16:28.744321 start [TestEmptyCluster] Testing remote API on an empty cluster Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node info moe.staging.ganeti.org' - Node name: moe.staging.ganeti.org primary ip: 192.168.1.8 secondary ip: 192.168.1.8 master candidate: True drained: False offline: False master_capable: True vm_capable: True primary for instances: secondary for instances: node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) GET / GET /2/info GET /2/tags GET /2/nodes GET /2/nodes?bulk=1 GET /2/groups GET /2/groups?bulk=1 GET /2/instances GET /2/instances?bulk=1 GET /2/os GET /2/filters GET /2/filters?bulk=1 GET /99/resource/not/here/99 PUT /99/resource/not/here/99 POST /99/resource/not/here/99 DELETE /99/resource/not/here/99 PUT /version POST /version DELETE /version Testing get/modify symmetry of /2/info and /2/modify GET successful at /2/info PUT successful at /2/modify ---- PASSED [TestEmptyCluster] Testing remote API on an empty cluster -- >>>> 2025-06-18 03:16:31.392091 time=0:00:02.647770 [TestEmptyCluster] Testing remote API on an empty cluster <<<< 2025-06-18 03:16:31.392275 start [TestRapiQuery] Testing resource queries via remote API Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node info moe.staging.ganeti.org' - Node name: moe.staging.ganeti.org primary ip: 192.168.1.8 secondary ip: 192.168.1.8 master candidate: True drained: False offline: False master_capable: True vm_capable: True primary for instances: secondary for instances: node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) GET /2/query/export/fields GET /2/query/export/fields?fields=export,export,export GET /2/query/export GET /2/query/export?fields=export,node GET /2/query/export?fields=export GET /2/query/export?fields=export,%20export%09,export%20 GET /2/query/job/fields GET /2/query/job/fields?fields=id,id,end_ts GET /2/query/job GET /2/query/job?fields=end_ts,opresult,opend,opstatus,opexec,opstart,status,priority,start_ts,received_ts,oplog,archived,id,ops,summary,oppriority GET /2/query/job?fields=id GET /2/query/job?fields=id,%20id%09,id%20 PUT /2/query/job?fields=id PUT /2/query/job PUT /2/query/job PUT /2/query/job PUT /2/query/job GET /2/query/network/fields GET /2/query/network/fields?fields=name,name,tags GET /2/query/network GET /2/query/network?fields=tags,network6,network,map,reserved_count,free_count,serial_no,mtime,name,uuid,group_list,group_cnt,inst_list,ctime,external_reservations,inst_cnt,gateway6,mac_prefix,gateway GET /2/query/network?fields=name GET /2/query/network?fields=name,%20name%09,name%20 GET /2/query/filter/fields GET /2/query/filter/fields?fields=uuid,uuid,reason_trail GET /2/query/filter GET /2/query/filter?fields=reason_trail,predicates,uuid,priority,watermark,action GET /2/query/filter?fields=uuid GET /2/query/filter?fields=uuid,%20uuid%09,uuid%20 PUT /2/query/filter?fields=uuid PUT /2/query/filter PUT /2/query/filter PUT /2/query/filter PUT /2/query/filter GET /2/query/node/fields GET /2/query/node/fields?fields=name,name,sinst_list GET /2/query/node GET /2/query/node?fields=sinst_list,powered,ndp/ovs_name,hv_state,drained,group.uuid,bootid,pinst_cnt,ndparams,master_candidate,mtotal,ndp/exclusive_storage,master_capable,pinst_list,mnode,csockets,ndp/ovs_link,sip,name,ctotal,offline,mtime,dtotal,ndp/ssh_port,sptotal,disk_state,master,role,group,uuid,ndp/ovs,vm_capable,pip,ctime,ndp/oob_program,serial_no,cnos,dfree,tags,sinst_cnt,mfree,spfree,custom_ndparams,cnodes,ndp/cpu_speed,ndp/spindle_count GET /2/query/node?fields=name GET /2/query/node?fields=name,%20name%09,name%20 PUT /2/query/node GET /2/query/instance/fields GET /2/query/instance/fields?fields=name,name,hv/kvm_pci_reservations GET /2/query/instance GET /2/query/instance?fields=hv/kvm_pci_reservations,hv/drop_capabilities,hv/kvm_path,nic.vlan/6,hv/cpu_weight,hv/spice_ip_version,sdb_size,disk.size/6,hv/bootloader_args,hv/cpu_cores,nic.mac/2,be/memory,nic.bridge/6,disk.spindles/7,disk.spindles/15,nic.name/3,ctime,ip,nic.bridge/5,hv/vnc_x509_path,nic.mode/2,pnode.group,nic.vlan/0,admin_up,hv/devices,disk.uuid/11,nic.name/6,nic.mac/0,disk.size/15,uuid,nic.mac/4,hv/cpu_threads,disk.sizes,nic.names,nic.ip/5,hv/pae,disk.uuid/10,hv/vnet_hdr,hv/migration_caps,nic.name/7,hv/machine_version,hv/floppy_image_path,hv/spice_tls_ciphers,nic.bridge/2,hv/use_guest_agent,nic.network.name/6,disk.size/2,nic.network.name/1,disk.name/10,disk.size/8,hv/vhost_net,disk.spindles/2,disk.uuid/14,hv/spice_jpeg_wan_compression,console,nic.vlan/7,nic.uuid/6,disk.name/2,mac,hv/cpu_cap,hv/spice_zlib_glz_wan_compression,hv/extra_config,hv/cpuid,hv/spice_image_compression,disk.uuid/3,disk.spindles/6,nic.network/6,nic.link/5,snodes.group.uuid,nic.mode/5,nic.mode/4,disk.name/9,nic.link/7,oper_ram,nic.network.name/0,disk.spindles/12,nic.networks.names,hv/disk_type,hv/use_chroot,hv/cpu_mask,nic.vlan/1,hv/viridian,hv/kvm_flag,hv/vga,be/maxmem,bridge,vcpus,disks_active,disk.spindles/10,network_port,disk.spindles/3,hv/virtio_net_queues,nic.mode/3,hv/init_script,nic.mac/1,tags,nic.uuid/7,disk.name/12,disk.uuid/9,hv/scsi_controller_type,disk.size/7,hv/soundhw,nic.ip/6,hv/reboot_behavior,nic.name/5,disk.size/11,nic.link/4,hv/kernel_args,disk.uuid/6,disk.uuid/12,disk.count,nic.bridge/1,admin_state_source,disk.size/14,disk.name/7,hv/serial_speed,hv/pci_pass,custom_beparams,hv/spice_bind,nic.mode/1,nic.link/2,nic.network/0,disk.name/14,nic_link,disk.spindles/5,disk.name/13,hv/migration_downtime,hv/kernel_path,name,hv/extra_cgroups,disk.name/3,hv/cdrom_image_path,pnode,disk.name/11,hv/num_ttys,hv/blockdev_prefix,hv/boot_order,hv/vnc_password_file,hv/disk_discard,disk.uuid/13,hv/mem_path,disk_template,nic.links,hv/startup_timeout,custom_osparams,nic.ip/3,nic.uuid/0,hv/usb_devices,hv/cdrom2_image_path,disk.uuid/2,disk.name/0,mtime,disk.spindles/8,nic.network/4,nic.mac/5,nic.name/4,admin_state,hv/use_localtime,disk_usage,nic.mac/7,disk.spindles/0,hv/spice_streaming_video,hv/bootloader_path,hv/cpu_sockets,disk.name/15,hypervisor,nic.vlan/3,hv/disk_aio,be/spindle_use,be/auto_balance,nic.modes,hv/vnc_tls,disk.spindles/1,nic.ip/1,disk.uuid/7,disk.spindles,hv/spice_use_tls,disk.size/9,hv/root_path,hv/kvm_extra,oper_vcpus,nic.uuids,nic.network/3,serial_no,nic.network/1,hv/security_domain,disk.name/4,hv/nic_type,nic.network/7,hv/spice_playback_compression,nic.uuid/1,nic.link/6,disk.size/5,oper_state,nic.link/3,beparams,hv/acpi,hv/security_model,nic.ip/4,hv/device_model,hv/disk_cache,hv/use_bootloader,nic.ips,hv/vnc_x509_verify,nic.uuid/5,disk.size/13,hv/keymap,forthcoming,nic.network/2,disk.size/0,disk.spindles/11,hv/serial_console,custom_hvparams,disk.spindles/9,nic.bridges,disk.spindles/13,disk.names,disk.uuid/5,nic.mode/6,nic.uuid/3,disk.spindles/14,nic.network.name/7,nic.mac/3,nic.ip/7,nic.bridge/3,nic.name/2,disk.uuid/8,nic.networks,snodes,nic.name/0,hv/usb_mouse,hv/user_shutdown,nic.bridge/0,disk.uuid/1,pnode.group.uuid,disk.uuid/4,nic.link/1,hv/cpu_type,disk.name/1,hvparams,nic.network.name/4,nic_mode,nic.mode/0,disk.spindles/4,hv/vif_type,hv/vif_script,os,disk.uuid/0,be/minmem,nic.ip/0,sda_size,nic.network.name/5,nic.vlan/5,nic.uuid/2,hv/cdrom_disk_type,disk.size/10,nic.bridge/4,nic.network/5,disk.size/4,disk.name/6,disk.size/1,hv/initrd_path,osparams,nic.mode/7,nic.name/1,disk.name/5,nic.vlans,nic.ip/2,nic.network.name/3,nic.vlan/4,nic.bridge/7,nic.mac/6,nic.count,nic.network.name/2,hv/vnc_bind_address,disk.size/3,disk.uuids,disk.size/12,nic_network,nic.vlan/2,status,hv/spice_password_file,hv/spice_use_vdagent,nic.uuid/4,nic.macs,disk.uuid/15,nic.link/0,be/vcpus,disk.name/8,be/always_failover,snodes.group,custom_nicparams GET /2/query/instance?fields=name GET /2/query/instance?fields=name,%20name%09,name%20 GET /2/query/group/fields GET /2/query/group/fields?fields=name,name,ndp/exclusive_storage GET /2/query/group GET /2/query/group?fields=ndp/exclusive_storage,custom_diskparams,ipolicy,ctime,mtime,ndp/ssh_port,custom_ipolicy,pinst_cnt,ndp/spindle_count,ndp/ovs_name,pinst_list,name,serial_no,uuid,node_list,ndp/ovs,node_cnt,alloc_policy,tags,ndp/ovs_link,ndparams,ndp/oob_program,diskparams,custom_ndparams,ndp/cpu_speed GET /2/query/group?fields=name GET /2/query/group?fields=name,%20name%09,name%20 GET /2/query/lock/fields GET /2/query/lock/fields?fields=name,name,mode GET /2/query/lock GET /2/query/lock?fields=mode,owner,pending,name GET /2/query/lock?fields=name GET /2/query/lock?fields=name,%20name%09,name%20 PUT /2/query/lock?fields=name PUT /2/query/lock PUT /2/query/lock PUT /2/query/lock PUT /2/query/lock ---- PASSED [TestRapiQuery] Testing resource queries via remote API ---- >>>> 2025-06-18 03:16:37.082167 time=0:00:05.689892 [TestRapiQuery] Testing resource queries via remote API ^^^^ BLOCK 2025-06-18 03:16:37.082329 time=0:01:24.196628 [RunClusterTests] Runs tests related to gnt-cluster vvvv BLOCK 2025-06-18 03:16:37.082412 start [RunOsTests] Runs all tests related to gnt-os **** 2025-06-18 03:16:37.082555 skipping [TestOsList] gnt-os list, test(s) ['os', >] disabled **** 2025-06-18 03:16:37.082590 skipping [TestOsDiagnose] gnt-os diagnose, test(s) ['os', >] disabled **** 2025-06-18 03:16:37.082611 skipping [TestOsValid] Testing valid OS definition, test(s) ['os', >] disabled **** 2025-06-18 03:16:37.082629 skipping [TestOsInvalid] Testing invalid OS definition, test(s) ['os', >] disabled **** 2025-06-18 03:16:37.082647 skipping [TestOsPartiallyValid] Testing partially valid OS definition, test(s) ['os', >] disabled **** 2025-06-18 03:16:37.082683 skipping [TestOsModifyValid] Testing a valid os modify invocation, test(s) ['os', >] disabled **** 2025-06-18 03:16:37.082700 skipping [TestOsModifyInvalid] Testing an invalid os modify invocation, test(s) ['os', >] disabled **** 2025-06-18 03:16:37.082732 skipping [TestOsStatesNonExisting] Testing OS states with non-existing OS, test(s) ['os', >] disabled ^^^^ BLOCK 2025-06-18 03:16:37.082746 time=0:00:00.000334 [RunOsTests] Runs all tests related to gnt-os <<<< 2025-06-18 03:16:37.082866 start [TestClusterTags] gnt-cluster tags Command: ssh moe.staging.ganeti.org 'gnt-cluster add-tags TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2' Command: ssh moe.staging.ganeti.org 'gnt-cluster list-tags' TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2 Command: ssh moe.staging.ganeti.org 'gnt-cluster search-tags '\''^TEMP-Ganeti-QA-Tag\d+$'\''' /cluster TEMP-Ganeti-QA-Tag0 /cluster TEMP-Ganeti-QA-Tag1 /cluster TEMP-Ganeti-QA-Tag2 Command: ssh moe.staging.ganeti.org 'gnt-cluster remove-tags TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2' PUT /2/tags?tag=TEMP-Ganeti-QA-Tag0&tag=TEMP-Ganeti-QA-Tag1&tag=TEMP-Ganeti-QA-Tag2 GET /2/jobs/72 GET /2/tags DELETE /2/tags?tag=TEMP-Ganeti-QA-Tag0&tag=TEMP-Ganeti-QA-Tag1&tag=TEMP-Ganeti-QA-Tag2 GET /2/jobs/73 ---- PASSED [TestClusterTags] gnt-cluster tags ------------------------- >>>> 2025-06-18 03:16:42.490136 time=0:00:05.407270 [TestClusterTags] gnt-cluster tags vvvv BLOCK 2025-06-18 03:16:42.490259 start [RunCommonNodeTests] Run a few common node tests <<<< 2025-06-18 03:16:42.490354 start [TestNodeVolumes] gnt-node volumes Command: ssh moe.staging.ganeti.org 'gnt-node volumes' Node PhysDev VG Name Size Instance ---- PASSED [TestNodeVolumes] gnt-node volumes ------------------------- >>>> 2025-06-18 03:16:43.643497 time=0:00:01.153143 [TestNodeVolumes] gnt-node volumes <<<< 2025-06-18 03:16:43.643615 start [TestNodeStorage] gnt-node storage Command: ssh moe.staging.ganeti.org 'gnt-node list-storage --storage-type file' Node Type Name Size Used Free Allocatable herman.staging.ganeti.org file /srv/ganeti/file-storage 12.7G 0M 8.4G Y krusty.staging.ganeti.org file /srv/ganeti/file-storage 12.7G 0M 8.4G Y moe.staging.ganeti.org file /srv/ganeti/file-storage 12.7G 0M 8.4G Y Command: ssh moe.staging.ganeti.org 'gnt-node list-storage --storage-type file --output=size,name,allocatable,used,type,node,free' Size Name Allocatable Used Type Node Free 12.7G /srv/ganeti/file-storage Y 0M file herman.staging.ganeti.org 8.4G 12.7G /srv/ganeti/file-storage Y 0M file krusty.staging.ganeti.org 8.4G 12.7G /srv/ganeti/file-storage Y 0M file moe.staging.ganeti.org 8.4G Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type file --output=node,name,allocatable '\''--separator=|'\'' --no-headers' herman.staging.ganeti.org|/srv/ganeti/file-storage|Y krusty.staging.ganeti.org|/srv/ganeti/file-storage|Y moe.staging.ganeti.org|/srv/ganeti/file-storage|Y Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage herman.staging.ganeti.org file /srv/ganeti/file-storage' Stderr was: No changes to perform, exiting. Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable no herman.staging.ganeti.org file /srv/ganeti/file-storage' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type file --output=name,allocatable '\''--separator=|'\'' --no-headers herman.staging.ganeti.org' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'file' can not be modified /srv/ganeti/file-storage|Y Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable yes herman.staging.ganeti.org file /srv/ganeti/file-storage' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type file --output=name,allocatable '\''--separator=|'\'' --no-headers herman.staging.ganeti.org'Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'file' can not be modified /srv/ganeti/file-storage|Y Command: ssh moe.staging.ganeti.org 'gnt-node repair-storage herman.staging.ganeti.org file /srv/ganeti/file-storage' Stderr was: Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'file' can not be repaired Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage krusty.staging.ganeti.org file /srv/ganeti/file-storage' Stderr was: Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable no krusty.staging.ganeti.org file /srv/ganeti/file-storage' No changes to perform, exiting. Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type file --output=name,allocatable '\''--separator=|'\'' --no-headers krusty.staging.ganeti.org' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'file' can not be modified /srv/ganeti/file-storage|Y Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable yes krusty.staging.ganeti.org file /srv/ganeti/file-storage' Stderr was: Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'file' can not be modified Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type file --output=name,allocatable '\''--separator=|'\'' --no-headers krusty.staging.ganeti.org' /srv/ganeti/file-storage|Y Command: ssh moe.staging.ganeti.org 'gnt-node repair-storage krusty.staging.ganeti.org file /srv/ganeti/file-storage' Stderr was: Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'file' can not be repaired Command: ssh moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-pv' Node Type Name Size Used Free Allocatable herman.staging.ganeti.org lvm-pv /dev/vdb 22.0G 0M 22.0G Y krusty.staging.ganeti.org lvm-pv /dev/vdb 22.0G 0M 22.0G Y moe.staging.ganeti.org lvm-pv /dev/vdb 22.0G 0M 22.0G Y Command: ssh moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-pv --output=size,name,allocatable,used,type,node,free' Size Name Allocatable Used Type Node Free 22.0G /dev/vdb Y 0M lvm-pv herman.staging.ganeti.org 22.0G 22.0G /dev/vdb Y 0M lvm-pv krusty.staging.ganeti.org 22.0G 22.0G /dev/vdb Y 0M lvm-pv moe.staging.ganeti.org 22.0G Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-pv --output=node,name,allocatable '\''--separator=|'\'' --no-headers' herman.staging.ganeti.org|/dev/vdb|Y krusty.staging.ganeti.org|/dev/vdb|Y moe.staging.ganeti.org|/dev/vdb|Y Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage herman.staging.ganeti.org lvm-pv /dev/vdb' Stderr was: No changes to perform, exiting. Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable no herman.staging.ganeti.org lvm-pv /dev/vdb' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-pv --output=name,allocatable '\''--separator=|'\'' --no-headers herman.staging.ganeti.org' /dev/vdb|N Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable yes herman.staging.ganeti.org lvm-pv /dev/vdb' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-pv --output=name,allocatable '\''--separator=|'\'' --no-headers herman.staging.ganeti.org' /dev/vdb|Y Command: ssh moe.staging.ganeti.org 'gnt-node repair-storage herman.staging.ganeti.org lvm-pv /dev/vdb' Stderr was: Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'lvm-pv' can not be repaired Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage krusty.staging.ganeti.org lvm-pv /dev/vdb' Stderr was: No changes to perform, exiting. Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable no krusty.staging.ganeti.org lvm-pv /dev/vdb' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-pv --output=name,allocatable '\''--separator=|'\'' --no-headers krusty.staging.ganeti.org' /dev/vdb|N Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable yes krusty.staging.ganeti.org lvm-pv /dev/vdb' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-pv --output=name,allocatable '\''--separator=|'\'' --no-headers krusty.staging.ganeti.org' /dev/vdb|Y Command: ssh moe.staging.ganeti.org 'gnt-node repair-storage krusty.staging.ganeti.org lvm-pv /dev/vdb' Stderr was: Command: ssh moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-vg' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'lvm-pv' can not be repaired Node Type Name Size Used Free Allocatable herman.staging.ganeti.org lvm-vg gnt 22.0G 0M 22.0G Y krusty.staging.ganeti.org lvm-vg gnt 22.0G 0M 22.0G Y moe.staging.ganeti.org lvm-vg gnt 22.0G 0M 22.0G Y Command: ssh moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-vg --output=size,name,allocatable,used,type,node,free' Size Name Allocatable Used Type Node Free 22.0G gnt Y 0M lvm-vg herman.staging.ganeti.org 22.0G 22.0G gnt Y 0M lvm-vg krusty.staging.ganeti.org 22.0G 22.0G gnt Y 0M lvm-vg moe.staging.ganeti.org 22.0G Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-vg --output=node,name,allocatable '\''--separator=|'\'' --no-headers' herman.staging.ganeti.org|gnt|Y krusty.staging.ganeti.org|gnt|Y moe.staging.ganeti.org|gnt|Y Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage herman.staging.ganeti.org lvm-vg gnt' Stderr was: Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable no herman.staging.ganeti.org lvm-vg gnt' No changes to perform, exiting. Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-vg --output=name,allocatable '\''--separator=|'\'' --no-headers herman.staging.ganeti.org' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'lvm-vg' can not be modified gnt|Y Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable yes herman.staging.ganeti.org lvm-vg gnt' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-vg --output=name,allocatable '\''--separator=|'\'' --no-headers herman.staging.ganeti.org' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'lvm-vg' can not be modified gnt|Y Command: ssh moe.staging.ganeti.org 'gnt-node repair-storage herman.staging.ganeti.org lvm-vg gnt' Wed Jun 18 03:17:21 2025 Repairing storage unit 'gnt' on herman.staging.ganeti.org ... Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage krusty.staging.ganeti.org lvm-vg gnt' Stderr was: Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable no krusty.staging.ganeti.org lvm-vg gnt' No changes to perform, exiting. Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-vg --output=name,allocatable '\''--separator=|'\'' --no-headers krusty.staging.ganeti.org' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'lvm-vg' can not be modified gnt|Y Command: ssh moe.staging.ganeti.org 'gnt-node modify-storage --allocatable yes krusty.staging.ganeti.org lvm-vg gnt' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-node list-storage --storage-type lvm-vg --output=name,allocatable '\''--separator=|'\'' --no-headers krusty.staging.ganeti.org' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Storage units of type 'lvm-vg' can not be modified gnt|Y Command: ssh moe.staging.ganeti.org 'gnt-node repair-storage krusty.staging.ganeti.org lvm-vg gnt' Wed Jun 18 03:17:27 2025 Repairing storage unit 'gnt' on krusty.staging.ganeti.org ... ---- PASSED [TestNodeStorage] gnt-node storage ------------------------- >>>> 2025-06-18 03:17:27.525371 time=0:00:43.881756 [TestNodeStorage] gnt-node storage **** 2025-06-18 03:17:27.525505 skipping [TestOutOfBand] gnt-node power, test(s) ['node-oob', >] disabled ^^^^ BLOCK 2025-06-18 03:17:27.525534 time=0:00:45.035275 [RunCommonNodeTests] Run a few common node tests vvvv BLOCK 2025-06-18 03:17:27.525620 start [RunGroupListTests] Run tests for listing node groups <<<< 2025-06-18 03:17:27.525740 start [TestGroupList] gnt-group list --- Command: ssh moe.staging.ganeti.org 'gnt-group list --output diskparams,ndp/ovs,alloc_policy,custom_ipolicy,custom_diskparams,node_cnt,ndp/ovs_link,serial_no,ipolicy,ndparams,ndp/ssh_port,tags,ndp/ovs_name,name,ndp/oob_program,pinst_list,custom_ndparams,ctime,uuid,ndp/spindle_count,ndp/cpu_speed,node_list,ndp/exclusive_storage,mtime,pinst_cnt >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-group list --output alloc_policy,ctime,custom_diskparams,custom_ipolicy,custom_ndparams,diskparams,ipolicy,mtime,name,ndp/cpu_speed,ndp/exclusive_storage,ndp/oob_program,ndp/ovs,ndp/ovs_link,ndp/ovs_name,ndp/spindle_count,ndp/ssh_port,ndparams,node_cnt,node_list,pinst_cnt,pinst_list,serial_no,tags,uuid >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-group list --output diskparams,ndp/ovs,alloc_policy,custom_ipolicy,custom_diskparams,node_cnt,ndp/ovs_link,serial_no,ipolicy,ndparams,ndp/ssh_port,tags,ndp/ovs_name,name,ndp/oob_program,pinst_list,custom_ndparams,ctime,uuid,ndp/spindle_count,ndp/cpu_speed,node_list,ndp/exclusive_storage,mtime,pinst_cnt,diskparams,ndp/ovs,alloc_policy,custom_ipolicy,custom_diskparams,node_cnt,ndp/ovs_link,serial_no,ipolicy,ndparams,ndp/ssh_port,tags,ndp/ovs_name,name,ndp/oob_program,pinst_list,custom_ndparams,ctime,uuid,ndp/spindle_count,ndp/cpu_speed,node_list,ndp/exclusive_storage,mtime,pinst_cnt >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-group list --output pinst_cnt,mtime,ndp/exclusive_storage,node_list,ndp/cpu_speed,ndp/spindle_count,uuid >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-group list --output ctime,custom_ndparams,pinst_list,ndp/oob_program,name,ndp/ovs_name,tags,ndp/ssh_port >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-group list --output ndparams,ipolicy,serial_no >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-group list --output ndp/ovs_link,node_cnt,custom_diskparams,custom_ipolicy,alloc_policy,ndp/ovs,diskparams >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group list '\''--separator=|'\'' --no-headers --output name' default Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group list '\''--separator=|'\'' --no-headers --output name default' default Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group list '\''--separator=|'\'' --no-headers --output name default' default Command: ssh moe.staging.ganeti.org 'gnt-group list this.name.certainly.does.not.exist' Stderr was: Failure: prerequisites not met for this operation: error type: unknown_entity, error details: NodeGroup name this.name.certainly.does.not.exist not found Command: ssh moe.staging.ganeti.org 'gnt-group list --output=field/does/not/exist >> /var/log/ganeti/qa-output.log' Stderr was: ---- PASSED [TestGroupList] gnt-group list ----------------------------- Warning: Queried for unknown fields field/does/not/exist >>>> 2025-06-18 03:17:29.953186 time=0:00:02.427446 [TestGroupList] gnt-group list <<<< 2025-06-18 03:17:29.953364 start [TestGroupListFields] gnt-group list-fields Command: ssh moe.staging.ganeti.org 'gnt-group list-fields >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-group list-fields alloc_policy name serial_no uuid node_cnt node_list pinst_cnt pinst_list tags ipolicy custom_ipolicy custom_ndparams ndparams diskparams custom_diskparams ndp/cpu_speed ndp/exclusive_storage ndp/oob_program ndp/ovs ndp/ovs_link ndp/ovs_name ndp/spindle_count ndp/ssh_port ctime mtime >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group list-fields '\''--separator=|'\'' --no-headers' alloc_policy|Text|AllocPolicy|Allocation policy for group ctime|Timestamp|CTime|Creation timestamp custom_diskparams|Custom|CustomDiskParameters|Custom disk parameters custom_ipolicy|Custom|CustomInstancePolicy|Custom instance policy limitations custom_ndparams|Custom|CustomNDParams|Custom node parameters diskparams|Custom|DiskParameters|Disk parameters (merged) ipolicy|Custom|InstancePolicy|Instance policy limitations (merged) mtime|Timestamp|MTime|Modification timestamp name|Text|Group|Group name ndp/cpu_speed|Floating-point number|ndp/cpu_speed|The "cpu_speed" node parameter ndp/exclusive_storage|Boolean|ExclusiveStorage|The "exclusive_storage" node parameter ndp/oob_program|Custom|OutOfBandProgram|The "oob_program" node parameter ndp/ovs|Boolean|OpenvSwitch|The "ovs" node parameter ndp/ovs_link|Custom|OpenvSwitchLink|The "ovs_link" node parameter ndp/ovs_name|Custom|OpenvSwitchName|The "ovs_name" node parameter ndp/spindle_count|Number|SpindleCount|The "spindle_count" node parameter ndp/ssh_port|Number|ndp/ssh_port|The "ssh_port" node parameter ndparams|Custom|NDParams|Node parameters node_cnt|Number|Nodes|Number of nodes node_list|Custom|NodeList|List of nodes pinst_cnt|Number|Instances|Number of primary instances pinst_list|Custom|InstanceList|List of primary instances serial_no|Number|SerialNo|Group object serial number, incremented on each modification tags|Custom|Tags|Tags uuid|Text|UUID|Group UUID Command: ssh moe.staging.ganeti.org 'gnt-group list-fields field/does/not/exist' Stdout was: Name Type Title Description field/does/not/exist Unknown field/does/not/exist Unknown field 'field/does/not/exist' Stderr was: ---- PASSED [TestGroupListFields] gnt-group list-fields ----------------Warning: Queried for unknown fields field/does/not/exist >>>> 2025-06-18 03:17:30.756677 time=0:00:00.803313 [TestGroupListFields] gnt-group list-fields ^^^^ BLOCK 2025-06-18 03:17:30.756789 time=0:00:03.231169 [RunGroupListTests] Run tests for listing node groups vvvv BLOCK 2025-06-18 03:17:30.756868 start [RunGroupRwTests] Run tests for adding/removing/renaming groups <<<< 2025-06-18 03:17:30.756952 start [TestGroupAddRemoveRename] gnt-group add/remove/rename Command: ssh moe.staging.ganeti.org 'gnt-group add group1' Command: ssh moe.staging.ganeti.org 'gnt-group add group2' Command: ssh moe.staging.ganeti.org 'gnt-group add group2' Stderr was: Failure: prerequisites not met for this operation: error type: already_exists, error details: Desired group name 'group2' already exists as a node group (UUID: 0cfaf459-8edf-46f8-9bac-215f55f208e3) Command: ssh moe.staging.ganeti.org 'gnt-group add default' Stderr was: Failure: prerequisites not met for this operation: error type: already_exists, error details: Desired group name 'default' already exists as a node group (UUID: 76c2abd1-f8ef-4b43-a584-2e02f6294a7d) Command: ssh moe.staging.ganeti.org 'gnt-group rename group1 group2' Stderr was: Failure: prerequisites not met for this operation: error type: already_exists, error details: Desired new name 'group2' clashes with existing node group (UUID: 0cfaf459-8edf-46f8-9bac-215f55f208e3) Command: ssh moe.staging.ganeti.org 'gnt-group rename group1 group3' Command: ssh moe.staging.ganeti.org 'gnt-group rename default group1' Command: ssh moe.staging.ganeti.org 'gnt-group remove group2' Command: ssh moe.staging.ganeti.org 'gnt-group remove group3' Command: ssh moe.staging.ganeti.org 'gnt-group remove group1' Stderr was: Failure: prerequisites not met for this operation: error type: wrong_state, error details: Group 'group1' not empty, has the following nodes: 919b5265-cb49-4254-aed3-9156883e5c08, d0123bdf-2c5c-4b2f-9f31-35ed390543b4, f4b89797-d22f-41f7-a71a-ca480d5346da Command: ssh moe.staging.ganeti.org 'gnt-group rename group1 default' ---- PASSED [TestGroupAddRemoveRename] gnt-group add/remove/rename ----- >>>> 2025-06-18 03:17:43.184145 time=0:00:12.427193 [TestGroupAddRemoveRename] gnt-group add/remove/rename <<<< 2025-06-18 03:17:43.184292 start [TestGroupAddWithOptions] gnt-group add with options Command: ssh moe.staging.ganeti.org 'gnt-group add --alloc-policy notvalid group1' Stderr was: Unhandled protocol error while talking to the master daemon: Failed to parse request: SubmitJob: Can't parse value for 'alloc_policy': Invalid string value for type AllocPolicy: "notvalid" Command: ssh moe.staging.ganeti.org 'gnt-group add --alloc-policy last_resort --node-parameters oob_program=/bin/true group1' Command: ssh moe.staging.ganeti.org 'gnt-group remove group1' ---- PASSED [TestGroupAddWithOptions] gnt-group add with options ------- >>>> 2025-06-18 03:17:45.742253 time=0:00:02.557961 [TestGroupAddWithOptions] gnt-group add with options <<<< 2025-06-18 03:17:45.742405 start [TestGroupModify] gnt-group modify Command: ssh moe.staging.ganeti.org 'gnt-group add group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: default (1) disk-count: default (0) disk-size: default (512) memory-size: default (128) nic-count: default (0) spindle-use: default (0) max/0: cpu-count: default (48) disk-count: default (8) disk-size: default (1048576) memory-size: default (1048576) nic-count: default (8) spindle-use: default (8) allowed disk templates: default (sharedfile, drbd, plain, file) vcpu-ratio: default (4) spindle-ratio: default (32) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:disk-size=4,memory-size=4,disk-count=4,nic-count=4,spindle-use=4,cpu-count=4/max:disk-size=4,memory-size=4,disk-count=4,nic-count=4,spindle-use=4,cpu-count=4 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: 4 disk-count: 4 disk-size: 4 memory-size: 4 nic-count: 4 spindle-use: 4 min/0: cpu-count: 4 disk-count: 4 disk-size: 4 memory-size: 4 nic-count: 4 spindle-use: 4 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=4,disk-count=4,disk-size=8,memory-size=4,nic-count=4,spindle-use=4/max:cpu-count=4,disk-count=4,disk-size=8,memory-size=4,nic-count=4,spindle-use=4 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 4 disk-count: 4 disk-size: 8 memory-size: 4 nic-count: 4 spindle-use: 4 max/0: cpu-count: 4 disk-count: 4 disk-size: 8 memory-size: 4 nic-count: 4 spindle-use: 4 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=4,disk-count=4,disk-size=8,memory-size=4,nic-count=4,spindle-use=4/max:cpu-count=4,disk-count=4,disk-size=4,memory-size=4,nic-count=4,spindle-use=4 group1' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Invalid instance policy: Invalid specification of min/max values for disk-size: 8/4 - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 4 disk-count: 4 disk-size: 8 memory-size: 4 nic-count: 4 spindle-use: 4 max/0: cpu-count: 4 disk-count: 4 disk-size: 8 memory-size: 4 nic-count: 4 spindle-use: 4 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=4,disk-count=4,disk-size=8,memory-size=8,nic-count=4,spindle-use=4/max:cpu-count=4,disk-count=4,disk-size=8,memory-size=8,nic-count=4,spindle-use=4 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 4 disk-count: 4 disk-size: 8 memory-size: 8 nic-count: 4 spindle-use: 4 max/0: cpu-count: 4 disk-count: 4 disk-size: 8 memory-size: 8 nic-count: 4 spindle-use: 4 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=4,disk-count=4,disk-size=8,memory-size=8,nic-count=4,spindle-use=4/max:cpu-count=4,disk-count=4,disk-size=8,memory-size=4,nic-count=4,spindle-use=4 group1' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Invalid instance policy: Invalid specification of min/max values for memory-size: 8/4 - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 4 disk-count: 4 disk-size: 8 memory-size: 8 nic-count: 4 spindle-use: 4 max/0: cpu-count: 4 disk-count: 4 disk-size: 8 memory-size: 8 nic-count: 4 spindle-use: 4 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=4,disk-count=8,disk-size=8,memory-size=8,nic-count=4,spindle-use=4/max:cpu-count=4,disk-count=8,disk-size=8,memory-size=8,nic-count=4,spindle-use=4 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 4 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 4 spindle-use: 4 max/0: cpu-count: 4 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 4 spindle-use: 4 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=4,disk-count=8,disk-size=8,memory-size=8,nic-count=4,spindle-use=4/max:cpu-count=4,disk-count=4,disk-size=8,memory-size=8,nic-count=4,spindle-use=4 group1' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Invalid instance policy: Invalid specification of min/max values for disk-count: 8/4 - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 4 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 4 spindle-use: 4 max/0: cpu-count: 4 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 4 spindle-use: 4 allowed disk templates: default (sharedfile, drbd, plain, file) vcpu-ratio: default (4) spindle-ratio: default (32) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=4,disk-count=8,disk-size=8,memory-size=8,nic-count=8,spindle-use=4/max:cpu-count=4,disk-count=8,disk-size=8,memory-size=8,nic-count=8,spindle-use=4 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 4 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 4 max/0: cpu-count: 4 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 4 allowed disk templates: default (sharedfile, drbd, plain, file) vcpu-ratio: default (4) spindle-ratio: default (32) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=4,disk-count=8,disk-size=8,memory-size=8,nic-count=8,spindle-use=4/max:cpu-count=4,disk-count=8,disk-size=8,memory-size=8,nic-count=4,spindle-use=4 group1' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Invalid instance policy: Invalid specification of min/max values for nic-count: 8/4 - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: 4 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 4 min/0: cpu-count: 4 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 4 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=4,disk-count=8,disk-size=8,memory-size=8,nic-count=8,spindle-use=8/max:cpu-count=4,disk-count=8,disk-size=8,memory-size=8,nic-count=8,spindle-use=8 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 4 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 8 max/0: cpu-count: 4 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 8 allowed disk templates: default (sharedfile, drbd, plain, file) vcpu-ratio: default (4) spindle-ratio: default (32) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=4,disk-count=8,disk-size=8,memory-size=8,nic-count=8,spindle-use=8/max:cpu-count=4,disk-count=8,disk-size=8,memory-size=8,nic-count=8,spindle-use=4 group1' Stderr was: Failure: prerequisites not met for this operation: error type: wrong_input, error details: Invalid instance policy: Invalid specification of min/max values for spindle-use: 8/4 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 4 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 8 max/0: cpu-count: 4 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 8 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=8,disk-count=8,disk-size=8,memory-size=8,nic-count=8,spindle-use=8/max:cpu-count=8,disk-count=8,disk-size=8,memory-size=8,nic-count=8,spindle-use=8 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: 8 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 8 min/0: cpu-count: 8 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 8 allowed disk templates: default (sharedfile, drbd, plain, file) vcpu-ratio: default (4) spindle-ratio: default (32) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=8,disk-count=8,disk-size=8,memory-size=8,nic-count=8,spindle-use=8/max:cpu-count=4,disk-count=8,disk-size=8,memory-size=8,nic-count=8,spindle-use=8 group1' Stderr was: Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' Failure: prerequisites not met for this operation: error type: wrong_input, error details: Invalid instance policy: Invalid specification of min/max values for cpu-count: 8/4 - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: 8 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 8 min/0: cpu-count: 8 disk-count: 8 disk-size: 8 memory-size: 8 nic-count: 8 spindle-use: 8 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs default group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: default (48) disk-count: default (8) disk-size: default (1048576) memory-size: default (1048576) nic-count: default (8) spindle-use: default (8) min/0: cpu-count: default (1) disk-count: default (0) disk-size: default (512) memory-size: default (128) nic-count: default (0) spindle-use: default (0) allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group show-ispecs-cmd --include-defaults group1' gnt-group add --ipolicy-bounds-specs min:cpu-count=1,disk-count=0,disk-size=512,memory-size=128,nic-count=0,spindle-use=0/max:cpu-count=48,disk-count=8,disk-size=1048576,memory-size=1048576,nic-count=8,spindle-use=8 group1 Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-bounds-specs min:cpu-count=1,disk-count=0,disk-size=512,memory-size=128,nic-count=0,spindle-use=0/max:cpu-count=48,disk-count=8,disk-size=1048576,memory-size=1048576,nic-count=8,spindle-use=8 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group show-ispecs-cmd group1' gnt-group add --ipolicy-bounds-specs min:cpu-count=1,disk-count=0,disk-size=512,memory-size=128,nic-count=0,spindle-use=0/max:cpu-count=48,disk-count=8,disk-size=1048576,memory-size=1048576,nic-count=8,spindle-use=8 group1 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 1 disk-count: 0 disk-size: 512 memory-size: 128 nic-count: 0 spindle-use: 0 max/0: cpu-count: 48 disk-count: 8 disk-size: 1048576 memory-size: 1048576 nic-count: 8 spindle-use: 8 allowed disk templates: default (sharedfile, drbd, plain, file) vcpu-ratio: default (4) spindle-ratio: default (32) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-vcpu-ratio 1.5 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 1 disk-count: 0 disk-size: 512 memory-size: 128 nic-count: 0 spindle-use: 0 max/0: cpu-count: 48 disk-count: 8 disk-size: 1048576 memory-size: 1048576 nic-count: 8 spindle-use: 8 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: 1.5 Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-vcpu-ratio default group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: 48 disk-count: 8 disk-size: 1048576 memory-size: 1048576 nic-count: 8 spindle-use: 8 min/0: cpu-count: 1 disk-count: 0 disk-size: 512 memory-size: 128 nic-count: 0 spindle-use: 0 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-spindle-ratio 1.5 group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - max/0: cpu-count: 48 disk-count: 8 disk-size: 1048576 memory-size: 1048576 nic-count: 8 spindle-use: 8 min/0: cpu-count: 1 disk-count: 0 disk-size: 512 memory-size: 128 nic-count: 0 spindle-use: 0 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: 1.5 vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-spindle-ratio default group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 1 disk-count: 0 disk-size: 512 memory-size: 128 nic-count: 0 spindle-use: 0 max/0: cpu-count: 48 disk-count: 8 disk-size: 1048576 memory-size: 1048576 nic-count: 8 spindle-use: 8 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-disk-templates plain group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 1 disk-count: 0 disk-size: 512 memory-size: 128 nic-count: 0 spindle-use: 0 max/0: cpu-count: 48 disk-count: 8 disk-size: 1048576 memory-size: 1048576 nic-count: 8 spindle-use: 8 allowed disk templates: plain vcpu-ratio: default (4) spindle-ratio: default (32) Command: ssh moe.staging.ganeti.org 'gnt-group modify --ipolicy-disk-templates default group1' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-group info group1' - Node group: group1 Node parameters: cpu_speed: default (1) exclusive_storage: default (False) oob_program: default () ovs: default (False) ovs_link: default () ovs_name: default (switch1) spindle_count: default (1) ssh_port: default (22) Disk parameters: blockdev: default ({}) diskless: default ({}) drbd: c-delay-target: default (1) c-fill-target: default (0) c-max-rate: default (1310720) c-min-rate: default (10240) c-plan-ahead: default (20) data-stripes: default (1) disk-barriers: default (n) disk-custom: default () dynamic-resync: default (True) meta-barriers: default (False) meta-stripes: default (1) metavg: default (gnt) net-custom: default (--max-buffers=16000 --max-epoch-size=16000) protocol: default (C) resync-rate: default (61440) ext: access: default (kernelspace) file: default ({}) gluster: access: default (kernelspace) host: default (127.0.0.1) port: default (24007) volume: default (gv0) plain: stripes: default (1) rbd: access: default (kernelspace) pool: default (rbd) sharedfile: default ({}) Instance policy: bounds specs: - min/0: cpu-count: 1 disk-count: 0 disk-size: 512 memory-size: 128 nic-count: 0 spindle-use: 0 max/0: cpu-count: 48 disk-count: 8 disk-size: 1048576 memory-size: 1048576 nic-count: 8 spindle-use: 8 allowed disk templates: default (sharedfile, drbd, plain, file) spindle-ratio: default (32) vcpu-ratio: default (4) Command: ssh moe.staging.ganeti.org 'gnt-group modify --alloc-policy unallocable --node-parameters oob_program=/bin/false group1' Modified node group group1 - ndparams -> {'oob_program': '/bin/false'} Command: ssh moe.staging.ganeti.org 'gnt-group modify --alloc-policy notvalid group1' Stderr was: Unhandled protocol error while talking to the master daemon: Failed to parse request: SubmitJob: Can't parse value for 'alloc_policy': Invalid string value for type AllocPolicy: "notvalid" Command: ssh moe.staging.ganeti.org 'gnt-group modify --node-parameters spindle_count=10 group1' Modified node group group1 - ndparams -> {'oob_program': '/bin/false', 'spindle_count': 10} Command: ssh moe.staging.ganeti.org 'hbal -L -G group1' Cluster is empty, exiting. Command: ssh moe.staging.ganeti.org 'gnt-group modify --node-parameters spindle_count=default group1' Modified node group group1 - ndparams -> {'oob_program': '/bin/false'} Command: ssh moe.staging.ganeti.org 'gnt-group remove group1' ---- PASSED [TestGroupModify] gnt-group modify ------------------------- >>>> 2025-06-18 03:18:18.728927 time=0:00:32.986522 [TestGroupModify] gnt-group modify <<<< 2025-06-18 03:18:18.729092 start [TestRapiNodeGroups] Test several node group operations using RAPI POST /2/groups GET /2/jobs/153 POST /2/groups GET /2/jobs/154 PUT /2/groups/group1/modify GET /2/jobs/155 PUT /2/groups/group2/rename GET /2/jobs/156 Testing get/modify symmetry of /2/groups/group3 and /2/groups/group3/modify GET successful at /2/groups/group3 PUT successful at /2/groups/group3/modify DELETE /2/groups/group1 GET /2/jobs/158 DELETE /2/groups/group3 GET /2/jobs/159 ---- PASSED [TestRapiNodeGroups] Test several node group operations using RAPI >>>> 2025-06-18 03:18:25.790462 time=0:00:07.061370 [TestRapiNodeGroups] Test several node group operations using RAPI <<<< 2025-06-18 03:18:25.790614 start [TestGroupTags] gnt-group tags --- Command: ssh moe.staging.ganeti.org 'gnt-group add-tags default TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2' Command: ssh moe.staging.ganeti.org 'gnt-group list-tags default' TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2 Command: ssh moe.staging.ganeti.org 'gnt-cluster search-tags '\''^TEMP-Ganeti-QA-Tag\d+$'\''' /nodegroup/default TEMP-Ganeti-QA-Tag0 /nodegroup/default TEMP-Ganeti-QA-Tag1 /nodegroup/default TEMP-Ganeti-QA-Tag2 Command: ssh moe.staging.ganeti.org 'gnt-group remove-tags default TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2' PUT /2/groups/default/tags?tag=TEMP-Ganeti-QA-Tag0&tag=TEMP-Ganeti-QA-Tag1&tag=TEMP-Ganeti-QA-Tag2 GET /2/jobs/163 GET /2/groups/default/tags DELETE /2/groups/default/tags?tag=TEMP-Ganeti-QA-Tag0&tag=TEMP-Ganeti-QA-Tag1&tag=TEMP-Ganeti-QA-Tag2 GET /2/jobs/164 ---- PASSED [TestGroupTags] gnt-group tags ----------------------------- >>>> 2025-06-18 03:18:30.782400 time=0:00:04.991786 [TestGroupTags] gnt-group tags ^^^^ BLOCK 2025-06-18 03:18:30.782662 time=0:01:00.025794 [RunGroupRwTests] Run tests for adding/removing/renaming groups vvvv BLOCK 2025-06-18 03:18:30.782868 start [RunNetworkTests] Run tests for network management <<<< 2025-06-18 03:18:30.783262 start [TestNetworkAddRemove] gnt-network add/remove Command: ssh moe.staging.ganeti.org 'gnt-network add --network 192.0.2.0/30 network1' Command: ssh moe.staging.ganeti.org 'gnt-network add --network 198.51.100.0/24 network2' Command: ssh moe.staging.ganeti.org 'gnt-network add --network 203.0.133.0/24 network2' Stderr was: Failure: prerequisites not met for this operation: error type: already_exists, error details: Desired network name 'network2' already exists as a network (UUID: 86492b58-d481-463d-b652-55c765ab6897) Command: ssh moe.staging.ganeti.org 'gnt-network list --output external_reservations,ctime,network6,mac_prefix,gateway6,group_list,reserved_count,mtime,group_cnt,map,free_count,name,inst_cnt,serial_no,inst_list,uuid,gateway,network,tags >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output ctime,external_reservations,free_count,gateway,gateway6,group_cnt,group_list,inst_cnt,inst_list,mac_prefix,map,mtime,name,network,network6,reserved_count,serial_no,tags,uuid >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output external_reservations,ctime,network6,mac_prefix,gateway6,group_list,reserved_count,mtime,group_cnt,map,free_count,name,inst_cnt,serial_no,inst_list,uuid,gateway,network,tags,external_reservations,ctime,network6,mac_prefix,gateway6,group_list,reserved_count,mtime,group_cnt,map,free_count,name,inst_cnt,serial_no,inst_list,uuid,gateway,network,tags >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output tags,network,gateway,uuid,inst_list,serial_no,inst_cnt,name,free_count >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output map,group_cnt,mtime >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output reserved_count,group_list,gateway6,mac_prefix,network6 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output ctime,external_reservations >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list '\''--separator=|'\'' --no-headers --output name' network1 network2 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list '\''--separator=|'\'' --no-headers --output name network2 network1' network2 network1 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list '\''--separator=|'\'' --no-headers --output name network1 network2' network1 network2 Command: ssh moe.staging.ganeti.org 'gnt-network list this.name.certainly.does.not.exist' Stderr was: Failure: prerequisites not met for this operation: error type: unknown_entity, error details: Network name this.name.certainly.does.not.exist not found Command: ssh moe.staging.ganeti.org 'gnt-network list --output=field/does/not/exist >> /var/log/ganeti/qa-output.log' Stderr was: Warning: Queried for unknown fields field/does/not/exist Command: ssh moe.staging.ganeti.org 'gnt-network list-fields >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list-fields tags name network gateway network6 gateway6 mac_prefix serial_no uuid group_cnt group_list inst_cnt inst_list free_count reserved_count map external_reservations ctime mtime >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list-fields '\''--separator=|'\'' --no-headers' ctime|Timestamp|CTime|Creation timestamp external_reservations|Text|ExternalReservations|External reservations free_count|Number|FreeCount|Number of available addresses gateway|Custom|Gateway|IPv4 gateway gateway6|Custom|IPv6Gateway|IPv6 gateway group_cnt|Number|NodeGroups|Number of nodegroups group_list|Custom|GroupList|List of nodegroups (group name, NIC mode, NIC link) inst_cnt|Number|Instances|Number of instances inst_list|Custom|InstanceList|List of instances mac_prefix|Custom|MacPrefix|MAC address prefix map|Text|Map|Actual mapping mtime|Timestamp|MTime|Modification timestamp name|Text|Network|Name network|Text|Subnet|IPv4 subnet network6|Custom|IPv6Subnet|IPv6 subnet reserved_count|Number|ReservedCount|Number of reserved addresses serial_no|Number|SerialNo|Network object serial number, incremented on each modification tags|Custom|Tags|Tags uuid|Text|UUID|Network UUID Command: ssh moe.staging.ganeti.org 'gnt-network list-fields field/does/not/exist' Stdout was: Name Type Title Description field/does/not/exist Unknown field/does/not/exist Unknown field 'field/does/not/exist' Stderr was: Warning: Queried for unknown fields field/does/not/exist Command: ssh moe.staging.ganeti.org 'gnt-network remove network1' Command: ssh moe.staging.ganeti.org 'gnt-network remove network2' Command: ssh moe.staging.ganeti.org 'gnt-network list --output external_reservations,ctime,network6,mac_prefix,gateway6,group_list,reserved_count,mtime,group_cnt,map,free_count,name,inst_cnt,serial_no,inst_list,uuid,gateway,network,tags >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output ctime,external_reservations,free_count,gateway,gateway6,group_cnt,group_list,inst_cnt,inst_list,mac_prefix,map,mtime,name,network,network6,reserved_count,serial_no,tags,uuid >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output external_reservations,ctime,network6,mac_prefix,gateway6,group_list,reserved_count,mtime,group_cnt,map,free_count,name,inst_cnt,serial_no,inst_list,uuid,gateway,network,tags,external_reservations,ctime,network6,mac_prefix,gateway6,group_list,reserved_count,mtime,group_cnt,map,free_count,name,inst_cnt,serial_no,inst_list,uuid,gateway,network,tags >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output tags,network,gateway,uuid,inst_list,serial_no,inst_cnt,name,free_count >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output map,group_cnt,mtime >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output reserved_count,group_list,gateway6,mac_prefix,network6 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output ctime,external_reservations >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list '\''--separator=|'\'' --no-headers --output name' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list '\''--separator=|'\'' --no-headers --output name' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list '\''--separator=|'\'' --no-headers --output name' Command: ssh moe.staging.ganeti.org 'gnt-network list this.name.certainly.does.not.exist' Stderr was: Failure: prerequisites not met for this operation: error type: unknown_entity, error details: Network name this.name.certainly.does.not.exist not found Command: ssh moe.staging.ganeti.org 'gnt-network list --output=field/does/not/exist >> /var/log/ganeti/qa-output.log' Stderr was: ---- PASSED [TestNetworkAddRemove] gnt-network add/remove -------------- Warning: Queried for unknown fields field/does/not/exist >>>> 2025-06-18 03:18:42.233690 time=0:00:11.450428 [TestNetworkAddRemove] gnt-network add/remove <<<< 2025-06-18 03:18:42.233864 start [TestNetworkConnect] gnt-network connect/disconnect Command: ssh moe.staging.ganeti.org 'gnt-group add group1' Command: ssh moe.staging.ganeti.org 'gnt-network add --network 192.0.2.0/24 network1' Command: ssh moe.staging.ganeti.org 'gnt-network connect --nic-parameters mode=bridged,link=xen-br0 network1 group1' Command: ssh moe.staging.ganeti.org 'gnt-network list --output external_reservations,ctime,network6,mac_prefix,gateway6,group_list,reserved_count,mtime,group_cnt,map,free_count,name,inst_cnt,serial_no,inst_list,uuid,gateway,network,tags >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output ctime,external_reservations,free_count,gateway,gateway6,group_cnt,group_list,inst_cnt,inst_list,mac_prefix,map,mtime,name,network,network6,reserved_count,serial_no,tags,uuid >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output external_reservations,ctime,network6,mac_prefix,gateway6,group_list,reserved_count,mtime,group_cnt,map,free_count,name,inst_cnt,serial_no,inst_list,uuid,gateway,network,tags,external_reservations,ctime,network6,mac_prefix,gateway6,group_list,reserved_count,mtime,group_cnt,map,free_count,name,inst_cnt,serial_no,inst_list,uuid,gateway,network,tags >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output tags,network,gateway,uuid,inst_list,serial_no,inst_cnt,name,free_count >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output map,group_cnt,mtime >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output reserved_count,group_list,gateway6,mac_prefix,network6 >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-network list --output ctime,external_reservations >> /var/log/ganeti/qa-output.log' Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list '\''--separator=|'\'' --no-headers --output name' network1 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list '\''--separator=|'\'' --no-headers --output name network1' network1 Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'gnt-network list '\''--separator=|'\'' --no-headers --output name network1' network1 Command: ssh moe.staging.ganeti.org 'gnt-network list this.name.certainly.does.not.exist' Stderr was: Failure: prerequisites not met for this operation: error type: unknown_entity, error details: Network name this.name.certainly.does.not.exist not found Command: ssh moe.staging.ganeti.org 'gnt-network list --output=field/does/not/exist >> /var/log/ganeti/qa-output.log' Stderr was: Warning: Queried for unknown fields field/does/not/exist Command: ssh moe.staging.ganeti.org 'gnt-network disconnect network1 group1' Command: ssh moe.staging.ganeti.org 'gnt-group remove group1' Command: ssh moe.staging.ganeti.org 'gnt-network remove network1' ---- PASSED [TestNetworkConnect] gnt-network connect/disconnect -------- >>>> 2025-06-18 03:18:51.382482 time=0:00:09.148618 [TestNetworkConnect] gnt-network connect/disconnect <<<< 2025-06-18 03:18:51.382657 start [TestNetworkTags] gnt-network tags Command: ssh moe.staging.ganeti.org 'gnt-network add --network 192.0.2.0/30 network1' Command: ssh moe.staging.ganeti.org 'gnt-network add-tags network1 TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2' Command: ssh moe.staging.ganeti.org 'gnt-network list-tags network1' TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2 Command: ssh moe.staging.ganeti.org 'gnt-cluster search-tags '\''^TEMP-Ganeti-QA-Tag\d+$'\''' /network/network1 TEMP-Ganeti-QA-Tag0 /network/network1 TEMP-Ganeti-QA-Tag1 /network/network1 TEMP-Ganeti-QA-Tag2 Command: ssh moe.staging.ganeti.org 'gnt-network remove-tags network1 TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2' PUT /2/networks/network1/tags?tag=TEMP-Ganeti-QA-Tag0&tag=TEMP-Ganeti-QA-Tag1&tag=TEMP-Ganeti-QA-Tag2 GET /2/jobs/180 GET /2/networks/network1/tags DELETE /2/networks/network1/tags?tag=TEMP-Ganeti-QA-Tag0&tag=TEMP-Ganeti-QA-Tag1&tag=TEMP-Ganeti-QA-Tag2 GET /2/jobs/181 Command: ssh moe.staging.ganeti.org 'gnt-network remove network1' ---- PASSED [TestNetworkTags] gnt-network tags ------------------------- >>>> 2025-06-18 03:18:58.860589 time=0:00:07.477932 [TestNetworkTags] gnt-network tags ^^^^ BLOCK 2025-06-18 03:18:58.860719 time=0:00:28.077851 [RunNetworkTests] Run tests for network management vvvv BLOCK 2025-06-18 03:18:58.860804 start [RunFilterTests] Run tests for job filter management **** 2025-06-18 03:18:58.860910 skipping [TestFilterList] gnt-filter list, test(s) filters disabled **** 2025-06-18 03:18:58.860939 skipping [TestFilterListFields] gnt-filter list-fields, test(s) filters disabled **** 2025-06-18 03:18:58.860955 skipping [TestFilterAddRemove] gnt-filter add/delete, test(s) filters disabled **** 2025-06-18 03:18:58.860971 skipping [TestFilterReject] Tests that the REJECT filter does reject new jobs and that the, test(s) filters disabled **** 2025-06-18 03:18:58.860988 skipping [TestFilterOpCode] Tests that filtering with the "opcode" predicate works, test(s) filters disabled **** 2025-06-18 03:18:58.861004 skipping [TestFilterReasonChain] Tests that filters are processed in the right order and that the, test(s) filters disabled **** 2025-06-18 03:18:58.861020 skipping [TestFilterContinue] Tests that the CONTINUE filter has no effect, test(s) filters disabled **** 2025-06-18 03:18:58.861036 skipping [TestFilterAcceptPause] Tests that the PAUSE filter allows scheduling, but prevents starting,, test(s) filters disabled **** 2025-06-18 03:18:58.861052 skipping [TestFilterWatermark] Tests that the filter watermark is set correctly, test(s) filters disabled **** 2025-06-18 03:18:58.861067 skipping [TestFilterRateLimit] Tests that the RATE_LIMIT filter does reject new jobs when all, test(s) filters disabled **** 2025-06-18 03:18:58.861083 skipping [TestAdHocReasonRateLimit] Tests that ad-hoc rate limiting using --reason="rate-limit:n:..." works, test(s) filters disabled ^^^^ BLOCK 2025-06-18 03:18:58.861096 time=0:00:00.000292 [RunFilterTests] Run tests for job filter management <<<< 2025-06-18 03:18:58.861219 start [TestNodeReadd] gnt-node add --readd Command: ssh moe.staging.ganeti.org 'gnt-node add --no-ssh-key-check --secondary-ip=192.168.1.10 --readd --no-node-setup herman.staging.ganeti.org' Stdout was: -- WARNING -- The option --no-node-setup is disabled. Whether or not the SSH setup is manipulated while adding a node is determined by the 'modify_ssh_setup' value in the cluster-wide configuration instead. Wed Jun 18 03:19:01 2025 - INFO: Readding a node, the offline/drained flags were reset Wed Jun 18 03:19:01 2025 - INFO: Node will be a master candidate Stderr was: ALERT: ganeti-noded started in debug mode. Private and secret parameters WILL be logged! Command: ssh moe.staging.ganeti.org 'gnt-cluster verify >> /var/log/ganeti/qa-output.log' ---- PASSED [TestNodeReadd] gnt-node add --readd ----------------------- >>>> 2025-06-18 03:19:06.866675 time=0:00:08.005456 [TestNodeReadd] gnt-node add --readd <<<< 2025-06-18 03:19:06.866821 start [TestNodeModify] gnt-node modify - Command: ssh moe.staging.ganeti.org 'gnt-cluster modify --candidate-pool-size=2' Command: ssh moe.staging.ganeti.org 'gnt-node modify --master-candidate=no --auto-promote herman.staging.ganeti.org' Modified node herman.staging.ganeti.org - master_candidate -> False Command: ssh moe.staging.ganeti.org 'gnt-node modify --force --master-candidate=yes herman.staging.ganeti.org' Modified node herman.staging.ganeti.org - master_candidate -> True Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 191, 192 Waiting for job 191 ... Wed Jun 18 03:19:13 2025 * Verifying cluster config Wed Jun 18 03:19:13 2025 * Verifying cluster certificate files Wed Jun 18 03:19:13 2025 * Verifying hypervisor parameters Wed Jun 18 03:19:13 2025 * Verifying all nodes belong to an existing group Waiting for job 192 ... Wed Jun 18 03:19:14 2025 * Verifying group 'default' Wed Jun 18 03:19:14 2025 * Gathering data (3 nodes) Wed Jun 18 03:19:14 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:19:15 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:19:15 2025 * Verifying configuration file consistency Wed Jun 18 03:19:15 2025 * Verifying node status Wed Jun 18 03:19:15 2025 * Verifying instance status Wed Jun 18 03:19:15 2025 * Verifying orphan volumes Wed Jun 18 03:19:15 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:19:15 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:19:15 2025 * Other Notes Wed Jun 18 03:19:15 2025 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-node modify --force --master-candidate=no herman.staging.ganeti.org' Modified node herman.staging.ganeti.org - master_candidate -> False Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 195, 196 Waiting for job 195 ... Wed Jun 18 03:19:19 2025 * Verifying cluster config Wed Jun 18 03:19:19 2025 * Verifying cluster certificate files Wed Jun 18 03:19:19 2025 * Verifying hypervisor parameters Wed Jun 18 03:19:19 2025 * Verifying all nodes belong to an existing group Waiting for job 196 ... Wed Jun 18 03:19:19 2025 * Verifying group 'default' Wed Jun 18 03:19:19 2025 * Gathering data (3 nodes) Wed Jun 18 03:19:19 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:19:20 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:19:20 2025 * Verifying configuration file consistency Wed Jun 18 03:19:20 2025 * Verifying node status Wed Jun 18 03:19:20 2025 * Verifying instance status Wed Jun 18 03:19:20 2025 * Verifying orphan volumes Wed Jun 18 03:19:20 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:19:20 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:19:20 2025 * Other Notes Wed Jun 18 03:19:20 2025 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-node modify --force --drained=yes herman.staging.ganeti.org' Modified node herman.staging.ganeti.org - drained -> True Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 199, 200 Waiting for job 199 ... Wed Jun 18 03:19:23 2025 * Verifying cluster config Wed Jun 18 03:19:23 2025 * Verifying cluster certificate files Wed Jun 18 03:19:23 2025 * Verifying hypervisor parameters Wed Jun 18 03:19:23 2025 * Verifying all nodes belong to an existing group Waiting for job 200 ... Wed Jun 18 03:19:23 2025 * Verifying group 'default' Wed Jun 18 03:19:23 2025 * Gathering data (3 nodes) Wed Jun 18 03:19:23 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:19:25 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:19:25 2025 * Verifying configuration file consistency Wed Jun 18 03:19:25 2025 * Verifying node status Wed Jun 18 03:19:25 2025 * Verifying instance status Wed Jun 18 03:19:25 2025 * Verifying orphan volumes Wed Jun 18 03:19:25 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:19:25 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:19:25 2025 * Other Notes Wed Jun 18 03:19:25 2025 - NOTICE: 1 drained node(s) found. Wed Jun 18 03:19:25 2025 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-node modify --force --drained=no herman.staging.ganeti.org' Modified node herman.staging.ganeti.org - drained -> False Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 203, 204 Waiting for job 203 ... Wed Jun 18 03:19:27 2025 * Verifying cluster config Wed Jun 18 03:19:27 2025 * Verifying cluster certificate files Wed Jun 18 03:19:27 2025 * Verifying hypervisor parameters Wed Jun 18 03:19:27 2025 * Verifying all nodes belong to an existing group Waiting for job 204 ... Wed Jun 18 03:19:28 2025 * Verifying group 'default' Wed Jun 18 03:19:28 2025 * Gathering data (3 nodes) Wed Jun 18 03:19:28 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:19:29 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:19:29 2025 * Verifying configuration file consistency Wed Jun 18 03:19:29 2025 * Verifying node status Wed Jun 18 03:19:29 2025 * Verifying instance status Wed Jun 18 03:19:29 2025 * Verifying orphan volumes Wed Jun 18 03:19:29 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:19:29 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:19:29 2025 * Other Notes Wed Jun 18 03:19:29 2025 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-node modify --force --offline=yes herman.staging.ganeti.org' Modified node herman.staging.ganeti.org - offline -> True Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 207, 208 Waiting for job 207 ... Wed Jun 18 03:19:32 2025 * Verifying cluster config Wed Jun 18 03:19:32 2025 * Verifying cluster certificate files Wed Jun 18 03:19:32 2025 * Verifying hypervisor parameters Wed Jun 18 03:19:32 2025 * Verifying all nodes belong to an existing group Waiting for job 208 ... Wed Jun 18 03:19:32 2025 * Verifying group 'default' Wed Jun 18 03:19:32 2025 * Gathering data (3 nodes) Wed Jun 18 03:19:32 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:19:33 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:19:33 2025 * Verifying configuration file consistency Wed Jun 18 03:19:33 2025 * Verifying node status Wed Jun 18 03:19:33 2025 * Verifying instance status Wed Jun 18 03:19:33 2025 * Verifying orphan volumes Wed Jun 18 03:19:33 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:19:33 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:19:33 2025 * Other Notes Wed Jun 18 03:19:33 2025 - NOTICE: 1 offline node(s) found. Wed Jun 18 03:19:33 2025 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-node modify --force --offline=no herman.staging.ganeti.org' Wed Jun 18 03:19:34 2025 - WARNING: Transitioning node from offline to online state without using re-add. Please make sure the node is healthy! Modified node herman.staging.ganeti.org - offline -> False Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 211, 212 Waiting for job 211 ... Wed Jun 18 03:19:36 2025 * Verifying cluster config Wed Jun 18 03:19:36 2025 * Verifying cluster certificate files Wed Jun 18 03:19:36 2025 * Verifying hypervisor parameters Wed Jun 18 03:19:36 2025 * Verifying all nodes belong to an existing group Waiting for job 212 ... Wed Jun 18 03:19:36 2025 * Verifying group 'default' Wed Jun 18 03:19:36 2025 * Gathering data (3 nodes) Wed Jun 18 03:19:36 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:19:38 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:19:38 2025 * Verifying configuration file consistency Wed Jun 18 03:19:38 2025 * Verifying node status Wed Jun 18 03:19:38 2025 * Verifying instance status Wed Jun 18 03:19:38 2025 * Verifying orphan volumes Wed Jun 18 03:19:38 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:19:38 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:19:38 2025 * Other Notes Wed Jun 18 03:19:38 2025 * Hooks Results Command: ssh moe.staging.ganeti.org 'gnt-node modify --master-candidate=yes herman.staging.ganeti.org' Modified node herman.staging.ganeti.org - master_candidate -> True Command: ssh moe.staging.ganeti.org 'gnt-node modify --secondary-ip=192.168.1.10 herman.staging.ganeti.org' Modified node herman.staging.ganeti.org - secondary_ip -> 192.168.1.10 Command: ssh moe.staging.ganeti.org 'gnt-cluster verify >> /var/log/ganeti/qa-output.log' Command: ssh moe.staging.ganeti.org 'gnt-cluster modify --candidate-pool-size=10' Wed Jun 18 03:19:46 2025 - INFO: Note: more nodes are candidates (3) than desired (2) ---- PASSED [TestNodeModify] gnt-node modify --------------------------- >>>> 2025-06-18 03:19:47.153069 time=0:00:40.286248 [TestNodeModify] gnt-node modify <<<< 2025-06-18 03:19:47.153182 start [TestDelay] gnt-debug delay ------ Command: ssh moe.staging.ganeti.org 'gnt-debug delay 1' Command: ssh moe.staging.ganeti.org 'gnt-debug delay --no-master 1' Command: ssh moe.staging.ganeti.org 'gnt-debug delay --no-master -n herman.staging.ganeti.org 1' ---- PASSED [TestDelay] gnt-debug delay -------------------------------- >>>> 2025-06-18 03:19:53.124204 time=0:00:05.971022 [TestDelay] gnt-debug delay Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' 8c1c69049363230c7b0834cf498017fa5c89d9fd /var/lib/ganeti/config.data Command: ssh moe.staging.ganeti.org 'gnt-cluster verify' Submitted jobs 223, 224 Waiting for job 223 ... Wed Jun 18 03:19:54 2025 * Verifying cluster config Wed Jun 18 03:19:54 2025 * Verifying cluster certificate files Wed Jun 18 03:19:54 2025 * Verifying hypervisor parameters Wed Jun 18 03:19:54 2025 * Verifying all nodes belong to an existing group Waiting for job 224 ... Wed Jun 18 03:19:55 2025 * Verifying group 'default' Wed Jun 18 03:19:55 2025 * Gathering data (3 nodes) Wed Jun 18 03:19:55 2025 * Gathering information about nodes (3 nodes) Wed Jun 18 03:19:56 2025 * Gathering disk information (3 nodes) Wed Jun 18 03:19:56 2025 * Verifying configuration file consistency Wed Jun 18 03:19:56 2025 * Verifying node status Wed Jun 18 03:19:56 2025 * Verifying instance status Wed Jun 18 03:19:56 2025 * Verifying orphan volumes Wed Jun 18 03:19:56 2025 * Verifying N+1 Memory redundancy Wed Jun 18 03:19:56 2025 * Assessing cluster hypervisor parameters Wed Jun 18 03:19:56 2025 * Other Notes Wed Jun 18 03:19:56 2025 * Hooks Results Command: ssh -oEscapeChar=none -oBatchMode=yes -lroot -oStrictHostKeyChecking=no -oClearAllForwardings=yes -oForwardAgent=yes -oControlPath=/tmp/ganeti-qa-multiplexer.85qz_rhs -oControlMaster=no moe.staging.ganeti.org 'sha1sum /var/lib/ganeti/config.data' 8c1c69049363230c7b0834cf498017fa5c89d9fd /var/lib/ganeti/config.data <<<< 2025-06-18 03:19:56.919662 start [TestNodeTags] gnt-node tags ----- Command: ssh moe.staging.ganeti.org 'gnt-node add-tags herman.staging.ganeti.org TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2' Command: ssh moe.staging.ganeti.org 'gnt-node list-tags herman.staging.ganeti.org' TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2 Command: ssh moe.staging.ganeti.org 'gnt-cluster search-tags '\''^TEMP-Ganeti-QA-Tag\d+$'\''' /nodes/herman.staging.ganeti.org TEMP-Ganeti-QA-Tag0 /nodes/herman.staging.ganeti.org TEMP-Ganeti-QA-Tag1 /nodes/herman.staging.ganeti.org TEMP-Ganeti-QA-Tag2 Command: ssh moe.staging.ganeti.org 'gnt-node remove-tags herman.staging.ganeti.org TEMP-Ganeti-QA-Tag0 TEMP-Ganeti-QA-Tag1 TEMP-Ganeti-QA-Tag2' PUT /2/nodes/herman.staging.ganeti.org/tags?tag=TEMP-Ganeti-QA-Tag0&tag=TEMP-Ganeti-QA-Tag1&tag=TEMP-Ganeti-QA-Tag2 GET /2/jobs/228 GET /2/nodes/herman.staging.ganeti.org/tags DELETE /2/nodes/herman.staging.ganeti.org/tags?tag=TEMP-Ganeti-QA-Tag0&tag=TEMP-Ganeti-QA-Tag1&tag=TEMP-Ganeti-QA-Tag2 GET /2/jobs/229 ---- PASSED [TestNodeTags] gnt-node tags ------------------------------- >>>> 2025-06-18 03:20:02.666676 time=0:00:05.747014 [TestNodeTags] gnt-node tags <<<< 2025-06-18 03:20:02.666839 start [TestNode] Testing getting node(s) info via remote API GET /2/nodes/herman.staging.ganeti.org GET /2/nodes GET /2/nodes?bulk=1 Testing get/modify symmetry of /2/nodes/herman.staging.ganeti.org and /2/nodes/herman.staging.ganeti.org/modify GET successful at /2/nodes/herman.staging.ganeti.org POST successful at /2/nodes/herman.staging.ganeti.org/modify ---- PASSED [TestNode] Testing getting node(s) info via remote API ----- >>>> 2025-06-18 03:20:03.671772 time=0:00:01.004933 [TestNode] Testing getting node(s) info via remote API <<<< 2025-06-18 03:20:03.671987 start [TestRapiInstanceAdd] Test adding a new instance via RAPI GET /2/jobs/231 Wed Jun 18 03:20:04 2025 * disk 0, size 768M Wed Jun 18 03:20:04 2025 * disk 1, size 512M Wed Jun 18 03:20:04 2025 * creating instance disks... Wed Jun 18 03:20:05 2025 adding instance kvm-test-instance01.staging.ganeti.org to cluster config Wed Jun 18 03:20:05 2025 adding disks to cluster config Wed Jun 18 03:20:06 2025 - INFO: Waiting for instance kvm-test-instance01.staging.ganeti.org to sync disks Wed Jun 18 03:20:06 2025 - INFO: Instance kvm-test-instance01.staging.ganeti.org's disks are in sync Wed Jun 18 03:20:06 2025 - INFO: Waiting for instance kvm-test-instance01.staging.ganeti.org to sync disks Wed Jun 18 03:20:06 2025 - INFO: Instance kvm-test-instance01.staging.ganeti.org's disks are in sync Wed Jun 18 03:20:06 2025 * running the instance OS create scripts... Wed Jun 18 03:20:06 2025 * starting instance... ---- FAILED [TestRapiInstanceAdd] Test adding a new instance via RAPI: Could not start instance: Hypervisor error: Failed to start instance kvm-test-instance01.staging.ganeti.org: exited with exit code 3 (Parsing config from /etc/xen/kvm-test-instance01.staging.ganeti.org WARNING: you seem to be using "kernel" directive to override HVM guest firmware. Ignore that. Use "firmware_override" instead if you really want a non-default firmware WARNING: ignoring device_model directive. WARNING: Use "device_model_override" instead if you really want a non-default device_model libxl: error: libxl_qmp.c:1399:qmp_ev_fd_callback: Domain 1:error on QMP socket: Connection reset by peer libxl: error: libxl_qmp.c:1438:qmp_ev_fd_callback: Domain 1:Error happened with the QMP connection to QEMU libxl: error: libxl_dm.c:3381:device_model_postconfig_done: Domain 1:Post DM startup configs failed, rc=-26 libxl: error: libxl_create.c:1896:domcreate_devmodel_started: Domain 1:device model did not start: -26 libxl: error: libxl_aoutils.c:646:libxl__kill_xs_path: Device Model already exited libxl: error: libxl_domain.c:1183:libxl__destroy_domid: Domain 1:Non-existant domain libxl: error: libxl_domain.c:1137:domain_destroy_callback: Domain 1:Unable to destroy guest libxl: error: libxl_domain.c:1064:domain_destroy_cb: Domain 1:Destruction of domain failed ). Moved config file to /var/log/ganeti/xen/kvm-test-instance01.staging.ganeti.org-2025-06-18_03_20_08 >>>> 2025-06-18 03:20:09.128933 time=0:00:05.456946 [TestRapiInstanceAdd] Test adding a new instance via RAPI Traceback (most recent call last): File "/usr/src/ganeti/qa/ganeti-qa.py", line 1192, in main() File "/usr/src/ganeti/ganeti/rapi/client.py", line 274, in wrapper return fn(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^ File "/usr/src/ganeti/qa/ganeti-qa.py", line 1187, in main RunQa() File "/usr/src/ganeti/qa/ganeti-qa.py", line 1050, in RunQa rapi_instance = RunTest(qa_rapi.TestRapiInstanceAdd, pnode, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/src/ganeti/qa/ganeti-qa.py", line 119, in RunTest retval = fn(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^ File "/usr/src/ganeti/qa/qa_rapi.py", line 936, in TestRapiInstanceAdd _WaitForRapiJob(job_id) File "/usr/src/ganeti/qa/qa_rapi.py", line 806, in _WaitForRapiJob return rapi.client_utils.PollJob(_rapi_client, job_id, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/src/ganeti/ganeti/rapi/client_utils.py", line 120, in PollJob return cli.GenericPollJob(job_id, RapiJobPollCb(rapi_client), reporter) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/src/ganeti/ganeti/cli.py", line 787, in GenericPollJob errors.MaybeRaise(msg) File "/usr/src/ganeti/ganeti/errors.py", line 550, in MaybeRaise raise errcls(*args) ganeti.errors.OpExecError: Could not start instance: Hypervisor error: Failed to start instance kvm-test-instance01.staging.ganeti.org: exited with exit code 3 (Parsing config from /etc/xen/kvm-test-instance01.staging.ganeti.org WARNING: you seem to be using "kernel" directive to override HVM guest firmware. Ignore that. Use "firmware_override" instead if you really want a non-default firmware