I already posted about this in the cobbler list and they sent me over here. It seems that whenever I try to install a new virtual machine(kvm) with koan, and the ram for the machine is higher than 2 gigs the machine fails to install. The domain and hard drive image are created, but they won't start up to do the install. My guess was that the arch was being set to i686 in the libvirt xml file, and that that was causing issues, but the vms with 2 gigs of ram and arch="i686" in the libvirt config install just fine with a 64 bit version of Fedora. I then decided to track down where the arch assignment was being made in the code, koan uses the default arch supplied by virtinst.FullVirtGuest. In that code the 2 lines that detect the host arch are commented out, I uncommented them, and tried again. The arch in the libvirt xml files became x86_64, but they still failled to install for vms with 4 gigs of ram!
So I am stumpted! Anyone have any suggestions?
Host machine: Fedora 10 64 bit, 8 3Ghz core, 32 Gigs of ram 1TB hdd
It is also running on a node in a red hat cluster suite 2.99
Here is the log from one of my systems:
LC_ALL=C PATH=/sbin:/usr/sbin:/bin:/usr/bin /usr/bin/qemu-kvm -S -M pc -m 4096 -smp 2 -name broker -uuid 60cec202-99dd-0f63-e198-f708c90a288b -monitor pty -no-reboot -boot c -kernel /var/lib/libvirt/boot/virtinst-vmlinuz.kmgRaG -initrd /var/lib/libvirt/boot/virtinst-initrd.img.W2X9jX -append ks= http://192.168.46.234/cblr/svc/op/ks/system/broker ksdevice=link kssendmac lang= text method=http://192.168.46.234:80/cblr/links/F10-x86_64/http://192.168.46.234/cblr/links/F10-x86_64/-drive file=/vm/images/broker-disk0,if=virtio,index=0,boot=on -net nic,macaddr=00:16:3e:38:81:65,vlan=0,model=virtio -net tap,fd=22,script=,vlan=0,ifname=vnet1 -serial pty -parallel none -usb -vnc 0.0.0.0:1 -k en-us char device redirected to /dev/pts/4 char device redirected to /dev/pts/5 i^[[K^[[Din^[[K^[[D^[[Dinf^[[K^[[D^[[D^[[Dinfo^[[K^[[D^[[D^[[D^[[Dinfo ^[[K^[[D^[[D^[[D^[[D^[[Dinfo c^[[K^[[D^[[D^[[D^[[D^[[D^[[Dinfo cp^[[K^[[D^[[D^[[D^[[D^[[D^[[D^[[Dinfo cpu^[[K^[[D^[[D^[[D^[[D^[[D^[[D^[[D^[[Dinfo cpus^[[K^M * CPU #0: pc=0x00000000000ffff0 thread_id=17984^M CPU #1: pc=0x00000000000ffff0 thread_id=17985^Mc^[[K^[[Dco^[[K^[[D^[[Dcon^[[K^[[D^[[D^[[Dcont^[[K^Mqemu: loading initrd (0x10efde0 bytes) at 0x000000007ef10000 kvm_cpu_register_physical_memory: failed create_userspace_phys_mem: Invalid argument
And here is some host system info:
/proc/cpuinfo: processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 23
model name : Intel(R) Xeon(R) CPU E5450 @ 3.00GHz
stepping : 6
cpu MHz : 3000.092
cache size : 6144 KB
physical id : 0
siblings : 4
core id : 0
cpu cores : 4
apicid : 0
initial apicid : 0
fpu : yes
fpu_exception : yes
cpuid level : 10
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca sse4_1 lahf_lm bogomips : 6000.18
clflush size : 64
cache_alignment : 64
address sizes : 38 bits physical, 48 bits virtual
power management:
processor : 1 vendor_id : GenuineIntel cpu family : 6 model : 23 model name : Intel(R) Xeon(R) CPU E5450 @ 3.00GHz stepping : 6 cpu MHz : 3000.092 cache size : 6144 KB physical id : 1 siblings : 4 core id : 0 cpu cores : 4 apicid : 4 initial apicid : 4 fpu : yes fpu_exception : yes cpuid level : 10 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca sse4_1 lahf_lm bogomips : 6000.31
clflush size : 64
cache_alignment : 64
address sizes : 38 bits physical, 48 bits virtual
power management:
processor : 2 vendor_id : GenuineIntel cpu family : 6 model : 23 model name : Intel(R) Xeon(R) CPU E5450 @ 3.00GHz stepping : 6 cpu MHz : 3000.092 cache size : 6144 KB physical id : 0 siblings : 4 core id : 1 cpu cores : 4 apicid : 1 initial apicid : 1 fpu : yes fpu_exception : yes cpuid level : 10 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca sse4_1 lahf_lm bogomips : 6000.29
clflush size : 64
cache_alignment : 64
address sizes : 38 bits physical, 48 bits virtual
power management:
processor : 3 vendor_id : GenuineIntel cpu family : 6 model : 23 model name : Intel(R) Xeon(R) CPU E5450 @ 3.00GHz stepping : 6 cpu MHz : 3000.092 cache size : 6144 KB physical id : 0 siblings : 4 core id : 2 cpu cores : 4 apicid : 2 initial apicid : 2 fpu : yes fpu_exception : yes cpuid level : 10 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca sse4_1 lahf_lm bogomips : 6000.27
clflush size : 64
cache_alignment : 64
address sizes : 38 bits physical, 48 bits virtual
power management:
processor : 4 vendor_id : GenuineIntel cpu family : 6 model : 23 model name : Intel(R) Xeon(R) CPU E5450 @ 3.00GHz stepping : 6 cpu MHz : 3000.092 cache size : 6144 KB physical id : 0 siblings : 4 core id : 3 cpu cores : 4 apicid : 3 initial apicid : 3 fpu : yes fpu_exception : yes cpuid level : 10 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca sse4_1 lahf_lm bogomips : 6000.26
clflush size : 64
cache_alignment : 64
address sizes : 38 bits physical, 48 bits virtual
power management:
processor : 5 vendor_id : GenuineIntel cpu family : 6 model : 23 model name : Intel(R) Xeon(R) CPU E5450 @ 3.00GHz stepping : 6 cpu MHz : 3000.092 cache size : 6144 KB physical id : 1 siblings : 4 core id : 1 cpu cores : 4 apicid : 5 initial apicid : 5 fpu : yes fpu_exception : yes cpuid level : 10 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca sse4_1 lahf_lm bogomips : 6000.31
clflush size : 64
cache_alignment : 64
address sizes : 38 bits physical, 48 bits virtual
power management:
processor : 6 vendor_id : GenuineIntel cpu family : 6 model : 23 model name : Intel(R) Xeon(R) CPU E5450 @ 3.00GHz stepping : 6 cpu MHz : 3000.092 cache size : 6144 KB physical id : 1 siblings : 4 core id : 2 cpu cores : 4 apicid : 6 initial apicid : 6 fpu : yes fpu_exception : yes cpuid level : 10 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca sse4_1 lahf_lm bogomips : 6000.32 clflush size : 64 cache_alignment : 64 address sizes : 38 bits physical, 48 bits virtual power management:
processor : 7 vendor_id : GenuineIntel cpu family : 6 model : 23 model name : Intel(R) Xeon(R) CPU E5450 @ 3.00GHz stepping : 6 cpu MHz : 3000.092 cache size : 6144 KB physical id : 1 siblings : 4 core id : 3 cpu cores : 4 apicid : 7 initial apicid : 7 fpu : yes fpu_exception : yes cpuid level : 10 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall lm constant_tsc arch_perfmon pebs bts rep_good nopl pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr dca sse4_1 lahf_lm bogomips : 6000.29 clflush size : 64 cache_alignment : 64 address sizes : 38 bits physical, 48 bits virtual power management:
/proc/meminfo:
MemTotal: 23452656 kB MemFree: 19856416 kB Buffers: 11308 kB Cached: 92944 kB SwapCached: 236 kB Active: 3073996 kB Inactive: 29244 kB SwapTotal: 10256376 kB SwapFree: 10256016 kB Dirty: 180 kB Writeback: 0 kB AnonPages: 2998556 kB Mapped: 16820 kB Slab: 189048 kB SReclaimable: 61812 kB SUnreclaim: 127236 kB PageTables: 10352 kB NFS_Unstable: 0 kB Bounce: 0 kB WritebackTmp: 0 kB CommitLimit: 21982704 kB Committed_AS: 3661632 kB VmallocTotal: 34359738367 kB VmallocUsed: 150160 kB VmallocChunk: 34359587191 kB HugePages_Total: 0 HugePages_Free: 0 HugePages_Rsvd: 0 HugePages_Surp: 0 Hugepagesize: 2048 kB DirectMap4k: 7920 kB DirectMap2M: 23846912 kB
On Fri, Jun 05, 2009 at 02:59:19PM -0600, Thomas S Hatch wrote:
I already posted about this in the cobbler list and they sent me over here. It seems that whenever I try to install a new virtual machine(kvm) with koan, and the ram for the machine is higher than 2 gigs the machine fails to install. The domain and hard drive image are created, but they won't start up to do the install.
I saw a bug like this go into Bugzilla this week, but for some reason I just can't find it right now ... Maybe someone else can find it?
My guess was that the arch was being set to i686 in the libvirt xml file, and that that was causing issues, but the vms with 2 gigs of ram and arch="i686" in the libvirt config install just fine with a 64 bit version of Fedora.
I believe if you're using KVM that there is no difference if the arch selected is i686 or x86-64. KVM provides an x86-64 processor - if you choose to install a i686 operating system in it, so be it.
You could try to give the guest some amount of memory which is just under 2GB, eg. 1800KB.
Rich.
-
Richard W.M. Jones -
Thomas S Hatch