vdsm-patches September 2014

vdsm-patches@lists.fedorahosted.org

47 participants
582 discussions

Change in vdsm[master]: hook: diskunmap: To include UNMAP support for disk and lun d...
by apahim＠redhat.com 29 Jun '15

29 Jun '15

Amador Pahim has uploaded a new change for review. Change subject: hook: diskunmap: To include UNMAP support for disk and lun devices ...................................................................... hook: diskunmap: To include UNMAP support for disk and lun devices This hook goes through VM definitions xml file and manipulate its disk device if it "disk" or "lun" and if the bus is "scsi" or "ide", adding "discard=unmap" option to "-drive" qemu command line patameter. UNMAP support was added to qemu 1.5 and it's intendded to return the unused/freed blocks back to the storage, optimizing the utilizationi, specially useful for thin provisioned LUNs. Result example: <disk device="disk" snapshot="no" type="block"> ... <target bus="ide" dev="hda"/> ... <driver cache="none" discard="unmap" ... /> </disk> <disk device="lun" sgio="filtered" snapshot="no" type="block"> ... <target bus="scsi" dev="sda"/> ... <driver cache="none" discard="unmap" ... /> </disk> Change-Id: I36385f1af24043755b3d4b6594bbe598b0d9518d Signed-off-by: Amador Pahim <apahim(a)redhat.com> --- M configure.ac M vdsm.spec.in M vdsm_hooks/Makefile.am A vdsm_hooks/diskunmap/Makefile.am A vdsm_hooks/diskunmap/README A vdsm_hooks/diskunmap/before_vm_start.py 6 files changed, 178 insertions(+), 0 deletions(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/70/29770/1 diff --git a/configure.ac b/configure.ac index d741c1b..ce9d800 100644 --- a/configure.ac +++ b/configure.ac @@ -285,6 +285,7 @@ vdsm_hooks/Makefile vdsm_hooks/checkimages/Makefile vdsm_hooks/directlun/Makefile + vdsm_hooks/diskunmap/Makefile vdsm_hooks/ethtool_options/Makefile vdsm_hooks/extnet/Makefile vdsm_hooks/fakevmstats/Makefile diff --git a/vdsm.spec.in b/vdsm.spec.in index 2b67962..2c48e3e 100644 --- a/vdsm.spec.in +++ b/vdsm.spec.in @@ -366,6 +366,14 @@ VDSM hook used to perform consistency check on a qcow2 format disk image using the QEMU disk image utility. +%package hook-diskunmap +Summary: Activate UNMAP for disk/lun devices +BuildArch: noarch +Requires: qemu-kvm >= 1.5 + +%description hook-diskunmap +VDSM hooks which allow to activate disk UNMAP. + %package hook-ethtool-options Summary: Allow setting custom ethtool options for vdsm controlled nics BuildArch: noarch @@ -1282,6 +1290,10 @@ %{_libexecdir}/%{vdsm_name}/hooks/after_vm_destroy/50_directlun %{_libexecdir}/%{vdsm_name}/hooks/before_vm_migrate_destination/50_directlun +%files hook-diskunmap +%defattr(-, root, root, -) +%{_libexecdir}/%{vdsm_name}/hooks/before_vm_start/50_diskunmap + %files hook-fakevmstats %defattr(-, root, root, -) %{_libexecdir}/%{vdsm_name}/hooks/after_get_all_vm_stats/10_fakevmstats diff --git a/vdsm_hooks/Makefile.am b/vdsm_hooks/Makefile.am index 5e4d731..20578db 100644 --- a/vdsm_hooks/Makefile.am +++ b/vdsm_hooks/Makefile.am @@ -27,6 +27,7 @@ SUBDIRS += \ checkimages \ directlun \ + diskunmap \ extnet \ fileinject \ fakevmstats \ diff --git a/vdsm_hooks/diskunmap/Makefile.am b/vdsm_hooks/diskunmap/Makefile.am new file mode 100644 index 0000000..f2b9a85 --- /dev/null +++ b/vdsm_hooks/diskunmap/Makefile.am @@ -0,0 +1,31 @@ +# +# Copyright 2014 Red Hat, Inc. +# +# This program is free software; you can redistribute it and/or modify +# it under the terms of the GNU General Public License as published by +# the Free Software Foundation; either version 2 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program; if not, write to the Free Software +# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA +# +# Refer to the README and COPYING files for full details of the license +# +# +EXTRA_DIST = \ + before_vm_start.py + +install-data-local: + $(MKDIR_P) $(DESTDIR)$(vdsmhooksdir)/before_vm_start + $(INSTALL_SCRIPT) $(srcdir)/before_vm_start.py \ + $(DESTDIR)$(vdsmhooksdir)/before_vm_start/50_diskunmap + +uninstall-local: + $(RM) $(DESTDIR)$(vdsmhooksdir)/before_vm_start/50_diskunmap + diff --git a/vdsm_hooks/diskunmap/README b/vdsm_hooks/diskunmap/README new file mode 100644 index 0000000..35751d6 --- /dev/null +++ b/vdsm_hooks/diskunmap/README @@ -0,0 +1,40 @@ +diskunmap vdsm hook: +================== +This hook goes through all of the VM's disks and manipulate its XML +file acccording to the input. This can be used to enable UNMAP feature +to discard unused blocks for better use of thin provisioned storage +devices. + +Syntax: + diskunmap=(off|on) + +Where: + 'on' is unmap enabled and off (default) is unmap disabled. + +Example: + diskunmap=on + +Installation: + - Use the engine-config to append the proper custom property: + $ sudo engine-config -s UserDefinedVMProperties='diskunmap=^(off|on)$' + - Verify that the macbind custom property was properly added: + $ sudo engine-config -g UserDefinedVMProperties + +Usage: + In the VM configuration window, open the custom properites tab, select + diskmap and select 'on', activating disk UNMAP for all disks and LUNs. + Only devices using IDE or VirtIO-SCSI interface will be affected. UNMAP is + not available for VirtIO interface. + +Expected Result: + For every DISK or LUN device, this configuration will include + "discard=unmap" to disk driver xml: + + <disk device="disk" snapshot="no" type="block"> + ... + <driver cache="none" discard="unmap" ... /> + </disk> + + This option will be tranlated to qemu as bellow: + + ... -drive file=<file>,discard=unmap,... diff --git a/vdsm_hooks/diskunmap/before_vm_start.py b/vdsm_hooks/diskunmap/before_vm_start.py new file mode 100644 index 0000000..2fc0b81 --- /dev/null +++ b/vdsm_hooks/diskunmap/before_vm_start.py @@ -0,0 +1,93 @@ +#!/usr/bin/env python2 +# +# Copyright 2014 Red Hat, Inc. +# +# This program is free software; you can redistribute it and/or modify +# it under the terms of the GNU General Public License as published by +# the Free Software Foundation; either version 2 of the License, or +# (at your option) any later version. +# +# This program is distributed in the hope that it will be useful, +# but WITHOUT ANY WARRANTY; without even the implied warranty of +# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the +# GNU General Public License for more details. +# +# You should have received a copy of the GNU General Public License +# along with this program; if not, write to the Free Software +# Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301 USA +# +# Refer to the README and COPYING files for full details of the license +# + + +''' +Hook to enable disk UNMAP for disk devices. + +Syntax: + diskunmap=(off|on) + +Example: + diskunmap=on +''' + +import os +import sys +import traceback +from xml.dom import minidom + +import hooking + + +def addDiscardUnmap(domxml): + for disk in domxml.getElementsByTagName('disk'): + device = disk.getAttribute('device') + target = disk.getElementsByTagName('target')[0] + bus = target.getAttribute('bus') + if ((device == 'disk' or device == 'lun') + and (bus == 'scsi' or bus == 'ide')): + driver = disk.getElementsByTagName('driver')[0] + driver.setAttribute('discard', 'unmap') + + +def main(): + if 'diskunmap' in os.environ: + unmapConfig = os.environ['diskunmap'] + domxml = hooking.read_domxml() + if unmapConfig == 'on': + addDiscardUnmap(domxml) + hooking.write_domxml(domxml) + + +def test(): + text = '''<disk device="disk" snapshot="no" type="block"> +<address bus="0" controller="0" target="0" type="drive" unit="0"/> +<source dev="/rhev/data-center/mnt/blockSD/ +b4cf7d74-6a07-4138-9d4f-80b14c3acefd/images/ +1580607a-b240-4199-99ac-3d2162934ba6/e5ba276f-dcba-4582-b13f-c165afa2f575"/> +<target bus="ide" dev="hda"/> +<serial>1580607a-b240-4199-99ac-3d2162934ba6</serial> +<driver cache="none" error_policy="stop" io="native" +name="qemu" type="raw"/> +</disk>''' + + xmldom = minidom.parseString(text) + + disk = xmldom.getElementsByTagName('disk')[0] + print "\nDisk device definition before execution: \n%s"\ + % disk.toxml(encoding='UTF-8') + + addDiscardUnmap(xmldom) + + print "\nDisk device after setting discard attribute: \n%s"\ + % disk.toxml(encoding='UTF-8') + + +if __name__ == '__main__': + try: + if '--test' in sys.argv: + test() + else: + main() + except: + hooking.exit_hook(' diskunmap hook: [unexpected error]: %s\n' % + traceback.format_exc()) -- To view, visit http://gerrit.ovirt.org/29770 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I36385f1af24043755b3d4b6594bbe598b0d9518d Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: master Gerrit-Owner: Amador Pahim <apahim(a)redhat.com>

7 27

Change in vdsm[ovirt-3.3]: vm: Continue to sample after errors
by Nir Soffer 28 Jun '15

28 Jun '15

Nir Soffer has uploaded a new change for review. Change subject: vm: Continue to sample after errors ...................................................................... vm: Continue to sample after errors When vm is running, we monitor disk usage, and if the disk becomes too full, we extend the disk. This avoid pausing of the vm after io errors. However, when sampling vm with multiple disks, an error when sampling one disk exit the sampling function and skip the next disks, making this machnisim useless. This patch logs exceptions raised when sampling one disk and continue to sample others. This patch is for ovirt-3.3.1 only - master patch must be different because of recent refactoring in this area. Change-Id: I8dbe60a4d3b216a5cd998d163407c09b12f2f28c Signed-off-by: Nir Soffer <nsoffer(a)redhat.com> --- M vdsm/vm.py 1 file changed, 14 insertions(+), 10 deletions(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/75/22575/1 diff --git a/vdsm/vm.py b/vdsm/vm.py index 90ab5a7..2d0cece 100644 --- a/vdsm/vm.py +++ b/vdsm/vm.py @@ -506,20 +506,24 @@ return for vmDrive in self._vm._devices[DISK_DEVICES]: - if not vmDrive.isExtendable(): - continue + try: + if not vmDrive.isExtendable(): + continue - capacity, alloc, physical = \ - self._vm._dom.blockInfo(vmDrive.path, 0) + capacity, alloc, physical = \ + self._vm._dom.blockInfo(vmDrive.path, 0) - if physical - alloc >= vmDrive.watermarkLimit: - continue + if physical - alloc >= vmDrive.watermarkLimit: + continue - self._log.info('%s/%s apparent: %s capacity: %s, alloc: %s, ' - 'phys: %s', vmDrive.domainID, vmDrive.volumeID, - vmDrive.apparentsize, capacity, alloc, physical) + self._log.info('%s/%s apparent: %s capacity: %s, alloc: %s, ' + 'phys: %s', vmDrive.domainID, vmDrive.volumeID, + vmDrive.apparentsize, capacity, alloc, physical) - self._vm.extendDriveVolume(vmDrive) + self._vm.extendDriveVolume(vmDrive) + except Exception: + self._log.exception("%s/%s", vmDrive.domainID, + vmDrive.volumeID) def _updateVolumes(self): if not self._vm.isDisksStatsCollectionEnabled(): -- To view, visit http://gerrit.ovirt.org/22575 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I8dbe60a4d3b216a5cd998d163407c09b12f2f28c Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: ovirt-3.3 Gerrit-Owner: Nir Soffer <nsoffer(a)redhat.com>

3 5

Change in vdsm[ovirt-3.3]: vm: Fix attribute error when accessing drive in sampling method
by Nir Soffer 28 Jun '15

28 Jun '15

Nir Soffer has uploaded a new change for review. Change subject: vm: Fix attribute error when accessing drive in sampling method ...................................................................... vm: Fix attribute error when accessing drive in sampling method Du to race when migration is finished and monitoring, drive may not have a format attribute when accessing it from the monitor. This patch use getattr to log spam. Change-Id: Ia50e8af94b9c9b54332066a3f30999ce73e7a56f Signed-off-by: Nir Soffer <nsoffer(a)redhat.com> --- M vdsm/vm.py 1 file changed, 2 insertions(+), 1 deletion(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/18/22518/1 diff --git a/vdsm/vm.py b/vdsm/vm.py index bb4a7ec..7e2d220 100644 --- a/vdsm/vm.py +++ b/vdsm/vm.py @@ -506,7 +506,8 @@ return for vmDrive in self._vm._devices[DISK_DEVICES]: - if not vmDrive.blockDev or vmDrive.format != 'cow': + # Note: drive may not have a format attribute during migration + if not vmDrive.blockDev or getattr(vmDrive, 'format', None) != 'cow': continue capacity, alloc, physical = \ -- To view, visit http://gerrit.ovirt.org/22518 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ia50e8af94b9c9b54332066a3f30999ce73e7a56f Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: ovirt-3.3 Gerrit-Owner: Nir Soffer <nsoffer(a)redhat.com>

9 29

Change in vdsm[master]: Moving conf init things together
by Vinzenz Feenstra 23 Jun '15

23 Jun '15

Vinzenz Feenstra has uploaded a new change for review. Change subject: Moving conf init things together ...................................................................... Moving conf init things together Change-Id: I41ac420cd0da5a3118ce5b3c4c3643b292ec2e86 Signed-off-by: Vinzenz Feenstra <vfeenstr(a)redhat.com> --- M vdsm/rpc/Bridge.py M vdsm/virt/vm.py 2 files changed, 2 insertions(+), 3 deletions(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/20/29320/1 diff --git a/vdsm/rpc/Bridge.py b/vdsm/rpc/Bridge.py index 539c70c..12ed98e 100644 --- a/vdsm/rpc/Bridge.py +++ b/vdsm/rpc/Bridge.py @@ -286,6 +286,7 @@ """ return [v['vmId'] for v in ret['vmList']] + def Host_queryVms_Ret(ret): """ The result contains two data structures which must be merged diff --git a/vdsm/virt/vm.py b/vdsm/virt/vm.py index 2c5c910..098a3d5 100644 --- a/vdsm/virt/vm.py +++ b/vdsm/virt/vm.py @@ -1814,8 +1814,7 @@ """ self._dom = None self.recovering = recover - self.conf = {'pid': '0'} - self.conf['_blockJobs'] = {} + self.conf = {'pid': '0', '_blockJobs': {}, 'clientIp': ''} self.conf.update(params) self._initLegacyConf() # restore placeholders for BC sake self.cif = cif @@ -1825,7 +1824,6 @@ str(self.conf['vmId']) + '.recovery' self.user_destroy = False self._monitorResponse = 0 - self.conf['clientIp'] = '' self.memCommitted = 0 self._confLock = threading.Lock() self._jobsLock = threading.Lock() -- To view, visit http://gerrit.ovirt.org/29320 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I41ac420cd0da5a3118ce5b3c4c3643b292ec2e86 Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: master Gerrit-Owner: Vinzenz Feenstra <vfeenstr(a)redhat.com>

5 10

Change in vdsm[master]: sampling: use constants for counter bounds
by Dan Kenigsberg 19 Jun '15

19 Jun '15

Dan Kenigsberg has uploaded a new change for review. Change subject: sampling: use constants for counter bounds ...................................................................... sampling: use constants for counter bounds When we report cpu and network usage, we take two samples of Linux counters, and divide their difference by the elapsed time. If a sampled counter wraps around its upper bound, we might report an invalid negative value. To avoid that, we take the modulu of the difference. For example, assume that the first sample was (2**64 - 10) jiffies and 30 jiffies have passed until the second sample, the difference would be the hugely negative value (30 - 2**64). Taking modulu 2**64 returns the correct value of 30 jiffies. JIFFIES_BOUND is taken from the size of clock_t and NETSTATS_BOUND - from the size of the fields of struct net_device_stats. I am not aware of any programmatic way to acquire this value, but they are both of 64 bit size on x86_64 and ppc64. Taking modulu 2**32 works perfectly well, since two subsequent samples are unlikly to be that far apart, and it has the benefit of working well on a 32 bit host, too. Change-Id: I706000106c3bc31edf8541c980bce1f49464ebf8 Signed-off-by: Dan Kenigsberg <danken(a)redhat.com> --- M vdsm/sampling.py M vdsm/vm.py 2 files changed, 11 insertions(+), 8 deletions(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/94/24194/1 diff --git a/vdsm/sampling.py b/vdsm/sampling.py index 54b6381..a5492ce 100644 --- a/vdsm/sampling.py +++ b/vdsm/sampling.py @@ -42,6 +42,9 @@ if not os.path.exists(_THP_STATE_PATH): _THP_STATE_PATH = '/sys/kernel/mm/redhat_transparent_hugepage/enabled' +JIFFIES_BOUND = 2 ** 32 +NETSTATS_BOUND = 2 ** 32 + class InterfaceSample: """ @@ -430,14 +433,14 @@ return stats hs0, hs1 = self._samples[0], self._samples[-1] interval = hs1.timestamp - hs0.timestamp - jiffies = (hs1.pidcpu.user - hs0.pidcpu.user) % (2 ** 32) + jiffies = (hs1.pidcpu.user - hs0.pidcpu.user) % JIFFIES_BOUND stats['cpuUserVdsmd'] = (jiffies / interval) - jiffies = hs1.pidcpu.sys - hs0.pidcpu.sys % (2 ** 32) + jiffies = hs1.pidcpu.sys - hs0.pidcpu.sys % JIFFIES_BOUND stats['cpuSysVdsmd'] = (jiffies / interval) - jiffies = (hs1.totcpu.user - hs0.totcpu.user) % (2 ** 32) + jiffies = (hs1.totcpu.user - hs0.totcpu.user) % JIFFIES_BOUND stats['cpuUser'] = jiffies / interval / self._ncpus - jiffies = (hs1.totcpu.sys - hs0.totcpu.sys) % (2 ** 32) + jiffies = (hs1.totcpu.sys - hs0.totcpu.sys) % JIFFIES_BOUND stats['cpuSys'] = jiffies / interval / self._ncpus stats['cpuIdle'] = max(0.0, 100.0 - stats['cpuUser'] - stats['cpuSys']) @@ -479,9 +482,9 @@ ifrate = ifrate or 1000 Mbps2Bps = (10 ** 6) / 8 thisRx = (hs1.interfaces[ifid].rx - hs0.interfaces[ifid].rx) % \ - (2 ** 32) + NETSTATS_BOUND thisTx = (hs1.interfaces[ifid].tx - hs0.interfaces[ifid].tx) % \ - (2 ** 32) + NETSTATS_BOUND rxRate = 100.0 * thisRx / interval / ifrate / Mbps2Bps txRate = 100.0 * thisTx / interval / ifrate / Mbps2Bps if txRate > 100 or rxRate > 100: diff --git a/vdsm/vm.py b/vdsm/vm.py index aae8bd6..07fb581 100644 --- a/vdsm/vm.py +++ b/vdsm/vm.py @@ -606,11 +606,11 @@ ifRxBytes = (100.0 * (eInfo[nic.name][0] - sInfo[nic.name][0]) % - 2 ** 32 / + sampling.NETSTATS_BOUND / sampleInterval / ifSpeed / self.MBPS_TO_BPS) ifTxBytes = (100.0 * (eInfo[nic.name][4] - sInfo[nic.name][4]) % - 2 ** 32 / + sampling.NETSTATS_BOUND / sampleInterval / ifSpeed / self.MBPS_TO_BPS) ifStats['rxRate'] = '%.1f' % ifRxBytes -- To view, visit http://gerrit.ovirt.org/24194 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I706000106c3bc31edf8541c980bce1f49464ebf8 Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: master Gerrit-Owner: Dan Kenigsberg <danken(a)redhat.com>

7 16

Change in vdsm[master]: attempt to make vdsm noarch
by Dan Kenigsberg 14 May '15

14 May '15

Dan Kenigsberg has uploaded a new change for review. Change subject: attempt to make vdsm noarch ...................................................................... attempt to make vdsm noarch I'd like to have a completely architecture-independent binary package. The only remaining bit that I can think of is the old "safelease" utility, which is dropped in this patch. I should be moved to a tiny helper package. However, this patch is not enough - when built on an x86_64 host, rpm still recognizes vdsm.rpm and vdsm-python.rpm as x86_64 instead of noarch. Dropping all mentions of x86_64 from the spec did not help, either. Change-Id: Ib858accfd9ff8c71c86ddc9e7a8628bb8630753e Signed-off-by: Dan Kenigsberg <danken(a)redhat.com> --- M vdsm.spec.in M vdsm/storage/protect/Makefile.am 2 files changed, 9 insertions(+), 15 deletions(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/78/30678/1 diff --git a/vdsm.spec.in b/vdsm.spec.in index f104ad9..91b13bd 100644 --- a/vdsm.spec.in +++ b/vdsm.spec.in @@ -83,9 +83,9 @@ BuildRequires: genisoimage BuildRequires: openssl BuildRequires: m2crypto -%ifarch x86_64 -BuildRequires: python-dmidecode -%endif +#%ifarch x86_64 +#BuildRequires: python-dmidecode +#%endif %if 0%{?rhel} == 6 BuildRequires: python-argparse BuildRequires: python-ordereddict @@ -133,10 +133,10 @@ Requires: mom >= 0.4.1 Requires: numactl -%ifarch x86_64 -Requires: python-dmidecode -Requires: dmidecode -%endif +#%ifarch x86_64 +#Requires: python-dmidecode +#Requires: dmidecode +#%endif %if 0%{?rhel} >= 7 || 0%{?fedora} >= 18 Requires: libvirt-daemon >= 1.0.2-1 @@ -169,7 +169,6 @@ %if 0%{?rhel} Requires: python-ethtool >= 0.6-3 %if 0%{?rhel} >= 7 -ExclusiveArch: x86_64 Requires: device-mapper-multipath Requires: e2fsprogs Requires: fence-agents-all @@ -1034,7 +1033,6 @@ %{_datadir}/%{vdsm_name}/storage/volume.py* %{_datadir}/%{vdsm_name}/storage/imageRepository/__init__.py* %{_datadir}/%{vdsm_name}/storage/imageRepository/formatConverter.py* -%{_libexecdir}/%{vdsm_name}/safelease %{_libexecdir}/%{vdsm_name}/spmprotect.sh %{_libexecdir}/%{vdsm_name}/spmstop.sh %dir %{_libexecdir}/%{vdsm_name}/hooks diff --git a/vdsm/storage/protect/Makefile.am b/vdsm/storage/protect/Makefile.am index feb40a9..1e9eb7c 100644 --- a/vdsm/storage/protect/Makefile.am +++ b/vdsm/storage/protect/Makefile.am @@ -6,11 +6,7 @@ # LICENSE_GPL_v2 which accompany this distribution. # -vdsmexec_PROGRAMS = safelease - dist_vdsmexec_SCRIPTS = \ spmprotect.sh \ - spmstop.sh - -safelease_SOURCES = \ - safelease.c + spmstop.sh \ + $(NULL) -- To view, visit http://gerrit.ovirt.org/30678 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ib858accfd9ff8c71c86ddc9e7a8628bb8630753e Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: master Gerrit-Owner: Dan Kenigsberg <danken(a)redhat.com>

5 7

Change in vdsm[master]: block: use the contextmanager for mapMetaOffset
by Federico Simoncelli 05 May '15

05 May '15

Federico Simoncelli has uploaded a new change for review. Change subject: block: use the contextmanager for mapMetaOffset ...................................................................... block: use the contextmanager for mapMetaOffset Change-Id: Id1496238ea4f9a1902f816b20959ce3379e87871 Signed-off-by: Federico Simoncelli <fsimonce(a)redhat.com> --- M vdsm/storage/blockSD.py M vdsm/storage/blockVolume.py M vdsm/storage/imageRepository/formatConverter.py 3 files changed, 13 insertions(+), 10 deletions(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/88/25988/1 diff --git a/vdsm/storage/blockSD.py b/vdsm/storage/blockSD.py index cac59fa..02c7dfd 100644 --- a/vdsm/storage/blockSD.py +++ b/vdsm/storage/blockSD.py @@ -29,6 +29,7 @@ import time import functools from collections import namedtuple +from contextlib import contextmanager from operator import itemgetter from vdsm.config import config @@ -732,11 +733,15 @@ newsize = self.metaSize(self.sdUUID) lvm.extendLV(self.sdUUID, sd.METADATA, newsize) + _mdSlotLock = threading.Lock() + + @contextmanager def mapMetaOffset(self, vol_name, slotSize): - if self.getVersion() in VERS_METADATA_LV: - return self.getVolumeMetadataOffsetFromPvMapping(vol_name) - else: - return self.getFreeMetadataSlot(slotSize) + with self._mdSlotLock: + if self.getVersion() in VERS_METADATA_LV: + yield self.getVolumeMetadataOffsetFromPvMapping(vol_name) + else: + yield self.getFreeMetadataSlot(slotSize) def _getOccupiedMetadataSlots(self): stripPrefix = lambda s, pfx: s[len(pfx):] diff --git a/vdsm/storage/blockVolume.py b/vdsm/storage/blockVolume.py index 36bfa1f..9a7fa81 100644 --- a/vdsm/storage/blockVolume.py +++ b/vdsm/storage/blockVolume.py @@ -73,7 +73,6 @@ class BlockVolume(volume.Volume): """ Actually represents a single volume (i.e. part of virtual disk). """ - _tagCreateLock = threading.Lock() def __init__(self, repoPath, sdUUID, imgUUID, volUUID): self.metaoff = None @@ -169,8 +168,7 @@ imgUUID, volUUID, srcImgUUID, srcVolUUID) volParent.clone(imgPath, volUUID, volFormat, preallocate) - with cls._tagCreateLock: - mdSlot = dom.mapMetaOffset(volUUID, VOLUME_MDNUMBLKS) + with dom.mapMetaOffset(volUUID, VOLUME_MDNUMBLKS) as mdSlot: mdTags = ["%s%s" % (TAG_PREFIX_MD, mdSlot), "%s%s" % (TAG_PREFIX_PARENT, srcVolUUID), "%s%s" % (TAG_PREFIX_IMAGE, imgUUID)] diff --git a/vdsm/storage/imageRepository/formatConverter.py b/vdsm/storage/imageRepository/formatConverter.py index c701163..11a0039 100644 --- a/vdsm/storage/imageRepository/formatConverter.py +++ b/vdsm/storage/imageRepository/formatConverter.py @@ -180,9 +180,9 @@ metaOffset, vol.volUUID) metaContent = vol.getMetadata() - with vol._tagCreateLock: - newMetaOffset = domain.mapMetaOffset( - vol.volUUID, blockVolume.VOLUME_MDNUMBLKS) + with domain.mapMetaOffset( + vol.volUUID, blockVolume.VOLUME_MDNUMBLKS) \ + as newMetaOffset: if newMetaOffset > metaMaxSlot: raise se.NoSpaceLeftOnDomain(domain.sdUUID) -- To view, visit http://gerrit.ovirt.org/25988 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Id1496238ea4f9a1902f816b20959ce3379e87871 Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: master Gerrit-Owner: Federico Simoncelli <fsimonce(a)redhat.com>

7 61

Change in vdsm[master]: debug: Integrate manhole debugging service
by Nir Soffer 01 May '15

01 May '15

Nir Soffer has uploaded a new change for review. Change subject: debug: Integrate manhole debugging service ...................................................................... debug: Integrate manhole debugging service Manhole is in-process service that will accept unix domain socket connections and present the stacktraces for all threads and an interactive prompt. Usage: 0. Install it pip install manhole 1. Enable it in vdsm.conf: [vars] manhole_enable = true 2. Dive into vdsm: $ nc -U /tmp/manhole-1234 Python 2.7.5 (default, Jun 26 2014, 11:55:39) [GCC 4.8.2 20131212 (Red Hat 4.8.2-7)] on linux2 Type "help", "copyright", "credits" or "license" for more information. >>> Change-Id: I8a6cdf97ddce446bea527e771eb641f969b1a532 Signed-off-by: Nir Soffer <nsoffer(a)redhat.com> --- M lib/vdsm/config.py.in M vdsm/vdsm 2 files changed, 7 insertions(+), 0 deletions(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/47/32147/1 diff --git a/lib/vdsm/config.py.in b/lib/vdsm/config.py.in index 69185e0..d085890 100644 --- a/lib/vdsm/config.py.in +++ b/lib/vdsm/config.py.in @@ -42,6 +42,9 @@ ('profile_clock', 'cpu', 'Sets the underlying clock type (cpu, wall)'), + ('manhole_enable', 'false', + 'Enable manhole debugging service (requires manhole package).'), + ('host_mem_reserve', '256', 'Reserves memory for the host to prevent VMs from using all the ' 'physical pages. The values are in Mbytes.'), diff --git a/vdsm/vdsm b/vdsm/vdsm index e575295..9fdf72f 100755 --- a/vdsm/vdsm +++ b/vdsm/vdsm @@ -70,6 +70,10 @@ profile.start() + if config.getboolean('vars', 'manhole_enable'): + import manhole + manhole.install() + libvirtconnection.start_event_loop() if config.getboolean('irs', 'irs_enable'): -- To view, visit http://gerrit.ovirt.org/32147 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I8a6cdf97ddce446bea527e771eb641f969b1a532 Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: master Gerrit-Owner: Nir Soffer <nsoffer(a)redhat.com>

7 36

Change in vdsm[master]: vm: per-attribute monitor response check
by fromani＠redhat.com 21 Apr '15

21 Apr '15

Francesco Romani has uploaded a new change for review. Change subject: vm: per-attribute monitor response check ...................................................................... vm: per-attribute monitor response check the responsiveness of the monitor is reported through a single instance variable, which is updated after each libvirt call. If one single call goes in timeout, while the others go well, due to interplay between timeouts and polling interval, it can happen that reported status bounces back and forth between 'Up' and 'Not Responding'. This patch address this behaviour by keeping track of the timeouts per-dom-attribute instead of per-dom, and reports the monitor as not respondig if, and until, at least one had a timeout in the last call. Change-Id: I32a98d34cde91fa9dc3d07f03c47a5f2f22da620 Signed-off-by: Francesco Romani <fromani(a)redhat.com> --- M vdsm/vm.py 1 file changed, 12 insertions(+), 7 deletions(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/38/23138/1 diff --git a/vdsm/vm.py b/vdsm/vm.py index 55683f4..9d7ca03 100644 --- a/vdsm/vm.py +++ b/vdsm/vm.py @@ -853,11 +853,11 @@ def f(*args, **kwargs): try: ret = attr(*args, **kwargs) - self._cb(False) + self._cb(False, name) return ret except libvirt.libvirtError as e: if e.get_error_code() == libvirt.VIR_ERR_OPERATION_TIMEOUT: - self._cb(True) + self._cb(True, name) toe = TimeoutError(e.get_error_message()) toe.err = e.err raise toe @@ -1938,6 +1938,9 @@ if (self.arch not in ['ppc64', 'x86_64']): raise RuntimeError('Unsupported architecture: %s' % self.arch) + + self._attrTimeoutLock = threading.Lock() + self._attrTimeoutExperienced = {} # will keep track of timeout data def _get_lastStatus(self): PAUSED_STATES = ('Powering down', 'RebootInProgress', 'Up') @@ -3631,11 +3634,13 @@ def _monitorDependentInit(self, timeout=None): self.log.warning('unsupported by libvirt vm') - def _timeoutExperienced(self, timeout): - if timeout: - self._monitorResponse = -1 - else: - self._monitorResponse = 0 + def _timeoutExperienced(self, timeout, attrName): + with self._attrTimeoutLock: + self._attrTimeoutExperienced[attrName] = timeout + if any(self._attrTimeoutExperienced.itervalues()): + self._monitorResponse = -1 + else: + self._monitorResponse = 0 def _waitForIncomingMigrationFinish(self): if 'restoreState' in self.conf: -- To view, visit http://gerrit.ovirt.org/23138 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I32a98d34cde91fa9dc3d07f03c47a5f2f22da620 Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: master Gerrit-Owner: Francesco Romani <fromani(a)redhat.com>

8 52

Change in vdsm[master]: vm: hyperv: hyperv enlightenment optimizations
by fromani＠redhat.com 15 Apr '15

15 Apr '15

Francesco Romani has uploaded a new change for review. Change subject: vm: hyperv: hyperv enlightenment optimizations ...................................................................... vm: hyperv: hyperv enlightenment optimizations This patch the hyperv enlightenment optimizations. The optimizations are both for stability and for performance, and they are added on top of the HyperV support. The parameters are hardcoded and not externally configurable because they are not supposed to be changed very often, if changed at all; moreover, this patch already implements the optimal recommended settings. Change-Id: Ia10cb4ce254b6e6f560c045aff9e68846fe4771f Bug-Url: https://bugzilla.redhat.com/1083529 Signed-off-by: Francesco Romani <fromani(a)redhat.com> --- M tests/vmTests.py M vdsm/virt/vm.py 2 files changed, 18 insertions(+), 4 deletions(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/34/29234/1 diff --git a/tests/vmTests.py b/tests/vmTests.py index 7ee2eb8..9317887 100644 --- a/tests/vmTests.py +++ b/tests/vmTests.py @@ -327,6 +327,8 @@ <acpi/> <hyperv> <relaxed state="on"/> + <vapic state="on"/> + <spinlocks retries="8191" state="on"/> </hyperv> </features>""" conf = {'hypervEnable': 'true'} @@ -382,7 +384,7 @@ def testHyperVClockXML(self): clockXML = """ <clock adjustment="-3600" offset="variable"> - <timer name="rtc" tickpolicy="catchup" track="guest"/> + <timer name="hypervclock" tickpolicy="catchup"/> <timer name="pit" tickpolicy="delay"/> <timer name="hpet" present="no"/> </clock>""" diff --git a/vdsm/virt/vm.py b/vdsm/virt/vm.py index ec8ca12..4f3c531 100644 --- a/vdsm/virt/vm.py +++ b/vdsm/virt/vm.py @@ -717,13 +717,20 @@ <clock offset="variable" adjustment="-3600"> <timer name="rtc" tickpolicy="catchup"> </clock> + + for hyperv: + <clock offset="variable" adjustment="-3600"> + <timer name="hypervclock" tickpolicy="catchup"> + </clock> """ + + clockName = 'hypervclock' if self._isHyperV() else 'rtc' + # 'hypervclock' does not support the 'track' attribute. + # libvirt docs is not very clear here. m = XMLElement('clock', offset='variable', adjustment=str(self.conf.get('timeOffset', 0))) - rtc = m.appendChildWithArgs('timer', name='rtc', tickpolicy='catchup') - if utils.tobool(self.conf.get('hypervEnable', 'false')): - rtc.setAttrs(track='guest') + m.appendChildWithArgs('timer', name=clockName, tickpolicy='catchup') m.appendChildWithArgs('timer', name='pit', tickpolicy='delay') if self.arch == caps.Architecture.X86_64: @@ -841,6 +848,11 @@ hyperv.appendChildWithArgs('relaxed', state='on') # turns off an internal Windows watchdog, and by doing so avoids # some high load BSODs. + hyperv.appendChildWithArgs('vapic', state='on') + hyperv.appendChildWithArgs( + 'spinlocks', state='on', retries='8191') + # performance optimization flags, that can improve the performance + # by 10% to much more (in extreme cases of resources overcommit). def appendCpu(self): """ -- To view, visit http://gerrit.ovirt.org/29234 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ia10cb4ce254b6e6f560c045aff9e68846fe4771f Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: master Gerrit-Owner: Francesco Romani <fromani(a)redhat.com>

7 115

← Newer
1
...
5
6
7
8
9
10
11
...
59
Older →

Jump to page:

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

vdsm-patches September 2014