vdsm-patches December 2012

vdsm-patches@lists.fedorahosted.org

51 participants
408 discussions

Change in vdsm[master]: (Schema) Change vm.cont to vm.coninue
by smizrahi＠redhat.com 11 May '14

11 May '14

Saggi Mizrahi has uploaded a new change for review. Change subject: (Schema) Change vm.cont to vm.coninue ...................................................................... (Schema) Change vm.cont to vm.coninue Change-Id: I302c86d638bc9e2f31b33014abebfc600a52d6ee Signed-off-by: Saggi Mizrahi <smizrahi(a)redhat.com> --- M vdsm_api/vdsmapi-schema.json 1 file changed, 2 insertions(+), 2 deletions(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/51/7151/1 diff --git a/vdsm_api/vdsmapi-schema.json b/vdsm_api/vdsmapi-schema.json index 9ee296b..44e444b 100644 --- a/vdsm_api/vdsmapi-schema.json +++ b/vdsm_api/vdsmapi-schema.json @@ -3976,13 +3976,13 @@ 'returns': {'vmList': 'VmDefinition'}} ## -# @VM.cont: +# @VM.continue: # # Resume a paused VM. # # Since: 4.10.0 ## -{'command': {'class': 'VM', 'name': 'cont'}} +{'command': {'class': 'VM', 'name': 'continue'}} ## # @VM.create: -- To view, visit http://gerrit.ovirt.org/7151 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I302c86d638bc9e2f31b33014abebfc600a52d6ee Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: master Gerrit-Owner: Saggi Mizrahi <smizrahi(a)redhat.com>

3 3

Change in vdsm[master]: (Schema) Remove deprecated network API functinos
by smizrahi＠redhat.com 11 May '14

11 May '14

Saggi Mizrahi has uploaded a new change for review. Change subject: (Schema) Remove deprecated network API functinos ...................................................................... (Schema) Remove deprecated network API functinos Change-Id: Ic12b90643e4f657510128f58fa16da19df8c8aca Signed-off-by: Saggi Mizrahi <smizrahi(a)redhat.com> --- M vdsm_api/vdsmapi-schema.json 1 file changed, 0 insertions(+), 66 deletions(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/38/6838/1 -- To view, visit http://gerrit.ovirt.org/6838 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ic12b90643e4f657510128f58fa16da19df8c8aca Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: master Gerrit-Owner: Saggi Mizrahi <smizrahi(a)redhat.com>

5 6

Change in vdsm[master]: (Schema) Change BlockDevicePathInfo so that it needs one les...
by smizrahi＠redhat.com 11 May '14

11 May '14

Saggi Mizrahi has uploaded a new change for review. Change subject: (Schema) Change BlockDevicePathInfo so that it needs one less redundant enum ...................................................................... (Schema) Change BlockDevicePathInfo so that it needs one less redundant enum Change-Id: I5ab262a1fbadf89aec0c649822a2a5879823521d Signed-off-by: Saggi Mizrahi <smizrahi(a)redhat.com> --- M vdsm_api/vdsmapi-schema.json 1 file changed, 6 insertions(+), 18 deletions(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/43/6843/1 -- To view, visit http://gerrit.ovirt.org/6843 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I5ab262a1fbadf89aec0c649822a2a5879823521d Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: master Gerrit-Owner: Saggi Mizrahi <smizrahi(a)redhat.com>

4 7

Change in vdsm[master]: (Schema) Replace host\port combos with NetworkAdress
by smizrahi＠redhat.com 11 May '14

11 May '14

Saggi Mizrahi has uploaded a new change for review. Change subject: (Schema) Replace host\port combos with NetworkAdress ...................................................................... (Schema) Replace host\port combos with NetworkAdress Change-Id: Iade8796a0168561ea0902ca512a817eb2f44aecb Signed-off-by: Saggi Mizrahi <smizrahi(a)redhat.com> --- M vdsm_api/vdsmapi-schema.json 1 file changed, 21 insertions(+), 15 deletions(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/64/6964/1 -- To view, visit http://gerrit.ovirt.org/6964 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Iade8796a0168561ea0902ca512a817eb2f44aecb Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: master Gerrit-Owner: Saggi Mizrahi <smizrahi(a)redhat.com>

4 4

Change in vdsm[master]: Related to 846307 - Simplifying clientIF._cleanOldFiles().
by ewarszaw＠redhat.com 11 May '14

11 May '14

Eduardo has uploaded a new change for review. Change subject: Related to 846307 - Simplifying clientIF._cleanOldFiles(). ...................................................................... Related to 846307 - Simplifying clientIF._cleanOldFiles(). Change-Id: Ifd63a1f4b1c64f84d5734da033a2420b97ce0ada Bug-Id: https://bugzilla.redhat.com/show_bug.cgi?id=846307 Signed-off-by: Eduardo <ewarszaw(a)redhat.com> --- M vdsm/clientIF.py 1 file changed, 15 insertions(+), 20 deletions(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/26/8626/1 diff --git a/vdsm/clientIF.py b/vdsm/clientIF.py index e9ca7c9..669c5be 100644 --- a/vdsm/clientIF.py +++ b/vdsm/clientIF.py @@ -1,3 +1,4 @@ +import os.path # # Copyright 2011 Red Hat, Inc. # @@ -453,24 +454,18 @@ return None def _cleanOldFiles(self): - for f in os.listdir(constants.P_VDSM_RUN): + for fName in os.listdir(constants.P_VDSM_RUN): + if fName in ('vdsmd.pid', 'respawn.pid', 'svdsm.pid', + 'svdsm.sock'): + continue try: - vmId, fileType = f.split(".", 1) - if fileType in ["guest.socket", "monitor.socket", "pid", - "stdio.dump", "recovery"]: - if vmId in self.vmContainer: - continue - if f == 'vdsmd.pid': - continue - if f == 'respawn.pid': - continue - if f == 'svdsm.pid': - continue - if f == 'svdsm.sock': - continue - else: - continue - self.log.debug("removing old file " + f) - utils.rmFile(constants.P_VDSM_RUN + f) - except: - pass + vmId, fileType = fName.split('.', 1) + except ValueError: + pass # fName does not contains '.' + if not fileType in ("guest.socket", "monitor.socket", "pid", + "stdio.dump", "recovery"): + continue + if vmId in self.vmContainer: + continue + self.log.debug("Removing old file %s", fName) + utils.rmFile(constants.P_VDSM_RUN + fName) -- To view, visit http://gerrit.ovirt.org/8626 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ifd63a1f4b1c64f84d5734da033a2420b97ce0ada Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: master Gerrit-Owner: Eduardo <ewarszaw(a)redhat.com>

8 20

Change in vdsm[master]: Extend Image.move to move and copy subchains
by Federico Simoncelli 11 May '14

11 May '14

Federico Simoncelli has uploaded a new change for review. Change subject: Extend Image.move to move and copy subchains ...................................................................... Extend Image.move to move and copy subchains The method Image.move was only capable of moving and copying the entire image chain. Now it's possible to specify an (optional) volUUID to move or copy a subchain from the base up to volUUID. Change-Id: Icb11818f830c6f02bcb74d69f1c119efaf100cc2 --- M vdsm/storage/image.py M vdsm/storage/sp.py 2 files changed, 33 insertions(+), 22 deletions(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/17/3217/1 -- To view, visit http://gerrit.ovirt.org/3217 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Icb11818f830c6f02bcb74d69f1c119efaf100cc2 Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: master Gerrit-Owner: Federico Simoncelli <fsimonce(a)redhat.com>

5 8

Change in vdsm[master]: Added a support for a guest hibernate command.
by ghammer＠redhat.com 28 Apr '14

28 Apr '14

Gal Hammer has uploaded a new change for review. Change subject: Added a support for a guest hibernate command. ...................................................................... Added a support for a guest hibernate command. Change-Id: I1ad6836e61e9d91ec6f46a599541f61ff12e9737 --- M vdsm/clientIF.py M vdsm/guestIF.py M vdsm_cli/vdsClient.py 3 files changed, 32 insertions(+), 0 deletions(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/21/1121/1 -- To view, visit http://gerrit.ovirt.org/1121 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I1ad6836e61e9d91ec6f46a599541f61ff12e9737 Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: master Gerrit-Owner: Gal Hammer <ghammer(a)redhat.com>

14 64

Change in vdsm[master]: [WIP] Added gluster geo-replication support
by barumuga＠redhat.com 28 Apr '14

28 Apr '14

Hello Ayal Baron, Timothy Asir, Saggi Mizrahi, Federico Simoncelli, Dan Kenigsberg, I'd like you to do a code review. Please visit http://gerrit.ovirt.org/8375 to review the following change. Change subject: [WIP] Added gluster geo-replication support ...................................................................... [WIP] Added gluster geo-replication support Below new verbs are added glusterValidateSshConnection glusterSetupSshConnection Change-Id: Ic783abd5f1b63bc5116ce4ff2a3c7be92001a387 Signed-off-by: Bala.FA <barumuga(a)redhat.com> --- M vdsm.spec.in M vdsm/gluster/api.py M vdsm/gluster/exception.py 3 files changed, 137 insertions(+), 0 deletions(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/75/8375/1 diff --git a/vdsm.spec.in b/vdsm.spec.in index 22e48fb..020344f 100644 --- a/vdsm.spec.in +++ b/vdsm.spec.in @@ -352,6 +352,7 @@ Requires: %{name} = %{version}-%{release} Requires: glusterfs glusterfs-server glusterfs-fuse +Requires: python-paramiko %description gluster Gluster plugin enables VDSM to serve Gluster functionalities. diff --git a/vdsm/gluster/api.py b/vdsm/gluster/api.py index a825de2..338cb06 100644 --- a/vdsm/gluster/api.py +++ b/vdsm/gluster/api.py @@ -19,11 +19,24 @@ # from functools import wraps +import socket +import paramiko +import re from vdsm.define import doneCode import supervdsm as svdsm +from vdsm.config import config +from vdsm import utils +import exception as ge _SUCCESS = {'status': doneCode} +_KEYFILE = config.get('vars', 'trust_store_path') + '/keys/vdsmkey.pem' +_sshKeyGenCommandPath = utils.CommandPath("ssh-keygen", + "/usr/bin/ssh-keygen", + ) +_SSH_COPY_ID_CMD = "umask 077; test -d ~/.ssh || mkdir ~/.ssh ; " \ + "cat >> ~/.ssh/authorized_keys && (test -x /sbin/restorecon && " \ + "/sbin/restorecon ~/.ssh ~/.ssh/authorized_keys >/dev/null 2>&1 || true)" def exportAsVerb(func): @@ -43,6 +56,52 @@ class VolumeStatus(): ONLINE = 'ONLINE' OFFLINE = 'OFFLINE' + + +class HostKeyMatchException(paramiko.SSHException): + def __init__(self, hostname, fingerprint, expected_fingerprint): + err = 'Fingerprint of Host key ' \ + '%s for server %s does not match with %s' % \ + (fingerprint, hostname, expected_fingerprint) + paramiko.SSHException.__init__(self, err) + self.hostname = hostname + self.fingerprint = fingerprint + self.expected_fingerprint = expected_fingerprint + + +class HostKeyMatchPolicy(paramiko.AutoAddPolicy): + def __init__(self, expected_fingerprint): + self.expected_fingerprint = expected_fingerprint + + def missing_host_key(self, client, hostname, key): + s = paramiko.util.hexlify(key.get_fingerprint()) + fingerprint = ':'.join(re.findall('..', s)) + if fingerprint == self.expected_fingerprint.upper(): + paramiko.AutoAddPolicy.missing_host_key(self, client, hostname, + key) + else: + raise HostKeyMatchException(hostname, fingerprint, + self.expected_fingerprint) + + +class GlusterSsh(paramiko.SSHClient): + def __init__(self, hostname, fingerprint, port=22, username=None, + password=None, pkey=None, key_filename=None, timeout=None, + allow_agent=True, look_for_keys=True, compress=False): + paramiko.SSHClient.__init__(self) + key_file_list = [_KEYFILE] + if key_filename: + key_file_list.append(list(key_filename)) + self.set_missing_host_key_policy(HostKeyMatchPolicy(fingerprint)) + try: + paramiko.SSHClient.connect(self, hostname, port, username, + password, pkey, key_file_list, timeout, + allow_agent, look_for_keys, compress) + except socket.error, e: + err = ['%s: %s' % (hostname, e)] + raise ge.GlusterSshConnectionFailedException(err=err) + except HostKeyMatchException, e: + raise ge.GlusterSshHostKeyMismatchException(err=[e.err]) class GlusterApi(object): @@ -236,6 +295,47 @@ def volumeProfileStop(self, volumeName, options=None): self.svdsmProxy.glusterVolumeProfileStop(volumeName) + def _validateSshConnection(self, hostname, fingerprint, username): + try: + ssh = GlusterSsh(hostname, + fingerprint, + username=username) + ssh.close() + return True + except paramiko.AuthenticationException, e: + raise ge.GlusterSshHostKeyAuthException(err=[str(e)]) + + @exportAsVerb + def validateSshConnection(self, hostname, fingerprint, username): + return self._validateSshConnection(hostname, fingerprint, username) + + @exportAsVerb + def setupSshConnection(self, hostname, fingerprint, username, password): + rc, out, err = utils.execCmd([_sshKeyGenCommandPath.cmd, '-y', '-f', + _KEYFILE]) + if rc != 0: + raise ge.GlusterSshPubKeyGenerationFailedException(rc=rc, err=err) + + try: + ssh = GlusterSsh(hostname, + fingerprint, + username=username, + password=password) + c = ssh.get_transport().open_session() + stdin, stdout, stderr = c.exec_command(_SSH_COPY_ID_CMD) + stdin.write('\n'.join(out) + '\n') + stdin.flush() + stdin.close() + rc = c.recv_exit_status() + ssh.close() + if rc != 0: + err = stderr.read().splitlines() + raise ge.GlusterSshSetupExecFailedException(rc=rc, err=err) + except paramiko.AuthenticationException, e: + raise ge.GlusterSshHostAuthException(err=[str(e)]) + + return self._validateSshConnection(hostname, fingerprint, username) + def getGlusterMethods(gluster): l = [] diff --git a/vdsm/gluster/exception.py b/vdsm/gluster/exception.py index 6d94ae3..0143a5e 100644 --- a/vdsm/gluster/exception.py +++ b/vdsm/gluster/exception.py @@ -377,3 +377,39 @@ class GlusterHostsListFailedException(GlusterHostException): code = 4407 message = "Hosts list failed" + + +# Ssh +class GlusterSshException(GlusterException): + code = 4500 + message = "Gluster ssh exception" + + +class GlusterSshConnectionFailedException(GlusterSshException): + code = 4501 + message = "SSH connection failed" + + +class GlusterSshHostKeyMismatchException(GlusterSshException): + code = 4502 + message = "Host key match failed" + + +class GlusterSshHostKeyAuthException(GlusterSshException): + code = 4503 + message = "SSH host key authentication failed" + + +class GlusterSshHostAuthException(GlusterSshException): + code = 4504 + message = "SSH host authentication failed" + + +class GlusterSshPubKeyGenerationFailedException(GlusterSshException): + code = 4505 + message = "SSH public key generation failed" + + +class GlusterSshSetupExecFailedException(GlusterSshException): + code = 4506 + message = "SSH key setup execution failed" -- To view, visit http://gerrit.ovirt.org/8375 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ic783abd5f1b63bc5116ce4ff2a3c7be92001a387 Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: master Gerrit-Owner: Bala.FA <barumuga(a)redhat.com> Gerrit-Reviewer: Ayal Baron <abaron(a)redhat.com> Gerrit-Reviewer: Dan Kenigsberg <danken(a)redhat.com> Gerrit-Reviewer: Federico Simoncelli <fsimonce(a)redhat.com> Gerrit-Reviewer: Saggi Mizrahi <smizrahi(a)redhat.com> Gerrit-Reviewer: Timothy Asir <tjeyasin(a)redhat.com>

3 4

Change in vdsm[master]: Add qemu's memory usage to VM statistics.
by ghammer＠redhat.com 28 Apr '14

28 Apr '14

Gal Hammer has uploaded a new change for review. Change subject: Add qemu's memory usage to VM statistics. ...................................................................... Add qemu's memory usage to VM statistics. Change-Id: Ibeb35759454c4a9b41e1303956267e93ca3545a0 Bug-Url: https://bugzilla.redhat.com/show_bug.cgi?id=799285 Signed-off-by: Gal Hammer <ghammer(a)redhat.com> --- M vdsm/config.py.in M vdsm/libvirtvm.py 2 files changed, 14 insertions(+), 1 deletion(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/06/9006/1 diff --git a/vdsm/config.py.in b/vdsm/config.py.in index df85e7e..ee1627b 100644 --- a/vdsm/config.py.in +++ b/vdsm/config.py.in @@ -111,6 +111,8 @@ ('vm_sample_net_interval', '5', None), ('vm_sample_net_window', '2', None), + + ('vm_sample_memory_interval', '2', None), ('trust_store_path', '@TRUSTSTORE@', 'Where the certificates and keys are situated.'), diff --git a/vdsm/libvirtvm.py b/vdsm/libvirtvm.py index 86e39a3..f76f35c 100644 --- a/vdsm/libvirtvm.py +++ b/vdsm/libvirtvm.py @@ -91,10 +91,13 @@ self._sampleNet, config.getint('vars', 'vm_sample_net_interval'), config.getint('vars', 'vm_sample_net_window'))) + self.sampleMem = (utils.AdvancedStatsFunction(self._sampleMem, + config.getint('vars', 'vm_sample_memory_interval'))) self.addStatsFunction( self.highWrite, self.updateVolumes, self.sampleCpu, - self.sampleDisk, self.sampleDiskLatency, self.sampleNet) + self.sampleDisk, self.sampleDiskLatency, self.sampleNet, + self.sampleMem) def _highWrite(self): if not self._vm.isDisksStatsCollectionEnabled(): @@ -168,6 +171,14 @@ netSamples[nic.name] = self._vm._dom.interfaceStats(nic.name) return netSamples + def _sampleMem(self): + memUsage = {} + for line in open('/proc/%d/status' %(self.conf['pid'])): + var, value = line.strip().split()[0:2] + if var in ('VmSize:', 'VmRSS:', 'VmData:'): + memUsage[var[:-1]] = long(value) + return memUsage + def _diff(self, prev, curr, val): return prev[val] - curr[val] -- To view, visit http://gerrit.ovirt.org/9006 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: Ibeb35759454c4a9b41e1303956267e93ca3545a0 Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: master Gerrit-Owner: Gal Hammer <ghammer(a)redhat.com>

8 29

Change in vdsm[master]: [WIP] Start moving proc parsing to it's own module
by smizrahi＠redhat.com 28 Apr '14

28 Apr '14

Saggi Mizrahi has uploaded a new change for review. Change subject: [WIP] Start moving proc parsing to it's own module ...................................................................... [WIP] Start moving proc parsing to it's own module Change-Id: I7ba84c7ece95bdef7448a7c7af277e7f58695401 Signed-off-by: Saggi Mizrahi <smizrahi(a)redhat.com> --- M vdsm.spec.in M vdsm/API.py M vdsm/Makefile.am M vdsm/caps.py A vdsm/procfs.py M vdsm/utils.py M vdsm/vm.py 7 files changed, 53 insertions(+), 40 deletions(-) git pull ssh://gerrit.ovirt.org:29418/vdsm refs/changes/13/7513/1 diff --git a/vdsm.spec.in b/vdsm.spec.in index bd01c2a..1f01961 100644 --- a/vdsm.spec.in +++ b/vdsm.spec.in @@ -573,6 +573,7 @@ %{_datadir}/%{vdsm_name}/supervdsmServer.py* %{_datadir}/%{vdsm_name}/vmChannels.py* %{_datadir}/%{vdsm_name}/vmContainer.py* +%{_datadir}/%{vdsm_name}/procfs.py* %{_datadir}/%{vdsm_name}/tc.py* %{_datadir}/%{vdsm_name}/vdsm %{_datadir}/%{vdsm_name}/vdsm-restore-net-config diff --git a/vdsm/API.py b/vdsm/API.py index 720c3b9..aab69cd 100644 --- a/vdsm/API.py +++ b/vdsm/API.py @@ -37,6 +37,7 @@ from vdsm.define import doneCode, errCode, Kbytes, Mbytes import caps from vdsm.config import config +import procfs import supervdsm @@ -864,7 +865,7 @@ """ def _readSwapTotalFree(): - meminfo = utils.readMemInfo() + meminfo = procfs.meminfo() return meminfo['SwapTotal'] / 1024, meminfo['SwapFree'] / 1024 stats = {} @@ -1111,17 +1112,16 @@ memCommitted = self._memCommitted() resident = 0 for v in self._cif.vmContainer.getVMs(): - if v.conf['pid'] == '0': - continue try: - statmfile = file('/proc/' + v.conf['pid'] + '/statm') - resident += int(statmfile.read().split()[1]) + resident += v.statm().resident except: pass + resident *= PAGE_SIZE_BYTES - meminfo = utils.readMemInfo() - freeOrCached = (meminfo['MemFree'] + - meminfo['Cached'] + meminfo['Buffers']) * Kbytes + + meminfo = procfs.meminfo() + freeOrCached = (meminfo['MemFree'] + meminfo['Cached'] + + meminfo['Buffers']) * Kbytes return freeOrCached + resident - memCommitted - \ config.getint('vars', 'host_mem_reserve') * Mbytes diff --git a/vdsm/Makefile.am b/vdsm/Makefile.am index 574d762..1a3ac43 100644 --- a/vdsm/Makefile.am +++ b/vdsm/Makefile.am @@ -47,6 +47,7 @@ momIF.py \ neterrors.py \ parted_utils.py \ + procfs.py \ pthread.py \ supervdsm.py \ supervdsmServer.py \ diff --git a/vdsm/caps.py b/vdsm/caps.py index f1641ff..39fc837 100644 --- a/vdsm/caps.py +++ b/vdsm/caps.py @@ -41,6 +41,7 @@ from vdsm import utils from vdsm import constants import storage.hba +import procfs # For debian systems we can use python-apt if available try: @@ -271,7 +272,7 @@ caps['HBAInventory'] = storage.hba.HBAInventory() caps['vmTypes'] = ['kvm'] - caps['memSize'] = str(utils.readMemInfo()['MemTotal'] / 1024) + caps['memSize'] = str(procfs.meminfo()['MemTotal'] / 1024) caps['reservedMem'] = str( config.getint('vars', 'host_mem_reserve') + config.getint('vars', 'extra_mem_reserve')) diff --git a/vdsm/procfs.py b/vdsm/procfs.py new file mode 100644 index 0000000..29fc973 --- /dev/null +++ b/vdsm/procfs.py @@ -0,0 +1,31 @@ +from collections import namedtuple + +buffsize = 4096 + +MemStat = namedtuple("MemStat", + "size, resident, share, text, UNUSED1, data, UNUSED2") + + +def statm(pid): + """ + Parses statm for a pid. Note all results are in pages. + """ + with open("/proc/%d/statm" % pid, "rb") as f: + return MemStat(*(int(val) for val in f.read().split())) + + +def meminfo(): + """ + Parse ``/proc/meminfo`` and return its content as a dictionary. + + note. + All values are in KB + """ + meminfo = {} + with open("/proc/meminfo", "rb") as f: + f.seek(0) + lines = f.readlines() + for var, val in (l.split()[0:2] for l in lines): + meminfo[var[:-1]] = int(val) + + return meminfo diff --git a/vdsm/utils.py b/vdsm/utils.py index 5e2d4e5..048a528 100644 --- a/vdsm/utils.py +++ b/vdsm/utils.py @@ -19,7 +19,8 @@ # """ -A module containing miscellaneous functions and classes that are user plentifuly around vdsm. +A module containing miscellaneous functions and classes that are user +plentifuly around vdsm. .. attribute:: utils.symbolerror @@ -28,7 +29,8 @@ from SimpleXMLRPCServer import SimpleXMLRPCServer import SocketServer import threading -import os, time +import os +import time import logging import errno import subprocess @@ -42,6 +44,7 @@ import constants from config import config import netinfo +import procfs _THP_STATE_PATH = '/sys/kernel/mm/transparent_hugepage/enabled' if not os.path.exists(_THP_STATE_PATH): @@ -63,34 +66,6 @@ os.unlink(fileToRemove) except: pass - -def readMemInfo(): - """ - Parse ``/proc/meminfo`` and return its content as a dictionary. - - For a reason unknown to me, ``/proc/meminfo`` is is sometime - empty when opened. If that happens, the function retries to open it - 3 times. - - :returns: a dictionary representation of ``/proc/meminfo`` - """ - # FIXME the root cause for these retries should be found and fixed - tries = 3 - meminfo = {} - while True: - tries -= 1 - try: - lines = [] - lines = file('/proc/meminfo').readlines() - for line in lines: - var, val = line.split()[0:2] - meminfo[var[:-1]] = int(val) - return meminfo - except: - logging.warning(lines, exc_info=True) - if tries <= 0: - raise - time.sleep(0.1) #Threaded version of SimpleXMLRPCServer class SimpleThreadedXMLRPCServer(SocketServer.ThreadingMixIn, SimpleXMLRPCServer): @@ -225,7 +200,7 @@ """ BaseSample.__init__(self, pid, ifids) self.totcpu = TotalCpuSample() - meminfo = readMemInfo() + meminfo = procfs.meminfo() freeOrCached = (meminfo['MemFree'] + meminfo['Cached'] + meminfo['Buffers']) self.memUsed = 100 - int(100.0 * (freeOrCached) / meminfo['MemTotal']) diff --git a/vdsm/vm.py b/vdsm/vm.py index c1a22b0..bd436e0 100644 --- a/vdsm/vm.py +++ b/vdsm/vm.py @@ -36,6 +36,7 @@ import libvirt from vdsm import vdscli import caps +import procfs DEFAULT_BRIDGE = config.get("vars", "default_bridge") @@ -693,6 +694,9 @@ load = len(self.cif.vmContainer.getVMs()) return base * (doubler + load) / doubler + def statm(self): + return procfs.statm(int(self.conf['pid'])) + def saveState(self): if self.destroyed: return -- To view, visit http://gerrit.ovirt.org/7513 To unsubscribe, visit http://gerrit.ovirt.org/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I7ba84c7ece95bdef7448a7c7af277e7f58695401 Gerrit-PatchSet: 1 Gerrit-Project: vdsm Gerrit-Branch: master Gerrit-Owner: Saggi Mizrahi <smizrahi(a)redhat.com>

4 4

← Newer
1
2
3
4
5
6
7
8
...
41
Older →

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

vdsm-patches December 2012