Re: koji memory usage?
On 12/12/2013 10:43 AM, Pat Riehecky wrote:
I noticed my apache logs are full of some odd messages:
google was not terribly helpful. Any suggestions for making these error
go away?
That change was an attempt to debug some memory issues we were seeing a
while back. Here's the original commit
https://git.fedorahosted.org/cgit/koji/commit/?id=8ffe4011dbba89849f4481e...
The test is: memory_usage_at_end - memory_usage_at_start >
opts['MemoryWarnThreshold']
MemoryWarnThreshold defaults to 5000 (KiB). You could set it higher (in
hub.conf) if you want to see the warnings less often.
[Thu Dec 12 09:36:28 2013] [error] 2013-12-12 09:36:28,871 [WARNING]
m=listBuildroots u=XXXXXXXXXXx.fnal.gov p=620 r=131.XXXXXXXXXX:41305
koji.xmlrpc: Memory usage of process 620 grew from 13128 KiB to 25668
KiB (+12540 KiB) processing request listBuildroots with args
({'buildrootID': [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16,
17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, ...
[Thu Dec 12 09:36:35 2013] [error] 2013-12-12 09:36:35,378 [WARNING]
m=getTaskInfo u=XXXXXXXXXXx.fnal.gov p=1800 r=131.XXXXXXXXXX:41319
koji.xmlrpc: Memory usage of process 1800 grew from 13064 KiB to 22796
KiB (+9732 KiB) processing request getTaskInfo with args ([31, 32, 33,
34, 35, 36, 48, 49, 50, 51, 52, 53, 60, 61, 62, 63, 64, 65, 66, 68, 76,
77, 79, 80, 82, 83, 84, 85, 94,...
[Thu Dec 12 09:36:57 2013] [error] 2013-12-12 09:36:57,745 [WARNING]
m=listBuildroots u=XXXXXXXXXXx.fnal.gov p=1800 r=131.XXXXXXXXXX:41393
koji.xmlrpc: Memory usage of process 1800 grew from 18252 KiB to 28544
KiB (+10292 KiB) processing request listBuildroots with args
({'buildrootID': [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16,
17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, ...
[Thu Dec 12 09:37:04 2013] [error] 2013-12-12 09:37:04,298 [WARNING]
m=getTaskInfo u=XXXXXXXXXXx.fnal.gov p=620 r=131.XXXXXXXXXX:41412
koji.xmlrpc: Memory usage of process 620 grew from 21004 KiB to 32924
KiB (+11920 KiB) processing request getTaskInfo with args ([31, 32, 33,
34, 35, 36, 48, 49, 50, 51, 52, 53, 60, 61, 62, 63, 64, 65, 66, 68, 76,
77, 79, 80, 82, 83, 84, 85, 94,...
[Thu Dec 12 09:37:11 2013] [error] 2013-12-12 09:37:11,997 [WARNING]
m=listBuildroots u=XXXXXXXXXXx.fnal.gov p=1799 r=131.XXXXXXXXXX:41457
koji.xmlrpc: Memory usage of process 1799 grew from 20932 KiB to 32400
KiB (+11468 KiB) processing request listBuildroots with args
({'buildrootID': [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16,
17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, ...
[Thu Dec 12 09:37:23 2013] [error] 2013-12-12 09:37:23,734 [WARNING]
m=listBuildroots u=XXXXXXXXXXx.fnal.gov p=1848 r=131.XXXXXXXXXX:41517
koji.xmlrpc: Memory usage of process 1848 grew from 13676 KiB to 25636
KiB (+11960 KiB) processing request listBuildroots with args
({'buildrootID': [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16,
17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, ...