koji memory usage?

[Mike McLean]

On 12/12/2013 10:43 AM, Pat Riehecky wrote:
> I noticed my apache logs are full of some odd messages:
> 
> google was not terribly helpful. Any suggestions for making these error
> go away?

That change was an attempt to debug some memory issues we were seeing a
while back. Here's the original commit

https://git.fedorahosted.org/cgit/koji/commit/?id=8ffe4011dbba89849f4481e7e209200887702c48

The test is: memory_usage_at_end - memory_usage_at_start >
opts['MemoryWarnThreshold']

MemoryWarnThreshold defaults to 5000 (KiB). You could set it higher  (in
hub.conf) if you want to see the warnings less often.


> [Thu Dec 12 09:36:28 2013] [error] 2013-12-12 09:36:28,871 [WARNING]
> m=listBuildroots u=XXXXXXXXXXx.fnal.gov p=620 r=131.XXXXXXXXXX:41305
> koji.xmlrpc: Memory usage of process 620 grew from 13128 KiB to 25668
> KiB (+12540 KiB) processing request listBuildroots with args
> ({'buildrootID': [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16,
> 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, ...
> [Thu Dec 12 09:36:35 2013] [error] 2013-12-12 09:36:35,378 [WARNING]
> m=getTaskInfo u=XXXXXXXXXXx.fnal.gov p=1800 r=131.XXXXXXXXXX:41319
> koji.xmlrpc: Memory usage of process 1800 grew from 13064 KiB to 22796
> KiB (+9732 KiB) processing request getTaskInfo with args ([31, 32, 33,
> 34, 35, 36, 48, 49, 50, 51, 52, 53, 60, 61, 62, 63, 64, 65, 66, 68, 76,
> 77, 79, 80, 82, 83, 84, 85, 94,...
> [Thu Dec 12 09:36:57 2013] [error] 2013-12-12 09:36:57,745 [WARNING]
> m=listBuildroots u=XXXXXXXXXXx.fnal.gov p=1800 r=131.XXXXXXXXXX:41393
> koji.xmlrpc: Memory usage of process 1800 grew from 18252 KiB to 28544
> KiB (+10292 KiB) processing request listBuildroots with args
> ({'buildrootID': [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16,
> 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, ...
> [Thu Dec 12 09:37:04 2013] [error] 2013-12-12 09:37:04,298 [WARNING]
> m=getTaskInfo u=XXXXXXXXXXx.fnal.gov p=620 r=131.XXXXXXXXXX:41412
> koji.xmlrpc: Memory usage of process 620 grew from 21004 KiB to 32924
> KiB (+11920 KiB) processing request getTaskInfo with args ([31, 32, 33,
> 34, 35, 36, 48, 49, 50, 51, 52, 53, 60, 61, 62, 63, 64, 65, 66, 68, 76,
> 77, 79, 80, 82, 83, 84, 85, 94,...
> [Thu Dec 12 09:37:11 2013] [error] 2013-12-12 09:37:11,997 [WARNING]
> m=listBuildroots u=XXXXXXXXXXx.fnal.gov p=1799 r=131.XXXXXXXXXX:41457
> koji.xmlrpc: Memory usage of process 1799 grew from 20932 KiB to 32400
> KiB (+11468 KiB) processing request listBuildroots with args
> ({'buildrootID': [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16,
> 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, ...
> [Thu Dec 12 09:37:23 2013] [error] 2013-12-12 09:37:23,734 [WARNING]
> m=listBuildroots u=XXXXXXXXXXx.fnal.gov p=1848 r=131.XXXXXXXXXX:41517
> koji.xmlrpc: Memory usage of process 1848 grew from 13676 KiB to 25636
> KiB (+11960 KiB) processing request listBuildroots with args
> ({'buildrootID': [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16,
> 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, ...
>