OOM killer on bapp02

Tue Dec 9 08:42:48 UTC 2014

On Tue, Nov 25, 2014 at 07:24:32AM -0700, Kevin Fenzi wrote:
> On Tue, 25 Nov 2014 10:27:19 +0100
> Adrian Reber <adrian at lisas.de> wrote:
> > The OOM killer on bapp02 has terminated a few mirrormanager crawler
> > processes. It seems it needs more memory or the number of parallel
> > crawlers has to be further limited.
> 
> Well, it's got 16GB now... I can bump it to 24 without too much
> trouble. Will of course need a freeze break... 
> 
> We are currently doing 60 threads. We could cut it down, but I guess
> I'd say lets try more memory first. 

As dmesg on bapp02 has no timestamps it is hard to tell when the last
crawler was terminated because of OOM. Looking at different log files it
seems, however, that some crawler processes are terminated without
finishing correctly. Especially mirrors which take a long time to crawl
are not examined completely. So maybe it would be a good thing to
decrease the number of parallel crawls to avoid OOM situations.

		Adrian
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 811 bytes
Desc: not available
URL: <http://lists.fedoraproject.org/pipermail/infrastructure/attachments/20141209/f6b2d01f/attachment.sig>