New Koji Install, createrepo never completes.

[Mike McLean]

On 06/11/2013 01:19 PM, Stephen Brasher wrote:
> I’ve installed all the pieces of koji-1.8.0 (hub, web, kojira kojid),
> configured for ssl and have everything working (I think).  Following the
> Server Bootstrap and I import all the SRPM’s and RPM’s for fedora fc17
> (approximately 35K rpms).  Can see all the packages imported on the web in
> the Packages and the Builds tabs.

Did you add any builders to the createrepo group (and do those builders 
have /mnt/koji mounted)?

> When I execute the “koji add-group f17-build build” and the “koji
> add-group-pkg f17-build build pkg1”, kojira starts two tasks, a newRepo
> task and a createrepo task.  Looking at the kojira.log, I see the following
> repeated about every 15 seconds:
>
> 2013-06-10 14:07:53,790 [DEBUG] koji.repo.manager: Task 17 is waiting
> 2013-06-10 14:07:53,876 [DEBUG] koji.repo.manager: Untracked task 19 is
> waiting
> 2013-06-10 14:07:53,877 [DEBUG] koji.repo.manager: Current tasks: {2: 17}
> 2013-06-10 14:07:53,877 [DEBUG] koji.repo.manager: Found 1 untracked
> newRepo tasks
> 2013-06-10 14:07:53,877 [DEBUG] koji.repo.manager: Updating repos
> 2013-06-10 14:07:53,877 [DEBUG] koji.repo.manager: Reading current repo data
> 2013-06-10 14:07:53,977 [DEBUG] koji.repo.manager: Repo data:
> [{'create_event': 34851, 'state': 2, 'tag_id': 2, 'tag_name': 'f17-build',
> 'create_ts': 1370716632.03544, 'id': 1}, {'create_event': 34888, 'state':
> 2, 'tag_id': 2, 'tag_name': 'f17-build', 'create_ts': 1370717056.06374,
> 'id': 2}, {'create_event': 34891, 'state': 0, 'tag_id': 2, 'tag_name':
> 'f17-build', 'create_ts': 1370882529.75254, 'id': 3}, {'create_event':
> 34892, 'state': 0, 'tag_id': 2, 'tag_name': 'f17-build', 'create_ts':
> 1370890996.61094, 'id': 4}, {'create_event': 34893, 'state': 0, 'tag_id':
> 2, 'tag_name': 'f17-build', 'create_ts': 1370891441.92783, 'id': 5},
> {'create_event': 34894, 'state': 0, 'tag_id': 2, 'tag_name': 'f17-build',
> 'create_ts': 1370891585.94049, 'id': 6}, {'create_event': 34895, 'state':
> 0, 'tag_id': 2, 'tag_name': 'f17-build', 'create_ts': 1370892392.69252,
> 'id': 7}, {'create_event': 34896, 'state': 0, 'tag_id': 2, 'tag_name':
> 'f17-build', 'create_ts': 1370892439.9626, 'id': 8}, {'create_event':
> 34897, 'state': 0, 'tag_id': 2, 'tag_name': 'f17-build', 'create_ts':
> 1370892487.90491, 'id': 9}, {'create_event': 34898, 'state': 0, 'tag_id':
> 2, 'tag_name': 'f17-build', 'create_ts': 1370892548.62247, 'id': 10},
> {'create_event': 34899, 'state': 0, 'tag_id': 2, 'tag_name': 'f17-build',
> 'create_ts': 1370892581.09955, 'id': 11}, {'create_event': 34900, 'state':
> 0, 'tag_id': 2, 'tag_name': 'f17-build', 'create_ts': 1370895682.22075,
> 'id': 12}, {'create_event': 34901, 'state': 0, 'tag_id': 2, 'tag_name':
> 'f17-build', 'create_ts': 1370895683.00858, 'id': 13}, {'create_event':
> 34905, 'state': 0, 'tag_id': 2, 'tag_name': 'f17-build', 'create_ts':
> 1370895884.96146, 'id': 14}, {'create_event': 34931, 'state': 0, 'tag_id':
> 2, 'tag_name': 'f17-build', 'create_ts': 1370896102.89165, 'id': 15}]
> 2013-06-10 14:07:54,061 [DEBUG] koji.repo.manager: Needed tags: [2]
> 2013-06-10 14:07:54,061 [DEBUG] koji.repo.manager: Current tags: [2]
> 2013-06-10 14:07:54,061 [DEBUG] koji.repo.manager: Skipped check for repos:
> set([1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14])
> 2013-06-10 14:07:54,157 [DEBUG] koji.repo.manager: order: []
> 2013-06-10 14:07:54,157 [DEBUG] koji.repo.manager: Tracking 15 repos, 0
> child processes
> 2013-06-10 14:07:54,157 [DEBUG] koji.repo.manager: Tracking task 17 for tag
> 2
> 2013-06-10 14:07:54,157 [DEBUG] koji.repo.manager: Scanning filesystem for
> repos
>
> When the above starts, I see the following the the kojid.log:
>
> 2013-06-10 14:10:39,768 [INFO] koji.TaskManager: pids: {17: 23421, 18:
> 23422}
> 2013-06-10 14:10:39,854 [INFO] koji.TaskManager: open task: {'waiting':
> None, 'id': 18, 'weight': 1.5}
> 2013-06-10 14:10:39,854 [INFO] koji.TaskManager: open task: {'waiting':
> True, 'id': 17, 'weight': 0.1}
>
> When I enter the “koji regen-repo f17-build” command, an additional task is
> created (newRepo with a child task of createrepo) and the kojid.log changes
> to:
>
> 2013-06-10 14:10:39,768 [INFO] koji.TaskManager: pids: {17: 23421, 18:
> 23422, 19: 23489, 20: 23492}
> 2013-06-10 14:10:39,854 [INFO] koji.TaskManager: open task: {'waiting':
> None, 'id': 18, 'weight': 1.5}
> 2013-06-10 14:10:39,854 [INFO] koji.TaskManager: open task: {'waiting':
> True, 'id': 17, 'weight': 0.1}
> 2013-06-10 14:10:39,854 [INFO] koji.TaskManager: open task: {'waiting':
> True, 'id': 19, 'weight': 0.1}
> 2013-06-10 14:10:39,854 [INFO] koji.TaskManager: open task: {'waiting':
> None, 'id': 20, 'weight': 1.5}
>
> And the system stays in this mode, never completing any of the tasks.  I’ve
> let them run for as long and 72 hours and they just don’t complete.
>
> The httpd/error_log doesn't show any errors, it is stuck in a loop also and
> attached as a .gz file.
>
> I think everything looks good in all three logs, just can’t figure out why
> it doesn’t complete.  If anyone has any suggestions, they would be greatly
> appreciated.
>
> Thanks in advance,
>
> Steve
>
>
>
> --
> buildsys mailing list
> buildsys at lists.fedoraproject.org
> https://admin.fedoraproject.org/mailman/listinfo/buildsys
>