[releng] Issue #6765: Fixing rawhide compose failure for variant Atomic on enabled arches

[Sinny Kumari]

sinnykumari reported a new issue against the project: `releng` that you are following:
``
Rawhide nightly composes are failing for variant Atomic on enabled arches- x86_64, ppc64le
and aarch64. From traceback, it seems cause of failure is common for all arches. 

From latest nightly (Fedora-Rawhide-20170426.n.0), traceback from pungi log [1]  on x86_64
is:
  File "/usr/lib/python2.7/site-packages/pungi/util.py", line 466, in failable
    yield
  File "/usr/lib/python2.7/site-packages/pungi/phases/ostree_installer.py", line
42, in process
    self.worker(compose, variant, arch, config)
  File "/usr/lib/python2.7/site-packages/pungi/phases/ostree_installer.py", line
61, in worker
    task_id = self._run_ostree_cmd(compose, variant, arch, config, source_repos,
output_dir, volid)
  File "/usr/lib/python2.7/site-packages/pungi/phases/ostree_installer.py", line
178, in _run_ostree_cmd
    % (output["task_id"], log_file))
RuntimeError: Runroot task failed: 19218947. See
/mnt/koji/compose/rawhide/Fedora-Rawhide-20170426.n.0/logs/x86_64/Atomic/ostree_installer-3/runroot.log
for more details.

In runrootlog [2] log for x86_64, traceback from lorax is:
Traceback (most recent call last):
  File "/usr/sbin/lorax", line 273, in <module>
    main()
  File "/usr/sbin/lorax", line 133, in main
    remove_temp=True, verify=opts.verify)
  File "/usr/lib/python3.6/site-packages/pylorax/__init__.py", line 329, in
run
    size=size)
  File "/usr/lib/python3.6/site-packages/pylorax/treebuilder.py", line 224, in
create_runtime
    "Anaconda", size=size)
  File "/usr/lib/python3.6/site-packages/pylorax/imgutils.py", line 113, in
mkrootfsimg
    mkext4img(rootdir, outfile, label=label, size=fssize)
  File "/usr/lib/python3.6/site-packages/pylorax/imgutils.py", line 442, in
mkext4img
    mkfsargs=["-L", label, "-b", "4096", "-m",
"0"], graft=graft)
  File "/usr/lib/python3.6/site-packages/pylorax/imgutils.py", line 427, in
mkfsimage
    copytree(rootdir, mnt, preserve)
  File "/usr/lib/python3.6/site-packages/pylorax/imgutils.py", line 238, in
copytree
    runcmd(cp)
  File "/usr/lib/python3.6/site-packages/pylorax/executils.py", line 341, in
runcmd
    return execWithRedirect(cmd[0], cmd[1:], **kwargs)
  File "/usr/lib/python3.6/site-packages/pylorax/executils.py", line 228, in
execWithRedirect
    env_add=env_add, reset_handlers=reset_handlers, reset_lang=reset_lang)[0]
  File "/usr/lib/python3.6/site-packages/pylorax/executils.py", line 201, in
_run_program
    raise subprocess.CalledProcessError(proc.returncode, argv, output)
subprocess.CalledProcessError: Command '['cp', '-a',
'/var/tmp/lorax.kd978bi0/installtree/.',
'/var/tmp/lorax.imgutils.v3h12bwm']' returned non-zero exit status 1.

Problem is happening while copying files from /var/tmp/lorax.kd978bi0/installtree/. to
created root filesystem. While debugging locally, found that size of created filesystem is
2GB which is default size provided by lorax. When I checked size of
/var/tmp/lorax.kd978bi0/installtree/. (source for copy) , it is 2.7G .

I ran locally on both x86_64 and ppc64le box, lorax command with additional option
--rootfs-size=3 (to specify size of root filesystem in GiB) and was able to run
successfully. Running lorax with additional option --rootfs-size with required size in our
compose script/config should fix the problem.

[1]
https://kojipkgs.fedoraproject.org/compose/rawhide/Fedora-Rawhide-2017042...
[2]
https://kojipkgs.fedoraproject.org/compose/rawhide/Fedora-Rawhide-2017042...
``

To reply, visit the link below or just reply to this email
https://pagure.io/releng/issue/6765

[Lubomír Sedlář]

lsedlar added a new comment to an issue you are following:
``
If `rootfs_size` option is added to [this
block](https://pagure.io/pungi-fedora/blob/master/f/fedora.conf#_751-765) (and possibly
others) it should be passed on to lorax running in the runroot.
``

To reply, visit the link below or just reply to this email
https://pagure.io/releng/issue/6765

[Mohan Boddu]

mohanboddu added a new comment to an issue you are following:
``
https://pagure.io/pungi-fedora/pull-request/220 should fix the issue.
``

To reply, visit the link below or just reply to this email
https://pagure.io/releng/issue/6765

[Sinny Kumari]

sinnykumari added a new comment to an issue you are following:
``
Thanks @lsedlar , @mohanboddu and @ausil for getting this issue fixed. With this fix,
nightly compose for Atomic variant in rawhide is building successfully for x86_64 and
ppc64le arches since Fedora-Rawhide-20170429.n.0 (
https://kojipkgs.fedoraproject.org/compose/rawhide/Fedora-Rawhide-2017042...
) . Still failing for aarch64 but it's a different issue.
``

To reply, visit the link below or just reply to this email
https://pagure.io/releng/issue/6765

[Sinny Kumari]

The status of the issue: `Fixing rawhide compose failure for variant Atomic on enabled
arches` of project: `releng` has been updated to: Closed by sinnykumari.

https://pagure.io/releng/issue/6765