On Wed, Apr 14, 2021 at 10:43:26PM +0200, Miroslav Vadkerti wrote:
Hi Coiby,
On Wed, Apr 14, 2021 at 3:57 PM Coiby Xu <coxu(a)redhat.com> wrote:
> Hi Miro,
[...]
>
> Since Packit supports running tests inside a VM, I expect packet to
> provision multiple VM instances for a single test and make the console
> output of the VMs accessible to test.
Unfortunately multihost support is not yet implemented.
All testing we do is single host.
So has the feature of VM console output accessible to the test been
implemented? If the answer is yes, I want to run the local-kdump test
(multihost support is not needed by this test) using tmi to have a
first-hand experience of Packit and tmt.
> If this works, one great benefit
> of using Packit is I can run the sames tests for both upstream and
> downstream kexec-tools and dracut. Because commits backported from
> upstream dracut could also break kexec-tools.
>
Yeah, we would like definitely to see multihost supported ...
>
> Btw, the kdump tests have already implemented a framework to provision
> multiple VM instances and watch the console output. Maybe I can help
> implement these features for Packit?
>
Not Packit. We first need to outline the syntax of multihost
test definition in tmt. Then implement it in the tmt tool. As
the last step we need to make sure this also works in Testing Farm,
the service which runs tmt tests for Packit.
Of course, we are very happy for any contribution. So if you have
some ideas, how this could work, share your experiences that would
be awesome.
I'll share it after getting more familiar with Packit and tmt:)
>
> [2]
https://src.fedoraproject.org/rpms/kexec-tools/blob/f34/f/tests
> >
> >....
> >
> >Currently, for Fedora CI and Packit, we use AWS EC2 instances, which do
> not
> >support
> >nested virtualization and we do not yet have bare metal support with AWS
> :/.
> >
>
> I see. So a AWS EC2 instance doesn't support starting a VM via qemu,
> right?
>
Yes, AWS EC2 does not support nested virtualization in VMs,
just on bare metal.
I'm curious to know if qemu without kvm can run on on AWS EC2 since QEMU
can fall back to software emulation?
>
> >So ... the only way to make this work **now** is to use internal
> >infrastructure,
> >but that is outside of Packit, and you would need to call
> >Testing Farm service yourself (from Github actions for example), scripting
> >the communication.
> >That way, you could, from upstream pull request, provision internal
> >infrastructure and return back results. The only drawback of this solution
> >is that the artifacts storage are not accessible from the public, you will
> >just get an xunit XML with Pass/Fail results, but the links will lead to
> >internal
> >Red Hat infrastructure.
> >
> >Unfortunately, as we do not yet have any users doing exactly this, this
> >would
> >be a prototype for your team. But should be possible ...
> >
> >If the internal artifact storage is a no-go for you, we do not have a
> >possible
> >solution right now. But we will be glad to talk about possibilities, like
> >prototyping the use of AWS bare metal instances ....
> >
> >If the problem is that this goes around Packit, we can have a talk if this
> >feature
> >(run tests against internal infrastucture) is something we could also
> >support via Packit.
>
> This feature is nice to have but I could prefer what has been described
> before.
>
Me too :) Proper tmt support would be the best.
Best regards,
/M
>
> >But this also needs some additional work ...
> >
> >Unfortunately we are a bit behind with docs, so the best sources we now
> >have are:
> >
> >https://packit.dev/docs/testing-farm/
> >https://docs.fedoraproject.org/en-US/ci/tmt/
> >
>
> Thanks for recommending these docs!
>
>
> >But what I wrote here is not included there ...
> >
> >Best regards,
> >/M
> >
> >
> >
> >> Tomas said you are running periodic
> >> onboarding sessions. When will you launch the next session? Can you
> share
> >> some materials with me since
docs.fedoraproject.org/en-US/ci seems to
> be
> >> outdated?
> >>
> >
> >
> >
> >
> >
> >--
> >Miroslav Vadkerti :: Senior Principal QE :: Testing Farm / BaseOS QE /
> OSCI
> >IRC mvadkert #tft #baseosci #osci :: GPG 0x7B5B2E95
> >TPB-C 2C215 :: Mobile +420 773 944 252
> >Red Hat Czech s.r.o, Purkyňova 115, 612 00, Brno, CR
>
> --
> Best regards,
> Coiby
>
>
--
Miroslav Vadkerti :: Senior Principal QE :: Testing Farm / BaseOS QE / OSCI
IRC mvadkert #tft #baseosci #osci :: GPG 0x7B5B2E95
TPB-C 2C215 :: Mobile +420 773 944 252
Red Hat Czech s.r.o, Purkyňova 115, 612 00, Brno, CR
--
Best regards,
Coiby