Re: CI Run Output Lifetime

[Miroslav Vadkerti]

Hey,

We will definitely want something as we have on downstream for artifacts
storage for Testing Farm. I would even go with the same simple rsync method
we use there, as it is just simple & awesome. I believe we can for sure
start with S3 for that :).

Best regards,
/M

On Thu, Feb 20, 2020 at 9:30 AM Michal Srb <msrb(a)redhat.com&gt; wrote:

>  On Thu, Feb 20, 2020 at 9:01 AM Bruno Goncalves <bgoncalv(a)redhat.com&gt;
>  wrote:
>
> > On Wed, Feb 19, 2020 at 10:53 PM Tim Flink <tflink(a)redhat.com&gt; wrote:
> > >
> > > On Wed, 19 Feb 2020 13:59:10 -0500
> > > Johnny Bieren <jbieren(a)redhat.com&gt; wrote:
> > >
> > > > On Wed, Feb 19, 2020 at 12:26 PM Tim Flink <tflink(a)redhat.com&gt;
> wrote:
> > > >
> > > > > On Wed, 19 Feb 2020 10:11:25 -0700
> > > > > Tim Flink <tflink(a)redhat.com&gt; wrote:
> > > > >
> > > > > > I'm looking back on a run that was done on 2020-02-05 and it
> > > > > > appears as if the logs have already been removed from the
> Jenkins
> > > > > > master.
> > > > > >
> > > > > > The blue ocean link to the run is:
> > > > > >
> > > > >
> >
> https://jenkins-continuous-infra.apps.ci.centos.org/blue/organizations/je...
> > > > >
> > > > > >
> > > > > > I think that this should be the link to the classic Jenkins
> result
> > > > > > page:
> > > > > >
> > > > >
> >
> https://jenkins-continuous-infra.apps.ci.centos.org/view/Fedora%20All%20P...
> > > > >
> > > > > >
> > > > > > Am I missing something? Are the logs supposed to be stored for
> > > > > > longer than this?
> > > > >
> > > > I believe this is controlled here
> > > >
> >
> https://github.com/CentOS-PaaS-SIG/upstream-fedora-pipeline/blob/master/J...
> > > >  read as, keep 30 days or 100 builds of artifacts (whichever is less)
> > > > and let a build stick around for 90 days or 100 builds (again
> > > > whichever is less) Those numbers would be per pipeline job
> > >
> > > OK, that would fit with what I'm seeing.
> > >
> > > Is this something we can or should increase? It doesn't take long to
> > > hit 100 builds in a single release.
> >
> > I'd prefer if we could have some other place to store the logs and not
> > having them only in the Jenkins jobs, for example is there any NFS
> > storage that we could use?
> >
>
>  Or S3 O:-)
>
>  Thanks,
>  Michal
>
>
> > > Tim
> > >
> > > > > Digging into this a little more, I found a run from 5 days ago
> > > > > (2020-02-14) which appears to have been removed from the Jenkins
> > > > > master
> > > > >
> > > > >
> > > > >
> >
> https://jenkins-continuous-infra.apps.ci.centos.org/job/fedora-rawhide-bu...
> > > > >
> > > > > I'm unclear if this only an issue for the rawhide pipeline or not
> > > > > as an older run from the F31 pipeline on 2020-02-13 is still
> > > > > present:
> > > > >
> > > > >
> > > > >
> >
> https://jenkins-continuous-infra.apps.ci.centos.org/job/fedora-f31-build-...
> > > > >
> > > > > Tim
> > > > > _______________________________________________
> > > > > CI mailing list -- ci(a)lists.fedoraproject.org
> > > > > To unsubscribe send an email to ci-leave(a)lists.fedoraproject.org
> > > > > Fedora Code of Conduct:
> > > > > https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> > > > > List Guidelines:
> > > > > https://fedoraproject.org/wiki/Mailing_list_guidelines List
> > > > > Archives:
> > > > >
> > https://lists.fedoraproject.org/archives/list/[e-mail]
> > >
> > > _______________________________________________
> > > CI mailing list -- ci(a)lists.fedoraproject.org
> > > To unsubscribe send an email to ci-leave(a)lists.fedoraproject.org
> > > Fedora Code of Conduct:
> > https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> > > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > > List Archives:
> > https://lists.fedoraproject.org/archives/list/[e-mail]
> > _______________________________________________
> > CI mailing list -- ci(a)lists.fedoraproject.org
> > To unsubscribe send an email to ci-leave(a)lists.fedoraproject.org
> > Fedora Code of Conduct:
> > https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> > List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> > List Archives:
> > https://lists.fedoraproject.org/archives/list/[e-mail]
> >
>  _______________________________________________
>  CI mailing list -- ci(a)lists.fedoraproject.org
>  To unsubscribe send an email to ci-leave(a)lists.fedoraproject.org
>  Fedora Code of Conduct:
>  https://docs.fedoraproject.org/en-US/project/code-of-conduct/
>  List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
>  List Archives:
>  https://lists.fedoraproject.org/archives/list/[e-mail]
>  

-- 
Miroslav Vadkerti :: Principal QE :: Testing Farm / OSCI / BaseOS QE
IRC mvadkert #tft #baseosci #osci :: GPG 0x7B5B2E95
TPB-C 2C215 :: Mobile [phone]
Red Hat Czech s.r.o, Purkyňova 115, 612 00, Brno, CR