[AutoQA] #414: rats_install: run twice, once for updates, once for updates+updates-testing

[fedora-badges]

#414: rats_install: run twice, once for updates, once for updates+updates-testing
--------------------------+-------------------------------
  Reporter:  kparal       |      Owner:
      Type:  enhancement  |     Status:  new
  Priority:  minor        |  Milestone:  Nice to have soon
 Component:  tests        |   Keywords:
Blocked By:               |   Blocking:
--------------------------+-------------------------------
 We decided it would be beneficial to run rats_install twice. Once for
 stable updates only, once for main+updates, once for main+updates+updates-
 testing. Currently we're running just the second option. The discussion is
 here:

 https://fedoraproject.org/wiki/QA/Meetings/20120319#t15:55:42

 Change rats_install to execute twice and report both variants. The easiest
 way is probably to modify 'control' file to execute the job twice and
 modify some input argument to distinguish the two cases. Also we need to
 change the summary accordingly so that we can easily distinguish that in
 our ResultsDB view.

 Marking "Nice to have soon" if we can do it before F17 Final, otherwise
 it'll probably go into "Future tasks".

-- 
Ticket URL: <https://fedorahosted.org/autoqa/ticket/414>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project

[fedora-badges]

#414: rats_install: run twice, once for updates, once for updates+updates-testing
-------------------------+--------------------------------
 Reporter:  kparal       |       Owner:
     Type:  enhancement  |      Status:  new
 Priority:  minor        |   Milestone:  Nice to have soon
Component:  tests        |  Resolution:
 Keywords:               |  Blocked By:
 Blocking:               |
-------------------------+--------------------------------

Comment (by kparal):

 Just a remark, currently rats_install fails due to
 https://bugzilla.redhat.com/show_bug.cgi?id=806931 , don't be surprised.

-- 
Ticket URL: <https://fedorahosted.org/autoqa/ticket/414#comment:1>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project

[fedora-badges]

#414: rats_install: run twice, once for updates, once for updates+updates-testing
-------------------------+--------------------------------
 Reporter:  kparal       |       Owner:  hongqing
     Type:  enhancement  |      Status:  new
 Priority:  minor        |   Milestone:  Nice to have soon
Component:  tests        |  Resolution:
 Keywords:               |  Blocked By:
 Blocking:               |
-------------------------+--------------------------------
Changes (by hongqing):

 * owner:   => hongqing


Comment:

 I would like to accept it. Not sure if it can be solved before Final, the
 manual test cost a lot of my time and I have to investigate in the control
 file. Anyway, I will give it high priority.

-- 
Ticket URL: <https://fedorahosted.org/autoqa/ticket/414#comment:2>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project

[fedora-badges]

#414: rats_install: run twice, once for updates, once for updates+updates-testing
-------------------------+--------------------------------
 Reporter:  kparal       |       Owner:  hongqing
     Type:  enhancement  |      Status:  new
 Priority:  minor        |   Milestone:  Nice to have soon
Component:  tests        |  Resolution:
 Keywords:               |  Blocked By:
 Blocking:               |
-------------------------+--------------------------------

Comment (by hongqing):

 Hi, All,

 I have investigated in it, the updates-testing repo is enabled with
 rawhide by default.
 but I have not found how to enable the updates-testing repo during the
 installation with
 branched Fedora. Any suggestions?

-- 
Ticket URL: <https://fedorahosted.org/autoqa/ticket/414#comment:3>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project

[fedora-badges]

#414: rats_install: run twice, once for updates, once for updates+updates-testing
-------------------------+--------------------------------
 Reporter:  kparal       |       Owner:  hongqing
     Type:  enhancement  |      Status:  new
 Priority:  minor        |   Milestone:  Nice to have soon
Component:  tests        |  Resolution:
 Keywords:               |  Blocked By:
 Blocking:               |
-------------------------+--------------------------------

Comment (by kparal):

 Hello, it can be controlled in the kickstart file. Currently we're using
 the default, which is main+updates+updates-testing (that might change
 after Beta, I'm not sure).

 You can control which repositories are enabled by a snippet like this:
 {{{
 # Use online Fedora repos
 repo --name=fedora
 repo --name=updates
 repo --name=updates-testing
 }}}

 E.g. if you add this to the kickstart:
 {{{
 # Use online Fedora repos
 repo --name=fedora
 repo --name=updates
 }}}
 then updates-testing should be disabled (verification needed).

 That means we will need two different kickstart files or modify the
 current one on the fly before the second test execution.

-- 
Ticket URL: <https://fedorahosted.org/autoqa/ticket/414#comment:4>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project

[fedora-badges]

#414: rats_install: run twice, once for updates, once for updates+updates-testing
-------------------------+--------------------------------
 Reporter:  kparal       |       Owner:  hongqing
     Type:  enhancement  |      Status:  new
 Priority:  minor        |   Milestone:  Nice to have soon
Component:  tests        |  Resolution:
 Keywords:               |  Blocked By:
 Blocking:               |
-------------------------+--------------------------------

Comment (by hongqing):

 I have updated the script in git branch 'rats_install' with three
 different repo: fedora, fedora+updates, fedora+updates+updates-
 testing.[[BR]]
 A loop is used in control file to run different test. but all the tests
 can only be scheduled as one test, they cannot have different ids if we
 keep the same name 'rats_install', so the debug logs are store in the same
 file. But the raw logs of anaconda are stored in different results
 directories.[[BR]]
 Please review the codes to see if there is anything that need to be
 updated.

-- 
Ticket URL: <https://fedorahosted.org/autoqa/ticket/414#comment:5>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project

[fedora-badges]

#414: rats_install: run twice, once for updates, once for updates+updates-testing
-------------------------+--------------------------------
 Reporter:  kparal       |       Owner:  hongqing
     Type:  enhancement  |      Status:  new
 Priority:  minor        |   Milestone:  Nice to have soon
Component:  tests        |  Resolution:
 Keywords:               |  Blocked By:
 Blocking:               |
-------------------------+--------------------------------

Comment (by kparal):

 I have reviewed the code and fixed a lot of problems, but currently
 installation fails on:

 {{{
 == anaconda disk probe test ==
 60 seconds elapsed - giving up.
 TEST RESULT: diskprobe: FAIL
 }}}

 That is caused by the fact that in resultsdir anaconda/anaconda.log is no
 longer created, everything goes to anaconda/syslog. Hongqing, can you have
 a look at that?

 My changes are committed to rats_install branch.

-- 
Ticket URL: <https://fedorahosted.org/autoqa/ticket/414#comment:6>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project

[fedora-badges]

#414: rats_install: run twice, once for updates, once for updates+updates-testing
-------------------------+--------------------------------
 Reporter:  kparal       |       Owner:  hongqing
     Type:  enhancement  |      Status:  new
 Priority:  minor        |   Milestone:  Nice to have soon
Component:  tests        |  Resolution:
 Keywords:               |  Blocked By:
 Blocking:               |
-------------------------+--------------------------------

Comment (by hongqing):

 Replying to [comment:6 kparal]:
>  I have reviewed the code and fixed a lot of problems, but currently
>  
 installation fails on:
>  {{{
>  == anaconda disk probe test ==
>  60 seconds elapsed - giving up.
>  TEST RESULT: diskprobe: FAIL
>  }}}
>
>  That is caused by the fact that in resultsdir anaconda/anaconda.log is
>  
 no longer created, everything goes to anaconda/syslog. Hongqing, can you
 have a look at that?
>  My changes are committed to rats_install branch.
>  

 It seems a F17 anaconda bug, it works well with F16. I will further
 investigate in it.

-- 
Ticket URL: <https://fedorahosted.org/autoqa/ticket/414#comment:7>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project

[fedora-badges]

#414: rats_install: run twice, once for updates, once for updates+updates-testing
-------------------------+--------------------------------
 Reporter:  kparal       |       Owner:  hongqing
     Type:  enhancement  |      Status:  new
 Priority:  minor        |   Milestone:  Nice to have soon
Component:  tests        |  Resolution:
 Keywords:               |  Blocked By:
 Blocking:               |
-------------------------+--------------------------------

Comment (by hongqing):

 It also does not work with manual installation, I have filed a bug at
 [[https://bugzilla.redhat.com/show_bug.cgi?id=820106]]

-- 
Ticket URL: <https://fedorahosted.org/autoqa/ticket/414#comment:8>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project

[fedora-badges]

#414: rats_install: run twice, once for updates, once for updates+updates-testing
-------------------------+--------------------------------
 Reporter:  kparal       |       Owner:  hongqing
     Type:  enhancement  |      Status:  new
 Priority:  minor        |   Milestone:  Nice to have soon
Component:  tests        |  Resolution:
 Keywords:               |  Blocked By:
 Blocking:               |
-------------------------+--------------------------------

Comment (by kparal):

 I have pushed the rats_install fixes to master in commit 3ec7707. I have
 also disabled rats_install execution in commit 15e3422 until we solve the
 problem mentioned in comment 8.

 Hongqing, can you please work around that problem mentioned in comment 8?
 It doesn't seem that anaconda guys are likely to fix that soon. We don't
 need to have it solved *right now*, but once F18 composes start to come
 out, I'd like to have rats_install working again.

-- 
Ticket URL: <https://fedorahosted.org/autoqa/ticket/414#comment:9>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project

[fedora-badges]

#414: rats_install: run twice, once for updates, once for updates+updates-testing
-------------------------+--------------------------------
 Reporter:  kparal       |       Owner:  kparal
     Type:  enhancement  |      Status:  new
 Priority:  minor        |   Milestone:  Nice to have soon
Component:  tests        |  Resolution:
 Keywords:               |  Blocked By:
 Blocking:               |
-------------------------+--------------------------------
Changes (by kparal):

 * owner:  hongqing => kparal


-- 
Ticket URL: <https://fedorahosted.org/autoqa/ticket/414#comment:10>
AutoQA <http://autoqa.fedorahosted.org>
Automated QA project