tunir tests: what's this useradd-not-found failure?

[Matthew Miller]

I'm looking at https://apps.fedoraproject.org/autocloud/jobs/740, where
there is a failure in the Fedora Cloud Base vagrant-libvirt image (yet
vagrant-virtualbox and others are fine).

The specific failure (with whitespace removed) from 
https://apps.fedoraproject.org/autocloud/jobs/1984/output is:

  command: ## sudo python3 -m unittest
  tunirtests.nongatingtests.TunirNonGatingtestaudit -v
  status: False
  test_audit (tunirtests.nongatingtests.TunirNonGatingtestaudit)
  Tests audit ... FAIL
  ======================================================================
  FAIL: test_audit (tunirtests.nongatingtests.TunirNonGatingtestaudit)
  Tests audit
  ----------------------------------------------------------------------
  Traceback (most recent call last):
  File "/home/vagrant/tunirtests/nongatingtests.py", line 265, in test_audit
  self.assertIn('useradd', f)
  AssertionError: 'useradd' not found in ''
  ----------------------------------------------------------------------
  Ran 1 test in 0.140s
  FAILED (failures=1)

How is it that useradd is not found in this image but everything else
works and other images are fine?




-- 
Matthew Miller
<mattdm(a)fedoraproject.org&gt;
Fedora Project Leader

[Kushal Das]

On 01/02/17, Matthew Miller wrote:
>  I'm looking at https://apps.fedoraproject.org/autocloud/jobs/740,
> where
>  there is a failure in the Fedora Cloud Base vagrant-libvirt image (yet
>  vagrant-virtualbox and others are fine). 
It was a non-gating test about auditd,
which got automatically fixed. We
did not make any changes on the tests.

Kushal
-- 
Fedora Cloud Engineer
CPython Core Developer
https://kushaldas.in
https://dgplug.org

[Matthew Miller]

On Thu, Feb 02, 2017 at 06:44:14PM +0530, Kushal Das wrote:
>  > I'm looking at
> https://apps.fedoraproject.org/autocloud/jobs/740, where
>  > there is a failure in the Fedora Cloud Base vagrant-libvirt image (yet
>  > vagrant-virtualbox and others are fine).
>  It was a non-gating test about auditd, which got automatically fixed. We
>  did not make any changes on the tests. 
Yeah, but... how could that go wrong in this way?

-- 
Matthew Miller
<mattdm(a)fedoraproject.org&gt;
Fedora Project Leader

[Trishna Guha]

On Thu, Feb 2, 2017 at 8:06 PM, Matthew Miller <mattdm(a)fedoraproject.org&gt;
wrote:
>  Yeah, but... how could that go wrong in this way? 
Here is the test for the above failure [0].
I'm going to debug this tomorrow and try to figure out what is going wrong.


[0]
https://github.com/kushaldas/tunirtests/blob/master/nongatingtests.py#L25...

-- 
Regards,
Trishna Guha

trishnaguha17(a)gmail.com
trishnag.wordpress.com

[Trishna Guha]

On Wed, Feb 1, 2017 at 7:23 PM, Matthew Miller <mattdm(a)fedoraproject.org&gt; wrote:
>  I'm looking at https://apps.fedoraproject.org/autocloud/jobs/740,
> where
>  there is a failure in the Fedora Cloud Base vagrant-libvirt image (yet
>  vagrant-virtualbox and others are fine).
>
>  The specific failure (with whitespace removed) from
>  https://apps.fedoraproject.org/autocloud/jobs/1984/output is:
>
>    command: ## sudo python3 -m unittest
>    tunirtests.nongatingtests.TunirNonGatingtestaudit -v
>    status: False
>    test_audit (tunirtests.nongatingtests.TunirNonGatingtestaudit)
>    Tests audit ... FAIL
>    ======================================================================
>    FAIL: test_audit (tunirtests.nongatingtests.TunirNonGatingtestaudit)
>    Tests audit
>    ----------------------------------------------------------------------
>    Traceback (most recent call last):
>    File "/home/vagrant/tunirtests/nongatingtests.py", line 265, in test_audit
>    self.assertIn('useradd', f)
>    AssertionError: 'useradd' not found in ''
>    ----------------------------------------------------------------------
>    Ran 1 test in 0.140s
>    FAILED (failures=1)
>
>  How is it that useradd is not found in this image but everything else
>  works and other images are fine?
>  
Interestingly this test passes for me:

[vagrant@localhost ~]$ sudo python3 -m unittest
tunirtests.nongatingtests.TunirNonGatingtestaudit -v
test_audit (tunirtests.nongatingtests.TunirNonGatingtestaudit)
Tests audit ... ok

----------------------------------------------------------------------
Ran 1 test in 0.280s

OK

Also I have tested the commands and checked the audit log *manually*
which looks fine to me (Nothing missing in there).
Not sure why it failed on autocloud.


-- 
Regards,
Trishna Guha

trishnaguha17(a)gmail.com
trishnag.wordpress.com