avocado icon indicating copy to clipboard operation
avocado copied to clipboard

xunit results missing some fields

Open beraldoleal opened this issue 2 years ago • 0 comments

Discussed in https://github.com/avocado-framework/avocado/discussions/5330

Originally posted by luckyh April 14, 2022 This is one of the issues we discovered when we were going to switch to nrunner for the internal use of Avocado-VT test execution. From the following comparison we can see testcase.classname, error.type(and also failure.type) and error.description(and also failure.description) are available in the result of legacy runner, but missing in the one of nrunner (whereas there are only the strings <unknown> as the placeholder).

legacy runner

<testcase classname="VirtTest" name="11-Host_RHEL.m8.u5.v0.qcow2.virtio_scsi.up.virtio_net.Guest.RHEL.8.5.0.x86_64.io-github-autotest-qemu.blockdev_stream.q35" time="324.873">
  <error type="VMIPAddressMissingError" message="No ipv4 DHCP lease for MAC 9a:d5:04:53:4c:60">
    Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/avocado_framework-92.0-py3.9.egg/avocado/core/test.py" ...
  </error>
  ...
</testcase>

nrunner

<testcase classname="<unknown>" name="Host_RHEL.m8.u5.v0.qcow2.virtio_blk.up.virtio_net.Guest.RHEL.8.5.0.x86_64.io-github-autotest-qemu.unattended_install.cdrom.extra_cdrom_ks.default_install.aio_threads.q35" time="101.714">
  <error type="<unknown>" message="Qemu crashed: ..."><unknown></error>
  ...
</testcase>

After checking the code, it seemed that this information had not been passed via tests discovery/messages when executing tests with nrunner. So I would like to confirm that if it is the desired behavior and for what purpose, or else, is it considered to be a bug?

beraldoleal avatar Apr 14 '22 13:04 beraldoleal