openscap icon indicating copy to clipboard operation
openscap copied to clipboard

1.3.6 + master (bd41965d): test suite is failing

Open kloczek opened this issue 2 years ago • 10 comments

Description of Problem:

Looks like cmake test suite is failing in several units

OpenSCAP Version:

1.3.6 + master up to bd41965d.

Operating System & Version:

Linux x86/64

Steps to Reproduce:

  1. build openscap
  2. execute ctest -vv

Expected Results:

Test suite should not fail

Additional Information / Debugging Steps:

cmake setup

[tkloczko@devel-g2v x86_64-redhat-linux-gnu]$ cmake -L
CMake Warning:
  No source or binary directory provided.  Both will be assumed to be the
  same as the current working directory, but note that this warning will
  become a fatal error in future CMake releases.


CMake Error: The source directory "/home/tkloczko/rpmbuild/BUILD/openscap-1.3.6/x86_64-redhat-linux-gnu" does not appear to contain CMakeLists.txt.
Specify --help for usage, or press the help button on the CMake GUI.
-- Cache values
ASCIIDOC_EXECUTABLE:FILEPATH=/usr/bin/asciidoc
CMAKE_BUILD_TYPE:STRING=RelWithDebInfo
CMAKE_INSTALL_PREFIX:PATH=/usr
ENABLE_DOCS:BOOL=ON
ENABLE_MITRE:BOOL=OFF
ENABLE_OSCAP_UTIL:BOOL=ON
ENABLE_OSCAP_UTIL_AS_RPM:BOOL=ON
ENABLE_OSCAP_UTIL_AUTOTAILOR:BOOL=ON
ENABLE_OSCAP_UTIL_CHROOT:BOOL=ON
ENABLE_OSCAP_UTIL_DOCKER:BOOL=ON
ENABLE_OSCAP_UTIL_PODMAN:BOOL=ON
ENABLE_OSCAP_UTIL_SSH:BOOL=ON
ENABLE_OSCAP_UTIL_VM:BOOL=ON
ENABLE_PROBES:BOOL=ON
ENABLE_PROBES_INDEPENDENT:BOOL=ON
ENABLE_PROBES_LINUX:BOOL=ON
ENABLE_PROBES_SOLARIS:BOOL=OFF
ENABLE_PROBES_UNIX:BOOL=ON
ENABLE_PROBES_WINDOWS:BOOL=OFF
ENABLE_PYTHON3:BOOL=ON
ENABLE_SCE:BOOL=ON
ENABLE_TESTS:BOOL=ON
ENABLE_VALGRIND:BOOL=OFF
ENV_PRESENT:FILEPATH=/usr/bin/env
GCONF_INCLUDE_DIR:PATH=GCONF_INCLUDE_DIR-NOTFOUND
GCONF_LIBRARY:FILEPATH=
GIT_EXECUTABLE:FILEPATH=/usr/bin/git
LIBXSLT_EXSLT_INCLUDE_DIR:PATH=/usr/include
LIBXSLT_LIBRARY:FILEPATH=/usr/lib64/libxslt.so
OPENDBX_INCLUDE_DIR:PATH=OPENDBX_INCLUDE_DIR-NOTFOUND
OPENDBX_LIBRARY:FILEPATH=OPENDBX_LIBRARY-NOTFOUND
OPENSCAP_ENABLE_MD5:BOOL=ON
OPENSCAP_ENABLE_SHA1:BOOL=ON
OPENSCAP_PROBE_INDEPENDENT_ENVIRONMENTVARIABLE:BOOL=ON
OPENSCAP_PROBE_INDEPENDENT_ENVIRONMENTVARIABLE58:BOOL=ON
OPENSCAP_PROBE_INDEPENDENT_FAMILY:BOOL=ON
OPENSCAP_PROBE_INDEPENDENT_FILEHASH:BOOL=ON
OPENSCAP_PROBE_INDEPENDENT_FILEHASH58:BOOL=ON
OPENSCAP_PROBE_INDEPENDENT_SYSTEM_INFO:BOOL=ON
OPENSCAP_PROBE_INDEPENDENT_TEXTFILECONTENT:BOOL=ON
OPENSCAP_PROBE_INDEPENDENT_TEXTFILECONTENT54:BOOL=ON
OPENSCAP_PROBE_INDEPENDENT_VARIABLE:BOOL=ON
OPENSCAP_PROBE_INDEPENDENT_XMLFILECONTENT:BOOL=ON
OPENSCAP_PROBE_LINUX_IFLISTENERS:BOOL=ON
OPENSCAP_PROBE_LINUX_INETLISTENINGSERVERS:BOOL=ON
OPENSCAP_PROBE_LINUX_PARTITION:BOOL=ON
OPENSCAP_PROBE_LINUX_RPMINFO:BOOL=ON
OPENSCAP_PROBE_LINUX_RPMVERIFY:BOOL=ON
OPENSCAP_PROBE_LINUX_RPMVERIFYFILE:BOOL=ON
OPENSCAP_PROBE_LINUX_RPMVERIFYPACKAGE:BOOL=ON
OPENSCAP_PROBE_LINUX_SELINUXBOOLEAN:BOOL=ON
OPENSCAP_PROBE_LINUX_SELINUXSECURITYCONTEXT:BOOL=ON
OPENSCAP_PROBE_LINUX_SYSTEMDUNITDEPENDENCY:BOOL=ON
OPENSCAP_PROBE_LINUX_SYSTEMDUNITPROPERTY:BOOL=ON
OPENSCAP_PROBE_UNIX_DNSCACHE:BOOL=ON
OPENSCAP_PROBE_UNIX_FILE:BOOL=ON
OPENSCAP_PROBE_UNIX_FILEEXTENDEDATTRIBUTE:BOOL=ON
OPENSCAP_PROBE_UNIX_INTERFACE:BOOL=ON
OPENSCAP_PROBE_UNIX_PASSWORD:BOOL=ON
OPENSCAP_PROBE_UNIX_PROCESS:BOOL=ON
OPENSCAP_PROBE_UNIX_PROCESS58:BOOL=ON
OPENSCAP_PROBE_UNIX_ROUTINGTABLE:BOOL=ON
OPENSCAP_PROBE_UNIX_RUNLEVEL:BOOL=ON
OPENSCAP_PROBE_UNIX_SHADOW:BOOL=ON
OPENSCAP_PROBE_UNIX_SYMLINK:BOOL=ON
OPENSCAP_PROBE_UNIX_SYSCTL:BOOL=ON
OPENSCAP_PROBE_UNIX_UNAME:BOOL=ON
OPENSCAP_PROBE_UNIX_XINETD:BOOL=ON
OSCAP_DOCKER_PYTHON:STRING=/usr/bin/python3
OSCAP_TEMP_DIR:STRING=/tmp
PROCPS_INCLUDE_DIR:PATH=PROCPS_INCLUDE_DIR-NOTFOUND
PROCPS_LIBRARY:FILEPATH=PROCPS_LIBRARY-NOTFOUND
SEAP_MSGID_BITS:STRING=32
SED_EXECUTABLE:FILEPATH=/usr/bin/sed
VALGRIND_PRESENT:FILEPATH=/usr/bin/valgrind
WANT_BASE64:BOOL=TRUE
WANT_XBASE64:BOOL=FALSE
WITH_CRYPTO:STRING=gcrypt

kloczek avatar May 31 '22 08:05 kloczek

Actual Results:

ctest output

Running tests...
/usr/bin/ctest --force-new-ctest-process --output-on-failure
Test project /home/tkloczko/rpmbuild/BUILD/openscap-1.3.6/x86_64-redhat-linux-gnu
        Start   1: API/CPE/dict/test_api_cpe_dict.sh
  1/264 Test   #1: API/CPE/dict/test_api_cpe_dict.sh ..................................................   Passed   26.41 sec
        Start   2: API/CPE/inbuilt/all.sh
  2/264 Test   #2: API/CPE/inbuilt/all.sh .............................................................   Passed    0.32 sec
        Start   3: API/CPE/lang/test_api_cpe_lang.sh
  3/264 Test   #3: API/CPE/lang/test_api_cpe_lang.sh ..................................................   Passed    0.25 sec
        Start   4: API/CPE/name/test_api_cpe_uri.sh
  4/264 Test   #4: API/CPE/name/test_api_cpe_uri.sh ...................................................   Passed   67.85 sec
        Start   5: API/crypt/test_api_crypt.sh
  5/264 Test   #5: API/crypt/test_api_crypt.sh ........................................................   Passed    0.73 sec
        Start   6: API/CVE/test_api_cve.sh
  6/264 Test   #6: API/CVE/test_api_cve.sh ............................................................   Passed    1.50 sec
        Start   7: API/CVRF/test_api_cvrf.sh
  7/264 Test   #7: API/CVRF/test_api_cvrf.sh ..........................................................   Passed    0.22 sec
        Start   8: API/CVSS/test_api_cvss.sh
  8/264 Test   #8: API/CVSS/test_api_cvss.sh ..........................................................   Passed    0.10 sec
        Start   9: API/OVAL/test_api_oval.sh
  9/264 Test   #9: API/OVAL/test_api_oval.sh ..........................................................   Passed    0.21 sec
        Start  10: API/OVAL/glob_to_regex/test_glob_to_regex.sh
 10/264 Test  #10: API/OVAL/glob_to_regex/test_glob_to_regex.sh .......................................   Passed    0.10 sec
        Start  11: API/OVAL/report_variable_values/all.sh
 11/264 Test  #11: API/OVAL/report_variable_values/all.sh .............................................   Passed    8.98 sec
        Start  12: API/OVAL/schema_version/test_schema_version.sh
 12/264 Test  #12: API/OVAL/schema_version/test_schema_version.sh .....................................   Passed    0.47 sec
        Start  13: API/OVAL/unittests/test_anyxml.sh
 13/264 Test  #13: API/OVAL/unittests/test_anyxml.sh ..................................................   Passed    1.24 sec
        Start  14: API/OVAL/unittests/test_applicability_check.sh
 14/264 Test  #14: API/OVAL/unittests/test_applicability_check.sh .....................................   Passed    0.77 sec
        Start  15: API/OVAL/unittests/test_cim_datetime.sh
 15/264 Test  #15: API/OVAL/unittests/test_cim_datetime.sh ............................................   Passed    0.86 sec
        Start  16: API/OVAL/unittests/test_circular_extend_def.sh
 16/264 Test  #16: API/OVAL/unittests/test_circular_extend_def.sh .....................................   Passed    0.51 sec
        Start  17: API/OVAL/unittests/test_comment.sh
 17/264 Test  #17: API/OVAL/unittests/test_comment.sh .................................................   Passed    0.41 sec
        Start  18: API/OVAL/unittests/test_count_function.sh
 18/264 Test  #18: API/OVAL/unittests/test_count_function.sh ..........................................   Passed    0.25 sec
        Start  19: API/OVAL/unittests/test_deprecated_def.sh
 19/264 Test  #19: API/OVAL/unittests/test_deprecated_def.sh ..........................................   Passed    0.89 sec
        Start  20: API/OVAL/unittests/test_directives.sh
 20/264 Test  #20: API/OVAL/unittests/test_directives.sh ..............................................   Passed    0.82 sec
        Start  21: API/OVAL/unittests/test_empty_filename.sh
 21/264 Test  #21: API/OVAL/unittests/test_empty_filename.sh ..........................................   Passed    0.30 sec
        Start  22: API/OVAL/unittests/test_envvar_insensitive_equals.sh
 22/264 Test  #22: API/OVAL/unittests/test_envvar_insensitive_equals.sh ...............................   Passed    1.89 sec
        Start  23: API/OVAL/unittests/test_evr_string_comparison.sh
 23/264 Test  #23: API/OVAL/unittests/test_evr_string_comparison.sh ...................................   Passed    1.96 sec
        Start  24: API/OVAL/unittests/test_evr_string_missing_epoch.sh
 24/264 Test  #24: API/OVAL/unittests/test_evr_string_missing_epoch.sh ................................   Passed    1.97 sec
        Start  25: API/OVAL/unittests/test_external_variable.sh
 25/264 Test  #25: API/OVAL/unittests/test_external_variable.sh .......................................   Passed    7.39 sec
        Start  26: API/OVAL/unittests/test_filecontent_line.sh
 26/264 Test  #26: API/OVAL/unittests/test_filecontent_line.sh ........................................   Passed    3.34 sec
        Start  27: API/OVAL/unittests/test_float_comparison.sh
 27/264 Test  #27: API/OVAL/unittests/test_float_comparison.sh ........................................   Passed    2.45 sec
        Start  28: API/OVAL/unittests/test_glob_to_regex.sh
 28/264 Test  #28: API/OVAL/unittests/test_glob_to_regex.sh ...........................................   Passed    0.44 sec
        Start  29: API/OVAL/unittests/test_int_comparison.sh
 29/264 Test  #29: API/OVAL/unittests/test_int_comparison.sh ..........................................   Passed    2.02 sec
        Start  30: API/OVAL/unittests/test_invalid_regex.sh
 30/264 Test  #30: API/OVAL/unittests/test_invalid_regex.sh ...........................................   Passed    0.34 sec
        Start  31: API/OVAL/unittests/test_ipv4_comparison.sh
 31/264 Test  #31: API/OVAL/unittests/test_ipv4_comparison.sh .........................................   Passed    9.69 sec
        Start  32: API/OVAL/unittests/test_ipv4_subset_of.sh
 32/264 Test  #32: API/OVAL/unittests/test_ipv4_subset_of.sh ..........................................   Passed    9.88 sec
        Start  33: API/OVAL/unittests/test_ipv4_super_set_of.sh
 33/264 Test  #33: API/OVAL/unittests/test_ipv4_super_set_of.sh .......................................   Passed    9.71 sec
        Start  34: API/OVAL/unittests/test_ipv6_subset_of.sh
 34/264 Test  #34: API/OVAL/unittests/test_ipv6_subset_of.sh ..........................................   Passed    9.81 sec
        Start  35: API/OVAL/unittests/test_ipv6_super_set_of.sh
 35/264 Test  #35: API/OVAL/unittests/test_ipv6_super_set_of.sh .......................................   Passed    9.85 sec
        Start  36: API/OVAL/unittests/test_item_not_exist.sh
 36/264 Test  #36: API/OVAL/unittests/test_item_not_exist.sh ..........................................   Passed    0.39 sec
        Start  37: API/OVAL/unittests/test_object_component_type.sh
 37/264 Test  #37: API/OVAL/unittests/test_object_component_type.sh ...................................   Passed    0.19 sec
        Start  38: API/OVAL/unittests/test_oval_empty_variable_evaluation.sh
 38/264 Test  #38: API/OVAL/unittests/test_oval_empty_variable_evaluation.sh ..........................   Passed    1.06 sec
        Start  39: API/OVAL/unittests/test_platform_version.sh
 39/264 Test  #39: API/OVAL/unittests/test_platform_version.sh ........................................   Passed    1.52 sec
        Start  40: API/OVAL/unittests/test_recursive_extend_def.sh
 40/264 Test  #40: API/OVAL/unittests/test_recursive_extend_def.sh ....................................   Passed    0.22 sec
        Start  41: API/OVAL/unittests/test_skip_valid.sh
 41/264 Test  #41: API/OVAL/unittests/test_skip_valid.sh ..............................................   Passed    0.14 sec
        Start  42: API/OVAL/unittests/test_state_check_existence.sh
 42/264 Test  #42: API/OVAL/unittests/test_state_check_existence.sh ...................................   Passed    1.72 sec
        Start  43: API/OVAL/unittests/test_statetype_operator.sh
 43/264 Test  #43: API/OVAL/unittests/test_statetype_operator.sh ......................................   Passed    1.75 sec
        Start  44: API/OVAL/unittests/test_variable_conversion.sh
 44/264 Test  #44: API/OVAL/unittests/test_variable_conversion.sh .....................................   Passed    0.57 sec
        Start  45: API/OVAL/unittests/test_without_syschars.sh
 45/264 Test  #45: API/OVAL/unittests/test_without_syschars.sh ........................................   Passed    0.72 sec
        Start  46: API/OVAL/unittests/test_xmlns_missing.sh
 46/264 Test  #46: API/OVAL/unittests/test_xmlns_missing.sh ...........................................   Passed    0.12 sec
        Start  47: API/OVAL/unittests/test_xsinil_envv58_pid.sh
 47/264 Test  #47: API/OVAL/unittests/test_xsinil_envv58_pid.sh .......................................   Passed    1.06 sec
        Start  48: API/OVAL/validate/all.sh
 48/264 Test  #48: API/OVAL/validate/all.sh ...........................................................   Passed    0.75 sec
        Start  49: API/probes/test_api_probes_smoke.sh
 49/264 Test  #49: API/probes/test_api_probes_smoke.sh ................................................   Passed    0.07 sec
        Start  50: API/probes/test_fsdev_is_local_fs.sh
 50/264 Test  #50: API/probes/test_fsdev_is_local_fs.sh ...............................................   Passed    0.08 sec
        Start  51: API/probes/fts.sh
 51/264 Test  #51: API/probes/fts.sh ..................................................................   Passed    1.15 sec
        Start  52: API/SEAP/test_api_seap.sh
 52/264 Test  #52: API/SEAP/test_api_seap.sh ..........................................................   Passed    2.57 sec
        Start  53: API/XCCDF/applicability/test_xccdf_cpe_eval.sh
 53/264 Test  #53: API/XCCDF/applicability/test_xccdf_cpe_eval.sh .....................................   Passed    1.80 sec
        Start  54: API/XCCDF/applicability/test_xccdf_cpe2_eval.sh
 54/264 Test  #54: API/XCCDF/applicability/test_xccdf_cpe2_eval.sh ....................................   Passed    0.46 sec
        Start  55: API/XCCDF/applicability/test_xccdf_embedded_cpe_eval.sh
 55/264 Test  #55: API/XCCDF/applicability/test_xccdf_embedded_cpe_eval.sh ............................   Passed    1.97 sec
        Start  56: API/XCCDF/applicability/test_platform_element.sh
 56/264 Test  #56: API/XCCDF/applicability/test_platform_element.sh ...................................   Passed    0.59 sec
        Start  57: API/XCCDF/applicability/test_platform_inheritance.sh
 57/264 Test  #57: API/XCCDF/applicability/test_platform_inheritance.sh ...............................   Passed    0.97 sec
        Start  58: API/XCCDF/applicability/test_remediate_fix_notapplicable.sh
 58/264 Test  #58: API/XCCDF/applicability/test_remediate_fix_notapplicable.sh ........................   Passed    3.32 sec
        Start  59: API/XCCDF/applicability/test_remediate_fix_processing.sh
 59/264 Test  #59: API/XCCDF/applicability/test_remediate_fix_processing.sh ...........................   Passed    4.53 sec
        Start  60: API/XCCDF/applicability/test_remediate_fix_processing_ds.sh
 60/264 Test  #60: API/XCCDF/applicability/test_remediate_fix_processing_ds.sh ........................   Passed    4.70 sec
        Start  61: API/XCCDF/applicability/test_report_anaconda_fixes.sh
 61/264 Test  #61: API/XCCDF/applicability/test_report_anaconda_fixes.sh ..............................   Passed    0.34 sec
        Start  62: API/XCCDF/default_cpe/test_cpe_applicability.sh
 62/264 Test  #62: API/XCCDF/default_cpe/test_cpe_applicability.sh ....................................   Passed    0.76 sec
        Start  63: API/XCCDF/fix/all.sh
 63/264 Test  #63: API/XCCDF/fix/all.sh ...............................................................   Passed    0.17 sec
        Start  64: API/XCCDF/guide/benchmark.sh
 64/264 Test  #64: API/XCCDF/guide/benchmark.sh .......................................................   Passed    0.39 sec
        Start  65: API/XCCDF/guide/guide.sh
 65/264 Test  #65: API/XCCDF/guide/guide.sh ...........................................................   Passed    0.27 sec
        Start  66: API/XCCDF/guide/profile.sh
 66/264 Test  #66: API/XCCDF/guide/profile.sh .........................................................   Passed    0.31 sec
        Start  67: API/XCCDF/parser/test_api_xccdf.sh
 67/264 Test  #67: API/XCCDF/parser/test_api_xccdf.sh .................................................   Passed    1.60 sec
        Start  68: API/XCCDF/parser/test_extensions.sh
 68/264 Test  #68: API/XCCDF/parser/test_extensions.sh ................................................   Passed    0.39 sec
        Start  69: API/XCCDF/progress/all.sh
 69/264 Test  #69: API/XCCDF/progress/all.sh ..........................................................   Passed    0.65 sec
        Start  70: API/XCCDF/report/all.sh
 70/264 Test  #70: API/XCCDF/report/all.sh ............................................................   Passed    0.48 sec
        Start  71: API/XCCDF/result_files/all.sh
 71/264 Test  #71: API/XCCDF/result_files/all.sh ......................................................   Passed    0.39 sec
        Start  72: API/XCCDF/tailoring/all.sh
 72/264 Test  #72: API/XCCDF/tailoring/all.sh .........................................................   Passed    5.58 sec
        Start  73: API/XCCDF/unittests/all_python.sh
 73/264 Test  #73: API/XCCDF/unittests/all_python.sh ..................................................   Passed    2.78 sec
        Start  74: API/XCCDF/unittests/test_ansible_yaml_block_scalar.sh
 74/264 Test  #74: API/XCCDF/unittests/test_ansible_yaml_block_scalar.sh ..............................   Passed    0.15 sec
        Start  75: API/XCCDF/unittests/test_xccdf_shall_pass1.sh
 75/264 Test  #75: API/XCCDF/unittests/test_xccdf_shall_pass1.sh ......................................   Passed    0.10 sec
        Start  76: API/XCCDF/unittests/test_xccdf_shall_pass2.sh
 76/264 Test  #76: API/XCCDF/unittests/test_xccdf_shall_pass2.sh ......................................   Passed    0.10 sec
        Start  77: API/XCCDF/unittests/test_xccdf_shall_pass3.sh
 77/264 Test  #77: API/XCCDF/unittests/test_xccdf_shall_pass3.sh ......................................   Passed    0.10 sec
        Start  78: API/XCCDF/unittests/test_oscap_common.sh
 78/264 Test  #78: API/XCCDF/unittests/test_oscap_common.sh ...........................................   Passed    0.09 sec
        Start  79: API/XCCDF/unittests/test_xccdf_overrides.sh
 79/264 Test  #79: API/XCCDF/unittests/test_xccdf_overrides.sh ........................................   Passed    4.76 sec
        Start  80: API/XCCDF/unittests/test_xccdf_role_unscored.sh
 80/264 Test  #80: API/XCCDF/unittests/test_xccdf_role_unscored.sh ....................................   Passed    1.01 sec
        Start  81: API/XCCDF/unittests/test_remediate_unresolved.sh
 81/264 Test  #81: API/XCCDF/unittests/test_remediate_unresolved.sh ...................................   Passed    1.55 sec
        Start  82: API/XCCDF/unittests/test_empty_variable.sh
 82/264 Test  #82: API/XCCDF/unittests/test_empty_variable.sh .........................................   Passed    0.75 sec
        Start  83: API/XCCDF/unittests/test_fix_instance.sh
 83/264 Test  #83: API/XCCDF/unittests/test_fix_instance.sh ...........................................   Passed    1.63 sec
        Start  84: API/XCCDF/unittests/test_xccdf_xml_escaping_value.sh
 84/264 Test  #84: API/XCCDF/unittests/test_xccdf_xml_escaping_value.sh ...............................   Passed    0.14 sec
        Start  85: API/XCCDF/unittests/test_xccdf_check_negate.sh
 85/264 Test  #85: API/XCCDF/unittests/test_xccdf_check_negate.sh .....................................   Passed    0.61 sec
        Start  86: API/XCCDF/unittests/test_xccdf_check_multi_check.sh
 86/264 Test  #86: API/XCCDF/unittests/test_xccdf_check_multi_check.sh ................................   Passed    0.68 sec
        Start  87: API/XCCDF/unittests/test_xccdf_check_multi_check2.sh
 87/264 Test  #87: API/XCCDF/unittests/test_xccdf_check_multi_check2.sh ...............................   Passed    1.49 sec
        Start  88: API/XCCDF/unittests/test_xccdf_check_multi_check_zero_definitions.sh
 88/264 Test  #88: API/XCCDF/unittests/test_xccdf_check_multi_check_zero_definitions.sh ...............   Passed    1.88 sec
        Start  89: API/XCCDF/unittests/test_xccdf_check_ocil.sh
 89/264 Test  #89: API/XCCDF/unittests/test_xccdf_check_ocil.sh .......................................   Passed    0.31 sec
        Start  90: API/XCCDF/unittests/test_xccdf_check_content_ref_without_name_attr.sh
 90/264 Test  #90: API/XCCDF/unittests/test_xccdf_check_content_ref_without_name_attr.sh ..............   Passed    0.86 sec
        Start  91: API/XCCDF/unittests/test_xccdf_check_without_content_refs.sh
 91/264 Test  #91: API/XCCDF/unittests/test_xccdf_check_without_content_refs.sh .......................   Passed    0.64 sec
        Start  92: API/XCCDF/unittests/test_xccdf_refine_rule.sh
 92/264 Test  #92: API/XCCDF/unittests/test_xccdf_refine_rule.sh ......................................   Passed    0.97 sec
        Start  93: API/XCCDF/unittests/test_xccdf_refine_rule_refine.sh
 93/264 Test  #93: API/XCCDF/unittests/test_xccdf_refine_rule_refine.sh ...............................   Passed    4.00 sec
        Start  94: API/XCCDF/unittests/test_xccdf_fix_attr_export.sh
 94/264 Test  #94: API/XCCDF/unittests/test_xccdf_fix_attr_export.sh ..................................   Passed    1.91 sec
        Start  95: API/XCCDF/unittests/test_xccdf_complex_check_and_notchecked.sh
 95/264 Test  #95: API/XCCDF/unittests/test_xccdf_complex_check_and_notchecked.sh .....................   Passed    1.07 sec
        Start  96: API/XCCDF/unittests/test_xccdf_check_processing_complex_priority.sh
 96/264 Test  #96: API/XCCDF/unittests/test_xccdf_check_processing_complex_priority.sh ................   Passed    2.24 sec
        Start  97: API/XCCDF/unittests/test_xccdf_check_processing_selector_bad.sh
 97/264 Test  #97: API/XCCDF/unittests/test_xccdf_check_processing_selector_bad.sh ....................   Passed    0.75 sec
        Start  98: API/XCCDF/unittests/test_xccdf_check_processing_selector_empty.sh
 98/264 Test  #98: API/XCCDF/unittests/test_xccdf_check_processing_selector_empty.sh ..................   Passed    0.85 sec
        Start  99: API/XCCDF/unittests/test_xccdf_check_processing_invalid_content_refs.sh
 99/264 Test  #99: API/XCCDF/unittests/test_xccdf_check_processing_invalid_content_refs.sh ............   Passed    1.94 sec
        Start 100: API/XCCDF/unittests/test_xccdf_notchecked_has_check.sh
100/264 Test #100: API/XCCDF/unittests/test_xccdf_notchecked_has_check.sh .............................   Passed    0.60 sec
        Start 101: API/XCCDF/unittests/test_xccdf_role_unchecked.sh
101/264 Test #101: API/XCCDF/unittests/test_xccdf_role_unchecked.sh ...................................   Passed    0.61 sec
        Start 102: API/XCCDF/unittests/test_xccdf_oval_absolute_path.sh
102/264 Test #102: API/XCCDF/unittests/test_xccdf_oval_absolute_path.sh ...............................   Passed    1.16 sec
        Start 103: API/XCCDF/unittests/test_xccdf_oval_relative_path.sh
103/264 Test #103: API/XCCDF/unittests/test_xccdf_oval_relative_path.sh ...............................   Passed    1.13 sec
        Start 104: API/XCCDF/unittests/test_xccdf_selectors_cluster1.sh
104/264 Test #104: API/XCCDF/unittests/test_xccdf_selectors_cluster1.sh ...............................   Passed    0.94 sec
        Start 105: API/XCCDF/unittests/test_xccdf_selectors_cluster2.sh
105/264 Test #105: API/XCCDF/unittests/test_xccdf_selectors_cluster2.sh ...............................   Passed    1.41 sec
        Start 106: API/XCCDF/unittests/test_xccdf_selectors_cluster3.sh
106/264 Test #106: API/XCCDF/unittests/test_xccdf_selectors_cluster3.sh ...............................   Passed    2.03 sec
        Start 107: API/XCCDF/unittests/test_deriving_xccdf_result_from_oval.sh
107/264 Test #107: API/XCCDF/unittests/test_deriving_xccdf_result_from_oval.sh ........................   Passed    1.44 sec
        Start 108: API/XCCDF/unittests/test_deriving_xccdf_result_from_oval2.sh
108/264 Test #108: API/XCCDF/unittests/test_deriving_xccdf_result_from_oval2.sh .......................   Passed    1.45 sec
        Start 109: API/XCCDF/unittests/test_oval_without_definition.sh
109/264 Test #109: API/XCCDF/unittests/test_oval_without_definition.sh ................................   Passed    0.69 sec
        Start 110: API/XCCDF/unittests/test_deriving_xccdf_result_from_oval_multicheck.sh
110/264 Test #110: API/XCCDF/unittests/test_deriving_xccdf_result_from_oval_multicheck.sh .............   Passed    1.40 sec
        Start 111: API/XCCDF/unittests/test_multiple_oval_files_with_same_basename.sh
111/264 Test #111: API/XCCDF/unittests/test_multiple_oval_files_with_same_basename.sh .................   Passed    3.96 sec
        Start 112: API/XCCDF/unittests/test_xccdf_check_unsupported_check_system.sh
112/264 Test #112: API/XCCDF/unittests/test_xccdf_check_unsupported_check_system.sh ...................   Passed    0.25 sec
        Start 113: API/XCCDF/unittests/test_xccdf_multiple_testresults.sh
113/264 Test #113: API/XCCDF/unittests/test_xccdf_multiple_testresults.sh .............................   Passed    3.93 sec
        Start 114: API/XCCDF/unittests/test_default_selector.sh
114/264 Test #114: API/XCCDF/unittests/test_default_selector.sh .......................................   Passed    1.81 sec
        Start 115: API/XCCDF/unittests/test_inherit_selector.sh
115/264 Test #115: API/XCCDF/unittests/test_inherit_selector.sh .......................................   Passed    0.95 sec
        Start 116: API/XCCDF/unittests/test_xccdf_refine_value_bad.sh
116/264 Test #116: API/XCCDF/unittests/test_xccdf_refine_value_bad.sh .................................   Passed    0.31 sec
        Start 117: API/XCCDF/unittests/test_xccdf_resolve.sh
117/264 Test #117: API/XCCDF/unittests/test_xccdf_resolve.sh ..........................................   Passed    1.38 sec
        Start 118: API/XCCDF/unittests/test_xccdf_resolve_profile_platform.sh
118/264 Test #118: API/XCCDF/unittests/test_xccdf_resolve_profile_platform.sh .........................   Passed    0.39 sec
        Start 119: API/XCCDF/unittests/test_xccdf_results_arf_no_oval.sh
119/264 Test #119: API/XCCDF/unittests/test_xccdf_results_arf_no_oval.sh ..............................   Passed    0.30 sec
        Start 120: API/XCCDF/unittests/test_xccdf_results_arf_asset.sh
120/264 Test #120: API/XCCDF/unittests/test_xccdf_results_arf_asset.sh ................................   Passed    0.90 sec
        Start 121: API/XCCDF/unittests/test_xccdf_sub_title.sh
121/264 Test #121: API/XCCDF/unittests/test_xccdf_sub_title.sh ........................................   Passed    1.02 sec
        Start 122: API/XCCDF/unittests/test_xccdf_test_system.sh
122/264 Test #122: API/XCCDF/unittests/test_xccdf_test_system.sh ......................................   Passed    0.54 sec
        Start 123: API/XCCDF/unittests/test_profile_selection_by_suffix.sh
123/264 Test #123: API/XCCDF/unittests/test_profile_selection_by_suffix.sh ............................   Passed    0.94 sec
        Start 124: API/XCCDF/unittests/test_unfinished.sh
124/264 Test #124: API/XCCDF/unittests/test_unfinished.sh .............................................   Passed    0.17 sec
        Start 125: API/XCCDF/unittests/test_xccdf_transformation.sh
125/264 Test #125: API/XCCDF/unittests/test_xccdf_transformation.sh ...................................   Passed    0.58 sec
        Start 126: API/XCCDF/unittests/test_single_rule.sh
126/264 Test #126: API/XCCDF/unittests/test_single_rule.sh ............................................   Passed    4.85 sec
        Start 127: API/XCCDF/unittests/test_single_rule_stigw.sh
127/264 Test #127: API/XCCDF/unittests/test_single_rule_stigw.sh ......................................   Passed    0.38 sec
        Start 128: API/XCCDF/unittests/test_remediation_simple.sh
128/264 Test #128: API/XCCDF/unittests/test_remediation_simple.sh .....................................   Passed    1.74 sec
        Start 129: API/XCCDF/unittests/test_remediation_offline.sh
129/264 Test #129: API/XCCDF/unittests/test_remediation_offline.sh ....................................***Skipped   0.09 sec
        Start 130: API/XCCDF/unittests/test_remediation_metadata.sh
130/264 Test #130: API/XCCDF/unittests/test_remediation_metadata.sh ...................................   Passed    0.19 sec
        Start 131: API/XCCDF/unittests/test_remediation_blueprint.sh
131/264 Test #131: API/XCCDF/unittests/test_remediation_blueprint.sh ..................................   Passed    0.15 sec
        Start 132: API/XCCDF/unittests/test_remediation_bad_fix.sh
132/264 Test #132: API/XCCDF/unittests/test_remediation_bad_fix.sh ....................................   Passed    1.82 sec
        Start 133: API/XCCDF/unittests/test_remediation_subs_plain_text.sh
133/264 Test #133: API/XCCDF/unittests/test_remediation_subs_plain_text.sh ............................   Passed    2.64 sec
        Start 134: API/XCCDF/unittests/test_remediation_subs_plain_text_empty.sh
134/264 Test #134: API/XCCDF/unittests/test_remediation_subs_plain_text_empty.sh ......................   Passed    2.63 sec
        Start 135: API/XCCDF/unittests/test_remediation_subs_value_refine_value.sh
135/264 Test #135: API/XCCDF/unittests/test_remediation_subs_value_refine_value.sh ....................   Passed    3.01 sec
        Start 136: API/XCCDF/unittests/test_remediation_subs_value_take_first.sh
136/264 Test #136: API/XCCDF/unittests/test_remediation_subs_value_take_first.sh ......................   Passed    3.13 sec
        Start 137: API/XCCDF/unittests/test_remediation_subs_value_without_selector.sh
137/264 Test #137: API/XCCDF/unittests/test_remediation_subs_value_without_selector.sh ................   Passed    3.17 sec
        Start 138: API/XCCDF/unittests/test_remediation_subs_value_title.sh
138/264 Test #138: API/XCCDF/unittests/test_remediation_subs_value_title.sh ...........................   Passed    3.40 sec
        Start 139: API/XCCDF/unittests/test_remediation_amp_escaping.sh
139/264 Test #139: API/XCCDF/unittests/test_remediation_amp_escaping.sh ...............................   Passed    2.37 sec
        Start 140: API/XCCDF/unittests/test_remediation_xml_comments.sh
140/264 Test #140: API/XCCDF/unittests/test_remediation_xml_comments.sh ...............................   Passed    2.38 sec
        Start 141: API/XCCDF/unittests/test_remediation_cdata.sh
141/264 Test #141: API/XCCDF/unittests/test_remediation_cdata.sh ......................................   Passed    2.39 sec
        Start 142: API/XCCDF/unittests/test_remediation_subs_unresolved.sh
142/264 Test #142: API/XCCDF/unittests/test_remediation_subs_unresolved.sh ............................   Passed    2.54 sec
        Start 143: API/XCCDF/unittests/test_remediation_fix_without_system.sh
143/264 Test #143: API/XCCDF/unittests/test_remediation_fix_without_system.sh .........................   Passed    0.87 sec
        Start 144: API/XCCDF/unittests/test_remediation_invalid_characters.sh
144/264 Test #144: API/XCCDF/unittests/test_remediation_invalid_characters.sh .........................   Passed    0.46 sec
        Start 145: API/XCCDF/unittests/test_remediate_simple.sh
145/264 Test #145: API/XCCDF/unittests/test_remediate_simple.sh .......................................   Passed    7.23 sec
        Start 146: API/XCCDF/unittests/test_remediate_perl.sh
146/264 Test #146: API/XCCDF/unittests/test_remediate_perl.sh .........................................   Passed    0.96 sec
        Start 147: API/XCCDF/unittests/test_report_check_with_empty_selector.sh
147/264 Test #147: API/XCCDF/unittests/test_report_check_with_empty_selector.sh .......................   Passed    0.16 sec
        Start 148: API/XCCDF/unittests/test_report_without_xsl_fails_gracefully.sh
148/264 Test #148: API/XCCDF/unittests/test_report_without_xsl_fails_gracefully.sh ....................   Passed    0.13 sec
        Start 149: API/XCCDF/unittests/test_report_without_oval_poses_no_errors.sh
149/264 Test #149: API/XCCDF/unittests/test_report_without_oval_poses_no_errors.sh ....................   Passed    0.15 sec
        Start 150: API/XCCDF/unittests/test_report_anaconda_fixes.sh
150/264 Test #150: API/XCCDF/unittests/test_report_anaconda_fixes.sh ..................................   Passed    0.42 sec
        Start 151: API/XCCDF/unittests/test_report_anaconda_fixes_ds.sh
151/264 Test #151: API/XCCDF/unittests/test_report_anaconda_fixes_ds.sh ...............................   Passed    0.74 sec
        Start 152: API/XCCDF/unittests/test_fix_filtering.sh
152/264 Test #152: API/XCCDF/unittests/test_fix_filtering.sh ..........................................   Passed    0.16 sec
        Start 153: API/XCCDF/unittests/test_fix_script_header.sh
153/264 Test #153: API/XCCDF/unittests/test_fix_script_header.sh ......................................   Passed    0.87 sec
        Start 154: API/XCCDF/unittests/test_fix_arf.sh
154/264 Test #154: API/XCCDF/unittests/test_fix_arf.sh ................................................   Passed    1.05 sec
        Start 155: API/XCCDF/unittests/test_fix_resultid_by_suffix.sh
155/264 Test #155: API/XCCDF/unittests/test_fix_resultid_by_suffix.sh .................................   Passed    0.24 sec
        Start 156: API/XCCDF/unittests/test_generate_fix_ansible_vars.sh
156/264 Test #156: API/XCCDF/unittests/test_generate_fix_ansible_vars.sh ..............................   Passed    0.45 sec
        Start 157: API/XCCDF/unittests/test_xccdf_requires_conflicts.sh
157/264 Test #157: API/XCCDF/unittests/test_xccdf_requires_conflicts.sh ...............................   Passed   16.60 sec
        Start 158: API/XCCDF/unittests/test_results_hostname.sh
158/264 Test #158: API/XCCDF/unittests/test_results_hostname.sh .......................................   Passed    1.12 sec
        Start 159: API/XCCDF/unittests/test_skip_rule.sh
159/264 Test #159: API/XCCDF/unittests/test_skip_rule.sh ..............................................   Passed    2.95 sec
        Start 160: API/XCCDF/variable_instance/all.sh
160/264 Test #160: API/XCCDF/variable_instance/all.sh .................................................   Passed   27.21 sec
        Start 161: bindings/test_python.sh
161/264 Test #161: bindings/test_python.sh ............................................................   Passed    0.81 sec
        Start 162: bz2/test_bz2_datastream.sh
162/264 Test #162: bz2/test_bz2_datastream.sh .........................................................   Passed    1.36 sec
        Start 163: codestyle/all.sh
163/264 Test #163: codestyle/all.sh ...................................................................   Passed    0.18 sec
        Start 164: curl/test_curl_encoding.sh
164/264 Test #164: curl/test_curl_encoding.sh .........................................................   Passed    0.42 sec
        Start 165: CPE/all.sh
165/264 Test #165: CPE/all.sh .........................................................................   Passed    3.07 sec
        Start 166: DS/test_ds_misc.sh
166/264 Test #166: DS/test_ds_misc.sh .................................................................***Failed   10.37 sec
+ sds_external_xccdf_in_ds
TEST: sds_external_xccdf_in_ds
--- Starting Evaluation ---

Title
Rule    xccdf_moc.elpmaxe.www_rule_1
Result  pass

OVAL Results are exported correctly.
XCCDF Results are exported correctly.
Result data stream exported correctly.
RESULT: PASSED

+ sds_external_xccdf
TEST: sds_external_xccdf
--- Starting Evaluation ---

Title
Rule    xccdf_moc.elpmaxe.www_rule_1
Result  pass

OVAL Results are exported correctly.
XCCDF Results are exported correctly.
Result data stream exported correctly.
RESULT: PASSED

+ sds_tailoring
TEST: sds_tailoring
Document type: Source Data Stream
Imported: 2022-01-19T23:00:51

Stream: scap_com.example_datastream_with_checklist
Generated: 2016-09-26T15:00:00
Version: 1.2
Checklists:
        Ref-Id: scap_com.example_cref_xccdf_01
                Status: incomplete
                Resolved: false
                Profiles:
                Referenced check files:
                        oval
                                system: http://oval.mitre.org/XMLSchema/oval-definitions-5
Checks:
        Ref-Id: scap_com.example_cref_oval_01
No dictionaries.

Stream: scap_com.example_datastream_with_tailoring
Generated: 2016-05-09T15:00:00
Version: 1.2
Checklists:
        Ref-Id: scap_com.example_cref_tailoring_01
                Benchmark Hint: #scap_com.example_cref_xccdf_01
                Profiles:
                        Title: Tailoring profile
                                Id: xccdf_com.example_profile_tailoring
        Ref-Id: scap_com.example_cref_xccdf_01-source
                Status: incomplete
                Resolved: false
                Profiles:
                Referenced check files:
                        oval
                                system: http://oval.mitre.org/XMLSchema/oval-definitions-5
Checks:
        Ref-Id: scap_com.example_cref_oval_01-source
No dictionaries.
--- Starting Evaluation ---

Title   Rule 2
Rule    xccdf_com.example_rule_2
Result  pass

XCCDF Results are exported correctly.
RESULT: PASSED

+ eval_simple
TEST: eval_simple
--- Starting Evaluation ---

RESULT: PASSED

+ cpe_in_ds
TEST: cpe_in_ds
--- Starting Evaluation ---

Title   Prelinking Disabled
Rule    xccdf_org.ssgproject.content_rule_disable_prelink
Result  notapplicable

RESULT: PASSED

+ eval_invalid
TEST: eval_invalid
OpenSCAP Error: File '/home/tkloczko/rpmbuild/BUILD/openscap-1.3.6/tests/DS/eval_invalid/sds.xml' line 2: Element '{http://scap.nist.gov/schema/scap/source/1.2}data-stream-collection': Missing child element(s). Expected is ( {http://scap.nist.gov/schema/scap/source/1.2}data-stream ).
 [/home/tkloczko/rpmbuild/BUILD/openscap-1.3.6/src/XCCDF/xccdf_session.c:723]
Invalid SCAP Source Datastream (1.2) content in /home/tkloczko/rpmbuild/BUILD/openscap-1.3.6/tests/DS/eval_invalid/sds.xml. [/home/tkloczko/rpmbuild/BUILD/openscap-1.3.6/src/source/oscap_source.c:353]
Invalid SCAP Source Datastream (1.2) content in /home/tkloczko/rpmbuild/BUILD/openscap-1.3.6/tests/DS/eval_invalid/sds.xml [/home/tkloczko/rpmbuild/BUILD/openscap-1.3.6/src/XCCDF/xccdf_session.c:836]
RESULT: PASSED

+ eval_invalid_oval
TEST: eval_invalid_oval
File '/home/tkloczko/rpmbuild/BUILD/openscap-1.3.6/tests/DS/eval_invalid/sds-oval.xml' line 10: Element '{http://oval.mitre.org/XMLSchema/oval-definitions-5}definitions': This element is not expected. Expected is ( {http://oval.mitre.org/XMLSchema/oval-definitions-5}generator ).
OpenSCAP Error: Invalid SCAP Source Datastream (1.2) content in /home/tkloczko/rpmbuild/BUILD/openscap-1.3.6/tests/DS/eval_invalid/sds-oval.xml. [/home/tkloczko/rpmbuild/BUILD/openscap-1.3.6/src/source/oscap_source.c:353]
RESULT: PASSED

+ eval_xccdf_id1
TEST: eval_xccdf_id1
RESULT: PASSED

+ eval_xccdf_id2
TEST: eval_xccdf_id2
RESULT: PASSED

+ eval_benchmark_id1
TEST: eval_benchmark_id1
RESULT: PASSED

+ eval_benchmark_id2
TEST: eval_benchmark_id2
RESULT: PASSED

+ eval_benchmark_id_conflict
TEST: eval_benchmark_id_conflict
RESULT: PASSED

+ eval_just_oval
TEST: eval_just_oval
Definition oval:x:def:1: true
Evaluation done.
RESULT: PASSED

+ eval_oval_id1
TEST: eval_oval_id1
out: Definition oval:x:def:1: true
Evaluation done.
RESULT: PASSED

+ eval_oval_id2
TEST: eval_oval_id2
out: Definition oval:x:def:2: true
Evaluation done.
RESULT: PASSED

+ eval_cpe
TEST: eval_cpe
RESULT: PASSED

+ test_eval_complex
TEST: test_eval_complex
Rule    xccdf_moc.elpmaxe.www_rule_second
Document type: Result Data Stream
Imported: 2022-05-31T03:24:40

Asset: asset0
        ARF report: xccdf1
                Report request: collection1
                Result ID: xccdf_org.open-scap_testresult_xccdf_moc.elpmaxe.www_profile_2
                Source benchmark: #scap_org.open-scap_comp_second-xccdf.xml2
                Source profile: xccdf_moc.elpmaxe.www_profile_2
                Evaluation started: 2022-05-31T03:24:39+00:00
                Evaluation finished: 2022-05-31T03:24:39+00:00
                Platform CPEs:
                        (none)
Query didn't return a nodeset. Value: Query didn't return a nodeset. Value: Query didn't return a nodeset. Value: Query didn't return a nodeset. Value: RESULT: PASSED

+ sds_add_multiple_oval_twice_in_row
TEST: sds_add_multiple_oval_twice_in_row
~/rpmbuild/BUILD/openscap-1.3.6/tests/DS/sds_multiple_oval ~/rpmbuild/BUILD/openscap-1.3.6/x86_64-redhat-linux-gnu/tests/DS
~/rpmbuild/BUILD/openscap-1.3.6/x86_64-redhat-linux-gnu/tests/DS
/tmp/tmp.7ZDFnQrb9p ~/rpmbuild/BUILD/openscap-1.3.6/x86_64-redhat-linux-gnu/tests/DS
~/rpmbuild/BUILD/openscap-1.3.6/x86_64-redhat-linux-gnu/tests/DS
Document type: Source Data Stream
Imported: 2022-05-31T03:24:41

Stream: scap_org.open-scap_datastream_from_xccdf_multiple-oval-xccdf.xml
Generated: (null)
Version: 1.2
Checklists:
        Ref-Id: scap_org.open-scap_cref_multiple-oval-xccdf.xml
                Status: draft
                Generated: 2011-10-12
                Resolved: true
                Profiles:
                Referenced check files:
                        first-oval.xml
                                system: http://oval.mitre.org/XMLSchema/oval-definitions-5
                        second-oval.xml
                                system: http://oval.mitre.org/XMLSchema/oval-definitions-5
        Ref-Id: scap_org.open-scap_cref_--tmp--tmp.7ZDFnQrb9p--multiple-oval-xccdf.xml
                Status: draft
                Generated: 2011-10-12
                Resolved: true
                Profiles:
                Referenced check files:
                        first-oval.xml
                                system: http://oval.mitre.org/XMLSchema/oval-definitions-5
                        second-oval.xml
                                system: http://oval.mitre.org/XMLSchema/oval-definitions-5
Checks:
        Ref-Id: scap_org.open-scap_cref_first-oval.xml
        Ref-Id: scap_org.open-scap_cref_second-oval.xml
        Ref-Id: scap_org.open-scap_cref_--tmp--tmp.7ZDFnQrb9p--first-oval.xml
        Ref-Id: scap_org.open-scap_cref_--tmp--tmp.7ZDFnQrb9p--second-oval.xml
No dictionaries.
Query didn't return a nodeset. Value: Query didn't return a nodeset. Value: Query didn't return a nodeset. Value: Query didn't return a nodeset. Value: Document type: Source Data Stream
Imported: 2022-05-31T03:24:41

Stream: scap_org.open-scap_datastream_from_xccdf_multiple-oval-xccdf.xml
Generated: (null)
Version: 1.2
Checklists:
        Ref-Id: scap_org.open-scap_cref_multiple-oval-xccdf.xml
                Status: draft
                Generated: 2011-10-12
                Resolved: true
                Profiles:
                Referenced check files:
                        first-oval.xml
                                system: http://oval.mitre.org/XMLSchema/oval-definitions-5
                        second-oval.xml
                                system: http://oval.mitre.org/XMLSchema/oval-definitions-5
        Ref-Id: scap_org.open-scap_cref_--tmp--tmp.7ZDFnQrb9p--multiple-oval-xccdf.xml
                Status: draft
                Generated: 2011-10-12
                Resolved: true
                Profiles:
                Referenced check files:
                        first-oval.xml
                                system: http://oval.mitre.org/XMLSchema/oval-definitions-5
                        second-oval.xml
                                system: http://oval.mitre.org/XMLSchema/oval-definitions-5
Checks:
        Ref-Id: scap_org.open-scap_cref_first-oval.xml
        Ref-Id: scap_org.open-scap_cref_second-oval.xml
        Ref-Id: scap_org.open-scap_cref_--tmp--tmp.7ZDFnQrb9p--first-oval.xml
        Ref-Id: scap_org.open-scap_cref_--tmp--tmp.7ZDFnQrb9p--second-oval.xml
No dictionaries.
/tmp/tmp.1JVT74v5gj ~/rpmbuild/BUILD/openscap-1.3.6/x86_64-redhat-linux-gnu/tests/DS
~/rpmbuild/BUILD/openscap-1.3.6/x86_64-redhat-linux-gnu/tests/DS
Document type: OVAL Definitions
OVAL version: 5.5
Generated: 2010-08-30T12:00:00-04:00
Imported: 2022-05-31T03:24:43
Document type: OVAL Definitions
OVAL version: 5.5
Generated: 2010-08-30T12:00:00-04:00
Imported: 2022-05-31T03:24:43
Document type: XCCDF Checklist
Checklist version: 1.2
Imported: 2022-05-31T03:24:43
Status: draft
Generated: 2011-10-12
Resolved: true
Profiles:
Referenced check files:
        first-oval.xml
                system: http://oval.mitre.org/XMLSchema/oval-definitions-5
        second-oval.xml
                system: http://oval.mitre.org/XMLSchema/oval-definitions-5
RESULT: PASSED

+ test_ds_1_2_continue_without_remote_resources
TEST: test_ds_1_2_continue_without_remote_resources
WARNING: This content points out to the remote resources. Use `--fetch-remote-resources' option to download them.
WARNING: Skipping https://www.example.com/security/data/oval/oval.xml.bz2 file which is referenced from XCCDF content
--- Starting Evaluation ---

Title   This rule always pass
Rule    xccdf_com.example.www_rule_test-pass
Result  pass

Title   This rule checks remote resource
Rule    xccdf_com.example.www_rule_test-remote_res
Result  notchecked

Title   This rule always pass
Rule    xccdf_com.example.www_rule_test-pass2
Result  pass

OVAL Results are exported correctly.
XCCDF Results are exported correctly.
RESULT: PASSED

+ test_ds_1_2_error_remote_resources
TEST: test_ds_1_2_error_remote_resources
--- Starting Evaluation ---

Title   This rule always pass
Rule    xccdf_com.example.www_rule_test-pass
Result  pass

Title   This rule checks remote resource
Rule    xccdf_com.example.www_rule_test-remote_res
Result  notchecked

Title   This rule always pass
Rule    xccdf_com.example.www_rule_test-pass2
Result  pass

XCCDF Results are exported correctly.

        Start 167: DS/test_rds.sh
167/264 Test #167: DS/test_rds.sh .....................................................................   Passed   30.15 sec
        Start 168: DS/test_sds_compose_split.sh
168/264 Test #168: DS/test_sds_compose_split.sh .......................................................   Passed   47.29 sec
        Start 169: DS/test_sds_eval.sh
169/264 Test #169: DS/test_sds_eval.sh ................................................................   Passed    7.39 sec
        Start 170: DS/test_sds_fix_from_results.sh
170/264 Test #170: DS/test_sds_fix_from_results.sh ....................................................   Passed    0.73 sec
        Start 171: DS/test_sds_fix_from_source.sh
171/264 Test #171: DS/test_sds_fix_from_source.sh .....................................................   Passed    0.38 sec
        Start 172: DS/test_ds_use_local_remote_resources.sh
172/264 Test #172: DS/test_ds_use_local_remote_resources.sh ...........................................   Passed    2.20 sec
        Start 173: DS/ds_sds_index/all.sh
173/264 Test #173: DS/ds_sds_index/all.sh .............................................................   Passed    0.15 sec
        Start 174: DS/schematron/schematron.sh
174/264 Test #174: DS/schematron/schematron.sh ........................................................   Passed    0.42 sec
        Start 175: DS/sds_detect_version/test_detect_version.sh
175/264 Test #175: DS/sds_detect_version/test_detect_version.sh .......................................   Passed    0.21 sec
        Start 176: DS/signed/all.sh
176/264 Test #176: DS/signed/all.sh ...................................................................   Passed    3.36 sec
        Start 177: DS/validate/all.sh
177/264 Test #177: DS/validate/all.sh .................................................................   Passed    1.41 sec
        Start 178: nist/nist_test.sh
178/264 Test #178: nist/nist_test.sh ..................................................................   Passed   10.98 sec
        Start 179: oscap_string/test_oscap_string.sh
179/264 Test #179: oscap_string/test_oscap_string.sh ..................................................   Passed    0.08 sec
        Start 180: oval_details/test_oval_details.sh
180/264 Test #180: oval_details/test_oval_details.sh ..................................................   Passed    3.17 sec
        Start 181: probes/environmentvariable/test_probes_environmentvariable.sh
181/264 Test #181: probes/environmentvariable/test_probes_environmentvariable.sh ......................   Passed    2.34 sec
        Start 182: probes/environmentvariable58/test_probes_environmentvariable58.sh
182/264 Test #182: probes/environmentvariable58/test_probes_environmentvariable58.sh ..................   Passed    2.53 sec
        Start 183: probes/environmentvariable58/test_probes_environmentvariable58_offline_mode.sh
183/264 Test #183: probes/environmentvariable58/test_probes_environmentvariable58_offline_mode.sh .....***Skipped   0.13 sec
        Start 184: probes/family/test_probes_family.sh
184/264 Test #184: probes/family/test_probes_family.sh ................................................   Passed    1.73 sec
        Start 185: probes/file/test_probes_file.sh
185/264 Test #185: probes/file/test_probes_file.sh ....................................................   Passed   19.02 sec
        Start 186: probes/file/test_probes_file_behaviour.sh
186/264 Test #186: probes/file/test_probes_file_behaviour.sh ..........................................   Passed    0.78 sec
        Start 187: probes/file/test_probes_file_multiple_file_paths.sh
187/264 Test #187: probes/file/test_probes_file_multiple_file_paths.sh ................................   Passed    0.51 sec
        Start 188: probes/fileextendedattribute/test_probes_fileextendedattribute.sh
188/264 Test #188: probes/fileextendedattribute/test_probes_fileextendedattribute.sh ..................   Passed    0.36 sec
        Start 189: probes/filehash/test_probes_filehash.sh
189/264 Test #189: probes/filehash/test_probes_filehash.sh ............................................   Passed    4.40 sec
        Start 190: probes/filehash58/test_probes_filehash58.sh
190/264 Test #190: probes/filehash58/test_probes_filehash58.sh ........................................   Passed    9.35 sec
        Start 191: probes/filehash58/rhbz1959570_segfault.sh
191/264 Test #191: probes/filehash58/rhbz1959570_segfault.sh ..........................................   Passed    0.19 sec
        Start 192: probes/filemd5/test_probes_filemd5.sh
192/264 Test #192: probes/filemd5/test_probes_filemd5.sh ..............................................   Passed    0.10 sec
        Start 193: probes/iflisteners/test_probes_iflisteners.sh
193/264 Test #193: probes/iflisteners/test_probes_iflisteners.sh ......................................   Passed    3.12 sec
        Start 194: probes/interface/test_probes_interface.sh
194/264 Test #194: probes/interface/test_probes_interface.sh ..........................................   Passed    0.41 sec
        Start 195: probes/maskattr/test_object_entity_mask.sh
195/264 Test #195: probes/maskattr/test_object_entity_mask.sh .........................................   Passed    0.94 sec
        Start 196: probes/maskattr/test_object_entity_mask_oval_5_9.sh
196/264 Test #196: probes/maskattr/test_object_entity_mask_oval_5_9.sh ................................   Passed    0.88 sec
        Start 197: probes/maskattr/test_object_entity_nomask.sh
197/264 Test #197: probes/maskattr/test_object_entity_nomask.sh .......................................   Passed    0.81 sec
        Start 198: probes/partition/test_probes_partition.sh
198/264 Test #198: probes/partition/test_probes_partition.sh ..........................................   Passed    0.37 sec
        Start 199: probes/partition/test_probes_partition_offline_mode.sh
199/264 Test #199: probes/partition/test_probes_partition_offline_mode.sh .............................***Skipped   0.13 sec
        Start 200: probes/password/test_probes_password.sh
200/264 Test #200: probes/password/test_probes_password.sh ............................................   Passed    6.45 sec
        Start 201: probes/password/test_probes_password_offline.sh
201/264 Test #201: probes/password/test_probes_password_offline.sh ....................................***Skipped   0.13 sec
        Start 202: probes/process58/capability.sh
202/264 Test #202: probes/process58/capability.sh .....................................................   Passed    0.70 sec
        Start 203: probes/process58/command_line.sh
203/264 Test #203: probes/process58/command_line.sh ...................................................   Passed    0.41 sec
        Start 204: probes/process58/command_line_extra.sh
204/264 Test #204: probes/process58/command_line_extra.sh .............................................   Passed   35.16 sec
        Start 205: probes/process58/dev_to_tty.sh
205/264 Test #205: probes/process58/dev_to_tty.sh .....................................................   Passed    0.42 sec
        Start 206: probes/process58/empty_proc.sh
206/264 Test #206: probes/process58/empty_proc.sh .....................................................   Passed    0.56 sec
        Start 207: probes/process58/loginuid.sh
207/264 Test #207: probes/process58/loginuid.sh .......................................................   Passed    0.49 sec
        Start 208: probes/process58/selinux_domain_label.sh
208/264 Test #208: probes/process58/selinux_domain_label.sh ...........................................***Failed    3.75 sec
result file: selinux_domain_label.out.lNKL80
stderr file: selinux_domain_label.err.d1bRtd
Collecting:
Collected: "oval:x:obj:1" : complete
OVAL System Characteristics are exported correctly.
/sbin/getenforce
Failed: expected count: 1, real count: 0, xpath: '/oval_system_characteristics/system_data/unix-sys:process58_item/unix-sys:selinux_domain_label'

        Start 209: probes/process58/sessionid.sh
209/264 Test #209: probes/process58/sessionid.sh ......................................................   Passed    0.41 sec
        Start 210: probes/process58/test_probes_process58_offline_mode.sh
210/264 Test #210: probes/process58/test_probes_process58_offline_mode.sh .............................***Skipped   0.11 sec
        Start 211: probes/rpm/rpminfo/test_probes_rpminfo.sh
211/264 Test #211: probes/rpm/rpminfo/test_probes_rpminfo.sh ..........................................   Passed    8.73 sec
        Start 212: probes/rpm/rpminfo/test_probes_rpminfo_offline.sh
212/264 Test #212: probes/rpm/rpminfo/test_probes_rpminfo_offline.sh ..................................***Skipped   0.15 sec
        Start 213: probes/rpm/rpmverify/test_probes_rpmverify_not_equals_operation.sh
213/264 Test #213: probes/rpm/rpmverify/test_probes_rpmverify_not_equals_operation.sh .................   Passed    5.79 sec
        Start 214: probes/rpm/rpmverify/test_probes_rpmverify_not_equals_operation_offline.sh
214/264 Test #214: probes/rpm/rpmverify/test_probes_rpmverify_not_equals_operation_offline.sh .........***Skipped   0.09 sec
        Start 215: probes/rpm/rpmverifyfile/test_probes_rpmverifyfile.sh
215/264 Test #215: probes/rpm/rpmverifyfile/test_probes_rpmverifyfile.sh ..............................   Passed    4.89 sec
        Start 216: probes/rpm/rpmverifyfile/test_probes_rpmverifyfile_older.sh
216/264 Test #216: probes/rpm/rpmverifyfile/test_probes_rpmverifyfile_older.sh ........................   Passed    4.35 sec
        Start 217: probes/rpm/rpmverifyfile/test_probes_rpmverifyfile_offline.sh
217/264 Test #217: probes/rpm/rpmverifyfile/test_probes_rpmverifyfile_offline.sh ......................***Skipped   0.08 sec
        Start 218: probes/rpm/rpmverifypackage/test_probes_rpmverifypackage.sh
218/264 Test #218: probes/rpm/rpmverifypackage/test_probes_rpmverifypackage.sh ........................   Passed    3.25 sec
        Start 219: probes/rpm/rpmverifypackage/test_probes_rpmverifypackage_offline.sh
219/264 Test #219: probes/rpm/rpmverifypackage/test_probes_rpmverifypackage_offline.sh ................***Skipped   0.08 sec
        Start 220: probes/runlevel/test_probes_runlevel.sh
220/264 Test #220: probes/runlevel/test_probes_runlevel.sh ............................................   Passed    0.27 sec
        Start 221: probes/selinuxboolean/test_probes_selinuxboolean.sh
221/264 Test #221: probes/selinuxboolean/test_probes_selinuxboolean.sh ................................   Passed    0.09 sec
        Start 222: probes/selinuxboolean/test_probes_selinuxboolean_offline_mode.sh
222/264 Test #222: probes/selinuxboolean/test_probes_selinuxboolean_offline_mode.sh ...................***Skipped   0.08 sec
        Start 223: probes/selinuxsecuritycontext/test_probes_selinuxsecuritycontext.sh
223/264 Test #223: probes/selinuxsecuritycontext/test_probes_selinuxsecuritycontext.sh ................   Passed    0.08 sec
        Start 224: probes/selinuxsecuritycontext/test_probes_selinuxsecuritycontext_offline_mode.sh
224/264 Test #224: probes/selinuxsecuritycontext/test_probes_selinuxsecuritycontext_offline_mode.sh ...   Passed    0.08 sec
        Start 225: probes/shadow/test_probes_shadow.sh
225/264 Test #225: probes/shadow/test_probes_shadow.sh ................................................   Passed    0.12 sec
        Start 226: probes/symlink/test_probes_symlink.sh
226/264 Test #226: probes/symlink/test_probes_symlink.sh ..............................................   Passed    1.35 sec
        Start 227: probes/symlink/test_offline_mode_symlink.sh
227/264 Test #227: probes/symlink/test_offline_mode_symlink.sh ........................................***Skipped   0.19 sec
        Start 228: probes/sysctl/test_sysctl_probe.sh
228/264 Test #228: probes/sysctl/test_sysctl_probe.sh .................................................   Passed    0.54 sec
        Start 229: probes/sysctl/test_sysctl_probe_all.sh
229/264 Test #229: probes/sysctl/test_sysctl_probe_all.sh .............................................   Passed    0.61 sec
        Start 230: probes/system_info/test_probes_system_info.sh
230/264 Test #230: probes/system_info/test_probes_system_info.sh ......................................   Passed    0.17 sec
        Start 231: probes/system_info/test_probes_system_info_offline_mode.sh
231/264 Test #231: probes/system_info/test_probes_system_info_offline_mode.sh .........................***Skipped   0.10 sec
        Start 232: probes/systemdunitdependency/test_probes_systemdunitdependency.sh
232/264 Test #232: probes/systemdunitdependency/test_probes_systemdunitdependency.sh ..................***Failed    0.49 sec
+ Probe systemdunitdependency general functionality
TEST: Probe systemdunitdependency general functionality
stderr file: .err.z2KgRy
W: oscap:     There was a problem processing referenced variable (oval:0:var:2).
Definition oval:0:def:3: false
Definition oval:0:def:2: error
Definition oval:0:def:1: error
Evaluation done.
Result of oval:0:def:1 should be TRUE and is ERROR
Result of oval:0:def:2 should be TRUE and is ERROR
Result of oval:0:def:3 should be TRUE and is FALSE

        Start 233: probes/systemdunitdependency/test_probes_systemdunitdependency_validation.sh
233/264 Test #233: probes/systemdunitdependency/test_probes_systemdunitdependency_validation.sh .......   Passed    0.51 sec
        Start 234: probes/systemdunitdependency/test_probes_systemdunitdependency_offline_mode.sh
234/264 Test #234: probes/systemdunitdependency/test_probes_systemdunitdependency_offline_mode.sh .....***Skipped   0.15 sec
        Start 235: probes/systemdunitproperty/test_probes_systemdunitproperty.sh
235/264 Test #235: probes/systemdunitproperty/test_probes_systemdunitproperty.sh ......................***Failed    0.64 sec
+ Probe systemdunitproperty general functionality
TEST: Probe systemdunitproperty general functionality
stderr file: .err.i38l48
Definition oval:0:def:8: unknown
Definition oval:0:def:7: error
Definition oval:0:def:6: error
Definition oval:0:def:5: error
Definition oval:0:def:4: error
Definition oval:0:def:3: error
Definition oval:0:def:2: error
Definition oval:0:def:1: error
Evaluation done.
Result of oval:0:def:1 should be TRUE and is ERROR
Result of oval:0:def:2 should be TRUE and is ERROR
Result of oval:0:def:3 should be TRUE and is ERROR
Result of oval:0:def:4 should be TRUE and is ERROR
Result of oval:0:def:5 should be TRUE and is ERROR
Result of oval:0:def:6 should be FALSE and is ERROR
Result of oval:0:def:7 should be FALSE and is ERROR
Result of oval:0:def:8 should be TRUE and is ERROR

        Start 236: probes/systemdunitproperty/test_probes_systemdunitproperty_mount_wants.sh
236/264 Test #236: probes/systemdunitproperty/test_probes_systemdunitproperty_mount_wants.sh ..........***Skipped   0.14 sec
        Start 237: probes/systemdunitproperty/test_probes_systemdunitproperty_offline_mode.sh
237/264 Test #237: probes/systemdunitproperty/test_probes_systemdunitproperty_offline_mode.sh .........***Skipped   0.15 sec
        Start 238: probes/textfilecontent54/test_behavior_multiline.sh
238/264 Test #238: probes/textfilecontent54/test_behavior_multiline.sh ................................   Passed    2.20 sec
        Start 239: probes/textfilecontent54/test_filecontent_non_utf.sh
239/264 Test #239: probes/textfilecontent54/test_filecontent_non_utf.sh ...............................   Passed    0.52 sec
        Start 240: probes/textfilecontent54/test_offline_mode_textfilecontent54.sh
240/264 Test #240: probes/textfilecontent54/test_offline_mode_textfilecontent54.sh ....................***Skipped   0.10 sec
        Start 241: probes/textfilecontent54/test_probes_textfilecontent54.sh
241/264 Test #241: probes/textfilecontent54/test_probes_textfilecontent54.sh ..........................   Passed    1.37 sec
        Start 242: probes/textfilecontent54/test_recursion_limit.sh
242/264 Test #242: probes/textfilecontent54/test_recursion_limit.sh ...................................   Passed    0.75 sec
        Start 243: probes/textfilecontent54/test_symlinks.sh
243/264 Test #243: probes/textfilecontent54/test_symlinks.sh ..........................................   Passed    1.04 sec
        Start 244: probes/textfilecontent54/test_validation_of_various_oval_versions.sh
244/264 Test #244: probes/textfilecontent54/test_validation_of_various_oval_versions.sh ...............   Passed    4.72 sec
        Start 245: probes/uname/test_probes_uname.sh
245/264 Test #245: probes/uname/test_probes_uname.sh ..................................................   Passed    3.64 sec
        Start 246: probes/xinetd/test_xinetd_probe.sh
246/264 Test #246: probes/xinetd/test_xinetd_probe.sh .................................................   Passed    0.34 sec
        Start 247: probes/yamlfilecontent/test_probes_yamlfilecontent_key.sh
247/264 Test #247: probes/yamlfilecontent/test_probes_yamlfilecontent_key.sh ..........................***Skipped   0.12 sec
        Start 248: probes/yamlfilecontent/test_probes_yamlfilecontent_array.sh
248/264 Test #248: probes/yamlfilecontent/test_probes_yamlfilecontent_array.sh ........................***Skipped   0.12 sec
        Start 249: probes/yamlfilecontent/test_probes_yamlfilecontent_offline_mode.sh
249/264 Test #249: probes/yamlfilecontent/test_probes_yamlfilecontent_offline_mode.sh .................***Skipped   0.12 sec
        Start 250: probes/yamlfilecontent/test_probes_yamlfilecontent_types.sh
250/264 Test #250: probes/yamlfilecontent/test_probes_yamlfilecontent_types.sh ........................***Skipped   0.12 sec
        Start 251: probes/yamlfilecontent/test_probes_yamlfilecontent_content.sh
251/264 Test #251: probes/yamlfilecontent/test_probes_yamlfilecontent_content.sh ......................***Skipped   0.11 sec
        Start 252: probes/xmlfilecontent/test_xmlfilecontent_probe.sh
252/264 Test #252: probes/xmlfilecontent/test_xmlfilecontent_probe.sh .................................   Passed    0.81 sec
        Start 253: report/report.sh
253/264 Test #253: report/report.sh ...................................................................   Passed    0.40 sec
        Start 254: sce/test_sce.sh
254/264 Test #254: sce/test_sce.sh ....................................................................   Passed    0.30 sec
        Start 255: sce/test_passing_vars.sh
255/264 Test #255: sce/test_passing_vars.sh ...........................................................   Passed    0.15 sec
        Start 256: sce/test_check_engine_results.sh
256/264 Test #256: sce/test_check_engine_results.sh ...................................................   Passed    0.19 sec
        Start 257: sce/test_sce_parse_errors.sh
257/264 Test #257: sce/test_sce_parse_errors.sh .......................................................   Passed    0.39 sec
        Start 258: sce/test_sce_in_ds.sh
258/264 Test #258: sce/test_sce_in_ds.sh ..............................................................   Passed    0.35 sec
        Start 259: sce/test_sce_in_report.sh
259/264 Test #259: sce/test_sce_in_report.sh ..........................................................   Passed    0.23 sec
        Start 260: sce/test_sce_stdout_stderr.sh
260/264 Test #260: sce/test_sce_stdout_stderr.sh ......................................................   Passed    0.18 sec
        Start 261: sce/test_sce_streams_fill.sh
261/264 Test #261: sce/test_sce_streams_fill.sh .......................................................   Passed    4.25 sec
        Start 262: schemas/all.sh
262/264 Test #262: schemas/all.sh .....................................................................   Passed    0.20 sec
        Start 263: sources/all.sh
263/264 Test #263: sources/all.sh .....................................................................   Passed    1.01 sec
        Start 264: utils/test_utils_args.sh
264/264 Test #264: utils/test_utils_args.sh ...........................................................   Passed    0.16 sec

98% tests passed, 4 tests failed out of 264

Total Test time (real) = 668.22 sec

The following tests did not run:
        129 - API/XCCDF/unittests/test_remediation_offline.sh (Skipped)
        183 - probes/environmentvariable58/test_probes_environmentvariable58_offline_mode.sh (Skipped)
        199 - probes/partition/test_probes_partition_offline_mode.sh (Skipped)
        201 - probes/password/test_probes_password_offline.sh (Skipped)
        210 - probes/process58/test_probes_process58_offline_mode.sh (Skipped)
        212 - probes/rpm/rpminfo/test_probes_rpminfo_offline.sh (Skipped)
        214 - probes/rpm/rpmverify/test_probes_rpmverify_not_equals_operation_offline.sh (Skipped)
        217 - probes/rpm/rpmverifyfile/test_probes_rpmverifyfile_offline.sh (Skipped)
        219 - probes/rpm/rpmverifypackage/test_probes_rpmverifypackage_offline.sh (Skipped)
        222 - probes/selinuxboolean/test_probes_selinuxboolean_offline_mode.sh (Skipped)
        227 - probes/symlink/test_offline_mode_symlink.sh (Skipped)
        231 - probes/system_info/test_probes_system_info_offline_mode.sh (Skipped)
        234 - probes/systemdunitdependency/test_probes_systemdunitdependency_offline_mode.sh (Skipped)
        236 - probes/systemdunitproperty/test_probes_systemdunitproperty_mount_wants.sh (Skipped)
        237 - probes/systemdunitproperty/test_probes_systemdunitproperty_offline_mode.sh (Skipped)
        240 - probes/textfilecontent54/test_offline_mode_textfilecontent54.sh (Skipped)
        247 - probes/yamlfilecontent/test_probes_yamlfilecontent_key.sh (Skipped)
        248 - probes/yamlfilecontent/test_probes_yamlfilecontent_array.sh (Skipped)
        249 - probes/yamlfilecontent/test_probes_yamlfilecontent_offline_mode.sh (Skipped)
        250 - probes/yamlfilecontent/test_probes_yamlfilecontent_types.sh (Skipped)
        251 - probes/yamlfilecontent/test_probes_yamlfilecontent_content.sh (Skipped)

The following tests FAILED:
        166 - DS/test_ds_misc.sh (Failed)
        208 - probes/process58/selinux_domain_label.sh (Failed)
        232 - probes/systemdunitdependency/test_probes_systemdunitdependency.sh (Failed)
        235 - probes/systemdunitproperty/test_probes_systemdunitproperty.sh (Failed)
Errors while running CTest

kloczek avatar May 31 '22 08:05 kloczek

Hey, you have to be a bit more specific than Linux x86/64 about the OS version you're running.

evgenyz avatar May 31 '22 09:05 evgenyz

Looking on the code I was not able to find anything kernel version specific .. nevertheless I'm using kernel version 5.17.8.

kloczek avatar May 31 '22 11:05 kloczek

Looking on the code I was not able to find anything kernel version specific .. nevertheless I'm using kernel version 5.17.8.

Please, provide content of /etc/os-release.

evgenyz avatar May 31 '22 12:05 evgenyz

I'm using my own distribution and I'm packaging for it OpenSCAP. If you want me to perform some diagnostics please let me know.

kloczek avatar May 31 '22 12:05 kloczek

Well, you have some configuration problems with systemd, SELinux and, probably, libxml (not sure here) in you distribution.

evgenyz avatar May 31 '22 13:05 evgenyz

systemd and libxml2? .. highly unlikely as none of other my packages have any issues with those two

[tkloczko@devel-g2v SPECS]$ grep BuildRequires:.*systemd *.spec -l | wc -l
178
[tkloczko@devel-g2v SPECS]$ grep BuildRequires:.*libxml-2.0 *.spec -l | wc -l
163
[tkloczko@devel-g2v SPECS]$ grep BuildRequires:.*libxml2-devel *.spec -l | wc -l
30

SELinux is messy as always however none of the test suites of other packages which depends on SELinux are failing.

Nevertheless would be really appreciated more details than only vectors .. FYI: test suite is executed on system with enabled SELinux and it uses btrfs.

kloczek avatar May 31 '22 13:05 kloczek

Well, this very same test suite works on vanilla versions of RHEL, Fedora, Ubuntu and Arch (at least, confirmed). So, if you haven't changed the code the problem is in the configuration of the system (about which I have no idea). Running the scanner in debug mode (--verbose=DEVEL) could help you connecting the behavior with the code.

evgenyz avatar May 31 '22 14:05 evgenyz

Just tested all those distros and none of those distros are executing OpenSCAP test suite. Fedora has intentionally disabled test suite (coincidence? 🤔 ) https://src.fedoraproject.org/rpms/openscap/blob/rawhide/f/openscap.spec#_142 So yes ItWorks ™️ .. kind of.

Running the scanner in debug mode (--verbose=DEVEL) could help you connecting the behavior with the code.

Which one scanner?

kloczek avatar May 31 '22 15:05 kloczek

gentle ping .. 🤔

kloczek avatar Jun 03 '22 14:06 kloczek

Our CI builds and tests in Ubuntu and Fedora (multiple versions). The scanner works as intended there (more or less). If you can identify specific problem in the code or build system, which is specific to other distros, we can try and fix it.

We are not going to debug OpenSCAP on the platforms we have no access to.

evgenyz avatar Feb 09 '24 19:02 evgenyz

Our CI builds and tests in Ubuntu and Fedora (multiple versions). The scanner works as intended there (more or less). If you can identify specific problem in the code or build system, which is specific to other distros, we can try and fix it.

How you are testing that on Fedora? Are you doing that on Fedora system image using custom set of settings/compile and link time flags instead what is implemented in fedora spec file? If yes you are not testing Fedora build procedure but your own version of that procedure. In such scenario you are not been able to reproduce what I'm doing.

We are not going to debug OpenSCAP on the platforms we have no access to.

I've did not ask to debug anything. If you have any suggestions what I can try to do to diagnose this fail please let me know what exactly you want me to do.

kloczek avatar Feb 10 '24 02:02 kloczek

How you are testing that on Fedora? Are you doing that on Fedora system image using custom set of settings/compile and link time flags instead what is implemented in fedora spec file? If yes you are not testing Fedora build procedure but your own version of that procedure. In such scenario you are not been able to reproduce what I'm doing.

That's how:

  • https://github.com/OpenSCAP/openscap/actions/runs/7845898940/job/21411366888
  • https://github.com/OpenSCAP/openscap/pull/2081/checks?check_run_id=21406366348

With this spec file: https://github.com/OpenSCAP/openscap/blob/maint-1.3/openscap.spec

We are not going to debug OpenSCAP on the platforms we have no access to.

I've did not ask to debug anything. If you have any suggestions what I can try to do to diagnose this fail please let me know what exactly you want me to do.

  • Use latest version of maint-1.3 branch.
  • Understand how --verbose= flag works.
  • Find differences in the behavior of the scanner based on the logs and/or use gdb if necessary.
  • Open issues case-by-case, with cmake configure and build logs, isolated DEVEL logs of the problematic session (keep it as simple as possible) and a description of behavior discrepancy.

It might or might not allow us to understand and fix portability problems.

evgenyz avatar Feb 14 '24 00:02 evgenyz