Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Robot plugin was introduced without documentation. This PR adds the
basic information about the Robot plugin.
Signed-off-by: NAmador Pahim <apahim@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

* https://github.com/avocado-framework/avocado:
  SPEC file: include resultsdb subpackage
  resultsdb plugin: require avocado-framework

This packages the newly introduced resultsdb optional plugin.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

All optional plugins require the installation (or presence) of
"avocado-framework", so let's do that to the newly introduced
resultsdb plugin too.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

We have a new section "optional_plugins". Let's create a "results"
category, move the "html" plugin documentation there and link to this
place from the "Result formats" section.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

The ResultsDB expects the Testcase, not the Test ID. Even so, the
Testcase can be considered the combination of the test name plus the
variant.

While on this, this patch adds the parameters information to the
ResultsDB 'data' section.
Signed-off-by: NAmador Pahim <apahim@redhat.com>

Some spelling issues, broken link fixes and updates related to recent
changes in Avocado.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

The default for our configuration is currently /var/lib, which was not
reflected in Configuration documentation. This is not really important
as we only share it as "example configuration" but it might create
confussion.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

With the resultdb optional plugin new arguments were added which are
missing in our man pages.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NAmador Pahim <apahim@redhat.com>

The avocado-server now requires both, "requirements.txt" and
"requirements-selftests.txt" to run "make check".
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

When --html is used the original in-job-dir results are removed just
before the second render. This was probably due to typo as the original
location was (probably) intended for removal. This patch doesn't do that
because the user-defined dir can be shared dir with other user files so
let's just produce the results and keep the dirs intact (while keeping
the refresh in job-dir as that is guaranteed to be our directory and we
do know it can be removed).
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

* https://github.com/avocado-framework/avocado:
  resultsdb plugin

Propagate tests results to resultsdb.

Reference: https://trello.com/c/AcruJdgS/906-result-plugin-for-resultsdbSigned-off-by: NAmador Pahim <apahim@redhat.com>

Signed-off-by: NAmador Pahim <apahim@redhat.com>

As it has already been done to some other tests, two other tests have
been producing false positives.  This has been observed recently in
package builds in build farms.

Let's run them only when `make check-full` is called, which is
usually done at dedicated machines with plenty of resources.

Reference: https://kojipkgs.fedoraproject.org/work/tasks/9189/19059189/build.log
Reference: https://kojipkgs.fedoraproject.org/work/tasks/9445/19069445/build.logSigned-off-by: NCleber Rosa <crosa@redhat.com>

When one extracts a zip file with symlinks multiple times, the symlinks
are not replaced by the `extractall`, which results in our
`_update_zip_extra_attrs` workaround to try to create a symlink to the
content of the file, rather than to the destination. This patch checks
whether the link already exists, removes it and refresh it from the
zipfile.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

* https://github.com/avocado-framework/avocado:
  data_dir: use a directory intended for writable content

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NAmador Pahim <apahim@redhat.com>

The FileLoader heuristic to find test is quite complicated and there was
one uncovered branch which did not report anything. Let's avoid this by
reporting `MissingTest` at the end of the execution unless we specify
otherwise (by return).
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

The MissingTest is yielded by TestLoaderProxy, but it was implemented
and described in FileLoader, which caused troubles when FileLoader was
not being used. This simple fix allows TestLoaderProxy to define basic
mappings and adds MissingTest to it.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Avocado's "data_dir" has always been meant for readable **and** writable
content.

Right now, this is broken because the system wide default for
"base_dir" (data_dir's parent) is set to /usr/share/avocado, and
consequently, "data_dir" is set to /usr/share/avocado/data.

Let's use "/var/lib/avocado" for the "base_dir", and
"/var/lib/avocado/data" for the "data_dir".  Content intended to be
read-only, such as example tests and wrappers, are still set to
/usr/share/avocado.

This has been tested with Avocado-VT, making the result of system
wide content, such as test providers and downloadable files be
put under "/var/lib/avocado/data/avocado-vt".

Reference: https://trello.com/c/KU1DvSAzSigned-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NAmador Pahim <apahim@redhat.com>

Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

* https://github.com/avocado-framework/avocado:
  python-avocado.spec: fix excluded files for optional plugin packages

Commit 7a249b7c removed files that were intended to be packaged in the
optional plugin packages.  By doing so, they ended up in the main
package.

This fixes that issue, and puts both the directories with the
package and module name (which differ) into each optional plugin
package file listing.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

The option "--loaders" accepts either loader plugin or plugin followed
by test type. Listing both at the same time was a bit confusing so this
patch lists them per-plugin.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

* https://github.com/avocado-framework/avocado:
  fix output on unknown tests

When the tests references cannot be resolved to a test_suite, the
results plugins should not output anything.

Reference: https://trello.com/c/oMQsQHC6Signed-off-by: NAmador Pahim <apahim@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

We prove that `post_tests` will always be executed when `pre_tests` was.
Let's remove the unnecessary `__del__` handling of teststmpdir.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>