Currently the `selftests/run_coverage` only reports unit coverage. This
patch allows specifying custom `avocado` command in selftests and uses
it to run coverage to also include the functional tests to results.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

`system-out` should be in the same level as `failure`, but we are
creating it as a `failure` child.

This patch puts system-out in the same level as `failure` and adds the
functional test to validate all the xunit outputs against the
junit-4.xsd schema.
Signed-off-by: NAmador Pahim <apahim@redhat.com>

Let's move the junit schema file to .data so we can reuse it for
functional tests.
Signed-off-by: NAmador Pahim <apahim@redhat.com>

Signed-off-by: NAmador Pahim <apahim@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NAmador Pahim <apahim@redhat.com>

The package names have changed, let's sync that with what's used
in the release example testplan.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NAmador Pahim <apahim@redhat.com>

Signed-off-by: NAmador Pahim <apahim@redhat.com>

Simply because this file won't be available when being installed
from any method outside the source tree.

The downside is obvious: it requires extra steps when doing a new
release.  But that is still better than not being able to ship
these plugins to users using the standard Python mechanisms.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

Now that the optional plugins have been excluded from the main
git archive, let's create them (currently with setuptools sdist
command).

Also, let's adjust the upload instruction a bit to signal that
other packages may be in PYPI_UPLOAD too.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

PyPI understands (rightfully so) one Python module per archive.  So,
it doesn't make sense to bundle all the plugins there for users of
`pip install avocado-framework`.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

So users will now be able to find Avocado plugins on PyPI, and install
them via `pip`.  Let's try to be consistent with the naming on those
packages, so that users don't fall into naming traps such as
installing Django related extensions.

Also, those packages map more closely to their (RPM) packaged versions.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Downstream file contains a conditional for the execution of
selftests.  Let's port that to the upstream SPEC file too.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

I have to say that having one requirement per line is really verbose,
but I have to admit that it makes diffs a lot easier to grasp.

Again, this syncs with the downstream SPEC file.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

The first line says it all.  While this change wouldn't be really
required, it brings the SPEC file close to the Fedora/EPEL downstream
version.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

* https://github.com/avocado-framework/avocado:
  Added -y to pvcreate in lv_utils

Added '-y' to pvcreate since pvcreate asks for confirmation
if previous filesystem signature exists.
Signed-off-by: NNarasimhan V <sim@linux.vnet.ibm.com>

The write to /proc/sys/vm/drop_caches requires root, let's use the
`sudo` to allow the execution for non-root executions as well.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

* https://github.com/avocado-framework/avocado:
  robot plugin: pylint fixes
  robot: fix error on unknown tests

This adds the support to define per-node filters, which take part of
environment and are evaluated during multiplexation.

The basic idea is to define relations ({could be only used | could
not be used} with other branch), which makes it a bit different from
what we know from `--mux-filter-{only|out}`:

1. They are applied per complete variant (because the filters are
   compound of per-leaf-filters)
2. They don't remove/keep the nodes, but they only evaluate whether
   this resulting variant makes sense (whether it passes the filters)

See the updated documentation for details.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Currently the user only gets information that something went wrong,
let's log the original exception into `avocado.debug` logger on
dispatcher error to allow simple debugging.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

The node environment is about to be expanded, let's wrap the values into
a custom object to contain all the necessary information and allow easy
extensibility.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

The tree_node_from_values is already quite complex and is about to be
extended. Let's split the body into functions.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Fixing pylint messages for the robot plugin module.
Signed-off-by: NAmador Pahim <apahim@redhat.com>

When robot plugin cannot determine the tests from the test references we
should return an empty list instead of an exception.
Signed-off-by: NAmador Pahim <apahim@redhat.com>

Signed-off-by: NAmador Pahim <apahim@redhat.com>

When the "sudo" is present in the PATH but is broken, the
"process.system" raises OSError. Let's address this issue and report
False in such case (as sudo is unusable)
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Improved linux_modules [v4]

avocado.utils.linux_modules: Improved the module.
Added the following parameters to the return value of
loaded_module_info()
* filename
* version
* parameters list
* depends list
Signed-off-by: NLucas Meneghel Rodrigues <lookkas@gmail.com>

robot: fix issue on missing test references
Signed-off-by: NLucas Meneghel Rodrigues <lookkas@gmail.com>

We have to consider that `avocado list` may be executed without the test
references.
Signed-off-by: NAmador Pahim <apahim@redhat.com>

Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

* https://github.com/avocado-framework/avocado:
  Robot Plugin

Recently we added a check for canceled test, let's also check the
"cancel" number of tests are reported correctly in json plugin.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

* https://github.com/avocado-framework/avocado:
  Deprecate message in self.skip()
  Accept self.cancel() in setUp() and tearDown()
  Don't execute setUp()/tearDown() on SKIP

Signed-off-by: NAmador Pahim <apahim@redhat.com>

This updates the mentions of the Avocado packages to new package
names.

Also, it tries to bring a more focused content to the README file,
that is, something more brief and direct, while using the updated
package names.
Signed-off-by: NCleber Rosa <crosa@redhat.com>