Signed-off-by: NAmador Pahim <apahim@redhat.com>

Signed-off-by: NAmador Pahim <apahim@redhat.com>

Signed-off-by: NAmador Pahim <apahim@redhat.com>

It looks like the tags mechanism has a lot of potential to be used
very often, so a long command line option seems to much typing.

Let's add `-t` (for *t*ags), to allow users to run commands which
are much nicer to type, such as:

 $ avocado run . -t BZ12345678
Signed-off-by: NCleber Rosa <crosa@redhat.com>

When trying out Avocado installations, I wanted to silence the plugin
errors that I knew would fail to load.  I chose to do that by running
a command such as:

 $ avocado --config=silent_plugins.conf run passtest.py

But it did not behave as expected.  The reason is that plugins are
loaded first, and then the parsing of command line (with additional
parsing of config files) is done.  Let's parse the command line
earlier then.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

There's now python-aexpect packages on EL7, so we should
be using it.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

That was actually a trial/error commit that was then removed.  I
merged the branch I had, instead of the latest one which excluded that
one.

This reverts commit 2d9baccd.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

This selftest tries to load jobdata and verifies they produce correct
results.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

The cmdline wasn't stored till avocado-40.0. Let's try to get it from
job.log, if available.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

This allows replaying jobs executed by Avocado-36.x in Avocado-52.0.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>
Signed-off-by: NAmador Pahim <apahim@redhat.com>

When loading older jobs some arguments might not be available. Let's
reflect that and only override the arg when it's available.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

The `Varianter.dump` function which serializes the object is quite
useful to walk and serialize arbitrary variants. Let's extract the
separatable part and make it available for outer use.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Before Avocado-49.0 the mux did not defined `variant_ids`, let's
emulate it when it's not available (usually after unpickling
of an old-type-mux object).
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

The `to_str` method is used to list/visualize the variants. As the
structure is not kept, let's just list all variants along with their
params.

This is a simplified version of the `mux` plugin's `to_str` and it
ignores `summary` and `variants` as it's not really useful nowadays, but
we can improve that in the future, if necessary.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Let's assume TreeNodeEnvOnly is equal to other node if they share the
same name, path and environment.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Avocado selftest supports parallel check, enabled by the env. variable
`AVOCADO_PARALLEL_CHECK`. Let's enable that in travis so big PRs will
have a better change to finish before the travis 50min timeout.
Signed-off-by: NAmador Pahim <apahim@redhat.com>

Let's whitelist the --execution-order in replay as it might be useful to
users and it is a safe value.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

During replay we distinguish between force-overridden values by checking
whether the current value is None, which fails when the default is
not-None. Let's prepare for being able to replay with execution-order by
using default based on None (code already handles that as
variants-per-test).
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NAmador Pahim <apahim@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

All other result plugins write (by default) to the job results dir.
The HTML plugin was different because it used to require a number of
files.  Now, it's a single file, and thus, could/should live in the
same place as other files.

To ease the transition of the location, let's add a symlink, so that
users can still rely on the old location.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NAmador Pahim <apahim@redhat.com>

This section should help people running 36.x to move towards using 52.x
Avocado version.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NAmador Pahim <apahim@redhat.com>

Signed-off-by: NAmador Pahim <apahim@redhat.com>

Words like JSON and YAML are acronyms, and should be written
using capital letters only.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

The yaml_to_mux plugin may be able to read JSON files, but this not
documented *at all* and conflicts even with the basic help information
given on yaml_to_mux.  Let's omit that until we decide if JSON should
be treated by Avocado as a valid input to yaml_to_mux.

Then, while at it, a hopefully clearer version, broken down into
smaller sentences, is being proposed.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

* https://github.com/avocado-framework/avocado:
  Docs: document the test process environment
  Docs: AVOCADO_* environment variables are available to all tests

Each test executed in Avocado gets its own process.  But, there are a
few peculiarities that test writers may have to deal with, so let's
document those.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

And not only to SIMPLE tests.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

When Varianter plugins report no variants, default is provided by
Varianter on `itertests`. The same needs to be emulated in case of
`to_str`, otherwise users would not get the same results as during
`run`.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

We are about to need human readable variant representation outside the
`mux` module, let's create a generic implementation based on that one to
allow people to re-use it.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

The `--system-wide` option's destination is "variants-skip-defaults" and
not "variants_skip_defaults" due which this option did not actually
work.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>