Run unittests during the build of RPM packages [v2]

It seems a good idea, and another safety net, to run the selftests
during the build of packages. For now, it's not trivial to run the
functional tests, so let's at least run the unittests.

Another current limitation is that unittests are only run on Fedora
and not on EL6 or EL7, and the reason for that are missing
dependencies on both EPEL6 and EPEL7.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

The basic idea here is to put all common requirements on a common line
and deal with the differences in conditional blocks.

Also, python-flexmock is not available on EPEL 7, but available on all
other supported platforms.

Finally, python-yaml and PyYAML are in their own lines because it
makes it easier to see that they're the same package with different
names.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

This means that we include the Makefile in the source tarball and just
use the `man` target.

With regards to portability among Python version, this should not be
an issue as rst2man on the system itself will the correct version. In
a sense, it's just another utility, it doesn't really matter it's
written in Python.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

There are two reasons for introducing this new target:

1) It adds symmetry to the Debian targets, which have both source only
   and complete versions.

2) It is useful when you only want to make the source package and
   build the "binary" elsewhere.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

avocado.remote: Add support for host-timeout [v2]

Sometimes avocado on guest hangs. This patch adds host timeout to
interrupt the execution.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NLucas Meneghel Rodrigues <lmr@redhat.com>

To help users to understand what each config option does.
Signed-off-by: NLucas Meneghel Rodrigues <lmr@redhat.com>

Those are not necessary in the avocado options and can
safely stay as a config file only option.
Signed-off-by: NLucas Meneghel Rodrigues <lmr@redhat.com>

The option --relative links instructed the htmlresult plugin
whether to use absolute log paths in anchor tags, or to use
relative paths, something that dates back to the old autotest
html job report. After thinking about it I realized that this
option doesn't need to be here, as using relative links is
basically better for all intents and purposes (the job results
can be safely redistributed and the report would still work).

So get rid of that option and always use relative links for
the job results dir links and logs. Tested with local execution
as well as remote/vm execution.
Signed-off-by: NLucas Meneghel Rodrigues <lmr@redhat.com>

Include virt API on readthedocs.org

This patch will checkout the avocado-virt repo during the documentation
build, so that all of avocado's API (including -virt) is presented at a
single and comprehensive location.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

The following things were changed and for the following reasons:

1) Remove the current hack to force the program name at the module
entry point, for obvious reasons.

2) Return the exit status code, for obvious reasons.

3) Add some safety with a `__main__` check, because Sphinx will
load the avocado module in such a way that the avocado app is run
and the build fails. This is true on my system, and may be the case
on others.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

avocado.aexpect: Fix bugs that broke avocado-virt

Let's try to avoid mistakes by explaining that we should not
use avocado imports in the stand alone part of the aexpect
module.
Signed-off-by: NLucas Meneghel Rodrigues <lmr@redhat.com>

We can't require avocado imports in the server part of
the aexpect process because that will be executed
stand alone, and will not have access to the rest
of the avocado libraries. The bugs were introduced
in commits:

6f380e0d
3fa9077f

This patch fixes the problem by moving the imports
to the client side of the module.
Signed-off-by: NLucas Meneghel Rodrigues <lmr@redhat.com>

Remove another seldomly used option, --job-log-level, and
move the opportunity to set the value to the config file.
Signed-off-by: NLucas Meneghel Rodrigues <lmr@redhat.com>

It is not a widely used option, so it's better to keep it
in runner.behavior.keep_tmp_files config.
Signed-off-by: NLucas Meneghel Rodrigues <lmr@redhat.com>

Bugfixes 26/03/2015

In the local runner, we use the multiplexer, but not so
in remote runner mode. Let's add the compatibility option
here to resolve the bug that broke the remote plugin.
Signed-off-by: NLucas Meneghel Rodrigues <lmr@redhat.com>

Review command line options. [V5]

avocado.job: Refactor how multiplexation happens [v3]

This pull request changes the way multiplexation is used.

1. tests are discovered by test_loader.discover()
2. multiplexer is initialized
3. suite is executed with initialized multiplexer class
4. each test works as template and iterates over multiplexer variants

Additionaly support for multiplex_files overriding was removed as I
haven't found any users of this API.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

This patch is initial support for people using custom bash scripts
with avocado. Tests should use:

    PATH=$(avocado "exec-path"):$PATH

and then they can utilize the helpers.

This version contain functions to write to Test.log the same way it's
possible from python including failing the test with TestWarn in case
avocado_warn was used.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

No actual change, only refactor code to use single function to get all
paths.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

avocado.job: Print test results dir even on --show-job-log

We were printing the results dir only when standalone test
mode was used. Let's extend that to --show-job-log as well
by moving the message to the end of the job execution
method.
Signed-off-by: NLucas Meneghel Rodrigues <lmr@redhat.com>

When no tag is supplied get_tagged_name() generates unique name. On the
other hand when tag is supplied, it silently reuses existing path. This
patch adds check for these cases and use $name.$tag.$number in case
$name.$tag exists.

This should avoid clashes when executing multiple tests with the same
name with multiplexation.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

No actual change, only merge 2 same branches together.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Validate options from `--job-log-level`.
Plus cosmetic change in `--output-check-record`.
Signed-off-by: NRudá Moura <rmoura@redhat.com>

Use `--paginator {on,off}` instead of `--disable-paginator`.
It is on by default, set `--paginator=off` to disable it.
Signed-off-by: NRudá Moura <rmoura@redhat.com>

Group together jsonresult, xunitresult, htmlresult and journal
inside "output related arguments".

Side effect: export `self.parser.runner.output` to the plugins.
Signed-off-by: NRudá Moura <rmoura@redhat.com>

Add command line `--job-results-dir` to the Avocado runner, so we can
store the job results in a different directory than the one
configured.

Remove `--logdir` from the main avocado application,
this option is obsolete and actually it was not working.

Update the manual page regarding this change.
Signed-off-by: NRudá Moura <rmoura@redhat.com>

From the current command line `--disable-output-check` replace it
with the new command line `--output-check {on,off}`, defaults to `on`.

Use `--output-check=off` to behave like ``--disable-output-check`.

Also, validate the value from command line `--output-check-record`.
Signed-off-by: NRudá Moura <rmoura@redhat.com>