avocado.plugins.remote: Unify test locations and use absolute path [v5]

Default timeout for execution is 60s. This patch removes this for the
remote `avocado ...` run as there is no sensible default for it, nor
convinient way to set it on the cmdline. It should be relatively safe as
Avocado on remote machine should timeout using the same timeouts as on
host and in case the machine dies fabric fails the execution and
returns.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Executable bit is not set without mirror_local_mode or mode setting.
This is needed for remote test execution as they need to be executable.
Correct me if I'm wrong but for our purposes mirror_local_mode is the
most useful way without the need to make it optional.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Use flexmock to supplement remote machine and check booth
vm and remote plugins deeper.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

This argument disables copying the tests and only executes the tests as
they are specified inside the remote or vm machine.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Currently remote plugin doubles the HumanTestResults. This removes
all shared parts and inherits from HumanTestResults. Results are
identical only the amount of code is decreased.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

No actual change, only:
1) imports are ordered global->local and alphabetically
2) 80 lines length (sorry guys, my debug screen is small)
3) added couple of docstrings.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

_setup_environment doesn't use `self` so it should be defined as
@staticmethod.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

All class variables should be defined in header or __init__ to avoid
AttributeError.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

No actual changes, only use UPPER_CASE to distinguish global variables
(PEP8)
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

avocado.multiplexer: Modify multiplexation mechanism [v4]

Using remote plugin results in very scary results when mixing different
ways to execute test. This patch translates urls into absolute paths
and copies each test's base directory into $remote_test_dir + the
original absolute path.

This approach is very deterministic, it avoids any clashes and as you
see the actual path it helps understanding of what happened where so
users can easily look into remote machine.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

vm plugin only extends the remote plugin and shares the test execution
part. This patch inherits vm plugin from remote one and adds only
the setup/cleanup part.

Additionally it removes the --vm argument and enables this plugin when
--vm-domain is set.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Check required params in plugin.activate() and set RemoteTestResults
urls during __init__.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

[V13] Test discovery and load (Phase II)

In case of custom tags like !using pyyaml requires space between the tag
and the ':'. This might be strange to people so this patch adds human
friendly message informing about this possibility.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

It might not be obvious how merging multiple yaml files work. Here is a
simple explanation.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Instead of detecting non-sibling nodes generate list of leaves per
each parent and pass it up the tree to the root. Results should be
the same as before, only speed is improved.

Additionally allow specifying nodes (!join), whose children belongs to
the same group. This extends the possibilities beyond what was possible
before.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NLucas Meneghel Rodrigues <lmr@redhat.com>

Signed-off-by: NLucas Meneghel Rodrigues <lmr@redhat.com>

Make the subcommand 'avocado list' to accept a list of paths.
Avocado will scan the directories passed to it and find suitable
tests in them. One can use --verbose to see headers with extra
information and summary of the files scanned.
Signed-off-by: NLucas Meneghel Rodrigues <lmr@redhat.com>

Add support to inspect and find tests inside a directory, recursively,
by using the method `discover_url`. It takes a url (path) and
returns the tests parameters it discovers.

The loader object has the .discover() method, that can be used
to inspect the location, and the .validate() method, that will
discover any problems on the user's input.

We are also changing the behavior of avocado to error out on
invalid inputs (missing paths or files that are not avocado
tests). Therefore, the concept of MISSING or NOT_A_TEST both
disappear from the UI. Unittests were updated to reflect the
new status quo.
Signed-off-by: NRudá Moura <rmoura@redhat.com>
Signed-off-by: NLucas Meneghel Rodrigues <lmr@redhat.com>

* Use --sysinfo=off in the current functional tests. It will
drop the total execution time of the tests.

* Add a new functional test `sysinfo_tests.py` which will actually
test if the sysinfo directory is being created or not, depending on
the proper command line option.

Implement runner command line option `--sysinfo` to turn on or off
any reports created and related to the execution of sysinfo, like
profilers, command lines utilities and other hardware logs. Default: on.

Example: avocado run --sysinfo=off passtest

There is a new configuration options inside [sysinfo.collect]
named "enabled" which will turn the feature on and off too.
It accepts a boolean value and the default is to enable sysinfo.

The command line option overwrites the configuration value.
Signed-off-by: NRudá Moura <rmoura@redhat.com>

Each operation (Remote.run) should have timeout to prevent unlimited
hangs. I choose default timeout 60s but it can be adjusted.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Remove occurences of old `print` statement syntax

avocado.plugins.xunit: Add WARN status as PASS

OK, I did it. This has got to be the most stupid commit ever on this repo.
Still, "print 'foo'" annoys me, and if want to have Avocado running on
Python 3 anytime, we would have to do this anyway.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

xunit doesn't support WARN test restul and currently is just ignored.
This commit maps WARN test results as PASS.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NLucas Meneghel Rodrigues <lmr@redhat.com>

This way, we fix a bug of avocado unable to list tests
from its own tree (it'll try to import them and then
fail due to recursively trying to import the already
loaded avocado modules).
Signed-off-by: NLucas Meneghel Rodrigues <lmr@redhat.com>

Unittests: remove shebangs and license headers

Commit 6fa0bfd8 remove license headers from non-essential files, but
a couple of them, introduced by yours truly in a later date, still
has them.

For consistency sake, let's remove from them too.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

Self test files used to be executable, but that changed on 143b574c.
So, it doesn't make much sense to keep the shebangs + python commands
on them.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

avocado/profiler.py: remove module that has been a placeholder

The idea of profilers running along a test is a pretty common and
desirable feature. But, for avocado, at least for now, we're seing
that feature emerging as an extention of the sysinfo module.

So, to avoid confusion, let's remove this placeholder module.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

Fix Wrapper Patterns