This patch allows running the tests in parallel, when
AVOCADO_PARALLEL_CHECK env variable is set. It spawns 2xno_cpu workers
(or less when there are not enough tests), captures the output and shows
only output of failed workers. Before the exit it also reports the
number of executed tests in the same fashion as normal unittest
execution (without the number of failed tests, though).

On my laptop this decreases the duration from 125s to 28s.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

This patch adds summary at the end of the execution and uses colors to
mark start and finish of each section. This might produce some
unexpected characters on redirections/unsupported terminals at the
beginning and endings of the highlighted lines, but in most cases it
looks way better and those +3 chars can be ignored by humans.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

The `checkall` script should not try to develop/install/clean anything.
It's suppose to run the tests and it's upto the user to prepare the
environment they want to check.

This won't affect `make check` as it already cleans/develops before
executing checkall.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Currently the `make check` goes through all checks and then reports
overall results. This might take a while and is not really `git bisect`
friendly. This patch changes it to report early unless
SELF_CHECK_CONTINUOUS is specified. This is used in `travis` as we are
interested in all failures.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

avocado.core.test: Always use "test" as methodName in dry-run

selftests: Use LC_ALL=C in tests which parse output

docs: Add note about args vs. positional args [v2]

Add link to the Avocado tests for Scylla Clusters

* https://github.com/avocado-framework/avocado:
  avocado/core/job.py: remove unused method _filter_test_suite

The filtering of test methods is now implemented at the loader module.
This is an unused leftover from older versions, so let's remove it.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

* https://github.com/avocado-framework/avocado:
  Added version file and updated the respective files

Added version file and updated the respective files

Currently one of the test_output tests depends on a correct English
message, but the test runs under the system locales. Let's force the
LC_ALL for that execution.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

The --dry-run replaces the test class with a special one instead. When
the original class used a different but "test" methodName this fails
during __init__ as unittest requires the methodName attribute to exists.
This patch always changes the methodName to "test", which is defined in
the fake dry-run class.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

The python's argparse is quite clever and usually evaluates the
positionals and arguments correctly. But with subparsers or weird test
names it might falsely evaluate test name as argument, for example:

    avocado run --my_test
    avocado run passtest.py --show-job-log failtest.py

those will fail as --my_test looks like an invalid option and
--show-job-log is subparser's option not known to the main parser but as
the main parser already filled positionals it evaluates the
`failtest.py` as extra argument.

The most appropriate way to distinguish between args and positional args
is the `--` separator:

    avocado run -- --my_test
    avocado run --show-job-log -- passtest.py failtest.py
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

* https://github.com/avocado-framework/avocado:
  selftests/checkall: skip `.git` directory on inspekt based checks

`.git` may hold content that ends up being checked by inspektor, such
as the `git-rerere` cache.  This may cause false positives, so let's
skip `.git` completetly from those checks.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

The avocado package was renamed in 760d82c9 to `avocado-framework`,
but the cleanup was left unchanged. This commit fixes it.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

avocado: Few little improvements to listing local vars

Improve virt module exceptions/messages when it is not able to connect
to libvirt and when the domain is not available.

Reference: https://trello.com/c/Ni1LvaMQSigned-off-by: NAmador Pahim <apahim@redhat.com>

The use of stacktrace.log_message is not really necessary as the test
already has `self.log` which is the actual log we want to write to.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

It could be useful to see not only key/value pairs, but also their
types. As the value could be pretty long this patch logs the type just
after the key.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

docs: add section on Avocado installation using pip

This patch enables all the optional plugins in travis to increate the
test coverage.

Reference: https://trello.com/c/UHdVHzOZSigned-off-by: NAmador Pahim <apahim@redhat.com>

We have introduced updated packages (41.0) to PyPI, which now support
a much improved installation experience using pip. Let's add a section
on that.

While on that, let's restructure the sub sections levels.  The proposal
here for the sub sections on the "Installing Avocado" section is:

   1) Installing from Packages
   1.1) Fedora
   1.2) Enterprise Linux
   2) Generic installation from a GIT repository
   3) Installing from standard Python tools
Signed-off-by: NCleber Rosa <crosa@redhat.com>

When the test fails, it is useful to expose the local variables of the
test function.
Signed-off-by: NAmador Pahim <apahim@redhat.com>

* https://github.com/avocado-framework/avocado:
  rename make to run_make which using process.run
  fix style compatible to pep8 standard

Signed-off-by: NCleber Rosa <crosa@redhat.com>

* spell:
  spell.ignore: add exceptions for this release

Adding exception to the spell.ignore.
Signed-off-by: NAmador Pahim <apahim@redhat.com>

* https://github.com/avocado-framework/avocado:
  testplan: install and start qemu-ga

Now the --vm-domain, when used without --vm-hostname, requires the qemu
guest agent to be running. This patch includes this information in our
pre-release test plan.
Signed-off-by: NAmador Pahim <apahim@redhat.com>

Signed-off-by: NPraveen K Pandey <praveen@linux.vnet.ibm.com>

Signed-off-by: NPraveen K Pandey <praveen@linux.vnet.ibm.com>