Now that the variant IDs are not a sequential number, we need this extra
information so users can easily know how many variants were generated.

Reference: https://trello.com/c/N7pB9E4OSigned-off-by: NAmador Pahim <apahim@redhat.com>

Signed-off-by: NAmador Pahim <apahim@redhat.com>

This adds the RFC on LTS to the documentation for future reference.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

After proposals discussions on the mailing list, RFCs shape the
current or future status of Avocado.  It makes sense to archive
them for future reference.

Also some RFCs are constantly referred in other parts of the
documentation, so it makes sense to allow cross references between
them.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

* https://github.com/avocado-framework/avocado:
  skip exceptions cleanup
  skip classes: internal improvements

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Test ID has the test UID, the Test Name and the Variant. Let's split
those three information so users can order by any of them separately.
Signed-off-by: NAmador Pahim <apahim@redhat.com>

Convenience tooltip to expose the parameters available to the test.
Signed-off-by: NAmador Pahim <apahim@redhat.com>

The TestDecoratorSkip and TestTimeoutSkip exceptions are not used
anymore. This patch removes them from avocado.exceptions and simplifies
the exception handlers in avocado.test

The only missing piece is to remove the TestSetupSkip exception, when the
time to drop the self.skip() comes.
Signed-off-by: NAmador Pahim <apahim@redhat.com>

Due to the deprecation of the self.skip(), the availability of the skip
decorators and the new CANCEL status, some internal improvements are
important to keep our behaviour sane and our own code sound and clean.

- The test.SkipTest class was renamed to test.MockingTest to be even more
  generic, intending to be overridden by sub-classes that make the test
  to end both with SKIP or CANCEL status. To keep it generic,
  test.MockingTest class will not SKIP the test if used directly anymore.

- The test.TimeOutSkipTest and test.ReplaySkipTest classes now are using
  the skip decorators instead of raising an exception in setUp(), since
  'skipping' the test means 'don't execute anything', not even the
  setUp().

- The test.DryRunTest class, which is expected to log itself in setUp()
  and then abort the test execution, is now using self.cancel() (instead
  of raising a SKIP exception), being now compliant with the concept
  that a SKIP test cannot execute anything.

- Selftests were adjusted accordingly.
Signed-off-by: NAmador Pahim <apahim@redhat.com>

Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

* https://github.com/avocado-framework/avocado:
  utils: Improve error message of pci.get_pci_class_name

When there is no device associated to given pci_address the error
message is a bit misleading. Let's report a better one.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

* https://github.com/avocado-framework/avocado:
  utils: Add "get_pci_class_name" method to pci.py

Signed-off-by: NAmador Pahim <apahim@redhat.com>

Test which are using this utility are failing as they start using
multipath as soon as services are re-satrted. But multipath need
some time to load the services completely. So to load the
multipaths properly we need to give some sleep time which resolve
the issue
Signed-off-by: NNaresh Bannoth <nbannoth@in.ibm.com>

Signed-off-by: NAmador Pahim <apahim@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Robot plugin was introduced without documentation. This PR adds the
basic information about the Robot plugin.
Signed-off-by: NAmador Pahim <apahim@redhat.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

* https://github.com/avocado-framework/avocado:
  SPEC file: include resultsdb subpackage
  resultsdb plugin: require avocado-framework

This packages the newly introduced resultsdb optional plugin.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

All optional plugins require the installation (or presence) of
"avocado-framework", so let's do that to the newly introduced
resultsdb plugin too.
Signed-off-by: NCleber Rosa <crosa@redhat.com>

We have a new section "optional_plugins". Let's create a "results"
category, move the "html" plugin documentation there and link to this
place from the "Result formats" section.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

The ResultsDB expects the Testcase, not the Test ID. Even so, the
Testcase can be considered the combination of the test name plus the
variant.

While on this, this patch adds the parameters information to the
ResultsDB 'data' section.
Signed-off-by: NAmador Pahim <apahim@redhat.com>

Some spelling issues, broken link fixes and updates related to recent
changes in Avocado.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

The default for our configuration is currently /var/lib, which was not
reflected in Configuration documentation. This is not really important
as we only share it as "example configuration" but it might create
confussion.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

With the resultdb optional plugin new arguments were added which are
missing in our man pages.
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NAmador Pahim <apahim@redhat.com>

The avocado-server now requires both, "requirements.txt" and
"requirements-selftests.txt" to run "make check".
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

When --html is used the original in-job-dir results are removed just
before the second render. This was probably due to typo as the original
location was (probably) intended for removal. This patch doesn't do that
because the user-defined dir can be shared dir with other user files so
let's just produce the results and keep the dirs intact (while keeping
the refresh in job-dir as that is guaranteed to be our directory and we
do know it can be removed).
Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

Given the PCI address, function will return corresponding
PCI Class name
Signed-off-by: NVenkat R B <vrbagal1@linux.vnet.ibm.com>

Signed-off-by: NCleber Rosa <crosa@redhat.com>

Signed-off-by: NLukáš Doktor <ldoktor@redhat.com>

* https://github.com/avocado-framework/avocado:
  resultsdb plugin