(cherry picked from commit 35861a99)

Authored-by: NTingfang Bao <bbao@pivotal.io>

Prior to this change it would only run on centos7.
Also pipelines that did not target centos7 would
fail to run.
Co-authored-by: NMark Sliva <msliva@pivotal.io>
Co-authored-by: NAmil Khanzada <akhanzada@pivotal.io>
(cherry picked from commit e995ae86)

The gpconfig test was failing for UTF-8 characters when run on Ubuntu because
our test containers use the POSIX locale. In this commit, we have set the
`LC_TYPE` to `en_US.UTF-8` for the gpconfig test so that the test has the same
behavior on all platforms.

(cherry picked from commit 4ba11535)
Co-authored-by: NJacob Champion <pchampion@pivotal.io>

Authored-by: NTingfang Bao <bbao@pivotal.io>

Authored-by: NTingfang Bao <bbao@pivotal.io>

The resource rename is needed in order to fetch the correct version.
Co-authored-by: NBradford D. Boyle <bboyle@pivotal.io>
Co-authored-by: NMark Sliva <msliva@pivotal.io>

Co-authored-by: NBradford D. Boyle <bboyle@pivotal.io>
Co-authored-by: NMark Sliva <msliva@pivotal.io>

Co-authored-by: NBradford D. Boyle <bboyle@pivotal.io>
Co-authored-by: NMark Sliva <msliva@pivotal.io>

Instead of re-compiling from source at a release tag, the pipeline downloads a
released RPM from PivNet and transforms it to a tarball for use in binary_swap
tests.
Co-authored-by: NAsim Praveen <apraveen@pivotal.io>
Co-authored-by: NBradford D. Boyle <bboyle@pivotal.io>

Authored-by: NTingfang Bao <bbao@pivotal.io>

   Add the windows clinets testing jobs to pipelines
Authored-by: NTingfang Bao <bbao@pivotal.io>

We have added Ubuntu 18.04 support for the behave CLI tests.
Co-authored-by: NJacob Champion <pchampion@pivotal.io>
Co-authored-by: NDavid Krieger <dkrieger@pivotal.io>
Co-authored-by: NNikolaos Kalampalikis <nkalampalikis@pivotal.io>

(cherry picked from commit 35d74d57)

Authored-by: NBradford D. Boyle <bboyle@pivotal.io>

Due to the number of platforms we now support and variety of customer
specific environments, it is not practical to update gpcheck to cover
all these cases.
Co-authored-by: NJamie McAtamney <jmcatamney@pivotal.io>
(cherry picked from commit 50f98856)

Authored-by: NTingfang Bao <bbao@pivotal.io>

This PR removes SLES11 from the gpAux build system and from Concourse CI
scripts. SLES11 will not be supported for GPDB 6+.

(cherry picked from commit 9b60c5b4)

Authored-by: NTingfang Bao <bbao@pivotal.io>

Co-authored-by: NBradford D. Boyle <bboyle@pivotal.io>
Co-authored-by: NJesse Zhang <jzhang@pivotal.io>

Rename pipeline_type to pipeline_target for clarity now that teams
have their own concourse instance and the -t argument specifys the fly
target.

Also add two new flags: --pipeline_configuration, to make it easy for
teams to make dev pipelines that match the prod pipeline, and
--use_branch, to make it easier to have pipelines in flight for
multiple branches without overlap.
Co-authored-by: NJamie McAtamney <jmcatamney@pivotal.io>
Co-authored-by: NShoaib Lari <slari@pivotal.io>

Co-authored-by: NDavid Krieger <dkrieger@pivotal.io>
Co-authored-by: NJacob Champion <pchampion@pivotal.io>
Co-authored-by: NShoaib Lari <slari@pivotal.io>
(cherry picked from commit db4c1daf)

Co-authored-by: NJamie McAtamney <jmcatamney@pivotal.io>
Co-authored-by: NMark Sliva <msliva@pivotal.io>
Co-authored-by: NKalen Krempely <kkrempely@pivotal.io>

(cherry-picked from 256d8380)
Co-authored-by: NGoutam Tadi <gtadi@pivotal.io>
Co-authored-by: NAmil Khanzada <akhanzada@pivotal.io>

Co-authored-by: NDavid Sharp <dsharp@pivotal.io>
Co-authored-by: NGoutam Tadi <gtadi@pivotal.io>
(cherry picked from commit 8af57a90)

(cherry picked from commit bb532dec)

concourse/scripts/gppkg_behave.sh, which installs an identical copy of
GPHOME into a new location, existed for exactly one test. Modify that
test to perform its own copy-install.

(cherry picked from commit e6b40a71)

gpexpand requires centos6, ICW, and CLI jobs to be enabled, but it was
being included in the groups when only a subset of those requirements
was met, so fly refused the pipeline. With this change, centos6/CLI
pipelines should work again.

(cherry picked from commit 52a21767)

  This is different from the gpdb-master,
  The gpdb-master pipeline save the RC artifacts
  to the server/published/master/
Authored-by: NBob Bao <bbao@pivotal.io>

Story: https://www.pivotaltracker.com/story/show/164917628

   The gp-integration-testing pipeline needs the gp-clients RC
   package as a input, and then create the clients RPM base on it.
   The custom installer patch also need it to build client bin installer.
Co-authored-by: NXiaoran Wang <xiwang@pivotal.io>
Co-authored-by: NShaoqi Bai <sbai@pivotal.io>
Co-authored-by: NBob Bao <bbao@pivotal.io>

6X_STABLE: Parameterize pipeline config to control binary swap tests 

Currently there are infrastructure issues affecting the maintainability
of these jobs. Until we can address these underlying issues, all CI jobs
related to AIX are being removed.
Co-authored-by: NPeifeng Qiu <pqiu@pivotal.io>
Co-authored-by: NBradford D. Boyle <bboyle@pivotal.io>
Co-authored-by: NKris Macoskey <kmacoskey@pivotal.io>

Co-authored-by: NOliver Albertini <oalbertini@pivotal.io>
Co-authored-by: NBradford D. Boyle <bboyle@pivotal.io>

Previously was using master.
Co-authored-by: NOliver Albertini <oalbertini@pivotal.io>
Co-authored-by: NBradford D. Boyle <bboyle@pivotal.io>

Make "demo_cluster" the default tag (ie: no tag). That is, when a
scenario does not specify a behave tag it uses the demo cluster
environment to run. Use the concourse_cluster tag if a scenario requires
a remote cluster. Concourse runs the scenarios with no tag that use a
demo cluster by filtering for --tags=~concourse_cluster.
Authored-by: NKalen Krempely <kkrempely@pivotal.io>
(cherry picked from commit 40028cf4)

Regenerate pipeline from CLI_BEHAVE_TESTS refactor.

(cherry picked from commit 5dc3bfaa)

* Remove unused IVYREPO_ variables for CentOS 6/7

Ivy is no longer used for CentOS 6/7.
Authored-by: NAmil Khanzada <akhanzada@pivotal.io>

* Remove unused IVYREPO_ variables for Coverity

Ivy is no longer used for CentOS 6/7 and will go away.
The coverity pipeline is also puased at this point in time, but we'll
clean this up now.

(cherry-picked from c4c99bb0)
Co-authored-by: NBradford D. Boyle <bboyle@pivotal.io>
Co-authored-by: NAmil Khanzada <akhanzada@pivotal.io>

* Fix bin_gpdb_centos6_icw_green versioned_file to store artifacts in gpdb_branch_6X_STABLE
* Generate pipeline

For GP 6 beta, the release engineering team is removing the apr-util
package from the list of bundled dependencies. Users will be asked
to provide their own apr-util package, which can differ in the version
on each platform. So it is necessary to verify gpperfmon is workable
with the platform provided apr-util on each supported platform.

Originally, gpperfmon test is done in CLI test suite, only covers centos6.
This commit changed it to a dedicated suite in order to test multiple
platforms.
Note: on SLES12 does not need to install libapr-util1 to run gpmmon

We add gpmovemirrors tests and add them to the pipeline as well.
Using behave tags, some of the tests can run locally on a demo
cluster.  We also introduce Behave tag logic to choose which
tests to run.

<Co-Authored-By> Kalen Krempely <kkrempely@pivotal.io>
<Co-Authored-By> Mark Sliva <msliva@pivotal.io>
(cherry-picked from fdf8b611)

This job is used to test online expand, it will create a cluster
with two segments, then expand to 3 and run all ICW to check
whether the cluster is OK after expansion.
As restart is forbidden in online expand test, so we exclude all
the case which contains restart opertaion. But if someone add a
new test with restart, the job may fail. Manual intervention to
exclude the test is needed.
So we move this job to our own dev pipeline to reduce the impact
on prod pipeline.