[ci skip]

Now that catalog updates are allowed, we should disable binary swap
validation.  Once the next catalog freeze comes, someone can flip this
back.

* Make PXF part of the gpdb binary

* Fix popd error

Signed-off-by: NNadeem Ghani <nghani@pivotal.io>

* Refactor GPHDFS regression to run for pxf

* remove customized Hadoop home location

* PXF tarball creation inside GPDB pipeline

* Remove legacy directory

* Use enable_pxf instead of with_pxf

Signed-off-by: NLarry Hamel <lhamel@pivotal.io>

Add MM_gpinitstandby as part of release candidate

Follow up commit on 51a1cad7

Signed-off-by: NShoaib Lari <slari@pivotal.io>

Signed-off-by: NLav Jain <ljain@pivotal.io>
Signed-off-by: NOleksandr Diachenko <odiachenko@pivotal.io>
Signed-off-by: NShivram Mani <smani@pivotal.io>
Signed-off-by: NJohn Gaskin <jgaskin@pivotal.io>
Signed-off-by: NAlexandra Wang <lewang@pivotal.io>

New jobs should also be added to the "All" group, but we expect that
there may be exceptions and it's not a dealbreaker

If the reusable anchors are declared at the end, some yaml parsers may
have trouble reading the file. In this case, pyyaml was throwing:

```
yaml.composer.ComposerError: found undefined alias 'ccp_create_params'
  in "<string>", line 702, column 11:
          <<: *ccp_create_params
              ^
```

Signed-off-by: NMarbin Tan <mtan@pivotal.io>

Signed-off-by: NNadeem Ghani <nghani@pivotal.io>

Signed-off-by: NJim Doty <jdoty@pivotal.io>

In order to protect users of the concourse cluster provisioner service from
some pending breaking changes, we are pinning the master pipeline to the latest
tag for the concourse cluster provisioner repo.  We will in the future facilitate
upgrades on the master pipeline to take advantage of the next release.
Signed-off-by: NJim Doty <jdoty@pivotal.io>

1)add pipeline job for resource group test
2)make test cases independent of segment count and hosts count

Discussed w/ CJ - we'll work offline on a better way to address groups but will temporarily accept this 

The job runs FTS tests and has failed intermittently.  By increasing
gp_segment_connect_timeout, we reduce the chance that test environment will
cause failures.
Signed-off-by: NAsim R P <apraveen@pivotal.io>

We would like to have the VMs up if there's a failure.

Signed-off-by: NMarbin Tan <mtan@pivotal.io>
Signed-off-by: NLarry Hamel <lhamel@pivotal.io>

Signed-off-by: NXin Zhang <xzhang@pivotal.io>

Signed-off-by: NTushar Dadlani <tdadlani@pivotal.io>
Signed-off-by: NLarry Hamel <lhamel@pivotal.io>

This will allow a user to cancel debug_sleep and be ensured the
ccp_destroy will still cleanup any created clusters.

The source code for gpdb is being copied to the master node, so there is no need to run scripts
in the container that can be directly run on the master node.  This makes scripts in the GPDB source
tree not depend on the connection that CI system has to the cluster, just that your test is running on
a cluster.
Signed-off-by: NDivya Bhargov <dbhargov@pivotal.io>

The instance size specified in the ccp_options anchor do not have to
match in the ccp_destroy anchor, the only requirement is that the field
must exist. With this revelation, there does not need to be test
specific anchors defined in ccp_options.

Instead the pattern is to not use a ccp_options anchor, but instead to
explicitly set the desired instance type for a given test.
Signed-off-by: NJingyi Mei <jmei@pivotal.io>

Signed-off-by: NKaren Huddleston <khuddleston@pivotal.io>
Signed-off-by: NChris Hajas <chajas@pivotal.io>

This commit introduces BEHAVE_FLAGS as a new parameter in concourse.
This will help us run specific tests within a specific scenario, it used
to be just all or nothing. Now we can separate multi-host testing vs
single host testing.

Add tests for gppkg --clean for multi-host
 * gppkg --clean should install to the segment host with no gppkg
 * gppkg --clean should remove on all segment hosts when gppkg does not exist in master

Signed-off-by: NXin Zhang <xzhang@pivotal.io>

This is the final part of the backup and restore TINC to behave
migration. The MFR suite tests the managed file replication for Data
Domain.
Signed-off-by: NChris Hajas <chajas@pivotal.io>

Signed-off-by: NJim Doty <jdoty@pivotal.io>

In an effort to make each secret have less access we are moving to use
git deploy keys to pull changes from github.

 For now GPDB and its submodules are public, so we should be able to
 pull without any keys.
Signed-off-by: NDivya Bhargov <dbhargov@pivotal.io>
Signed-off-by: NJim Doty <jdoty@pivotal.io>

This patch contains the changes to pipeline.yml to enable the testing of
segment wal replication feature on concourse.
Signed-off-by: NAbhijit Subramanya <asubramanya@pivotal.io>

* Remove DDBoost Full and Incremental backup/restore TINC jobs
* Add behave backup/restore DDBoost job

The previous job took 3h, 50 mins and the new job takes 1h, 20 mins.

Signed-off-by: NTushar Dadlani <tdadlani@pivotal.io>

Signed-off-by: NLarry Hamel <lhamel@pivotal.io>