The parallelism tests were too stringent, wanting to observe maximum parallelism
in order to go green. An example failure we saw was as follows, when 3 threads
had been "In Progress" together, but not all four (because one thread finished
really quickly):

`Worker GpExpandTests.check_number_of_parallel_tables_expanded_case_1 failed
execution: AssertionError: The specified value was never reached.`

Now, we simply assert that some parallelism is observed at some point (2 or more
"In Progress" at a time). If a test run "flakes" such that there never were two
"In Progress" at a time, that would be indistinguishable from serial execution,
so the test would still fail.

Author: C.J. Jameson <cjameson@pivotal.io>
Author: Shoaib Lari <slari@pivotal.io>

Author: C.J. Jameson <cjameson@pivotal.io>
Author: Shoaib Lari <slari@pivotal.io>

Run a distributed query across all segments to force FTS to detect and mark all
downed segments.

Author: Nadeem Ghani <nghani@pivotal.io>
Author: Marbin Tan <mtan@pivotal.io>
Author: Shoaib Lari <slari@pivotal.io>
Author: C.J. Jameson <cjameson@pivotal.io>

If we did stop all primaries on that host, the cluster would be down
anyway. Best to just do a full-cluster gpstop, then bring it all back up
together.

underlying pylib code identifies master and standby by content id

`gpstop --host localhost` will fail differently: it will simply not find
the host in the set of hostnames (unless that's how you configured
things at first)

For interaction with `-r`: Since we don't stop the master with --host, restart
will fail anyways, so we don't allow it from the get go.

For interaction with `-m`: If someone is using `--host` and then thinking they
want to stop the master but not the segments on a particular host, they should
just do a full gpstop and then bring everything back up. If someone is using
`-m` and then thinking they need to specify the host for the `-m` flag, they
don't need to -- the tool infers from the system and shell state.

Author: C.J. Jameson <cjameson@pivotal.io>
Author: Shoaib Lari <slari@pivotal.io>
Author: Marbin Tan <mtan@pivotal.io>

Signed-off-by: NMarbin Tan <mtan@pivotal.io>

Add a flag `--host` which stops all segments
on the specified host. An easy way to take down a set of segments
without having to ssh and kill processes.

Refuse to stop specific host if any primary isn't synched
Signed-off-by: NNadeem Ghani <nghani@pivotal.io>
Signed-off-by: NC.J. Jameson <cjameson@pivotal.io>

This class was handling the hasMirrors field incorrectly. Now we're
correctly setting the hasMirrors flag.

This change broke the gpaddmirrors test, so fixed it.

The check for whether the remote server is a Greenplum instance was
using the current version as an optimization, but with the current
strategy of aggressively merging that will become a problem. Remove
the version check and only go by the server version() output instead.

* add -compression-level

* add -single-data-file option

* add gprestore -include-schema and -include-table-file options

* removing statement about using -compression-level and -no-compression together

* remove restriction about using both -include-schema and -redirect together

* remove restriction about using both -include-table-file and -globals together

* add note re: default compression level

eg:

if(big_condition_a &&
   big_condition_b)

not:

if(big_condition_a
   && big_condition_b)

- This is not intended to replace pgindent, but can help get close to
  Postgres style during development.
- It is not completely matching the Postgres style, so please update it
  as you use it.
Signed-off-by: NAmil Khanzada <akhanzada@pivotal.io>

* docs: optimizer_join_order guc

* Implement suggested edits

* Note iteractions with other params; correct inaccurate statement.

* Clarify this is a GPORCA guc

* docs: postGIS - add GDAL raster driver information

* docs: postgis GDAL - fix typos.

Instead of throwing a NOTICE on every object/role combination, track
whether anything at all was revoked, and only issue one NOTICE for the
whole command, if nothing was revoked. This reduces the noise if the REVOKE
lists multiple objects and/or roles.

This refactoring makes it easier to carry this diff vs. upstream, as we
merge the column-level permissions feature from upstream.

Discussion: https://groups.google.com/a/greenplum.org/d/msg/gpdb-dev/Ttn_UJb4Otg/LS1cFrDiAwAJ

Commit 3fe43b8a introduced a lock upgrade in the plan revalidation
for UDFs. This makes the lock acquire in RevalidateCachedPlanWithParams()
match CdbTryOpenRelation() closer in order to avoid distributed deadlock
for UPDATE/DELETE DMLs. It does however also upgrade the lock for INSERT
which is overly aggressive. Fix by only upgrading the lock for the two
specified DML commands. Also includes an isolationtest test that cause
distributed deadlock without this patch.

This solves reported cases of deadlock introduced around INSERTs in UDFs.

The simplejson library was partially imported, but no longer used
so remove. Suds seemed to be vendored more intact, but also seems
unused to remove as well.

This was accidentally removed in the commit that changed debug_sleep

While porting the test from tinc, we added a schema for each test.
During refactoring we forgot to add the schema name and correct table
name in the test query.

The failed cluster now will remain running for some time and can be accessed
Signed-off-by: NEd Espino <eespino@pivotal.io>

* docs: PL/Container - add information about disk quotas

The information is added to the Notes section.

Also
--edited some existing information
--fixed description of plcontainer_refresh_config and plcontainer_show_config to be views, not functions

* docs: plcontainer - fix typo

* docs: pl/container - clarified when base device size is displayed by docker info.

ServiceUnavailable and RequestTimeout are errors needed retry, this
commit treats them as S3ConnectionError.

Other errors returned by S3 than 500, 503 and RequestTimeout are
still considered as S3LogicError.

Move gporca regression test out of the parallel group so that
gp_fault_injector functionality works correctly.
Also, as it turns out, ORCA is used to run pg/PLSQL queries sometimes
even when the GUC optimizer is set to off. So when gporca sets up the
gp_fault_injector, it gets activated later on in parallel group
qp_functions_in_from test is part of. So, reset the fault in gporca just
in case.

These were added back in 2009 to work around DNS issues on Mac OS X. The
comment there says it shouldn't really be needed, and should be removed
once we gain confidence that it's not needed. I'm feeling confident now;
there are no hacks like this in the upstream, and I don't recall any
reports of issues like this.

It was used by the old nb_classify() aggregate function. It was removed in
commit fae97ae7, but this type was left over.

These tests were failing, because commit 724f9d27 changed the error
message. Instead of just memorizing the new expected output, let's remove
these tests altogether. We have similar tests in the main regression suite,
that ought to be enough.