This closes #2460.

This way, if all slaves refer to "localhost", we do not require ssh at all.

This closes #3298

This closes #3657

This will be re-added when we have a coherent plan for Docker support
and after the official Docker images are available.

This closes #3658

This closes #3679

This closes #3687

This closes #3706

[FLINK-6210] [rocksdb] Close RocksDB in ListViaMergeSpeedMiniBenchmark && ListViaRangeSpeedMiniBenchmark

This closes #3652

This closes #3592

This closes #3600

Sorts files read from Flink's lib directory and places the distribution
JAR to the end of the CLASSPATH.

This closes #3632

This closes #3749

Properly reset the "pipeline breaker" upon closing.

This closes #3747

This closes #3598

This closes #3738.

This more intuitivce name clarifies the role of the class.
This also marks the class as PublicEvolving, as it is not actually used as an internal class.

This reduces the public API of the StreamingJobGraphGenerator to a static createJobGraph() method,
which internally instantiates a generator, creates the job, and drops the generator.

Cleanup to consistently use
  - checkpoint for the overall fault tolerance mechanism and procedure
  - snapshot for an operators state snapshot that is part of a checkpoint

  - Move new 'Types' class to 'common' scope, not 'java api'.
  - Make the method names the same in Scala and Java

This closes #3127

This closes #3722

[hotfix] [tests] Stabilize AsyncCallsTest by ensuring delayed messages are not executed before their time

This closes #3740.

- refactor SimpleDriver to call internal plan method
- add CLI parameters for RMatGraph, AdamicAdar, JaccardIndex
- remove unused data from VertexDegrees
- JaccardIndex now filters on > rather than >=
- handle null in ValueArrayTypeInfo
- add NonForwardingIdentityMapper to GraphUtils

This closes #3414.

JDBCFullTest:
- split testJdbcInOut into 2 methods to avoid manul test-lifecycle calls
JDBCTestBase:
- remove all qualified static accesses
- remove static Connection field
- remove (now) unused prepareTestDB method
- create RowTypeInfo directly instead of first allocating a separate
TypeInfo[]
- rename testData to TEST_DATA in-line with naming conventions
- rework test data to not rely on Object arrays

JDBCInputFormatTest:
- call InputFormat#closeInputFormat() in tearDown()
- simplify method exception declarations
- remove unreachable branch when format returns null (this should fail
the test)
- replace loops over splits with for-each loops
- rework comparisons; no longer ignore nulls, no longer check class,
compare directly against expected value

JDBCOutputFormatTest:
- directly create Row instead of first creating a tuple
- simplify method exception declarations

General:
- do not catch exceptions if the catch block only calls Assert.fail()

This closes #3723.

[FLINK-6149] [table] Add additional flink logical relation nodes and separate current optimization to logical and physical optimize

This closes #3594.

This commit exposes the union list state scheme for managed operator state.
The actual functionality was already previously added to the
`DefaultOperatorStateBackend`, so this change simply exposes the feature
through the `OperatorStateStore` interface.

This commit also updates the documentation for managed operator state so
that it covers the new union list state scheme. It strengthens the
difference between keyed and non-keyed state data structures by
emphasizing the semantic differences in the state access method Javadocs.

This closes #3508.

This commit refines the OperatorStateStore interface by,
- deprecating Java serialization shortcuts
- rename getOperatorState to getListState

The Java serialization shortcuts are deprecated because they were
previously introduced to provide a smoother migration path from older
savepoints. However, its usage should definitely be discouraged.

Renaming to getListState is a preparation of making the names of state
access methods contain information about both its redistribution pattern
on restore and the shape of its datastructure, since the combination of
these two is orthogonal. This convention will also provide a better
naming pattern for more state access methods in the future, for example
getUnionListState. If the method name does not contain its
redistribution pattern (e.g., getListState), then it simply implies the
default repartitioning scheme (SPLIT_DISTRIBUTE).

This reverts commit 9cfae899.

The fixes around FLINK-5808 introduced follow-up issues.

This reverts commit e4fbae36.

The fixes around FLINK-5808 introduced follow-up issues.

This reverts commit f31a55e0.

The fixes around FLINK-5808 introduced follow-up issues.

And earlier version of the code was throwing an NPE if the sink was
closed without ever seeing any input.