The flip6 build profile only runs the Flip-6 related test cases. Moreover,
all Flip-6 related test cases are excluded when not running the flip6 build
profile. This should reduce testing time when adding more and more Flip-6
test cases.

Include flink-test-utils-junit in all submodules to make the Category marker interfaces Flip6 and OldAndFlip6 available

This closes #4889.

+ includes a new unit tests for recursive uploads to hfds:// targets
+ add a unit test for recursive file uploads to s3:// via s3a

[FLINK-4228][yarn/s3] turn the dependencies around

Instead of having flink-s3-fs-hadoop depend on flink-yarn_<scala_version>,
let flink-yarn depend on the s3 filesystem and implement the test there.
This is safer with regards to the scala-independent flink-s3-fs-hadoop project.

[FLINK-4228][yarn] change the S3 upload tests to use Hadoop's S3 implementations

This is how YARN would use it and what should really be tested.

[FLINK-4228][yarn] enable S3 tests for newer Hadoop versions

- requires the 'include_hadoop_aws' build profile (or property) to be set
- requires a newer aws-sdk version (than Hadoop pulls in) to work with our
  httpcomponents version
- we also add a check that at least one S3 implementation is tested to not
silently ignore all tests because of such a missing dependency

This closes #4939.

Disable it in most modules.

We can do this now that we dropped support for Scala 2.10.

This closes #4807

This closes #4453.

This closes #3495.

Use scala.binary.version as defined in the parent POM and remove the
script to swap scala version identifiers.

This closes #3800

This closes #3132

This uses Flakka (a custom Akka 2.3 build) to resolve the issue that
the bind address needs to be matching the external address of the
JobManager. With the changes applied, we can now bind to all
interfaces, e.g. via 0.0.0.0 (IPv4) or :: (IPv6).

For this to work properly, the configuration entry
JOB_MANAGER_IPC_ADDRESS now represents the external address of the
JobManager. Consequently, it should not be resolved to an IP address
anymore because it may not be resolvable from within containered
environments. Akka treats this address as the logical address. Any
messages which are not tagged with this address will be received by
the Actor System (because we listen on all interfaces) but will be
dropped subsequently. In addition, we need the external address for
the JobManager to be able to publish it to Zookeeper for HA setups.

Flakka: https://github.com/mxm/flakka
Patch applied: https://github.com/akka/akka/pull/15610

- convert host to lower case
- use consistent format for IPv6 address
- adapt config and test cases
- adapt documentation to clarify the address config entry
- TaskManager: resolve the initial hostname of the StandaloneLeaderRetrievalService

This closes #2917.

This closes #2850

This closes #2324

- Add YarnFlinkResourceManager test to reaccept task manager registrations from a re-elected job manager

- Remove unnecessary sync logic between JobManager and ResourceManager

- Avoid duplicate reigstration attempts in case of a refused registration

- Add test case to check that not an excessive amount of RegisterTaskManager messages are sent

- Remove containersLaunched from YarnFlinkResourceManager and instead not clearing registeredWorkers when JobManager loses leadership

- Let YarnFlinkResourceManagerTest extend TestLogger

- Harden YarnFlinkResourceManager.getContainersFromPreviousAttempts

- Add FatalErrorOccurred message handler to FlinkResourceManager;
  Increase timeout for YarnFlinkResourceManagerTest;
  Add additional constructor to TestingYarnFlinkResourceManager for tests

- Rename registeredWorkers field into startedWorkers
Additionally, the RegisterResource message is renamed into NotifyResourceStarted which
tells the RM that a resource has been started. This reflects the current semantics of
the startedWorkers map in the resource manager.

- Fix concurrency issues in TestingLeaderRetrievalService

This closes #2257

This closes #1915

Consolidation is done via plugin management.

Closes #1753

- add suffixes
- adapt change-scala-version script

This closes #1529.

0.10-SNAPSHOT continues on branch release-0.10

Tests would fail because of version conflicts because the tests include
the original curator dependencies even though we shade them away in the
final build result.

This also fixes dependency management entries for curator dependencies.
We shade it, therefore it cannot be in the dependency management
section in the root pom.

Closes #851

This closes #689

This closes #454

- users can now also deploy Flink on YARN for executing a single job.
- The flink-yarn project has been moved out of the flink-addons module
- the MiniYARNCluster is used for testing Flink on YARN
- There is now a (undocumented) Java interface Flink's YARN client, allowing users to manually control the Yarn session.
- ALL ports used by Flink when running on YARN are automatically determined. In the past users reported problems with blocked ports (YARN is telling the client the RPC address of the application master)
- The checks before deployment have been improved to give better error messages if the user is requesting too many resources for a YARN session

to HadoopFileSystem wrapper, which supports all subclasses of org.apache.hadoop.fs.FileSystem.
This allows us to let users use all file systems with support for HDFS.
The change has been tested with Tachyon, Google Cloud Storage Hadoop Adapter and HDFS.

The change also cleans up the Hadoop dependency exclusions.

Removed Disclaimer file
Eliminated unnecessary incubating substrings
Bumped version to 0.9-SNAPSHOT

Replacing the EventCollector and the MemoryArchivist.

Finished EventCollector and adjusted ExecutionGraph and ExecutionVertex to register actors as listeners.

This closes #232

- Clean dependencies in flink-streaming connectors