This closes #7491.

This closes #7477.

In order to use the RocksDBStateBackend, the user has to add the flink-statebackend-rocksdb
dependency to his project. This commit adds this information to the state_backends.md.

This closes #7480.

This commit removes container requests after containers have been allocated. This prevents that
we will request more and more containers from Yarn in case of a recovery.

Since we cannot rely on the reported container Resource, we remove the container request by
using the requested Resource. This is due Yarn's DefaultResourceCalculator which neglects the
number of vCores when allocating containers.

This closes #7430.

Derby has two CVE's:
https://ossindex.sonatype.org/vuln/b01781a6-31db-4dbc-b091-d683aaeb98e6
https://ossindex.sonatype.org/vuln/bbe6594a-c255-41a7-a397-d762d1aa8b00

Although it is only a test dependency, updating would be nice.

Offset is Long type, the default value is null, and executing offset+=1 in Java 1.8.x will throw a NullPointerException

Logging configuration was set only for scala-shell in yarn mode. This commit sets the configuration for local and remote mode in start-scala-shell.sh script as well.

This closes #7258

This closes #7453.

Move final application report logging out of the shutdownCluster method. This allows
to not log the final application report if the cluster is shut down via a shutdown hook.

This closes #7414.

Change-Id: Id79c8bf97002a387a80be563a43dce3210143dc2

The markdown treats the TOC as the last item in CLI use list, thus this list could not be shown properly. This PR revert the two paragraph to fix this issue.

This closes #7437

[FLINK-11073] [state backends, tests] Activate ignored testKeyedListStateSerializerReconfiguration test in StateBackendMigrationTestBase

This test was previously ignored due to 2 missing changes:
- ListSerializerSnapshot was not respecting serializer reconfiguration
  (fixed by FLINK-11073), and
- RocksDBListState did not use the correct registered state serializer
  in backend's state meta info (fixed by FLINK-11287)

With those fixes in, the test can now be activated and expected to pass.

This closes #7434.

* [FLINK-10436] Add ConfigOption#withFallbackKeys

* [hotfix] correct javadoc

* [FLINK-10436] Code quality improvement

Move initialization logic out of the ZooKeeperSubmittedJobGraphStore constructor.

This addresses CVE-2018-11771.

Bump the jython dependency because of a security issue.