This changes the S3AccessHelper API to take a file instead of an input
stream.

This allows s3 client to properly reset a file instead of a file over
stream for writes.

This fixes an issue where the underlying s3 implementation has an
intermittent failure, tries to reset the stream, fails to do so, and
results in hung requests with delayed errors.

This closes #7494

The clock parameter is missing in the docstring.

This closes #7484.

This closes #7485.

This closes #7491.

This closes #7477.

In order to use the RocksDBStateBackend, the user has to add the flink-statebackend-rocksdb
dependency to his project. This commit adds this information to the state_backends.md.

This closes #7480.

This commit removes container requests after containers have been allocated. This prevents that
we will request more and more containers from Yarn in case of a recovery.

Since we cannot rely on the reported container Resource, we remove the container request by
using the requested Resource. This is due Yarn's DefaultResourceCalculator which neglects the
number of vCores when allocating containers.

This closes #7430.

Derby has two CVE's:
https://ossindex.sonatype.org/vuln/b01781a6-31db-4dbc-b091-d683aaeb98e6
https://ossindex.sonatype.org/vuln/bbe6594a-c255-41a7-a397-d762d1aa8b00

Although it is only a test dependency, updating would be nice.

Offset is Long type, the default value is null, and executing offset+=1 in Java 1.8.x will throw a NullPointerException

Logging configuration was set only for scala-shell in yarn mode. This commit sets the configuration for local and remote mode in start-scala-shell.sh script as well.

This closes #7258

This closes #7453.

Move final application report logging out of the shutdownCluster method. This allows
to not log the final application report if the cluster is shut down via a shutdown hook.

This closes #7414.

Change-Id: Id79c8bf97002a387a80be563a43dce3210143dc2

The markdown treats the TOC as the last item in CLI use list, thus this list could not be shown properly. This PR revert the two paragraph to fix this issue.

This closes #7437