This closes #5117.

This closes #4504.

The Container Interface was extended in Hadoop 2.9, meaning that the
test would not run when compiling with Hadoop 2.9. Using a mock fixes
this problem.

The WikipediaEditsSourceTest unnecessarily implements an integration
test that starts a FlinkMiniCluster and executes a small Flink program.

This simply creates a source and executes run in a separate thread until
a single WikipediaEditEvent is received.

This closes #5102.

- Minor eager sanity checks
- Use UUID suffix for nickname. As reported in FLINK-8167, the current
  nickname suffix can result in nickname clashes which lead to test
  failures.

This closes #4651.

This closes #7907.

This closes #5110.

This closes #5040.

Remove a check for a deleted directory since we may not see our own delete yet
with S3.

This closes #5066.

This commit lets the JobMaster implement the RestfulGateway. That way,
the JobMaster can be used in combination with the existing REST handlers.

This closes #4986.

Make sure that the value maps are of type LinkedHashMap in SlotSharingGroupAssignment#availableSlotsPerJid

This closes #4839.

The JsonPlan in JobDetailInfo must be serialized as a raw value
to make it parsable for downstream applications.

This closes #5109.

This closes #5111.

This closes #5070.

Algorithm result types no longer extend Tuple but are now custom POJOs.
This prevents the use of DataSet#writeAsCsv which accepts custom line
and field delimiters. Anticipating this lose the result types override

This patch uses DataSet#writeAsCsv for types extending Tuple and
DataSet#writeAsText otherwise. Since most algorithm result types are now
custom POJOs the custom delimiters are now largely ineffective.

[hotfix] Rename RestfulGateway#requestJobDetails into requestMultipleJobDetails to avoid name conflicts with JobMasterGateway

By letting the existing REST handlers work with an arbitrary RestfulGateway,
they can be used by the Dispatcher as well as the JobMaster, once it implements
the RestfulGateway.

This closes #4985.

This closes #5069.

This closes #5017.

This closes #5075.

Instead of storing the JobID and the JobStatus in a Tuple2 which is serialized
as an array of values in JSON, this commit introduces the JobIdWithStatus which
is serialized as a proper JSON object with an id and a status field.

This closes #4734.

Closes #5096

We always add the dist.jar ourselves, but it could also be inside a shipped
folder such as the "lib/" folder and was then distributed multiple times.

This closes #4951.

Migrate logic in
org.apache.flink.runtime.rest.handler.legacy.metrics.JobMetrisHandler to new
handler, and add new handler to DispatcherRestEndpoint.

[FLINK-7694][flip6] Use jobid path parameter constant in JobMetricsHandlerTest

This closes #5084.

Migrate logic from
org.apache.flink.runtime.rest.handler.legacy.metrics.SubtaskMetricsHandler to
new handler. Add new handler to DispatcherRestEndpoint.

[FLINK-8143][flip6] Assert that SubtaskIndexPathParameter is mandatory

[FLINK-8143][flip6] Use path parameter constants in SubtaskMetricsHandlerTest

This closes #5082.

Migrate logic in
org.apache.flink.runtime.rest.handler.legacy.metrics.JobManagerMetricsHandler
to new handler and add new handler to DispatcherRestEndpoint.

[FLINK-7716][Javadoc] Deprecate method MetricStore#getJobManager().

There is a semantically equivalent method in MetricStore.

This closes #5083.

Migrate logic in
org.apache.flink.runtime.rest.handler.legacy.metrics.TaskManagerMetricsHandler
to new handler, and add new handler to DispatcherRestEndpoint.

[FLINK-7717][flip6] Use taskmanagerid constant in TaskManagerMetricsHandlerTest

This closes #5081.