- 24 10月, 2015 1 次提交
-
-
由 Maximilian Michels 提交于
-
- 23 10月, 2015 16 次提交
-
-
由 Aljoscha Krettek 提交于
This enhances the TriggerResult enum with methods isFire() and isPurge() that simplify the logic in WindowOperator.processTriggerResult(). Also, the operator now keeps track of the current watermark and fires immediately if a trigger registers an event-time callback for a timestamp that lies in the past. For this the TriggerResult now as method merge() that allows to merge to TriggerResultS.
-
由 Aljoscha Krettek 提交于
Before these trigger methods had no information about the window that they are responsible for. This information might be required for implementing more advanced trigger behaviour.
-
由 Aljoscha Krettek 提交于
This fixes the aggregators to make copies of the objects so that it works with window operators that are not mutable-object safe. This also disables object copy in WindowOperator and NonKeyedWindowOperator.
-
由 Aljoscha Krettek 提交于
Before, the StreamRecords was not copied, now it is.
-
由 Aljoscha Krettek 提交于
-
由 Greg Hogan 提交于
Operators defer object creation when object reuse is disabled. This closes #1288
-
由 Greg Hogan 提交于
This closes #1290
-
由 Ufuk Celebi 提交于
Rename config key prefix from 'ha.zookeeper' to 'recovery.zookeeper' Rename config key from 'state.backend.fs.dir.recovery' => 'state.backend.fs.recoverydir' Move ZooKeeper file system state backend configuration keys This closes #1286
-
由 Fabian Hueske 提交于
Rename Match*Test to Join*Test and MapTaskTest to FlatMapTaskTest This closes #1294
-
由 Maximilian Michels 提交于
-
由 Maximilian Michels 提交于
0.10-SNAPSHOT continues on branch release-0.10
-
由 Aljoscha Krettek 提交于
Before it would only trigger if expectedTime < time. Now it is expectedTime <= time.
-
由 Fabian Hueske 提交于
-
由 Ulf Karlsson 提交于
This closes #1252
-
由 zentol 提交于
This closes #1279
-
由 Fabian Hueske 提交于
[FLINK-2206] [webui] Fix incorrect counts of finished, canceled, and failed jobs in new web dashboard This closes #1287
-
- 22 10月, 2015 5 次提交
-
-
由 Aljoscha Krettek 提交于
Before, this was not set, leading to incorrect results if KV-State was used in the WindowFunction. This also adds a test.
-
由 vasia 提交于
[FLINK-2887] [gelly] make sendMessageToAllNeighbors respect the EdgeDirection if set in the configuration This closes #1281
-
由 Maximilian Michels 提交于
- create Scala 2.11 binaries - remove Java 6 specific checks - cleanup Tested for 0.10.0-rc0
-
由 Aljoscha Krettek 提交于
In very rare cases it could happen that a checkpoint would be performed after the ValidatingSink signaled that it had seen all expected elements. If this happened the job would be restarted with the already complete state and we would never finish since no more elements would arrive. This adds a check in open() of ValidatingSink that signals success if we already have the final state.
-
由 Ufuk Celebi 提交于
-
- 21 10月, 2015 14 次提交
-
-
由 Till Rohrmann 提交于
The HandlerRedirectUtils.getRedirectAddress decides whether the retrieved leader address is equal to the local job manager address. The local job manager address is, however, in the form akka.tcp://flink@url/user/jobmanager whereas the leader address can be akka://flink/user/jobmanager if the local job manager is the current leader. Such a case produced a warning which is not correct. This PR checks for the local job manager address and signals that no redirection has to be done if it receives akka://flink/user/jobmanager. Add test for HandlerRedirectUtils This closes #1280.
-
由 Ufuk Celebi 提交于
-
由 Greg Hogan 提交于
This was previously reported as FLINK-2625 (commit 8a849372). The Client class was concurrently refactored with FLINK-2097 (commit 71bf2f57). This closes #1278
-
由 Greg Hogan 提交于
A collection of small documentation and grammar updates. This closes #1277
-
由 Stephan Ewen 提交于
This closes #1275
-
由 Greg Hogan 提交于
Multiple TaskManager filesystems can be used by configuring multiple temporary directories. This patch changes the process of spilling files from a per-operator round-robin to a global round-robin such that each directory is written to in turn across all operators, reducing unbalanced I/O due to bunching. This closes #1272
-
由 Alexander Alexandrov 提交于
This closes #1260
-
由 chengxiang li 提交于
This closes #1170
-
由 Aljoscha Krettek 提交于
This adds Time.milliseconds(), Time.seconds(), and so on.
-
由 Rufus Refactor 提交于
-
由 Maximilian Michels 提交于
-
由 Henry Saputra 提交于
[FLINK-2872] [Documentation] Update the documentation for Scala part to add ExecutionEnvironment.readFileOfPrimitives. Add the missing Scala part for ExecutionEnvironment.readFileOfPrimitives API doc in the programming guide. Author: Henry Saputra <hsaputra@apache.org> Closes #1268 from hsaputra/add_readFileOfPrimitives_scala_guide and squashes the following commits: f543436 [Henry Saputra] Add variant of ExecutionEnvironment.readFileOfPrimitives in Java with additional delimiter. 1209019 [Henry Saputra] [FLINK-2872] [Documentation] Update the documentation for Scala part to add readFileOfPrimitives.
-
由 Aljoscha Krettek 提交于
This also renames WatermarkTrigger to EventTimeTrigger and ContinuousWatermarkTrigger to ContinuousEventTimeTrigger.
-
由 Aljoscha Krettek 提交于
This adds method state() on Trigger context that should be used to create an OperatorState to deal with fault-tolerant state. WindowAssigner now has a method getWindowSerializer() that is used to get a TypeSerializer for the Windows that it assigns. The Serializer for the Key is retrieved from the input KeyedStream and the serializer for the input elements is already available. During checkpointing all currently in-flight windows (per key, per window) are serialized using the TypeSerializers. The state that is accessible in Triggers using state() is kept in a HashMap<String, Serializable>, this is serialized using java serialization.
-
- 20 10月, 2015 4 次提交
-
-
由 Maximilian Michels 提交于
-
由 Maximilian Michels 提交于
- set the upper bound to Long.MAX_VALUE For YARN, we set it to the calculated maximum container size (no need to fix).
-
由 Till Rohrmann 提交于
[FLINK-2354] [runtime] Replace old StateHandleProvider by StateStorageHelper in ZooKeeperStateHandleStore The old StateHandleProvider used in ZooKeeperStateHandleStore had to be replaced because the state backend implementation has changed. Since the new state backend could not be used anymore, a new StateStorageHelper interface has been created. The default implementation FileSystemStateStorageHelper stores the given state onto the specified file system and returns a FileSerializableStateHandle. Various fixes due to rebasing.
-
由 Till Rohrmann 提交于
Changes test program to use an int accumulator which is checked at the end of the program. This avoids to look for the "Job status changed to FINISHED." string in the stdout output, which can sometimes not be printed if the JobExecutionResult arrives earlier than the JobStatusChanged message at the JobClientActor.
-