提交 0360fb96 编写于 作者: G Greg Hogan

[hotfix] [gelly] Reduce maximum number of generator blocks

The default maximum akka transfer size is 10 MB. This commit reduces the
number of generator blocks from 2^20 to 2^15 which removes the limit on
graph size. The original limit of one millions blocks was intended to
future-proof scalability.

This is a temporary fix as graph generation will be reworked in FLINK-3997.
上级 177168b2
...@@ -35,7 +35,7 @@ implements RandomGenerableFactory<T> { ...@@ -35,7 +35,7 @@ implements RandomGenerableFactory<T> {
// A large computation will run in parallel but blocks are generated on // A large computation will run in parallel but blocks are generated on
// and distributed from a single node. This limit should be greater // and distributed from a single node. This limit should be greater
// than the maximum expected parallelism. // than the maximum expected parallelism.
public static final int MAXIMUM_BLOCK_COUNT = 1 << 20; public static final int MAXIMUM_BLOCK_COUNT = 1 << 15;
// This should be sufficiently large relative to the cost of instantiating // This should be sufficiently large relative to the cost of instantiating
// and initializing the random generator and sufficiently small relative to // and initializing the random generator and sufficiently small relative to
......
Markdown is supported
0% .
You are about to add 0 people to the discussion. Proceed with caution.
先完成此消息的编辑!
想要评论请 注册