Fix seq_pool failed when input dims is too large.
Resolve issue #3023