Created by: reyoung

The executor will be silent if any operator produces NAN or INF. It is hard to debug networks. We need an exception when NAN/INF is produced.

However, it is extremely slow in GPU if we check NAN or INF when every operator is completed. So we need to make this feature configurable at runtime.