CompareOp can run on CPU even other operators are running on GPU, since
opeatations like comparing control flags should be performed only on CPU