On k40 with 4 devices, time reduces from ~4.0 to ~3.8+, should be
more obvious on better hardware