This increases the chances we'll manage to hit a partially configured
state on restart and the power savings are extremely small.
Signed-off-by: NMark Brown <broonie@opensource.wolfsonmicro.com>