Otherwise we might not have a sensible clocking setup ready.
Signed-off-by: NMark Brown <broonie@opensource.wolfsonmicro.com>