Since the cache is currently open coded this is more of a win than for
most devices.
Signed-off-by: NMark Brown <broonie@opensource.wolfsonmicro.com>
Acked-by: NDaniel Mack <zonque@gmail.com>