Otherwise ioremap can fail with early_init patch unless we have
a static mapping for everything.
Signed-off-by: NTony Lindgren <tony@atomide.com>