mod and ahb clocks are not disabled when the NAND controller device is
removed.
Signed-off-by: NBoris Brezillon <boris.brezillon@free-electrons.com>