Now that there is support for the sama5d4 slow clock controller, use its
driver.
Signed-off-by: NAlexandre Belloni <alexandre.belloni@free-electrons.com>