Instead of erroring out when we don't have clocks,
let's just avoid any calls to the clk API.
Tested-by: NSteven J. Hill <Steven.Hill@cavium.com>
Signed-off-by: NFelipe Balbi <felipe.balbi@linux.intel.com>