The if pclk enable fails the refclk is not disabled.
Fix the same.
Signed-off-by: NShubhrajyoti Datta <shubhraj@xilinx.com>
Signed-off-by: NMark Brown <broonie@kernel.org>