After configuration accesses have been completed deassert the
configuration access enable cleanly.
Signed-off-by: NPaul Mundt <lethal@linux-sh.org>