For KMS drivers, we really need to cleanup the driver before disabling
the AGP subsystem.
Signed-off-by: NDave Airlie <airlied@redhat.com>