vc4 already has a proper load sequence, but the unload one needed some
fixups: First unregister, and last drop the final ref.
Signed-off-by: NDaniel Vetter <daniel.vetter@intel.com>
Signed-off-by: NEric Anholt <eric@anholt.net>