Move the locking for armada_drm_vbl_event_remove() into itself, which
makes this function symmetrical with armada_drm_vbl_event_add().
Signed-off-by: NRussell King <rmk+kernel@arm.linux.org.uk>