Make sure we don't deadlock when removing a suspended block
queue, something that might happen if the card is removed during
suspend.
Signed-off-by: NPierre Ossman <drzeus@drzeus.cx>