I've suspected some bug there wrt to suspend, but that was not
the case. Clean up the code anyway.
Signed-off-by: NDaniel Vetter <daniel.vetter@ffwll.ch>
Signed-off-by: NEric Anholt <eric@anholt.net>