To avoid some races.  Still not perfect, but now a bit safer.
Signed-off-by: NTakashi Iwai <tiwai@suse.de>