The work struct must be initialized before the possible call in the
destructor.
Signed-off-by: NTakashi Iwai <tiwai@suse.de>