fix the regression in commit 29fab0cd
that this driver executed reconnection processing when disconnected
some devices.
Signed-off-by: NYoshihiro Shimoda <shimoda.yoshihiro@renesas.com>
Signed-off-by: NGreg Kroah-Hartman <gregkh@suse.de>