This reverts commit 9b510df7.

We want to avoid having the USB stack rely on unbind.
Signed-off-by: NSimon Glass <sjg@chromium.org>