Remove usb-serial-device field from private data as it can be accessed
from the usb-serial-port structure.
Signed-off-by: NJohan Hovold <jhovold@gmail.com>
Signed-off-by: NGreg Kroah-Hartman <gregkh@linuxfoundation.org>