Simplify the endpoint sanity check by letting core verify that the
required endpoints are present.

Note that this driver uses an additional bulk-endpoint pair as an
out-of-band port.
Signed-off-by: NJohan Hovold <johan@kernel.org>