that way we will only tell gadget framework about
the endpoints we actually have.
Signed-off-by: NFelipe Balbi <balbi@ti.com>