The removed condition is always true, since the endpoint descriptor is
set prior to calling the enable endpoint.
Signed-off-by: NIdo Shayevitz <idos@codeaurora.org>
Signed-off-by: NFelipe Balbi <balbi@ti.com>