Remove the CONFIG_DM_USB limitation to enable cache support functions.
Tested on SAMA5D3x-EK board.
Signed-off-by: NJosh Wu <josh.wu@atmel.com>
Acked-by: NHans de Goede <hdegoede@redhat.com>