In order to avoid situation where a USB device is
in use by two domains, we must keep a list of already
attached devices like we do for PCI.