This cleans up the next patch that calls unmap from map.
Signed-off-by: NAlex Williamson <alex.williamson@redhat.com>