If we don't do this, projects will end up with dangling project
references, which isn't something we want. Even if the project later
reloads, the fact there's still old ProjectIds floating around causes
us to fail to convert to P2P references again later.

Fixes https://devdiv.visualstudio.com/DevDiv/_workitems/edit/714766.