Samples.sln and Roslyn.sln were fighting over the GUIDs of Immutable, Metadata and Compostion.
Searching across the tree, and made sure that they were the uniform everywhere to prevent this.