If these tests exit while a thread is panicking it often leads to situations
like #22628.