• C
    futex: Ensure get_futex_key_refs() always implies a barrier · 76835b0e
    Catalin Marinas 提交于
    Commit b0c29f79 (futexes: Avoid taking the hb->lock if there's
    nothing to wake up) changes the futex code to avoid taking a lock when
    there are no waiters. This code has been subsequently fixed in commit
    11d4616b (futex: revert back to the explicit waiter counting code).
    Both the original commit and the fix-up rely on get_futex_key_refs() to
    always imply a barrier.
    
    However, for private futexes, none of the cases in the switch statement
    of get_futex_key_refs() would be hit and the function completes without
    a memory barrier as required before checking the "waiters" in
    futex_wake() -> hb_waiters_pending(). The consequence is a race with a
    thread waiting on a futex on another CPU, allowing the waker thread to
    read "waiters == 0" while the waiter thread to have read "futex_val ==
    locked" (in kernel).
    
    Without this fix, the problem (user space deadlocks) can be seen with
    Android bionic's mutex implementation on an arm64 multi-cluster system.
    Signed-off-by: NCatalin Marinas <catalin.marinas@arm.com>
    Reported-by: NMatteo Franchin <Matteo.Franchin@arm.com>
    Fixes: b0c29f79 (futexes: Avoid taking the hb->lock if there's nothing to wake up)
    Acked-by: NDavidlohr Bueso <dave@stgolabs.net>
    Tested-by: NMike Galbraith <umgwanakikbuti@gmail.com>
    Cc: <stable@vger.kernel.org>
    Cc: Darren Hart <dvhart@linux.intel.com>
    Cc: Thomas Gleixner <tglx@linutronix.de>
    Cc: Peter Zijlstra <peterz@infradead.org>
    Cc: Ingo Molnar <mingo@kernel.org>
    Cc: Paul E. McKenney <paulmck@linux.vnet.ibm.com>
    Signed-off-by: NLinus Torvalds <torvalds@linux-foundation.org>
    76835b0e
futex.c 81.5 KB