Always add udev linker flags when WITH_UDEV is enabled to avoid
underlinking.

See commit 43dbcb15 (interface: always build all available backends)
Signed-off-by: NNatanael Copa <ncopa@alpinelinux.org>