GCC can't see that flags is only set and used when PageHighmem() is
true.

Inspired by a patch from Jean Delvare.
Signed-off-by: NDavid S. Miller <davem@davemloft.net>