This allowed to us to kill a lot of casts,
with no loss of readability in any places
Signed-off-by: NSam Ravnborg <sam@ravnborg.org>
Signed-off-by: NDavid S. Miller <davem@davemloft.net>