Stop the clean timer earlier to be sure there's no asynchronous
interference while stopping the port.

Orabug: 25748241
Signed-off-by: NShannon Nelson <shannon.nelson@oracle.com>
Signed-off-by: NDavid S. Miller <davem@davemloft.net>