This fixes sporadic timeout on initial packet Tx (usually ARP), with an
error message like:

  timeout: packet not sent
Reviewed-by: NStefan Roese <sr@denx.de>
Tested-by: NChris Packham <judge.packham@gmail.com>
Acked-by: NJoe Hershberger <joe.hershberger@ni.com>
Signed-off-by: NRabeeh Khoury <rabeeh@solid-run.com>
Signed-off-by: NBaruch Siach <baruch@tkos.co.il>