When the lan966x driver is removed make sure to remove also the ptp_irq
IRQ.

Fixes: e85a96e4 ("net: lan966x: Add support for ptp interrupts")
Signed-off-by: NHoratiu Vultur <horatiu.vultur@microchip.com>
Link: https://lore.kernel.org/r/20220413195716.3796467-1-horatiu.vultur@microchip.comSigned-off-by: NJakub Kicinski <kuba@kernel.org>