Otherwise that IRQ will trigger forever. It's quite
unnecessary.
Signed-off-by: NFelipe Balbi <balbi@ti.com>