The ctlr->idling flag is never checked now, so we don't need to set it
either.
Signed-off-by: NDavid Jander <david@protonic.nl>
Link: https://lore.kernel.org/r/20220621061234.3626638-8-david@protonic.nlSigned-off-by: NMark Brown <broonie@kernel.org>