This prepares the driver for multi-channel support.
Signed-off-by: NLaurent Pinchart <laurent.pinchart+renesas@ideasonboard.com>