If we used the pinctrl-rockchip driver, these config is not needed,
so remove them.
Signed-off-by: NDavid Wu <david.wu@rock-chips.com>
Reviewed-by: NKever Yang <kever.yang@rock-chips.com>
Reviewed-by: NPhilipp Tomsich <philipp.tomsich@theobroma-systems.com>