After the GPIO driver move, some symbols became selectable when they
shouldn't be.  Tighten the dependencies.
Reported-by: NRandy Dunlap <rdunlap@xenotime.net>
Signed-off-by: NGrant Likely <grant.likely@secretlab.ca>