Gets rid of some of the CONFIG_MIPS_MT_FPAFF #ifdefery.
Signed-off-by: NRalf Baechle <ralf@linux-mips.org>