Don't assume the first fire indicates that we're done.
Signed-off-by: NMark Brown <broonie@opensource.wolfsonmicro.com>