[PATCH 15/16] ASoC: cs42l42: Fix WARN in remove() if running without an interrupt