[PATCH v2 2/2] ASoC: soc-pcm: Move debugfs removal out of spinlock