[PATCH 4/4] ASoC: da732x: Drop no-op remove function