[PATCH v2 4/5] soundwire: cadence: Fix lost ATTACHED interrupts when enumerating