[PATCH v3 4/5] soundwire: cadence: Fix lost ATTACHED interrupts when enumerating