[PATCH] soundwire: return earlier if no slave is attached