[PATCH] soundwire: bus_type: fix remove and shutdown support