[PATCH] ALSA: usb-audio: Skip setting clock selector for single connections