Re: UCM ConflictingDevice/Priority concepts
[fixing alsa-devel email and rejoining threads]
On 3/19/20 4:06 AM, Jaroslav Kysela wrote:
Dne 18. 03. 20 v 22:46 Pierre-Louis Bossart napsal(a):
Hi,
Traditionally on most PC or mobile platforms, we have one audio output that can be routed to either speakers or headphone, and likewise we can record from either internal mics or headset mic. We signal with UCM that the headphone/speakers and internal mic/headset conflict so hopefully PulseAudio/CRAS switch auto-magically.
For SoundWire-based platforms, we typically have a headphone/headset codec on one link, and one or more amplifiers on the other. Functionally it's supported to capture from local mics and headset mic at the same time, or play different streams on speakers and headphones. Recent Intel-based Chromebooks have in theory the same capabilities at the hardware level even with I2S/TDM + DMIC connections.
So for UCM, should we use the notion of 'ConflictingDevice' to fall-back to a more traditional single-endpoint user experience, or is this concept only indented to model hardware restrictions? I just checked that Chrome/adhd does not seem to use this concept at all, while it's prevalent in alsa-ucm-conf
Or should we instead only use the concept of Playback/CapturePriority, which is also used in a lot of alsa-ucm-conf files, but again not at all in Chrome/adhd?
I did find some UCM files relying both on the concept of ConflictingDevices and PlaybackPriorities, which seems rather odd/overkill to me.
ConflictingDevices/SupportedDevices should be used only if there's a hardware restriction which prevents the simultaneous usage of devices. The application can decide how to use those devices.
The priority describes the preference. Usually, headphones has higher priority than build-in speakers etc.
I may be thick on this one, but how would an application use both types of information?
Does it e.g.
a) revisit the list all devices currently available when an event occurs (uevent card creation, jack detection, etc)
b) pick the device with the highest priority for the 'default' stream
c) allow for simultaneous use of devices not marked at 'Conflicting', e.g. use the internal microphone for assistant while using the headset mic for a call as suggested by Dylan.
In other words the priority is the first key, and additional devices are filtered with the ConflictingDevice information.
Did I get this right?
In my opinion, it's not part of UCM if the application will use one or multiple devices. The application must decide. It's another upper usage / abstraction layer.
I tend to agree, but I wanted to make sure the use of 'ConflictingDevices' was not expected outside of true hardware limitations.
Also, we need to consider this to have the whole picture:
Tanu (the pulseaudio maintainer) has also good question how to ensure, that the stream can be re-used for the multiple devices. Actually, PA does not re-open PCM device when the PCM device name and parameters are similar for the switched devices. I also think that this is also missing in the UCM specification to resolve this requirement. Usually, the stream transfer mechanism is separate from the routing control. But I can assume, that we may have the hardware which will need extra setup for the streaming (not routing) when the devices are switched.
I think that adding something like "PlaybackStream" to "PlaybackPCM" for the stream identification might be sufficient to cover those cases. So, keep "PlaybackPCM" usage and if "PlaybackStream" exists, use this value to determine the stream identification. Similar situation is for the capture direction, of course.
I am not sure I understand the notion of stream and stream transfer. Is there a pointer to this so that I could understand the problem statement?
Thanks,
-Pierre
Dne 19. 03. 20 v 15:25 Pierre-Louis Bossart napsal(a):
[fixing alsa-devel email and rejoining threads]
On 3/19/20 4:06 AM, Jaroslav Kysela wrote:
Dne 18. 03. 20 v 22:46 Pierre-Louis Bossart napsal(a):
Hi,
Traditionally on most PC or mobile platforms, we have one audio output that can be routed to either speakers or headphone, and likewise we can record from either internal mics or headset mic. We signal with UCM that the headphone/speakers and internal mic/headset conflict so hopefully PulseAudio/CRAS switch auto-magically.
For SoundWire-based platforms, we typically have a headphone/headset codec on one link, and one or more amplifiers on the other. Functionally it's supported to capture from local mics and headset mic at the same time, or play different streams on speakers and headphones. Recent Intel-based Chromebooks have in theory the same capabilities at the hardware level even with I2S/TDM + DMIC connections.
So for UCM, should we use the notion of 'ConflictingDevice' to fall-back to a more traditional single-endpoint user experience, or is this concept only indented to model hardware restrictions? I just checked that Chrome/adhd does not seem to use this concept at all, while it's prevalent in alsa-ucm-conf
Or should we instead only use the concept of Playback/CapturePriority, which is also used in a lot of alsa-ucm-conf files, but again not at all in Chrome/adhd?
I did find some UCM files relying both on the concept of ConflictingDevices and PlaybackPriorities, which seems rather odd/overkill to me.
ConflictingDevices/SupportedDevices should be used only if there's a hardware restriction which prevents the simultaneous usage of devices. The application can decide how to use those devices.
The priority describes the preference. Usually, headphones has higher priority than build-in speakers etc.
I may be thick on this one, but how would an application use both types of information?
Does it e.g.
a) revisit the list all devices currently available when an event occurs (uevent card creation, jack detection, etc)
The jack detection / hw mute just handle the device (I/O) availability.
b) pick the device with the highest priority for the 'default' stream
Yes, but the priority is just a hint for the application. The user may be override this. It's another layer.
c) allow for simultaneous use of devices not marked at 'Conflicting', e.g. use the internal microphone for assistant while using the headset mic for a call as suggested by Dylan.
Yes.
In other words the priority is the first key, and additional devices are filtered with the ConflictingDevice information.
Did I get this right?
Basically, yes.
In my opinion, it's not part of UCM if the application will use one or multiple devices. The application must decide. It's another upper usage / abstraction layer.
I tend to agree, but I wanted to make sure the use of 'ConflictingDevices' was not expected outside of true hardware limitations.
Also, we need to consider this to have the whole picture:
Tanu (the pulseaudio maintainer) has also good question how to ensure, that the stream can be re-used for the multiple devices. Actually, PA does not re-open PCM device when the PCM device name and parameters are similar for the switched devices. I also think that this is also missing in the UCM specification to resolve this requirement. Usually, the stream transfer mechanism is separate from the routing control. But I can assume, that we may have the hardware which will need extra setup for the streaming (not routing) when the devices are switched.
I think that adding something like "PlaybackStream" to "PlaybackPCM" for the stream identification might be sufficient to cover those cases. So, keep "PlaybackPCM" usage and if "PlaybackStream" exists, use this value to determine the stream identification. Similar situation is for the capture direction, of course.
I am not sure I understand the notion of stream and stream transfer. Is there a pointer to this so that I could understand the problem statement?
Example:
Device1: ... some enable sequence ... PlaybackPCM "hw:0" PlaybackStream "DAC1"
Device2: ... another enable sequence ... PlaybackPCM "hw:0" PlaybackStream "DAC2"
In this case, PCM names for alsa-lib are same, but there's a different setup to route signal to different DAC which cannot be executed without the PCM re-open task (when the PCM "hw:0" is active).
Jaroslav
Also, we need to consider this to have the whole picture:
Tanu (the pulseaudio maintainer) has also good question how to ensure, that the stream can be re-used for the multiple devices. Actually, PA does not re-open PCM device when the PCM device name and parameters are similar for the switched devices. I also think that this is also missing in the UCM specification to resolve this requirement. Usually, the stream transfer mechanism is separate from the routing control. But I can assume, that we may have the hardware which will need extra setup for the streaming (not routing) when the devices are switched.
I think that adding something like "PlaybackStream" to "PlaybackPCM" for the stream identification might be sufficient to cover those cases. So, keep "PlaybackPCM" usage and if "PlaybackStream" exists, use this value to determine the stream identification. Similar situation is for the capture direction, of course.
I am not sure I understand the notion of stream and stream transfer. Is there a pointer to this so that I could understand the problem statement?
Example:
Device1: ... some enable sequence ... PlaybackPCM "hw:0" PlaybackStream "DAC1"
Device2: ... another enable sequence ... PlaybackPCM "hw:0" PlaybackStream "DAC2"
In this case, PCM names for alsa-lib are same, but there's a different setup to route signal to different DAC which cannot be executed without the PCM re-open task (when the PCM "hw:0" is active).
I see, thanks for the explanations.
Indeed in the past we had similar routing issues that required re-configuration and possibly stopping the stream or changing clock settings/ownership.
However I would argue that the solution is more to define additional steps than add additional qualifiers in the enable/disable steps.
FWIW in the Android solutions from Intel, we had 5 steps for each routing change: - mute old paths - disable streaming on old paths - configure new paths - enable streaming on new paths - unmute new paths
At each step we could describe what actions were necessary or if the step could be skipped. That allowed us to deal nicely with transitions, I don't think we encountered any case that these steps couldn't handle.
On Thu, 2020-03-19 at 14:27 -0500, Pierre-Louis Bossart wrote:
Also, we need to consider this to have the whole picture:
Tanu (the pulseaudio maintainer) has also good question how to ensure, that the stream can be re-used for the multiple devices. Actually, PA does not re-open PCM device when the PCM device name and parameters are similar for the switched devices. I also think that this is also missing in the UCM specification to resolve this requirement. Usually, the stream transfer mechanism is separate from the routing control. But I can assume, that we may have the hardware which will need extra setup for the streaming (not routing) when the devices are switched.
I think that adding something like "PlaybackStream" to "PlaybackPCM" for the stream identification might be sufficient to cover those cases. So, keep "PlaybackPCM" usage and if "PlaybackStream" exists, use this value to determine the stream identification. Similar situation is for the capture direction, of course.
I am not sure I understand the notion of stream and stream transfer. Is there a pointer to this so that I could understand the problem statement?
Example:
Device1: ... some enable sequence ... PlaybackPCM "hw:0" PlaybackStream "DAC1"
Device2: ... another enable sequence ... PlaybackPCM "hw:0" PlaybackStream "DAC2"
In this case, PCM names for alsa-lib are same, but there's a different setup to route signal to different DAC which cannot be executed without the PCM re-open task (when the PCM "hw:0" is active).
I see, thanks for the explanations.
Indeed in the past we had similar routing issues that required re-configuration and possibly stopping the stream or changing clock settings/ownership.
However I would argue that the solution is more to define additional steps than add additional qualifiers in the enable/disable steps.
FWIW in the Android solutions from Intel, we had 5 steps for each routing change:
- mute old paths
- disable streaming on old paths
- configure new paths
- enable streaming on new paths
- unmute new paths
At each step we could describe what actions were necessary or if the step could be skipped. That allowed us to deal nicely with transitions, I don't think we encountered any case that these steps couldn't handle.
It seems that Pierre understood the idea behind the PlaybackStream proposal, but I still don't understand what problem it's solving. Is the problem that PulseAudio doesn't reopen the stream when it should? So in the example, there are two DACs, and selecting the DAC is done via the mixer, but the switch can't be done while the stream is open? I haven't seen such devices, so this is a new problem to me.
The "problem" that I brought up earlier in the device variant discussion was different: the PulseAudio profile scheme that Jaroslav proposed would mean that PulseAudio would always reopen the stream even when it would be sufficient to just change a setting in the mixer. I don't think this is a significant problem. When changing routing, it's not important to keep the stream running without any interruption.
The 5-step process that Pierre described is good, in particular it allows setting the volume at the right time (currently PulseAudio doesn't follow that process, and as a result there can be volume glitches when changing routing). To me it seems that following this process is already possible without changes to UCM, so I don't know what Pierre meant by defining additional steps.
On 3/22/20 11:37 PM, Tanu Kaskinen wrote:
On Thu, 2020-03-19 at 14:27 -0500, Pierre-Louis Bossart wrote:
Also, we need to consider this to have the whole picture:
Tanu (the pulseaudio maintainer) has also good question how to ensure, that the stream can be re-used for the multiple devices. Actually, PA does not re-open PCM device when the PCM device name and parameters are similar for the switched devices. I also think that this is also missing in the UCM specification to resolve this requirement. Usually, the stream transfer mechanism is separate from the routing control. But I can assume, that we may have the hardware which will need extra setup for the streaming (not routing) when the devices are switched.
I think that adding something like "PlaybackStream" to "PlaybackPCM" for the stream identification might be sufficient to cover those cases. So, keep "PlaybackPCM" usage and if "PlaybackStream" exists, use this value to determine the stream identification. Similar situation is for the capture direction, of course.
I am not sure I understand the notion of stream and stream transfer. Is there a pointer to this so that I could understand the problem statement?
Example:
Device1: ... some enable sequence ... PlaybackPCM "hw:0" PlaybackStream "DAC1"
Device2: ... another enable sequence ... PlaybackPCM "hw:0" PlaybackStream "DAC2"
In this case, PCM names for alsa-lib are same, but there's a different setup to route signal to different DAC which cannot be executed without the PCM re-open task (when the PCM "hw:0" is active).
I see, thanks for the explanations.
Indeed in the past we had similar routing issues that required re-configuration and possibly stopping the stream or changing clock settings/ownership.
However I would argue that the solution is more to define additional steps than add additional qualifiers in the enable/disable steps.
FWIW in the Android solutions from Intel, we had 5 steps for each routing change:
- mute old paths
- disable streaming on old paths
- configure new paths
- enable streaming on new paths
- unmute new paths
At each step we could describe what actions were necessary or if the step could be skipped. That allowed us to deal nicely with transitions, I don't think we encountered any case that these steps couldn't handle.
It seems that Pierre understood the idea behind the PlaybackStream proposal, but I still don't understand what problem it's solving. Is the problem that PulseAudio doesn't reopen the stream when it should? So in the example, there are two DACs, and selecting the DAC is done via the mixer, but the switch can't be done while the stream is open? I haven't seen such devices, so this is a new problem to me.
It's not very common but does happen. I had a laptop where one mixer control would only take effect if the PCM was already open. In phones the clock ownership may change during a voice call, and handling of alert streams could involve different PCMs or had to be held while the clocks were changed.
The "problem" that I brought up earlier in the device variant discussion was different: the PulseAudio profile scheme that Jaroslav proposed would mean that PulseAudio would always reopen the stream even when it would be sufficient to just change a setting in the mixer. I don't think this is a significant problem. When changing routing, it's not important to keep the stream running without any interruption.
Can you stop/restart the PCM device without impacting apps though?
The 5-step process that Pierre described is good, in particular it allows setting the volume at the right time (currently PulseAudio doesn't follow that process, and as a result there can be volume glitches when changing routing). To me it seems that following this process is already possible without changes to UCM, so I don't know what Pierre meant by defining additional steps.
I meant instead of having just an 'enable' and 'disable' step in UCM, have additional ones done prior to streaming and after streaming. The 'Enable' handles too many things at the moment IMHO, it's both routing, streaming and mute.
participants (3)
-
Jaroslav Kysela
-
Pierre-Louis Bossart
-
Tanu Kaskinen