[alsa-devel] [RFC] AVB - network-based soundcards in ALSA

[Henrik Austad]

On Tue, May 27, 2014 at 06:10:40PM +0600, Alexander E. Patrakov wrote:
> 27.05.2014 15:02, Henrik Austad wrote:
> >On Mon, May 26, 2014 at 10:21:10PM +0600, Alexander E. Patrakov wrote:
> >>26.05.2014 19:03, Henrik Austad wrote:
> >>>Hi all!
> >>>
> >>>This is an RFC for a new class of soundcards. I am not very familiar
> >>>with how ALSA is tied together underneath the hood, so what you see
> >>>here, is based on my naive understanding of ALSA. I wear asbestos
> >>>underwear on a regular basis, so I prefer honesty over sugarcoating :)
> >>
> >>Hello. All of this looks very interesting, but a bit more
> >>information is needed in order to put this in context.
> >
> >Hi Alexander, thank you for the feedback.
> >
> >First a disclaimer, I am in no sense an expert in this area, so if
> >something seems fishy, it might just be.
> 
> I am not an expert in the kernel part of ALSA, either.
> >>Obviously, as the intention is to create something that looks like a
> >>regular ALSA sound card, there should be a circular buffer that
> >>holds sound samples (just like the DMA buffer on regular sound
> >>cards). There also needs to be "something" that sends samples from
> >>this buffer into the network. Is my understanding correct?
> >
> >Yes, that is pretty much what I've planned. Since we cannot interrupt
> >userspace to fill the buffer all the time, I was planning on adding a ~20ms
> >buffer. If this is enough, I don't know yet.
> 
> Actually a sound card with only 20 ms of buffer would be a very
> strange beast. "Typical sound card" buffers have a 200-2000 ms
> range. When setting hardware parameters, an ALSA application
> specifies the desired buffer size (that is, how much they want to
> survive without getting scheduled) and the period size (i.e. how
> often they want to be notified that the sound card has played
> something - in order to supply additional samples). So that "20 ms"
> buffer size should be client-settable.

Ah, true. I just grabbed a size that would give pretty low latency, but
yes, you're right, this should be configurable from userspace. Given the
nature of AVB, the lower limit should probably be a lot lower than 200ms
though. But at this stage, this is just details methinks.

> You also have, in the ideal world, to provide the following:
> 
>  * An option to disable period wakeups for the application that
> relies on some other clock source and position queries.

Hmm, I see. This makes sense if AVB is not the primary driver of the
application.

>  * A method to get the position of the sample currently being
> played, with good-enough (<= 0.25 ms) precision for the
> application-level synchronization with other sound cards not sharing
> the same clock source (via adaptive resampling).
>  * A method to get the position of the first safe-to-rewrite sample
> (aka DMA position), for implementing dynamic-latency tricks at the
> application level (via snd_pcm_rewind).
>

All of these are good points, but I'm not sure if this is what I'll start
working on right now. I've added them to the list of "stuff to remember
once we get going". I fear the size of that list... :)

> >As stated in the previous mail, I'm no alsa-expert, I expect to learn a lot
> >as I dig into this :)
> >
> >As to moving samples from the buffer onto the network, one approach would
> >be to wrap a set of samples and place it into a ready frame with headers
> >and bits set and leave it in a buffer for the network layer to pick up.
> >
> >The exact method here is not clear to me yet, I need to experiment, and
> >probably send something off to the networking guys. But before I do that,
> >I'd like to have a reasonable sane idea of how ALSA should handle this.
> >
> >I expect this to be rewritten a few times :)
> 
> I think that snd-pcsp should provide you some insight on this,
> possibly even yielding (as a quick hack) a very very suboptimal (8k
> interrupts per second) but somewhat-working version, assuming that
> the arguments for doing this in the kernel are valid. Which is not a
> given - please talk to BlueTooth guys about that, they opted for a
> special socket type + userspace solution in a similar situation.

Thanks! That is a nice place to start looking, I'll do that.

> >>>* IEEE 1722 (and 1733 for layer-3) Layer 2 Transport for
> >>>   audio/video. The packing is similar to what is done in Firewire. You
> >>>   have 8kHz frame intervals for class A, 4kHz for class B. This gives
> >>>   relatively few samples pr. frame. Currently we only look at Layer 2 as
> >>>   small peripherals (microphones, speakers) will only have to implement
> >>>   L2 instead of the entire IP-stack.
> >>
> >>So, are you proposing to create a real-time kernel thread that will
> >>wake up 4000 or 8000 times per second in order to turn a few samples
> >>from the circular buffer into an Ethernet packet and send it, also
> >>advancing the "hardware pointer" in the process? Or do you have an
> >>idea how to avoid that rate of wakeups?
> >
> >I'm hoping to get some help from the NICs hardware and a DMA engine here as
> >it would be pretty crazy to do a task wakeup 8k times/sec. Not only would
> >the overhead be high, but if you have a 125us window for filling a buffer,
> >you are going to fail miserably in a GPOS.
> >
> >For instance, if you can prepare, say 5ms worth of samples at a go, that
> >would mean you have to prepare 40 frames. If you then could get the NIC and
> >network infrastructure take thos frames and even them out over the next 5
> >ms, all would be well.
>
> Except that on cheap cards, all of this will be software timer-based
> anyway, and thus will not avoid the 8 kHz interrupt-rate
> requirement. So maybe we just have to accept this requirement for
> now at least as a fallback path (especially since even a DNS server
> at your ISP has more stringent requirements) and add optimizations
> later.

Well, there's a world of difference between the cheapest, low-end
soundcards and those intended for the professional market. Since AVB
"moves" the soundcard out of the computer, placing at least -some-
demand on the NIC does not seem that far fetched.

> >The process of evening out the rate of samples is what traffic shaping and
> >stream reservation will help you do (or enforce, ymmv), to some extent at
> >least. The credit based shaper algorithm is designed to force bursty
> >traffic into a steady stream. How much you can press the queues, I'm not
> >sure. It may very well be that 40 frames is too much.
>
> Well, yes, because some software (e.g. PulseAudio) sometimes wants
> to rewind as close to the currently-playing sample as possible.
> Currently, PulseAudio allows for only 1.3 ms of the safety margin.

So PulseAudio requires some extra buffering so that they can alter the
samples already given to ALSA? Or does it mean that you can only safely
move the next 1.3ms of audio to the soundcard at any given time?

-- 
Henrik Austad