February 2017 - Sound-open-firmware - mailman.alsa-project.org

[Sound-open-firmware] [PATCH v3 00/27] add R/W pointers check for pipeline buffers
by Keyon Jie 22 Feb '17

22 Feb '17

This series adding the R/W buffer pointers check and make sure we won't copy wrong/missed/repeated data for the whole pipeline. For ALSA applications, usually we have two kinds of trigger command sequences: 1. (e.g. aplay) prefill datas ==> trigger start ==> refill buffer(when buffer free is enough) ==> ... ==> data filling finished ==> trigger drain ==> when all datas are rendered(via read pointer feedback) ==> trigger stop; 2. (e.g. speaker-test with large buffer size > wav file size): prefill all datas one time ==> trigger start ==> wait until all datas are rendered(via feedback read pointer) ==> trigger stop ==> prefill another wav file ==> trigger start ==> ... So the feedback from firmware about the read pointer is very important for the pipeline's running, to make the firmware can handle these two kinds of sequences, this series design/assume with preconditions: 1. We do down stream full preload(full fill all pipeline buffers, except host side one); 2. Using pull mode at running stage and pulling one period per time; 3. When in normal running status, if buffer a->avail is 0, then all those upstream buffers are empty; For those two sequence, we use a same logic to handle it: 1. We put all components in running status even some of them are empty(dai is an exception); 2. We stop dai/ssp once we found there is no more data for it to render, and notify this last read position to host side; 3. Host side will trigger stop and we will reset all buffer pointers and related resources; 4. For case #1, trigger reset will reset/free more resources(allocated/init in set_params()); For case #2, another start cmd will trigger preload and start in firmware, before that all pointers are reset to original ones. TODOs: It is only verified for playback, for capture, we may need some vivid code to implement them. Changes in v3: 1. add one preload patch for pipeline full preload, which make playback works. 2. fix DMA channel status wrong after trigger stop issue. Changes in v2: 1. extract some common code to separate functions to save code; 2. add comments for component status; 3. other slight changes per Liam's suggestion. Keyon Jie (26): host: handle more possibility for playback spitting dai: reset dai_pos at MMAP_PPOS command pipleline: op_sink: don't need clear the buffer for each prepare host: start: don't real start for start command ipc: presentation_posn should be uint64_t type intel-ipc: add application buffer pointer update from host side intel-ipc: add stream operation IPC_INTEL_STR_STOP host: add host_update_buffer for produce and consume host: rename host_pos_blks to host_pos_read host: for the last bytes/period, send read notification later host: add R/W pointers check for playback host: add a completion work to notify host side host: reset pointers at new() and reset() host: cleanup host_cmd() cases host: host_copy: only copy when there is data and wait until finish volume: volume_params(): set the sink buffer params depending on its sink component: status: rename COMP_STATE_STOPPED to COMP_STATE_SETUP volume: volume_cmd(): only stop/pause at running volume: add R/W pointer check for volume_copy() mixer: mixer_params(): set the sink buffer params to STREAM_FORMAT_S32_LE. mixer: add R/W pointer check for mixer_copy() mixer: add dd->last_bytes for the last bytes(< period) caculation dai: add R/W pointer check for dai copy dw-dma: handle different cases in irq handler component: host/volume/mixer: reset buffers for stop cmd host: create host_elements_reset() and host_pointer_reset() for common use Liam Girdwood (1): pipeline: Add support for full pipeline pre-loading. src/audio/dai.c | 71 ++++- src/audio/host.c | 313 ++++++++++++++++------ src/audio/mixer.c | 85 +++++- src/audio/pipeline.c | 107 +++++++- src/audio/volume.c | 59 +++- src/drivers/dw-dma.c | 30 ++- src/include/reef/audio/component.h | 59 +++- src/include/reef/audio/pipeline.h | 2 + src/include/reef/dma.h | 7 + src/include/uapi/intel-ipc.h | 3 +- src/ipc/intel-ipc.c | 69 +++++ src/platform/baytrail/include/platform/platform.h | 6 + 12 files changed, 661 insertions(+), 150 deletions(-) -- 2.7.4

4 32

Re: [Sound-open-firmware] [PATCH v3 00/27] add R/W pointers check for pipeline buffers
by Pierre-Louis Bossart 21 Feb '17

21 Feb '17

On 2/13/17 1:56 AM, Ughreja, Rakesh A wrote: > > >> -----Original Message----- >> From: Keyon Jie [mailto:yang.jie@linux.intel.com] >> Sent: Monday, February 13, 2017 12:35 PM >> To: Ughreja, Rakesh A <rakesh.a.ughreja(a)intel.com>; Pierre-Louis Bossart >> <pierre-louis.bossart(a)linux.intel.com>; sound-open-firmware@alsa- >> project.org; liam.r.girdwood(a)linux.intel.com >> Cc: Jie, Yang <yang.jie(a)intel.com>; Ingalsuo, Seppo >> <seppo.ingalsuo(a)intel.com> >> Subject: Re: [Sound-open-firmware] [PATCH v3 00/27] add R/W pointers >> check for pipeline buffers >> >> On 2017年02月13日 12:31, Ughreja, Rakesh A wrote: >>> >>> >>>> -----Original Message----- >>>> From: Keyon Jie [mailto:yang.jie@linux.intel.com] >>>> Sent: Monday, February 13, 2017 7:31 AM >>>> To: Pierre-Louis Bossart <pierre-louis.bossart(a)linux.intel.com>; sound- >> open- >>>> firmware(a)alsa-project.org; liam.r.girdwood(a)linux.intel.com >>>> Cc: Ughreja, Rakesh A <rakesh.a.ughreja(a)intel.com>; Jie, Yang >>>> <yang.jie(a)intel.com>; Ingalsuo, Seppo <seppo.ingalsuo(a)intel.com> >>>> Subject: Re: [Sound-open-firmware] [PATCH v3 00/27] add R/W pointers >>>> check for pipeline buffers >>>> >>>> On 2017年02月11日 10:37, Pierre-Louis Bossart wrote: >>>>> On 2/10/17 8:17 PM, Keyon Jie wrote: >>>>>> This series adding the R/W buffer pointers check and make sure we >> won't >>>>>> copy wrong/missed/repeated data for the whole pipeline. >>>>>> >>>>>> For ALSA applications, usually we have two kinds of trigger command >>>>>> sequences: >>>>>> 1. (e.g. aplay) prefill datas ==> trigger start ==> refill buffer(when >>>>>> buffer >>>>>> free is enough) ==> ... ==> data filling finished ==> trigger >>>>>> drain ==> >>>>>> when all datas are rendered(via read pointer feedback) ==> >>>>>> trigger stop; >>>>>> 2. (e.g. speaker-test with large buffer size > wav file size): >>>>>> prefill all datas one time ==> trigger start ==> wait until >>>>>> all datas are >>>>>> rendered(via feedback read pointer) ==> trigger stop ==> >>>>>> prefill another >>>>>> wav file ==> trigger start ==> ... >>>>>> >>>>>> So the feedback from firmware about the read pointer is very important >>>>>> for >>>>>> the pipeline's running, to make the firmware can handle these two >>>>>> kinds of >>>>>> sequences, this series design/assume with preconditions: >>>>>> >>>>>> 1. We do down stream full preload(full fill all pipeline buffers, >>>>>> except host >>>>>> side one); >>>>>> 2. Using pull mode at running stage and pulling one period per time; >>>>>> 3. When in normal running status, if buffer a->avail is 0, then all those >>>>>> upstream buffers are empty; >>>>>> >>>>>> For those two sequence, we use a same logic to handle it: >>>>>> >>>>>> 1. We put all components in running status even some of them are >>>>>> empty(dai is >>>>>> an exception); >>>>>> 2. We stop dai/ssp once we found there is no more data for it to >>>>>> render, and >>>>>> notify this last read position to host side; >>>>>> 3. Host side will trigger stop and we will reset all buffer pointers and >>>>>> related resources; >>>>>> 4. For case #1, trigger reset will reset/free more >>>>>> resources(allocated/init >>>>>> in set_params()); For case #2, another start cmd will trigger preload >>>>>> and start >>>>>> in firmware, before that all pointers are reset to original ones. >>>>>> >>>>>> TODOs: It is only verified for playback, for capture, we may need some >>>>>> vivid >>>>>> code to implement them. >>>>> >>>>> I may be missing something here - the cover letter isn't very clear - , >>>>> but I see mentions of 'pull one period at a time' and no mention of the >>>>> start/stop threshold. Is this really going to work in no-irq mode where >>>>> periods are irrelevant and with start/stop thresholds that are smaller >>>>> than a period. >>>> >>>> Um, we don't actually use start/stop thresholds inside sof, or you can >>>> think of we are using one period as thresholds and it is >>>> non-configurable: after preloaded, we trigger dai dma start, in dma tfr >>>> callback(the tfr copies one period each time), we will schedule upstream >>>> copy(what I called it 'pull mode' upper) that will copy one period >>>> upstream. >>>> >>> >>> Hi Keyon, >>> >>> There is a register called SDnFIFO. Its defined in the HDA Spec and used >>> by ALSA framework. FW should advertise the buffering via this parameter. >>> >>> By default this value is 1ms in the HDA Spec. (legacy mode) >> >> Thanks for sharing that, Rakesh. BTW, does this SDnFIFO register only >> influence HDA audio, or it is needed for ASoC also? >> > > Its common code for both. But only for SKL and newer platforms. It's irrelevant for BYT/CHT/HAS/BDW where the HDAudio DMA is not used for host-DSP transfers. > >>> >>> The buffer on the firmware side should be configurable by the driver. >>> By default driver may assign it to 1ms and when no-rewind flag is set >>> it can set it to larger value for offload playback. >> >> Our target is definitely to make the buffer on firmware side >> configurable, by the driver, we may introduce topology support in next >> milestone release, where the pipeline/buffer can be changed dynamically. >> >>> >>> It is not wrong to fetch 1 period as long as you advertise that via SDxFIFO. >>> In order to comply with legacy applications, which does not assume too >>> much buffering it is better to start with minimum buffering possible that >>> FW can handle. >> >> Um, we haven't advertised this yet, for ASoC, we preset ALSA buffer >> size/period size/num range in snd_pcm_hw, application will set it in >> initial stage. >> For firmware inside buffer size, we are using quite small ones, but will >> make it configurable in short future. >> >> Thanks, >> ~Keyon >> >> >>> >>> >>>>> If you really want to make the transfers reliable then you should also >>>>> assume that there are no rewinds and compare read/write pointers to >>>>> avoid fetching stale data. that's a useful mode to have >>>> >>>> We have added handling for rewinds and comparing R/W pointers in this >>>> series, and won't fetch stale data with them applied. >>>> >>>> Thanks, >>>> ~Keyon >>>> >>>>> >>>>>> >>>>>> Changes in v3: >>>>>> 1. add one preload patch for pipeline full preload, which make >>>>>> playback works. >>>>>> 2. fix DMA channel status wrong after trigger stop issue. >>>>>> >>>>>> Changes in v2: >>>>>> 1. extract some common code to separate functions to save code; >>>>>> 2. add comments for component status; >>>>>> 3. other slight changes per Liam's suggestion. >>>>>> >>>>>> Keyon Jie (26): >>>>>> host: handle more possibility for playback spitting >>>>>> dai: reset dai_pos at MMAP_PPOS command >>>>>> pipleline: op_sink: don't need clear the buffer for each prepare >>>>>> host: start: don't real start for start command >>>>>> ipc: presentation_posn should be uint64_t type >>>>>> intel-ipc: add application buffer pointer update from host side >>>>>> intel-ipc: add stream operation IPC_INTEL_STR_STOP >>>>>> host: add host_update_buffer for produce and consume >>>>>> host: rename host_pos_blks to host_pos_read >>>>>> host: for the last bytes/period, send read notification later >>>>>> host: add R/W pointers check for playback >>>>>> host: add a completion work to notify host side >>>>>> host: reset pointers at new() and reset() >>>>>> host: cleanup host_cmd() cases >>>>>> host: host_copy: only copy when there is data and wait until finish >>>>>> volume: volume_params(): set the sink buffer params depending on its >>>>>> sink >>>>>> component: status: rename COMP_STATE_STOPPED to >>>> COMP_STATE_SETUP >>>>>> volume: volume_cmd(): only stop/pause at running >>>>>> volume: add R/W pointer check for volume_copy() >>>>>> mixer: mixer_params(): set the sink buffer params to >>>>>> STREAM_FORMAT_S32_LE. >>>>>> mixer: add R/W pointer check for mixer_copy() >>>>>> mixer: add dd->last_bytes for the last bytes(< period) caculation >>>>>> dai: add R/W pointer check for dai copy >>>>>> dw-dma: handle different cases in irq handler >>>>>> component: host/volume/mixer: reset buffers for stop cmd >>>>>> host: create host_elements_reset() and host_pointer_reset() for >> common >>>>>> use >>>>>> >>>>>> Liam Girdwood (1): >>>>>> pipeline: Add support for full pipeline pre-loading. >>>>>> >>>>>> src/audio/dai.c | 71 ++++- >>>>>> src/audio/host.c | 313 >>>>>> ++++++++++++++++------ >>>>>> src/audio/mixer.c | 85 +++++- >>>>>> src/audio/pipeline.c | 107 +++++++- >>>>>> src/audio/volume.c | 59 +++- >>>>>> src/drivers/dw-dma.c | 30 ++- >>>>>> src/include/reef/audio/component.h | 59 +++- >>>>>> src/include/reef/audio/pipeline.h | 2 + >>>>>> src/include/reef/dma.h | 7 + >>>>>> src/include/uapi/intel-ipc.h | 3 +- >>>>>> src/ipc/intel-ipc.c | 69 +++++ >>>>>> src/platform/baytrail/include/platform/platform.h | 6 + >>>>>> 12 files changed, 661 insertions(+), 150 deletions(-) >>>>>> >>>>> >>>>> _______________________________________________ >>>>> Sound-open-firmware mailing list >>>>> Sound-open-firmware(a)alsa-project.org >>>>> http://mailman.alsa-project.org/mailman/listinfo/sound-open-firmware >>>>>

1 0

[Sound-open-firmware] [PATCH v2 0/5] Fix capture doesn't work issue
by Keyon Jie 21 Feb '17

21 Feb '17

This small series fix the capture doesn't work after W/R pointer check implemented: 1. Make sure the component .params() works for capture; 2. Fix host side buffer for capture; 3. rename host side buffer pointer to make it more understandable for capture also. 4. integrate produce and consume version host_update_buffer to fix capture issue. Changes in v2: 1. change to use w_ptr/r_ptr host buffer pointers to make it easy to understand. Keyon Jie (5): component: set source buffer params for capture component .params() host: only update host_avail and host_free in host_update_buffer_xx() host: host_copy(): add handle for capture host: change host buffer pointer to w_ptr/r_ptr and update comments host: integrate consume and produce to host_update_buffer src/audio/host.c | 99 +++++++++++++++++++++----------------- src/audio/volume.c | 39 +++++++++------ src/include/reef/audio/component.h | 13 +++++ 3 files changed, 94 insertions(+), 57 deletions(-) -- 2.7.4

2 7

[Sound-open-firmware] [PATCH 0/5] Fix capture doesn't work issue
by Keyon Jie 15 Feb '17

15 Feb '17

This small series fix the capture doesn't work after W/R pointer check implemented: 1. Make sure the component .params() works for capture; 2. Fix host side buffer for capture; 3. rename host side buffer pointer to make it more understandable for capture also. 4. integrate produce and consume version host_update_buffer to fix capture issue. Keyon Jie (5): component: set source buffer params for capture component .params() host: only update host_avail and host_free in host_update_buffer_xx() host: host_copy(): add handle for capture host: rename host_pos_read to host_pos_local and update comments host: integrate consume and produce to host_update_buffer and fix for capture src/audio/host.c | 94 ++++++++++++++++++++++---------------- src/audio/volume.c | 39 ++++++++++------ src/include/reef/audio/component.h | 13 ++++++ 3 files changed, 92 insertions(+), 54 deletions(-) -- 2.7.4

4 11

[Sound-open-firmware] [PATCH] host: fix an uninitialized warning issue
by Keyon Jie 14 Feb '17

14 Feb '17

We met a variable uninitialized issue: 'ret' might be used uninitialized in this function. host.c:606 | host_preload() Here adding the initialized assignment to fix this issue. Signed-off-by: Keyon Jie <yang.jie(a)linux.intel.com> --- src/audio/host.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/audio/host.c b/src/audio/host.c index d1e4eaf..069c6a2 100644 --- a/src/audio/host.c +++ b/src/audio/host.c @@ -583,7 +583,7 @@ static int host_params(struct comp_dev *dev, struct stream_params *params) static int host_preload(struct comp_dev *dev) { struct host_data *hd = comp_get_drvdata(dev); - int ret, i; + int ret = 0, i; trace_host("PrL"); -- 2.7.4

2 1

Re: [Sound-open-firmware] [PATCH v3 00/27] add R/W pointers check for pipeline buffers
by Keyon Jie 13 Feb '17

13 Feb '17

On 2017年02月13日 12:31, Ughreja, Rakesh A wrote: > > >> -----Original Message----- >> From: Keyon Jie [mailto:yang.jie@linux.intel.com] >> Sent: Monday, February 13, 2017 7:31 AM >> To: Pierre-Louis Bossart <pierre-louis.bossart(a)linux.intel.com>; sound-open- >> firmware(a)alsa-project.org; liam.r.girdwood(a)linux.intel.com >> Cc: Ughreja, Rakesh A <rakesh.a.ughreja(a)intel.com>; Jie, Yang >> <yang.jie(a)intel.com>; Ingalsuo, Seppo <seppo.ingalsuo(a)intel.com> >> Subject: Re: [Sound-open-firmware] [PATCH v3 00/27] add R/W pointers >> check for pipeline buffers >> >> On 2017年02月11日 10:37, Pierre-Louis Bossart wrote: >>> On 2/10/17 8:17 PM, Keyon Jie wrote: >>>> This series adding the R/W buffer pointers check and make sure we won't >>>> copy wrong/missed/repeated data for the whole pipeline. >>>> >>>> For ALSA applications, usually we have two kinds of trigger command >>>> sequences: >>>> 1. (e.g. aplay) prefill datas ==> trigger start ==> refill buffer(when >>>> buffer >>>> free is enough) ==> ... ==> data filling finished ==> trigger >>>> drain ==> >>>> when all datas are rendered(via read pointer feedback) ==> >>>> trigger stop; >>>> 2. (e.g. speaker-test with large buffer size > wav file size): >>>> prefill all datas one time ==> trigger start ==> wait until >>>> all datas are >>>> rendered(via feedback read pointer) ==> trigger stop ==> >>>> prefill another >>>> wav file ==> trigger start ==> ... >>>> >>>> So the feedback from firmware about the read pointer is very important >>>> for >>>> the pipeline's running, to make the firmware can handle these two >>>> kinds of >>>> sequences, this series design/assume with preconditions: >>>> >>>> 1. We do down stream full preload(full fill all pipeline buffers, >>>> except host >>>> side one); >>>> 2. Using pull mode at running stage and pulling one period per time; >>>> 3. When in normal running status, if buffer a->avail is 0, then all those >>>> upstream buffers are empty; >>>> >>>> For those two sequence, we use a same logic to handle it: >>>> >>>> 1. We put all components in running status even some of them are >>>> empty(dai is >>>> an exception); >>>> 2. We stop dai/ssp once we found there is no more data for it to >>>> render, and >>>> notify this last read position to host side; >>>> 3. Host side will trigger stop and we will reset all buffer pointers and >>>> related resources; >>>> 4. For case #1, trigger reset will reset/free more >>>> resources(allocated/init >>>> in set_params()); For case #2, another start cmd will trigger preload >>>> and start >>>> in firmware, before that all pointers are reset to original ones. >>>> >>>> TODOs: It is only verified for playback, for capture, we may need some >>>> vivid >>>> code to implement them. >>> >>> I may be missing something here - the cover letter isn't very clear - , >>> but I see mentions of 'pull one period at a time' and no mention of the >>> start/stop threshold. Is this really going to work in no-irq mode where >>> periods are irrelevant and with start/stop thresholds that are smaller >>> than a period. >> >> Um, we don't actually use start/stop thresholds inside sof, or you can >> think of we are using one period as thresholds and it is >> non-configurable: after preloaded, we trigger dai dma start, in dma tfr >> callback(the tfr copies one period each time), we will schedule upstream >> copy(what I called it 'pull mode' upper) that will copy one period >> upstream. >> > > Hi Keyon, > > There is a register called SDnFIFO. Its defined in the HDA Spec and used > by ALSA framework. FW should advertise the buffering via this parameter. > > By default this value is 1ms in the HDA Spec. (legacy mode) Thanks for sharing that, Rakesh. BTW, does this SDnFIFO register only influence HDA audio, or it is needed for ASoC also? > > The buffer on the firmware side should be configurable by the driver. > By default driver may assign it to 1ms and when no-rewind flag is set > it can set it to larger value for offload playback. Our target is definitely to make the buffer on firmware side configurable, by the driver, we may introduce topology support in next milestone release, where the pipeline/buffer can be changed dynamically. > > It is not wrong to fetch 1 period as long as you advertise that via SDxFIFO. > In order to comply with legacy applications, which does not assume too > much buffering it is better to start with minimum buffering possible that > FW can handle. Um, we haven't advertised this yet, for ASoC, we preset ALSA buffer size/period size/num range in snd_pcm_hw, application will set it in initial stage. For firmware inside buffer size, we are using quite small ones, but will make it configurable in short future. Thanks, ~Keyon > > >>> If you really want to make the transfers reliable then you should also >>> assume that there are no rewinds and compare read/write pointers to >>> avoid fetching stale data. that's a useful mode to have >> >> We have added handling for rewinds and comparing R/W pointers in this >> series, and won't fetch stale data with them applied. >> >> Thanks, >> ~Keyon >> >>> >>>> >>>> Changes in v3: >>>> 1. add one preload patch for pipeline full preload, which make >>>> playback works. >>>> 2. fix DMA channel status wrong after trigger stop issue. >>>> >>>> Changes in v2: >>>> 1. extract some common code to separate functions to save code; >>>> 2. add comments for component status; >>>> 3. other slight changes per Liam's suggestion. >>>> >>>> Keyon Jie (26): >>>> host: handle more possibility for playback spitting >>>> dai: reset dai_pos at MMAP_PPOS command >>>> pipleline: op_sink: don't need clear the buffer for each prepare >>>> host: start: don't real start for start command >>>> ipc: presentation_posn should be uint64_t type >>>> intel-ipc: add application buffer pointer update from host side >>>> intel-ipc: add stream operation IPC_INTEL_STR_STOP >>>> host: add host_update_buffer for produce and consume >>>> host: rename host_pos_blks to host_pos_read >>>> host: for the last bytes/period, send read notification later >>>> host: add R/W pointers check for playback >>>> host: add a completion work to notify host side >>>> host: reset pointers at new() and reset() >>>> host: cleanup host_cmd() cases >>>> host: host_copy: only copy when there is data and wait until finish >>>> volume: volume_params(): set the sink buffer params depending on its >>>> sink >>>> component: status: rename COMP_STATE_STOPPED to >> COMP_STATE_SETUP >>>> volume: volume_cmd(): only stop/pause at running >>>> volume: add R/W pointer check for volume_copy() >>>> mixer: mixer_params(): set the sink buffer params to >>>> STREAM_FORMAT_S32_LE. >>>> mixer: add R/W pointer check for mixer_copy() >>>> mixer: add dd->last_bytes for the last bytes(< period) caculation >>>> dai: add R/W pointer check for dai copy >>>> dw-dma: handle different cases in irq handler >>>> component: host/volume/mixer: reset buffers for stop cmd >>>> host: create host_elements_reset() and host_pointer_reset() for common >>>> use >>>> >>>> Liam Girdwood (1): >>>> pipeline: Add support for full pipeline pre-loading. >>>> >>>> src/audio/dai.c | 71 ++++- >>>> src/audio/host.c | 313 >>>> ++++++++++++++++------ >>>> src/audio/mixer.c | 85 +++++- >>>> src/audio/pipeline.c | 107 +++++++- >>>> src/audio/volume.c | 59 +++- >>>> src/drivers/dw-dma.c | 30 ++- >>>> src/include/reef/audio/component.h | 59 +++- >>>> src/include/reef/audio/pipeline.h | 2 + >>>> src/include/reef/dma.h | 7 + >>>> src/include/uapi/intel-ipc.h | 3 +- >>>> src/ipc/intel-ipc.c | 69 +++++ >>>> src/platform/baytrail/include/platform/platform.h | 6 + >>>> 12 files changed, 661 insertions(+), 150 deletions(-) >>>> >>> >>> _______________________________________________ >>> Sound-open-firmware mailing list >>> Sound-open-firmware(a)alsa-project.org >>> http://mailman.alsa-project.org/mailman/listinfo/sound-open-firmware >>>

1 0

[Sound-open-firmware] [PATCH v2 00/26] add R/W pointers check for pipeline buffers
by Keyon Jie 11 Feb '17

11 Feb '17

This series adding the R/W buffer pointers check and make sure we won't copy wrong/missed/repeated data for the whole pipeline. For ALSA applications, usually we have two kinds of trigger command sequences: 1. (e.g. aplay) prefill datas ==> trigger start ==> refill buffer(when buffer free is enough) ==> ... ==> data filling finished ==> trigger drain ==> when all datas are rendered(via read pointer feedback) ==> trigger stop; 2. (e.g. speaker-test with large buffer size > wav file size): prefill all datas one time ==> trigger start ==> wait until all datas are rendered(via feedback read pointer) ==> trigger stop ==> prefill another wav file ==> trigger start ==> ... So the feedback from firmware about the read pointer is very important for the pipeline's running, to make the firmware can handle these two kinds of sequences, this series design/assume with preconditions: 1. We do down stream full preload(full fill all pipeline buffers, except host side one); 2. Using pull mode at running stage and pulling one period per time; 3. When in normal running status, if buffer a->avail is 0, then all those upstream buffers are empty; For those two sequence, we use a same logic to handle it: 1. We put all components in running status even some of them are empty(dai is an exception); 2. We stop dai/ssp once we found there is no more data for it to render, and notify this last read position to host side; 3. Host side will trigger stop and we will reset all buffer pointers and related resources; 4. For case #1, trigger reset will reset/free more resources(allocated/init in set_params()); For case #2, another start cmd will trigger preload and start in firmware, before that all pointers are reset to original ones. TODOs: It is only verified for playback, for capture, we may need some vivid code to implement them. Changes in v2: 1. extract some common code to separate functions to save code; 2. add comments for component status; 3. other slight changes per Liam's suggestion. Keyon Jie (26): host: handle more possibility for playback spitting dai: reset dai_pos at MMAP_PPOS command pipleline: op_sink: don't need clear the buffer for each prepare host: start: don't real start for start command ipc: presentation_posn should be uint64_t type intel-ipc: add application buffer pointer update from host side intel-ipc: add stream operation IPC_INTEL_STR_STOP host: add host_update_buffer for produce and consume host: rename host_pos_blks to host_pos_read host: for the last bytes/period, send read notification later host: add R/W pointers check for playback host: add a completion work to notify host side host: reset pointers at new() and reset() host: cleanup host_cmd() cases host: host_copy: only copy when there is data and wait until finish volume: volume_params(): set the sink buffer params depending on its sink component: status: rename COMP_STATE_STOPPED to COMP_STATE_SETUP volume: volume_cmd(): only stop/pause at running volume: add R/W pointer check for volume_copy() mixer: mixer_params(): set the sink buffer params to STREAM_FORMAT_S32_LE. mixer: add R/W pointer check for mixer_copy() mixer: add dd->last_bytes for the last bytes(< period) caculation dai: add R/W pointer check for dai copy dw-dma: handle different cases in irq handler component: host/volume/mixer: reset buffers for stop cmd host: create host_elements_reset() and host_pointer_reset() for common use src/audio/dai.c | 63 ++++- src/audio/host.c | 306 ++++++++++++++++------ src/audio/mixer.c | 39 ++- src/audio/pipeline.c | 11 +- src/audio/volume.c | 43 ++- src/drivers/dw-dma.c | 28 +- src/include/reef/audio/component.h | 42 ++- src/include/reef/audio/pipeline.h | 2 + src/include/reef/dma.h | 7 + src/include/uapi/intel-ipc.h | 3 +- src/ipc/intel-ipc.c | 69 +++++ src/platform/baytrail/include/platform/platform.h | 6 + 12 files changed, 488 insertions(+), 131 deletions(-) -- 2.7.4

3 28

[Sound-open-firmware] [PATCH] pipeline: Add support for full pipeline pre-loading.
by Keyon Jie 10 Feb '17

10 Feb '17

From: Liam Girdwood <liam.r.girdwood(a)linux.intel.com> Preload entire pipeline and all components by walking the pipeline graph. Signed-off-by: Liam Girdwood <liam.r.girdwood(a)linux.intel.com> Modified-by: Keyon Jie <yang.jie(a)linux.intel.com> --- src/audio/dai.c | 8 ++++ src/audio/host.c | 9 ++-- src/audio/mixer.c | 46 ++++++++++++++++-- src/audio/pipeline.c | 96 ++++++++++++++++++++++++++++++++++++-- src/audio/volume.c | 18 ++++--- src/include/reef/audio/component.h | 17 ++++++- 6 files changed, 173 insertions(+), 21 deletions(-) diff --git a/src/audio/dai.c b/src/audio/dai.c index 230acbf..75f9acf 100644 --- a/src/audio/dai.c +++ b/src/audio/dai.c @@ -488,6 +488,12 @@ static int dai_copy(struct comp_dev *dev) return 0; } +/* source component will preload dai */ +static int dai_preload(struct comp_dev *dev) +{ + return 0; +} + static int dai_config(struct comp_dev *dev, struct dai_config *dai_config) { struct dai_data *dd = comp_get_drvdata(dev); @@ -513,6 +519,7 @@ static struct comp_driver comp_dai_ssp = { .prepare = dai_prepare, .reset = dai_reset, .dai_config = dai_config, + .preload = dai_preload, .dai_set_loopback = dai_set_loopback, }, }; @@ -526,6 +533,7 @@ static struct comp_driver comp_dai_hda = { .cmd = dai_cmd, .copy = dai_copy, .prepare = dai_prepare, + .preload = dai_preload, }, }; diff --git a/src/audio/host.c b/src/audio/host.c index d71c010..d1e4eaf 100644 --- a/src/audio/host.c +++ b/src/audio/host.c @@ -586,8 +586,9 @@ static int host_preload(struct comp_dev *dev) int ret, i; trace_host("PrL"); + /* preload all periods */ - for (i = 0; i < PLAT_HOST_PERIODS; i++) { + for (i = 0; i < dev->preload; i++) { /* do DMA transfer */ wait_init(&hd->complete); dma_set_config(hd->dma, hd->chan, &hd->config); @@ -632,11 +633,8 @@ static int host_prepare(struct comp_dev *dev) hd->params.period_frames * hd->params.frame_size; hd->split_remaining = 0; + dev->preload = PLAT_HOST_PERIODS; - if (hd->params.direction == STREAM_DIRECTION_PLAYBACK) - host_preload(dev); - - host_update_buffer_consume(hd); dev->state = COMP_STATE_PREPARE; return 0; } @@ -830,6 +828,7 @@ struct comp_driver comp_host = { .cmd = host_cmd, .copy = host_copy, .prepare = host_prepare, + .preload = host_preload, .host_buffer = host_buffer, }, }; diff --git a/src/audio/mixer.c b/src/audio/mixer.c index c653fd9..740ccaf 100644 --- a/src/audio/mixer.c +++ b/src/audio/mixer.c @@ -286,18 +286,53 @@ static int mixer_reset(struct comp_dev *dev) return 0; } +/* + * Prepare the mixer. The mixer may already be running at this point with other + * sources. Make sure we only prepare the "prepared" source streams and not + * the active or inactive sources. + * + * We should also make sure that we propagate the prepare call to downstream + * if downstream is not currently active. + */ static int mixer_prepare(struct comp_dev *dev) { struct mixer_data *md = comp_get_drvdata(dev); - int i; + struct list_item * blist; + struct comp_buffer *source; + int downstream = 0; trace_mixer("MPp"); - md->mix_func = mix_n; - dev->state = COMP_STATE_PREPARE; + if (dev->state != COMP_STATE_RUNNING) { + md->mix_func = mix_n; + dev->state = COMP_STATE_PREPARE; + dev->preload = PLAT_INT_PERIODS; + } + + /* check each mixer source state */ + list_for_item(blist, &dev->bsource_list) { + source = container_of(blist, struct comp_buffer, sink_list); + + /* only prepare downstream if we have no active sources */ + if (source->source->state == COMP_STATE_PAUSED || + source->source->state == COMP_STATE_RUNNING) { + downstream = 1; + } + } + + /* prepare downstream */ + return downstream; +} + +static int mixer_preload(struct comp_dev *dev) +{ + int i; + + if (dev->state != COMP_STATE_PREPARE) + return 1; - /* mix periods */ - for (i = 0; i < PLAT_HOST_PERIODS; i++) + /* preload and mix periods if inactive */ + for (i = 0; i < dev->preload; i++) mixer_copy(dev); return 0; @@ -310,6 +345,7 @@ struct comp_driver comp_mixer = { .free = mixer_free, .params = mixer_params, .prepare = mixer_prepare, + .preload = mixer_preload, .cmd = mixer_cmd, .copy = mixer_copy, .reset = mixer_reset, diff --git a/src/audio/pipeline.c b/src/audio/pipeline.c index 41693ae..5c03659 100644 --- a/src/audio/pipeline.c +++ b/src/audio/pipeline.c @@ -306,6 +306,78 @@ int pipeline_comp_connect(struct pipeline *p, struct comp_dev *source, return 0; } +/* preload component buffers prior to playback start */ +static int component_preload(struct comp_dev *comp, uint32_t depth, + uint32_t max_depth) +{ + struct list_item *clist; + int err; + + /* bail if we are at max_depth */ + if (depth > max_depth) + return 0; + + trace_value(comp->id); + err = comp_preload(comp); + + /* dont walk the graph any further if this component fails */ + if (err < 0) { + trace_pipe_error("eOp"); + return err; + } else if (err > 0 || comp->is_dai) { + /* we finish walking the graph if we reach the DAI or component is + * currently active and configured already (err > 0). + */ + trace_pipe("prl"); + trace_value((uint32_t)err); + trace_value(comp->is_dai); + trace_value(comp->id); + trace_value(comp->is_host); + return 0; + } + + /* now run this operation downstream */ + list_for_item(clist, &comp->bsink_list) { + struct comp_buffer *buffer; + + buffer = container_of(clist, struct comp_buffer, source_list); + + /* dont go downstream if this component is not connected */ + if (!buffer->connected) + continue; + + err = component_preload(buffer->sink, depth + 1, max_depth); + if (err < 0) + break; + } + + return err; +} + +/* work out the pipeline depth from this component to the farthest endpoint */ +static int pipeline_depth(struct comp_dev *comp, int current) +{ + struct list_item *clist; + int depth = 0; + + /* go down stream to deepest endpoint */ + list_for_item(clist, &comp->bsink_list) { + struct comp_buffer *buffer; + + buffer = container_of(clist, struct comp_buffer, source_list); + + /* dont go downstream if this component is not connected */ + if (!buffer->connected) + continue; + + depth = pipeline_depth(buffer->sink, current + 1); + if (depth > current) + current = depth; + } + + return current; +} + /* call op on all downstream components - locks held by caller */ static int component_op_sink(struct op_data *op_data, struct comp_dev *comp) { @@ -459,7 +531,7 @@ static int component_op_source(struct op_data *op_data, struct comp_dev *comp) int pipeline_prepare(struct pipeline *p, struct comp_dev *host) { struct op_data op_data; - int ret; + int ret, depth, i; trace_pipe("Ppr"); @@ -467,12 +539,28 @@ int pipeline_prepare(struct pipeline *p, struct comp_dev *host) op_data.op = COMP_OPS_PREPARE; spin_lock(&p->lock); - if (host->direction == STREAM_DIRECTION_PLAYBACK) + if (host->direction == STREAM_DIRECTION_PLAYBACK) { + + /* first of all prepare the pipeline */ ret = component_op_sink(&op_data, host); - else + if (ret < 0) + goto out; + + /* then preload buffers - the buffers must be moved + * downstream so that every component has full buffers for + * trigger start */ + depth = pipeline_depth(host, 0); + for (i = depth; i > 0; i--) { + ret = component_preload(host, 0, i); + if (ret < 0) + break; + } + } else { ret = component_op_source(&op_data, host); - spin_unlock(&p->lock); + } +out: + spin_unlock(&p->lock); return ret; } diff --git a/src/audio/volume.c b/src/audio/volume.c index f347847..1eb6004 100644 --- a/src/audio/volume.c +++ b/src/audio/volume.c @@ -548,16 +548,21 @@ found: *cd->hvol[i] = cd->volume[i]; } - /* copy periods from host */ - if (source->params.direction == STREAM_DIRECTION_PLAYBACK) { - for (i = 0; i < PLAT_INT_PERIODS; i++) - volume_copy(dev); - } - + dev->preload = PLAT_INT_PERIODS; dev->state = COMP_STATE_PREPARE; return 0; } +static int volume_preload(struct comp_dev *dev) +{ + int i; + + for (i = 0; i < dev->preload; i++) + volume_copy(dev); + + return 0; +} + static int volume_reset(struct comp_dev *dev) { dev->state = COMP_STATE_INIT; @@ -575,6 +580,7 @@ struct comp_driver comp_volume = { .copy = volume_copy, .prepare = volume_prepare, .reset = volume_reset, + .preload = volume_preload, }, }; diff --git a/src/include/reef/audio/component.h b/src/include/reef/audio/component.h index 3abae3d..1e784f5 100644 --- a/src/include/reef/audio/component.h +++ b/src/include/reef/audio/component.h @@ -140,7 +140,12 @@ struct buffer_desc { struct period_desc source_period; }; -/* audio component operations - all mandatory */ +/* + * Audio component operations - all mandatory. + * + * All component operations must return 0 for success, negative values for + * errors and 1 to stop the pipeline walk operation. + */ struct comp_ops { /* component creation and destruction */ struct comp_dev *(*new)(uint32_t type, uint32_t index, @@ -150,6 +155,9 @@ struct comp_ops { /* set component audio stream paramters */ int (*params)(struct comp_dev *dev, struct stream_params *params); + /* preload buffers */ + int (*preload)(struct comp_dev *dev); + /* set component audio stream paramters */ int (*dai_config)(struct comp_dev *dev, struct dai_config *dai_config); @@ -194,6 +202,7 @@ struct comp_dev { uint32_t is_host; /* component is graph host endpoint */ uint32_t is_mixer; /* component is mixer */ uint32_t direction; /* STREAM_DIRECTION_ */ + uint16_t preload; /* number of periods to preload during prepare() */ spinlock_t lock; /* lock for this component */ void *private; /* private data */ struct comp_driver *drv; @@ -281,6 +290,12 @@ static inline int comp_prepare(struct comp_dev *dev) return dev->drv->ops.prepare(dev); } +/* component preload buffers -mandatory */ +static inline int comp_preload(struct comp_dev *dev) +{ + return dev->drv->ops.preload(dev); +} + /* copy component buffers - mandatory */ static inline int comp_copy(struct comp_dev *dev) { -- 2.7.4

1 0

[Sound-open-firmware] [PATCH 00/25] add R/W pointers check for pipeline buffers
by Keyon Jie 09 Feb '17

09 Feb '17

This series adding the R/W buffer pointers check and make sure we won't copy wrong/missed/repeated data for the whole pipeline. For ALSA applications, usually we have two kinds of trigger command sequences: 1. (e.g. aplay) prefill datas ==> trigger start ==> refill buffer(when buffer free is enough) ==> ... ==> data filling finished ==> trigger drain ==> when all datas are rendered(via read pointer feedback) ==> trigger stop; 2. (e.g. speaker-test with large buffer size > wav file size): prefill all datas one time ==> trigger start ==> wait until all datas are rendered(via feedback read pointer) ==> trigger stop ==> prefill another wav file ==> trigger start ==> ... So the feedback from firmware about the read pointer is very important for the pipeline's running, to make the firmware can handle these two kinds of sequences, this series design/assume with preconditions: 1. We do down stream full preload(full fill all pipeline buffers, except host side one); 2. Using pull mode at running stage and pulling one period per time; 3. When in normal running status, if buffer a->avail is 0, then all those upstream buffers are empty; For those two sequence, we use a same logic to handle it: 1. We put all components in running status even some of them are empty(dai is an exception); 2. We stop dai/ssp once we found there is no more data for it to render, and notify this last read position to host side; 3. Host side will trigger stop and we will reset all buffer pointers and related resources; 4. For case #1, trigger reset will reset/free more resources(allocated/init in set_params()); For case #2, another start cmd will trigger preload and start in firmware, before that all pointers are reset to original ones. TODOs: It is only verified for playback, for capture, we may need some vivid code to implement them. Keyon Jie (25): host: handle more possibility for playback spitting dai: reset dai_pos at MMAP_PPOS command pipleline: op_sink: don't need clear the buffer for each prepare host: start: don't real start for start command ipc: presentation_posn should be uint64_t type intel-ipc: add application buffer pointer update from host side intel-ipc: add stream operation IPC_INTEL_STR_STOP host: add host_update_buffer for produce and consume host: rename host_pos_blks to host_pos_read host: for the last bytes/period, send read notification later host: add R/W pointers check for playback host: add a completion work to notify host side host: reset pointers at new() and reset() host: cleanup host_cmd() cases host: host_copy: only copy when there is data and wait until finish volume: volume_params(): set the sink buffer params depending on its sink component: status: rename COMP_STATE_STOPPED to COMP_STATE_SETUP volume: volume_cmd(): only stop/pause at running volume: add R/W pointer check for volume_copy() mixer: mixer_params(): set the sink buffer params to STREAM_FORMAT_S32_LE. mixer: add R/W pointer check for mixer_copy() mixer: add dd->last_bytes for the last bytes(< period) caculation dai: add R/W pointer check for dai copy dw-dma: handle different cases in irq handler component: host/volume/mixer: reset buffers for stop cmd src/audio/dai.c | 60 ++++- src/audio/host.c | 289 +++++++++++++++++----- src/audio/mixer.c | 64 ++++- src/audio/pipeline.c | 11 +- src/audio/volume.c | 66 ++++- src/drivers/dw-dma.c | 25 +- src/include/reef/audio/component.h | 6 +- src/include/reef/audio/pipeline.h | 2 + src/include/reef/dma.h | 6 + src/include/uapi/intel-ipc.h | 4 +- src/ipc/intel-ipc.c | 77 ++++++ src/platform/baytrail/include/platform/platform.h | 6 + 12 files changed, 511 insertions(+), 105 deletions(-) -- 2.7.4

3 46