Expose API for custom audio processing
See original GitHub issueThe library exposes public API for custom Video Filters. It would be good to have a similar thing but for audio. There already is AudioPostProcessEffect which does audio processing but I couldn’t find a way to define my own AudioProcessor.
Issue Analytics
- State:
- Created 3 years ago
- Comments:6 (3 by maintainers)
Top Results From Across the Web
Web Audio API - MDN Web Docs - Mozilla
Audio processing in JavaScript. Using audio worklets, you can define custom audio nodes written in JavaScript or WebAssembly. Audio worklets ...
Read more >Windows 11 APIs for Audio Processing Objects - Microsoft Learn
Custom implementations for these core audio processing extensions ... This API is exposed to an HSA and Win32 applications to provide access ...
Read more >Web Audio Processing: Use Cases and Requirements - W3C
Abstract. This document introduces a series of scenarios and a list of requirements guiding the work of the W3C Audio Working Group in...
Read more >Video and Audio Processing API - Filestack
In order to start working with our Video and Audio transcoding feature you need to implement Webhooks. As it is described below, the...
Read more >Enter Audio Worklet - Chrome Developers
To enable custom audio processing in JavaScript, the Web Audio API proposed a ScriptProcessorNode which used event handlers to invoke user ...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found

I tried add audio sink but I can’t listen any difference. For now, I added a class without effect. The idea is similar to gl filter. Use this method to set an effect: https://github.com/pedroSG94/rtmp-rtsp-stream-client-java/blob/master/rtplibrary/src/main/java/com/pedro/rtplibrary/base/Camera1Base.java#L117 You can clear audio effect with this:
To create a new effect you should extend from CustomAudioEffect and modify buffer in process method.
Commit: https://github.com/pedroSG94/rtmp-rtsp-stream-client-java/commit/e3a3731845b7a97b193050ce1c8caa4b1ea745d5
Quickly looking at ExoPlayer I found this: https://github.com/google/ExoPlayer/blob/62092e664586175107a3aaac3e1b0efa3059049f/library/core/src/main/java/com/google/android/exoplayer2/audio/DefaultAudioSink.java#L709
seems like this class is a default sink that is responsible for managing the buffers and audio processors pipeline, and this method that I pasted above executes AudioProcessor’s methods passing audio buffers into processors and getting the results back.