question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Expose API for custom audio processing

See original GitHub issue

The library exposes public API for custom Video Filters. It would be good to have a similar thing but for audio. There already is AudioPostProcessEffect which does audio processing but I couldn’t find a way to define my own AudioProcessor.

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:6 (3 by maintainers)

github_iconTop GitHub Comments

1reaction
pedroSG94commented, Apr 1, 2020

I tried add audio sink but I can’t listen any difference. For now, I added a class without effect. The idea is similar to gl filter. Use this method to set an effect: https://github.com/pedroSG94/rtmp-rtsp-stream-client-java/blob/master/rtplibrary/src/main/java/com/pedro/rtplibrary/base/Camera1Base.java#L117 You can clear audio effect with this:

rtspCamera1.setCustomAudioEffect(new NoAudioEffect());

To create a new effect you should extend from CustomAudioEffect and modify buffer in process method.

Commit: https://github.com/pedroSG94/rtmp-rtsp-stream-client-java/commit/e3a3731845b7a97b193050ce1c8caa4b1ea745d5

0reactions
mzgreencommented, Mar 31, 2020

Quickly looking at ExoPlayer I found this: https://github.com/google/ExoPlayer/blob/62092e664586175107a3aaac3e1b0efa3059049f/library/core/src/main/java/com/google/android/exoplayer2/audio/DefaultAudioSink.java#L709

seems like this class is a default sink that is responsible for managing the buffers and audio processors pipeline, and this method that I pasted above executes AudioProcessor’s methods passing audio buffers into processors and getting the results back.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Web Audio API - MDN Web Docs - Mozilla
Audio processing in JavaScript. Using audio worklets, you can define custom audio nodes written in JavaScript or WebAssembly. Audio worklets ...
Read more >
Windows 11 APIs for Audio Processing Objects - Microsoft Learn
Custom implementations for these core audio processing extensions ... This API is exposed to an HSA and Win32 applications to provide access ...
Read more >
Web Audio Processing: Use Cases and Requirements - W3C
Abstract. This document introduces a series of scenarios and a list of requirements guiding the work of the W3C Audio Working Group in...
Read more >
Video and Audio Processing API - Filestack
In order to start working with our Video and Audio transcoding feature you need to implement Webhooks. As it is described below, the...
Read more >
Enter Audio Worklet - Chrome Developers
To enable custom audio processing in JavaScript, the Web Audio API proposed a ScriptProcessorNode which used event handlers to invoke user ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found