Using WebRTC, MSE & HLS as audio source. Problems with visualization.

[IgorA100]

I use IP cameras + RTSPToWeb
When using MSE & audio AAC there are no problems with visualization. Everything works fine.
When using WebRTC & audio G.711A there is no visualization, although the sound from the camera is audible. No errors!

Connection code:

    ...................................
   const mediaStream = new MediaStream();
   audioEl.srcObject = mediaStream;
    ...................................

    const audioEl = document.getElementById('liveStream');
    var audioMotion = new AudioMotionAnalyzer(
      document.getElementById('audioVisualisation'),
      {
        source: audioEl,
        height: 100,
      }
    );

When doing audioEl .srcObject.getAudioTracks() I get an audio track.

I can't figure out why visualization doesn't work for MediaStream()

[cslamar]

I'm having the same issue

[swanom]

worked for me like this:

audioMotion.connectInput(audioMotion.audioCtx.createMediaStreamSource(myStream))

[IgorA100]

audioMotion.connectInput

Yes, connecting using "connectInput" works. But according to the documentation, it should also work when specifying "source."

[hvianna]

It seems the audio node created by createMediaElementSource() cannot handle an element's srcObject, or at least not dynamic changes to it. This is what I need to use to connect <audio> or <video> sources (code here).

I don't see anything I can do to solve this, but I can improve connectInput() to accept MediaStreams directly, which would also allow specifying a stream as source in the constructor.