Recherche avancée

Sur d’autres sites (9496)

• How to interpret ndarray in a pyAV AudioFrame ?

  30 janvier 2024, par Sachin Dole

  I want to process streaming audio (coming in from a person speaking on the peer of a webRTC peer connection) to detect when the person is done talking. I have got the audio track and access to individual frames. I see that each frame can be converted to an nd_array using Frame.to_ndarray. I can also see values in the ndarray changing depending on what the person is speaking, what pitch, what volume etc. Now, I want to detect silence on the stream. My question is what is in the ndarray and how can I make sense of the data ?

  


          while True:
            try:
                frame:AudioFrame = await track.recv()
                frame_nd_array = frame.to_ndarray() 


  


  Where can I learn what is in the frame_nd_array ?

  


• How to detect silence in a pyAV AudioFrame ?

  29 janvier 2024, par Sachin Dole

  I want to process streaming audio (coming in from a person speaking on the peer of a webRTC peer connection) to detect when the person is done talking. I have got the audio track and access to individual frames. I see that each frame can be converted to an nd_array using Frame.to_ndarray. I can also see values in the ndarray changing depending on what the person is speaking, what pitch, what volume etc. Now, I want to detect silence on the stream. My question is what is in the ndarray and how can I make sense of the data ?

  


          while True:
            try:
                frame:AudioFrame = await track.recv()
                frame_nd_array = frame.to_ndarray() 


  


  Where can I learn what is in the frame_nd_array ?

  


• FFmpeg - Error submitting a packet to the muxer [closed]

  26 novembre 2023, par undercash

  I m having an issue with my self compiled ffmpeg since 2020.
here is my ffmpeg comfig

  


  [```
built with gcc 11 (Ubuntu 11.4.0-1ubuntu1 22.04)
configuration : —enable-gpl —enable-version3 —enable-nonfree —enable-postproc —enable-libfdk_aac —enable-libtheora —enable-libvorbis —enable-libmp3lame —enable-libx264 —enable-libx265 —enable-libvpx —enable-librtmp —enable-libass —enable-libfreetype —enable-libdav1d —extra-libs='-lpthread -lm' —enable-openssl —enable-cuda-nvcc —enable-libnpp —extra-cflags=-I/usr/local/cuda/include —extra-ldflags=-L/usr/local/cuda/lib64 —disable-static —enable-shared

  


  
I know this is a config with nvidea but this is not relevent to the problem. Happens to me on real server without gpu , ubuntu 20 or 22.

I use ffmpeg to stream to a remote rtmp server (-f flv rtmp://xx)
Depending on the file it will consistently fail at the same time of the file with this error warning
If I just transcode a video locally, there is no issue at all
I have been testing streaming to youtube or big sites so I could discard the possibility of my own rtmp servers being misconfigured.

[```
[vost#0:0/h264 @ 0x55de16e8ebc0] Error submitting a packet to the muxer: End of fileop=1 speed=   1x
[flv @ 0x55de16e78980] Failed to update header with correct duration.
[flv @ 0x55de16e78980] Failed to update header with correct filesize.
[out#0/flv @ 0x55de16e83640] Error writing trailer: End of file
```]


    0070:  22 30                                              "0
    [vost#0:0/h264 @ 0x55ca300a0200] Error submitting a packet to the muxer: End of file
    [out#0/flv @ 0x55ca3019f6c0] Muxer returned EOF
    [out#0/flv @ 0x55ca3019f6c0] Terminating muxer thread
    [out#0/flv @ 0x55ca3019f6c0] sq: send 1 ts 1676.94
    [out#0/flv @ 0x55ca3019f6c0] sq: receive 1 ts 1676.93 queue head -1 ts N/A
    [NULL @ 0x55ca30076180] ct_type:0 pic_struct:3
    Last message repeated 2 times
    [out#0/flv @ 0x55ca3019f6c0] sq: send 0 ts 1676.72
    [out#0/flv @ 0x55ca3019f6c0] sq: receive 0 ts 1676.72 queue head -1 ts N/A
    No more output streams to write to, finishing.
    [vist#0:0/h264 @ 0x55ca301a3b40] Decoder thread received EOF packet
    [vist#0:0/h264 @ 0x55ca301a3b40] Decoder returned EOF, finishing
    [vist#0:0/h264 @ 0x55ca301a3b40] Terminating decoder thread
    [aist#0:1/ac3 @ 0x55ca301a3680] Decoder thread received EOF packet
    [aist#0:1/ac3 @ 0x55ca301a3680] Decoder returned EOF, finishing
    [aist#0:1/ac3 @ 0x55ca301a3680] Terminating decoder thread


As a work around, and since I have not seen any threads on the internet talking about this issue, I have been using since 2020 static builds from https://johnvansickle.com/ffmpeg/
They work fine (once you enable dns resolution with them) but as I m willing to use a nvidea card I need to use my own ffmpeg with nvidea drivers.

thanks

Well pretty much what I wrote previously