Recherche avancée

Sur d’autres sites (7402)

• Audio offset get wrong after some time when streaming audios

  7 septembre 2024, par Antoine Grenard

  I use microsoft-cognitiveservices-speech-sdk (1.38.0) in order to do real time speech to text.
It seems like the offset is right when I send a full audio but it is wrong when I send it cut in a lot of audio chunks.

  


  The more there is audio chunks the more inaccurate the offset is :

  


  

  • No chunks : 1 726 300 000

  


  • 369 chunks of 0.5 seconds : 1 729 600 000

  


  • 923 chunks of 0.2 seconds : 1 744 600 000

  


  • 1443 chunks of 0.1 seconds : 1 757 900 000

  


  


  To reproduce here is some piece of code :

  


      const speechConfig = SpeechConfig.fromSubscription(<key>,  {console.log(event)}&#xA;    speechRecognizer.canceled = async (recognizer, event) => {console.log(event)}&#xA;    speechRecognizer.startContinuousRecognitionAsync();&#xA;&#xA;    for (let i = 1; i &lt;= 1443; i&#x2B;&#x2B;) {&#xA;      const formattedNumber = i.toString().padStart(4, &#x27;0&#x27;);&#xA;      const buffer = fs.readFileSync(`/var/tmp/chunks/output_${formattedNumber}.wav`);&#xA;      pushStream.write(buffer);&#xA;    }&#xA;</key>

  


  To create the audio chunks :

  


  ffmpeg -i  -f segment -segment_time 0.1 -c copy output_%04d.wav


  


  Here is the audio link : https://drive.google.com/file/d/1H_RJuqMiBaVkpo9XHrgp1bpuFdgQl64O/view?usp=sharing

  


  Thanks for your help

  


• When I use ffprobe to check a video stream，I get the error below [closed]

  21 mai 2024, par dongrixinyu

  I came across with a problem when ffprobe and decoding video stream .

  


  Here is the log :

  


  ffprobe version 6.1.1 Copyright (c) 2007-2023 the FFmpeg developers
  built with gcc 9 (Ubuntu 9.4.0-1ubuntu1~20.04.2)
  configuration: --enable-gpl --enable-version3 --enable-shared --disable-w32threads --disable-autodetect --enable-fontconfig --enable-iconv --enable-gnutls --enable-libxml2 --enable-libsnappy --enable-zlib --enable-libsrt --enable-libssh --enable-libbluray --enable-libcaca --enable-sdl2 --enable-libdav1d --enable-libdavs2 --enable-libzvbi --enable-libwebp --enable-libx264 --enable-libx265 --enable-libaom --enable-libopenjpeg --enable-libvpx --enable-libass --enable-libfreetype --enable-libfribidi --enable-libvidstab --enable-libmfx --enable-opencl --enable-libgme --enable-libmodplug --enable-libopenmpt --enable-libopencore-amrwb --enable-libmp3lame --enable-libshine --enable-libtheora --enable-libtwolame --enable-libopencore-amrnb --enable-libopus --enable-libspeex --enable-libvorbis --enable-ladspa --enable-libbs2b --enable-libmysofa --enable-librubberband --enable-libsoxr
  libavutil      58. 29.100 / 58. 29.100
  libavcodec     60. 31.102 / 60. 31.102
  libavformat    60. 16.100 / 60. 16.100
  libavdevice    60.  3.100 / 60.  3.100
  libavfilter     9. 12.100 /  9. 12.100
  libswscale      7.  5.100 /  7.  5.100
  libswresample   4. 12.100 /  4. 12.100
  libpostproc    57.  3.100 / 57.  3.100
[NULL @ 0x5595d3e72040] illegal reordering_of_pic_nums_idc 7
[h264 @ 0x5595d3e72040] illegal modification_of_pic_nums_idc 7
[h264 @ 0x5595d3e72040] decode_slice_header error
[h264 @ 0x5595d3e72040] no frame!
[h264 @ 0x5595d3e72040] decode_slice_header error
[h264 @ 0x5595d3e72040] no frame!
[h264 @ 0x5595d3e72040] reference overflow 66 > 15 or 0 > 15
    Last message repeated 1 times
[h264 @ 0x5595d3e72040] decode_slice_header error
[h264 @ 0x5595d3e72040] no frame!
[h264 @ 0x5595d3e72040] chroma_log2_weight_denom 27 is out of range
    Last message repeated 1 times
[h264 @ 0x5595d3e72040] Missing reference picture, default is 4
[h264 @ 0x5595d3e72040] concealing 8144 DC, 8144 AC, 8144 MV errors in P frame
[h264 @ 0x5595d3e72040] top block unavailable for requested intra mode
[h264 @ 0x5595d3e72040] error while decoding MB 4 0, bytestream 12113
[h264 @ 0x5595d3e72040] concealing 8160 DC, 8160 AC, 8160 MV errors in P frame
[h264 @ 0x5595d3e72040] illegal short term buffer state detected
[h264 @ 0x5595d3e72040] top block unavailable for requested intra mode -1
[h264 @ 0x5595d3e72040] error while decoding MB 1 0, bytestream 9617
[h264 @ 0x5595d3e72040] concealing 8160 DC, 8160 AC, 8160 MV errors in P frame
[h264 @ 0x5595d3e72040] illegal short term buffer state detected
[h264 @ 0x5595d3e72040] luma_log2_weight_denom 15 is out of range
    Last message repeated 1 times
[h264 @ 0x5595d3e72040] top block unavailable for requested intra mode
[h264 @ 0x5595d3e72040] error while decoding MB 4 0, bytestream 12323
[h264 @ 0x5595d3e72040] concealing 8160 DC, 8160 AC, 8160 MV errors in P frame
[h264 @ 0x5595d3e72040] illegal short term buffer state detected
[h264 @ 0x5595d3e72040] top block unavailable for requested intra mode -1
[h264 @ 0x5595d3e72040] error while decoding MB 27 0, bytestream 12229
[h264 @ 0x5595d3e72040] concealing 8160 DC, 8160 AC, 8160 MV errors in P frame
[h264 @ 0x5595d3e72040] illegal short term buffer state detected
[h264 @ 0x5595d3e72040] illegal reordering_of_pic_nums_idc 15 
[h264 @ 0x5595d3e72040] illegal modification_of_pic_nums_idc 15
[h264 @ 0x5595d3e72040] decode_slice_header error 
[h264 @ 0x5595d3e72040] no frame!
[h264 @ 0x5595d3e72040] reference count 1 overflow
[h264 @ 0x5595d3e72040] reference count overflow
[h264 @ 0x5595d3e72040] decode_slice_header error 
[h264 @ 0x5595d3e72040] no frame!
[h264 @ 0x5595d3e72040] luma_log2_weight_denom 31 is out of range
[h264 @ 0x5595d3e72040] illegal memory management control operation 21
[h264 @ 0x5595d3e72040] luma_log2_weight_denom 31 is out of range
[h264 @ 0x5595d3e72040] illegal memory management control operation 21
[h264 @ 0x5595d3e72040] deblocking filter parameters -7 0 out of range
[h264 @ 0x5595d3e72040] decode_slice_header error 
[h264 @ 0x5595d3e72040] no frame!
[h264 @ 0x5595d3e72040] Reference 6 >= 3
[h264 @ 0x5595d3e72040] error while decoding MB 29 0, bytestream 8581
[h264 @ 0x5595d3e72040] concealing 8160 DC, 8160 AC, 8160 MV errors in P frame
[h264 @ 0x5595d3e72040] number of reference frames (0+4) exceeds max (3; probably corrupt input), discarding one
[h264 @ 0x5595d3e72040] chroma_log2_weight_denom 15 is out of range
    Last message repeated 1 times
[h264 @ 0x5595d3e72040] deblocking_filter_idc 13 out of range
[h264 @ 0x5595d3e72040] decode_slice_header error 
[h264 @ 0x5595d3e72040] no frame!
[h264 @ 0x5595d3e72040] deblocking_filter_idc 32 out of range
[h264 @ 0x5595d3e72040] decode_slice_header error
[h264 @ 0x5595d3e72040] no frame!
[h264 @ 0x5595d3e72040] illegal reordering_of_pic_nums_idc 31
[h264 @ 0x5595d3e72040] illegal modification_of_pic_nums_idc 31
[h264 @ 0x5595d3e72040] decode_slice_header error 
[h264 @ 0x5595d3e72040] no frame!
[h264 @ 0x5595d3e72040] illegal reordering_of_pic_nums_idc 6
[h264 @ 0x5595d3e72040] illegal modification_of_pic_nums_idc 6
[h264 @ 0x5595d3e72040] decode_slice_header error 



  


  I executed both ffprobe xxxx.mp4 and avcodec receive frame functions to decode one frame. reproduced the same error log.

  


  But when I open it using VLC or OBS it worked well. So,

  


  

  • does any error when I configure the options of ffmpeg ?

  


  • how to fix this problem ?

  


  


  the mp4 file I upload a piece in mp4 link

  


• Streaming raw yuv as jpeg2000 over a network [closed]

  12 juillet 2024, par userDtrm

  Is there a mechanism to stream video over a network with video as jpeg2000 coded images ? I tried to mux jpeg2000 video with aac audio in ffmpeg into mpegts, but this fails. As I understand ffmpeg doesn't support muxing jpeg2000 to mpegts.

  


  


  ffmpeg -f rawvideo -framerate 50 -pix_fmt yuv422p -s:v 1920x1080 -i video.yuv -f s16le -ar 48000 -ac 6 -i audio5-1.wav -c:v jpeg2000 -c:a libfdk_aac -b:a 128k -f mpegts srt ://127.0.0.1:1222 ?mode=caller

  


  


  The above produces the following error :

  


  


  codec jpeg2000, is muxed as a private data stream and may not be recognized upon reading

  


  


  Are there any other tools/methods that I can use to stream a video as jpeg2000 ?