Recherche avancée

Sur d’autres sites (4952)

• WebRTC Stream Freezes When Picture Complexity Increases

  12 octobre 2021, par user1259576

  I am developing an application that uses WebRTC to display a live video stream being captured from a V4L2 source. The stream originates from a Linux box that has a DVI-USB capture card, is encoded to H264 by ffmpeg and sent to RTP, received by a Janus WebRTC server which is accessed by the web interface.

  


  Here is my current ffmpeg command - pretty simple :
ffmpeg -f v4l2 -i /dev/video0 -vf "transpose=1,scale=768:1024" -vcodec libx264 -profile:v baseline -pix_fmt yuv420p -f rtp rtp ://10.116.80.86:8004

  


  I can't go into details, but the DVI source generates a portrait 768x1024 image that initially is a simple image where the only movement is a small clock near the center that increments every second. At this stage, everything appears to work great. The image is high-quality and continuous/smooth in the browser.

  


  Once I interact with the DVI source, a more complex image is generated, with some text/lines in the upper half. Still not very complex - only 2 colors involved and some basic 1px line shapes, and only the little clock is moving. At this point, the video starts to freeze frequently, and only updates once in a while for a few seconds. Bandwidth should not be an issue here, and the bitrate appears to stay high. However, many fewer frames are decoded.

  


  I have also tried scaling the video down to 480x640 from 768x1024 and with that change the issue does not occur. However, I really need the full resolution and, again, there should not be a bandwidth issue here.

  


  I have also tried capturing the output of ffmpeg to a file rather than streaming to RTP and in the file everything is good.

  


  Here is a screenshot of the WebRTC internals (in Edge) for this stream. You can clearly see when the video image changes from the simple clock to including more shapes & text (nothing is changed here other than the image from the DVI source) :

  


  

  


  In Firefox, the video just freezes whenever frames are not decoded. In Edge, the video goes black after a moment with no frames decoded.

  


  Any ideas as to what might be causing this ?

  


• Can't get the right formula to set frame pts for a stream using libav

  4 avril 2022, par user1365836

  I'm trying to save a stream of frames as mp4.
Source framerate is not fixed and it stay in the range [15,30]

  


  Encoder params :

  


  ...
eCodec.time_base = AVRational(1,3000);
eCodec.framerate = AVRational(30, 1);
...


  


  Stream params :

  


  eStream = avformat_new_stream(eFormat, null);                
eStream.codecpar = codecParams;
eStream.time_base = eCodec.time_base;


  


  Decoder time_base is 0/1 and it marks each frame with a pts like :

  


  480000
528000
576000
...


  


  PTS(f) is always == PTS(f-1)+48000

  


  Encoding (dFrame is the received frame, micro the elapsed time in microseconds) :

  


  av_frame_copy(eFrame, dFrame);
eFrame.pts = micro*3/1000;


  


  This make the video playing too fast.
I can't understand why, but changing micro*3/1000 to micro*3*4/1000 make the video play at the correct speed (checked against a clock after many minutes of varying fps)

  


  What am I missing ?

  


• ffmpeg : add option -isync

  13 juin 2022, par Gyan Doshi

  ffmpeg : add option -isync
  This is a per-file input option that adjusts an input's timestamps
  
  with reference to another input, so that emitted packet timestamps
  
  account for the difference between the start times of the two inputs.
  Typical use case is to sync two or more live inputs such as from capture
  
  devices. Both the target and reference input source timestamps should be
  
  based on the same clock source.
  If either input lacks starting timestamps, then no sync adjustment is made.
  

  • [DH] doc/ffmpeg.texi
  • [DH] fftools/ffmpeg.h
  • [DH] fftools/ffmpeg_opt.c