Recherche avancée

Sur d’autres sites (10441)

• AVFrame : factor out freeing the side data

  18 juin 2014, par Roman Savchenko

  AVFrame : factor out freeing the side data
  Signed-off-by : Anton Khirnov <anton@khirnov.net>
  

  • [DH] libavutil/frame.c

• FFMPEG mosaic/side-by-side-compositing from simultaneous DirectShow input devices

  9 juin 2013, par timlukins

  This is what I'm trying to do :

  ffmpeg.exe -y \
  
  -f dshow -i video="Microsoft LifeCam Cinema" \
  
  -f dshow -i video="Microsoft LifeCam VX-2000" \
  
  -filter_complex "[0:v]pad=iw*2:ih:0[left];[left][1:v]overlay=W/2.0[fileout]" \
  
  -map "[fileout]" -vcodec libx264 -f flv out.flv

  Basically, I have 2 webcams and I would like to combine them into a single video file in which the frames are 2x1 in size with the frame from one camera in the left and the other on the right.

  In other words, what might be termed "mosaic-ing" or "side-by-side compositing". This is not concatenation - i.e. one file after the other (so not using the concat filter).

  I've gleamed that this use of -filter_complex to pad and then position the frames appears the prescribed way. Indeed, when I test this with files like so :

  ffmpeg.exe -y -i test1.flv -i test2.flv -filter_complex "[0:v]pad=iw*2:ih:0[left];[left][1:v]overlay=W/2.0[fileout]" -map "[fileout]" -vcodec libx264 -f flv testout.flv

  It works fine !

  With the "live" version however, both cameras seem to start (their lights come on) but the capture stalls.

  (Suspiciously like there is some DirectShow deadlock on the separate input device threads...)

  And so, I wonder is there some way to overcome this and force the two input stream's data to merge ?

  I have also tried the extended format of the dshow filter option like so as well :

  -f dshow -i video="Microsoft LifeCam Cinema":video="Microsoft LifeCam VX-2000"

  But only one camera is then selected (I suspect this option is really only to enable separate video and audio streams to be combined).

  I've also tried explicitly setting each input device to have the exact same frame size and rate with -f dshow -video_size 640x480 -framerate 30. No joy though. It still stalls once the camera is listed.

  Here is the tail end of the output (with -v debug on) :

  Finished splitting the commandline.
  
  Parsing a group of options: global .
  
  Applying option y (overwrite output files) with argument 1.
  
  Applying option v (set libav* logging level) with argument debug.
  
  Applying option filter_complex (create a complex filtergraph) with argument [0:v]pad=iw*2:ih:0[left];[left][1:v]overlay=W/2.0[fileout].
  
  Successfully parsed a group of options.
  
  Parsing a group of options: input file video=Microsoft LifeCam Cinema.
  
  Applying option f (force format) with argument dshow.
  
  Successfully parsed a group of options.
  
  Opening an input file: video=Microsoft LifeCam Cinema.
  
  [dshow @ 00000000016e79a0] All info found
  
  [dshow @ 00000000016e79a0] Estimating duration from bitrate, this may be inaccurate
  
  Input #0, dshow, from 'video=Microsoft LifeCam Cinema':
  
    Duration: N/A, start: 1130406.072000, bitrate: N/A
  
      Stream #0:0, 1, 1/10000000: Video: rawvideo (YUY2 / 0x32595559), yuyv422, 640x480, 333333/10000000, 30 tbr, 10000k tbn, 30 tbc
  
  Successfully opened the file.
  
  Parsing a group of options: input file video=Microsoft LifeCam VX-2000.
  
  Applying option f (force format) with argument dshow.
  
  Successfully parsed a group of options.
  
  Opening an input file: video=Microsoft LifeCam VX-2000.
  
  [dshow @ 00000000016e79a0] real-time buffer 101% full! frame dropped!

  EDIT Further details trying to fix within the code...*

  I've always understood from past Windows DirectShow work that multiple calls to CoInitialize() on the same thread is bad. See here. Perhaps I've misunderstood how FFMPEG is multi-threaded (i.e. if each input device is on it's own thread) but I thought to just try regulating the call with a guard variable (a static int com_init = 0; - this should probably be mutex-ed...).

  e.g. in libavdevice/dshow.c method dshow_read_header

  889    if (com_init==0)
  
  890     CoInitialize(0);
  
  891    com_init++

  And similar for dshow_read_close

  170    com_init--;
  
  171    if (com_init==0)
  
  172     CoUninitialize()

  Sadly, this doesn't work. The first camera starts but the second doesn't and the error is :

  [dshow @ 0000000000301760] Could not set video options
  
  video=Microsoft LifeCam VX-2000: Input/output error

  (Worth a shot. Looks like each input device is indeed on the same thread...)

• libavutil : document side effects of macros

  10 juillet 2014, par Christophe Gisquet

  libavutil : document side effects of macros
  Signed-off-by : Michael Niedermayer <michaelni@gmx.at>
  

  • [DH] libavutil/intreadwrite.h