Recherche avancée

Sur d’autres sites (13780)

• Video frame difference with FFMPEG

  18 octobre 2018, par StepTNT

  I need to compute the frame differences between a source video and a compressed one.
  For now I’m using OpenCV with Java, by extracting each frame and doing a simple difference, but it’s quite slow (working a 0.5 fps, meaning that a 500 frames video will take more than 15 mins) so I was thinking to move to FFMPEG.

  FFMPEG feels a lot faster (everything’s done under 1 minute) but it has one big issue that makes the results useless : when compressing the source file, done with FFMPEG too, an extra gray frame is added at the beginning and this fakes the results because different frames are compared.

  This is what I’m doing now (knowing that the extra frame messes it all) :

  ffmpeg -y -i src.avi -i compressed.avi -filter_complex "blend=all_mode=difference,hue=s=0" -c:v libx264 -crf 18 -c:a copy difference.avi

  To fix the frame issue I was trying to remove the first frame by re-encoding the compressed video with this command

  ffmpeg -y -ss 0.02 -i compressed.mpg -an -f mpeg2video compressed-cut.mpg"

  (Note that -ss is 0.02 because it’s a 50 fps video, so I did 1/FPS as suggested here)

  But I get this response

  Output file is empty, nothing was encoded (check -ss / -t / -frames parameters if used)

  So, finally, the question is : since extracting all the frames and then compute differences with OpenCV is really slow, how can I use FFMPEG to produce a video containing the difference between two sources while keeping in mind that one of them has an extra frame at the beginning ?

  EDIT : I wanted to avoid posting endless console outputs but since you asked for it, here we go.

  1) Encoding

  Input

  ffmpeg -i "720p50_mobcal_ter.avi" -an -f mpeg2video -y "720p50_mobcal_ter.mpg"

  Output

  ffmpeg version N-76684-g1fe82ab Copyright (c) 2000-2015 the FFmpeg developers
  
    built with gcc 5.2.0 (GCC)
  
    configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libdcadec --enable-libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libschroedinger --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-libzimg --enable-lzma --enable-decklink --enable-zlib
  
    libavutil      55.  6.100 / 55.  6.100
  
    libavcodec     57. 15.100 / 57. 15.100
  
    libavformat    57. 14.100 / 57. 14.100
  
    libavdevice    57.  0.100 / 57.  0.100
  
    libavfilter     6. 15.100 /  6. 15.100
  
    libswscale      4.  0.100 /  4.  0.100
  
    libswresample   2.  0.101 /  2.  0.101
  
    libpostproc    54.  0.100 / 54.  0.100
  
  Input #0, avi, from '720p50_mobcal_ter.avi':
  
    Metadata:
  
      encoder         : Lavf57.14.100
  
    Duration: 00:00:10.08, start: 0.000000, bitrate: 552974 kb/s
  
      Stream #0:0: Video: rawvideo (I420 / 0x30323449), yuv420p, 1280x720, 554059 kb/s, SAR 1:1 DAR 16:9, 50 fps, 50 tbr, 50 tbn, 50 tbc
  
  Output #0, mpeg2video, to '720p50_mobcal_ter.mpg':
  
    Metadata:
  
      encoder         : Lavf57.14.100
  
      Stream #0:0: Video: mpeg2video, yuv420p, 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 50 fps, 50 tbn, 50 tbc
  
      Metadata:
  
        encoder         : Lavc57.15.100 mpeg2video
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (rawvideo (native) -> mpeg2video (native))
  
  Press [q] to stop, [?] for help
  
  frame=   41 fps=0.0 q=31.0 size=     984kB time=00:00:00.78 bitrate=10330.5kbits/frame=   80 fps= 78 q=31.0 size=    1323kB time=00:00:01.56 bitrate=6948.1kbits/frame=  124 fps= 80 q=31.0 size=    1725kB time=00:00:02.44 bitrate=5790.0kbits/frame=  168 fps= 81 q=31.0 size=    2084kB time=00:00:03.32 bitrate=5142.8kbits/frame=  212 fps= 81 q=31.0 size=    2482kB time=00:00:04.20 bitrate=4841.4kbits/frame=  255 fps= 82 q=31.0 size=    2840kB time=00:00:05.06 bitrate=4597.2kbits/frame=  296 fps= 82 q=31.0 size=    3133kB time=00:00:05.88 bitrate=4364.5kbits/frame=  338 fps= 82 q=24.8 size=    3453kB time=00:00:06.72 bitrate=4209.2kbits/frame=  382 fps= 82 q=31.0 size=    3723kB time=00:00:07.60 bitrate=4013.4kbits/frame=  426 fps= 83 q=31.0 size=    4005kB time=00:00:08.48 bitrate=3869.1kbits/frame=  470 fps= 83 q=24.8 size=    4276kB time=00:00:09.36 bitrate=3742.5kbits/frame=  504 fps= 83 q=31.0 Lsize=    4469kB time=00:00:10.06 bitrate=3639.3kbits/s
  
  video:4469kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.000000%

  This adds the extra grey frame at the beginning, it just duplicates the first one

  2) Removing first frame

  Input

  ffmpeg -y -i "720p50_mobcal_ter.mpg" -an -f mpeg2video -vf select=gte(n\,1) "CUT-720p50_mobcal_ter.mpg"

  Output

  ffmpeg version N-76684-g1fe82ab Copyright (c) 2000-2015 the FFmpeg developers
  
    built with gcc 5.2.0 (GCC)
  
    configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libdcadec --enable-libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libschroedinger --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-libzimg --enable-lzma --enable-decklink --enable-zlib
  
    libavutil      55.  6.100 / 55.  6.100
  
    libavcodec     57. 15.100 / 57. 15.100
  
    libavformat    57. 14.100 / 57. 14.100
  
    libavdevice    57.  0.100 / 57.  0.100
  
    libavfilter     6. 15.100 /  6. 15.100
  
    libswscale      4.  0.100 /  4.  0.100
  
    libswresample   2.  0.101 /  2.  0.101
  
    libpostproc    54.  0.100 / 54.  0.100
  
  Input #0, mpegvideo, from '720p50_mobcal_ter.mpg':
  
    Duration: N/A, bitrate: N/A
  
      Stream #0:0: Video: mpeg2video (Main), yuv420p(tv), 1280x720 [SAR 1:1 DAR 16:9], max. 104857 kb/s, 50 fps, 50 tbr, 1200k tbn, 100 tbc
  
  Output #0, mpeg2video, to 'CUT-720p50_mobcal_ter.mpg':
  
    Metadata:
  
      encoder         : Lavf57.14.100
  
      Stream #0:0: Video: mpeg2video, yuv420p, 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 50 fps, 50 tbn, 50 tbc
  
      Metadata:
  
        encoder         : Lavc57.15.100 mpeg2video
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (mpeg2video (native) -> mpeg2video (native))
  
  Press [q] to stop, [?] for help
  
  frame=  255 fps=0.0 q=31.0 size=    2781kB time=00:00:05.10 bitrate=4467.3kbits/frame=  503 fps=0.0 q=31.0 Lsize=    4415kB time=00:00:10.08 bitrate=3588.5kbits/s
  
  video:4415kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.000000%

  3) Frame difference

  Input

  ffmpeg -y -i "720p50_mobcal_ter.avi" -i "CUT-720p50_mobcal_ter.mpg" -filter_complex "blend=all_mode=difference,hue=s=0" -c:v libx264 -crf 18 -c:a copy "DIFF-720p50_mobcal_ter.mpg"

  Output

  ffmpeg version N-76684-g1fe82ab Copyright (c) 2000-2015 the FFmpeg developers
  
    built with gcc 5.2.0 (GCC)
  
    configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libdcadec --enable-libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libschroedinger --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-libzimg --enable-lzma --enable-decklink --enable-zlib
  
    libavutil      55.  6.100 / 55.  6.100
  
    libavcodec     57. 15.100 / 57. 15.100
  
    libavformat    57. 14.100 / 57. 14.100
  
    libavdevice    57.  0.100 / 57.  0.100
  
    libavfilter     6. 15.100 /  6. 15.100
  
    libswscale      4.  0.100 /  4.  0.100
  
    libswresample   2.  0.101 /  2.  0.101
  
    libpostproc    54.  0.100 / 54.  0.100
  
  Input #0, avi, from '720p50_mobcal_ter.avi':
  
    Metadata:
  
      encoder         : Lavf57.14.100
  
    Duration: 00:00:10.08, start: 0.000000, bitrate: 552974 kb/s
  
      Stream #0:0: Video: rawvideo (I420 / 0x30323449), yuv420p, 1280x720, 554059 kb/s, SAR 1:1 DAR 16:9, 50 fps, 50 tbr, 50 tbn, 50 tbc
  
  Input #1, mpegvideo, from 'CUT-720p50_mobcal_ter.mpg':
  
    Duration: N/A, bitrate: N/A
  
      Stream #1:0: Video: mpeg2video (Main), yuv420p(tv), 1280x720 [SAR 1:1 DAR 16:9], max. 104857 kb/s, 50 fps, 50 tbr, 1200k tbn, 100 tbc
  
  [libx264 @ 000002784dbeb980] using SAR=1/1
  
  [libx264 @ 000002784dbeb980] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 AVX2 LZCNT BMI2
  
  [libx264 @ 000002784dbeb980] profile High, level 3.2
  
  [mpeg @ 000002784dbeaf20] VBV buffer size not set, using default size of 130KB
  
  If you want the mpeg file to be compliant to some specification
  
  Like DVD, VCD or others, make sure you set the correct buffer size
  
  Output #0, mpeg, to 'D:\DOWNLOADS\TMP\Video TDI\AVI\DIFF-720p50_mobcal_ter.mpg':
  
    Metadata:
  
      encoder         : Lavf57.14.100
  
      Stream #0:0: Video: h264 (libx264), yuv420p, 1280x720 [SAR 1:1 DAR 16:9], q=-1--1, 50 fps, 90k tbn, 50 tbc (default)
  
      Metadata:
  
        encoder         : Lavc57.15.100 libx264
  
  Stream mapping:
  
    Stream #0:0 (rawvideo) -> blend:top
  
    Stream #1:0 (mpeg2video) -> blend:bottom
  
    hue -> Stream #0:0 (libx264)
  
  Press [q] to stop, [?] for help
  
  frame=  504 fps= 39 q=-1.0 Lsize=   32182kB time=00:00:10.04 bitrate=26258.5kbits/s
  
  video:32061kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.377054%
  
  [libx264 @ 000002784dbeb980] frame I:30    Avg QP:19.69  size:149974
  
  [libx264 @ 000002784dbeb980] frame P:299   Avg QP:23.28  size: 69423
  
  [libx264 @ 000002784dbeb980] frame B:175   Avg QP:24.48  size: 43280
  
  [libx264 @ 000002784dbeb980] consecutive B-frames: 30.6% 69.4%  0.0%  0.0%
  
  [libx264 @ 000002784dbeb980] mb I  I16..4: 18.3% 51.4% 30.4%
  
  [libx264 @ 000002784dbeb980] mb P  I16..4:  0.6%  5.6%  2.4%  P16..4: 35.9% 22.9% 15.6%  0.0%  0.0%    skip:17.0%
  
  [libx264 @ 000002784dbeb980] mb B  I16..4:  0.2%  0.5%  0.3%  B16..8: 49.5% 12.4%  5.6%  direct:15.5%  skip:16.1%  L0:47.8% L1:42.1% BI:10.1%
  
  [libx264 @ 000002784dbeb980] 8x8 transform intra:57.5% inter:38.5%
  
  [libx264 @ 000002784dbeb980] coded y,uvDC,uvAC intra: 90.7% 0.0% 0.0% inter: 50.3% 0.0% 0.0%
  
  [libx264 @ 000002784dbeb980] i16 v,h,dc,p: 32% 23% 35% 10%
  
  [libx264 @ 000002784dbeb980] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 11% 11% 41%  7%  5%  6%  5%  6%  8%
  
  [libx264 @ 000002784dbeb980] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 18% 14% 23%  8%  7%  7%  7%  7%  8%
  
  [libx264 @ 000002784dbeb980] i8c dc,h,v,p: 100%  0%  0%  0%
  
  [libx264 @ 000002784dbeb980] Weighted P-Frames: Y:33.8% UV:0.0%
  
  [libx264 @ 000002784dbeb980] ref P L0: 58.1% 16.3% 14.2%  9.4%  2.0%
  
  [libx264 @ 000002784dbeb980] ref B L0: 79.3% 20.7%
  
  [libx264 @ 000002784dbeb980] kb/s:26056.02

  The second command made everything work while the second one in the first part didn’t (the one with the -ss option), so I could be quite happy about it but I’m not that sure if FFMPEG duplicates the first frame for every video or if it’s just related to the one I’m using now, so it could be better to start off with a compressed video that has the same frame count of the original one.

  So let’s get to one final question : why does FFMPEG add a duplicated first frame at the beginning of the compressed video and how can I avoid that ?

• Video frame difference with FFMPEG

  27 décembre 2015, par StepTNT

  I need to compute the frame differences between a source video and a compressed one.
  For now I’m using OpenCV with Java, by extracting each frame and doing a simple difference, but it’s quite slow (working a 0.5 fps, meaning that a 500 frames video will take more than 15 mins) so I was thinking to move to FFMPEG.

  FFMPEG feels a lot faster (everything’s done under 1 minute) but it has one big issue that makes the results useless : when compressing the source file, done with FFMPEG too, an extra gray frame is added at the beginning and this fakes the results because different frames are compared.

  This is what I’m doing now (knowing that the extra frame messes it all) :

  ffmpeg -y -i src.avi -i compressed.avi -filter_complex "blend=all_mode=difference,hue=s=0" -c:v libx264 -crf 18 -c:a copy difference.avi

  To fix the frame issue I was trying to remove the first frame by re-encoding the compressed video with this command

  ffmpeg -y -ss 0.02 -i compressed.mpg -an -f mpeg2video compressed-cut.mpg"

  (Note that -ss is 0.02 because it’s a 50 fps video, so I did 1/FPS as suggested here)

  But I get this response

  Output file is empty, nothing was encoded (check -ss / -t / -frames parameters if used)

  So, finally, the question is : since extracting all the frames and then compute differences with OpenCV is really slow, how can I use FFMPEG to produce a video containing the difference between two sources while keeping in mind that one of them has an extra frame at the beginning ?

  EDIT : I wanted to avoid posting endless console outputs but since you asked for it, here we go.

  1) Encoding

  Input

  ffmpeg -i "720p50_mobcal_ter.avi" -an -f mpeg2video -y "720p50_mobcal_ter.mpg"

  Output

  ffmpeg version N-76684-g1fe82ab Copyright (c) 2000-2015 the FFmpeg developers
  
    built with gcc 5.2.0 (GCC)
  
    configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libdcadec --enable-libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libschroedinger --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-libzimg --enable-lzma --enable-decklink --enable-zlib
  
    libavutil      55.  6.100 / 55.  6.100
  
    libavcodec     57. 15.100 / 57. 15.100
  
    libavformat    57. 14.100 / 57. 14.100
  
    libavdevice    57.  0.100 / 57.  0.100
  
    libavfilter     6. 15.100 /  6. 15.100
  
    libswscale      4.  0.100 /  4.  0.100
  
    libswresample   2.  0.101 /  2.  0.101
  
    libpostproc    54.  0.100 / 54.  0.100
  
  Input #0, avi, from '720p50_mobcal_ter.avi':
  
    Metadata:
  
      encoder         : Lavf57.14.100
  
    Duration: 00:00:10.08, start: 0.000000, bitrate: 552974 kb/s
  
      Stream #0:0: Video: rawvideo (I420 / 0x30323449), yuv420p, 1280x720, 554059 kb/s, SAR 1:1 DAR 16:9, 50 fps, 50 tbr, 50 tbn, 50 tbc
  
  Output #0, mpeg2video, to '720p50_mobcal_ter.mpg':
  
    Metadata:
  
      encoder         : Lavf57.14.100
  
      Stream #0:0: Video: mpeg2video, yuv420p, 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 50 fps, 50 tbn, 50 tbc
  
      Metadata:
  
        encoder         : Lavc57.15.100 mpeg2video
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (rawvideo (native) -> mpeg2video (native))
  
  Press [q] to stop, [?] for help
  
  frame=   41 fps=0.0 q=31.0 size=     984kB time=00:00:00.78 bitrate=10330.5kbits/frame=   80 fps= 78 q=31.0 size=    1323kB time=00:00:01.56 bitrate=6948.1kbits/frame=  124 fps= 80 q=31.0 size=    1725kB time=00:00:02.44 bitrate=5790.0kbits/frame=  168 fps= 81 q=31.0 size=    2084kB time=00:00:03.32 bitrate=5142.8kbits/frame=  212 fps= 81 q=31.0 size=    2482kB time=00:00:04.20 bitrate=4841.4kbits/frame=  255 fps= 82 q=31.0 size=    2840kB time=00:00:05.06 bitrate=4597.2kbits/frame=  296 fps= 82 q=31.0 size=    3133kB time=00:00:05.88 bitrate=4364.5kbits/frame=  338 fps= 82 q=24.8 size=    3453kB time=00:00:06.72 bitrate=4209.2kbits/frame=  382 fps= 82 q=31.0 size=    3723kB time=00:00:07.60 bitrate=4013.4kbits/frame=  426 fps= 83 q=31.0 size=    4005kB time=00:00:08.48 bitrate=3869.1kbits/frame=  470 fps= 83 q=24.8 size=    4276kB time=00:00:09.36 bitrate=3742.5kbits/frame=  504 fps= 83 q=31.0 Lsize=    4469kB time=00:00:10.06 bitrate=3639.3kbits/s
  
  video:4469kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.000000%

  This adds the extra grey frame at the beginning, it just duplicates the first one

  2) Removing first frame

  Input

  ffmpeg -y -i "720p50_mobcal_ter.mpg" -an -f mpeg2video -vf select=gte(n\,1) "CUT-720p50_mobcal_ter.mpg"

  Output

  ffmpeg version N-76684-g1fe82ab Copyright (c) 2000-2015 the FFmpeg developers
  
    built with gcc 5.2.0 (GCC)
  
    configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libdcadec --enable-libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libschroedinger --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-libzimg --enable-lzma --enable-decklink --enable-zlib
  
    libavutil      55.  6.100 / 55.  6.100
  
    libavcodec     57. 15.100 / 57. 15.100
  
    libavformat    57. 14.100 / 57. 14.100
  
    libavdevice    57.  0.100 / 57.  0.100
  
    libavfilter     6. 15.100 /  6. 15.100
  
    libswscale      4.  0.100 /  4.  0.100
  
    libswresample   2.  0.101 /  2.  0.101
  
    libpostproc    54.  0.100 / 54.  0.100
  
  Input #0, mpegvideo, from '720p50_mobcal_ter.mpg':
  
    Duration: N/A, bitrate: N/A
  
      Stream #0:0: Video: mpeg2video (Main), yuv420p(tv), 1280x720 [SAR 1:1 DAR 16:9], max. 104857 kb/s, 50 fps, 50 tbr, 1200k tbn, 100 tbc
  
  Output #0, mpeg2video, to 'CUT-720p50_mobcal_ter.mpg':
  
    Metadata:
  
      encoder         : Lavf57.14.100
  
      Stream #0:0: Video: mpeg2video, yuv420p, 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 50 fps, 50 tbn, 50 tbc
  
      Metadata:
  
        encoder         : Lavc57.15.100 mpeg2video
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (mpeg2video (native) -> mpeg2video (native))
  
  Press [q] to stop, [?] for help
  
  frame=  255 fps=0.0 q=31.0 size=    2781kB time=00:00:05.10 bitrate=4467.3kbits/frame=  503 fps=0.0 q=31.0 Lsize=    4415kB time=00:00:10.08 bitrate=3588.5kbits/s
  
  video:4415kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.000000%

  3) Frame difference

  Input

  ffmpeg -y -i "720p50_mobcal_ter.avi" -i "CUT-720p50_mobcal_ter.mpg" -filter_complex "blend=all_mode=difference,hue=s=0" -c:v libx264 -crf 18 -c:a copy "DIFF-720p50_mobcal_ter.mpg"

  Output

  ffmpeg version N-76684-g1fe82ab Copyright (c) 2000-2015 the FFmpeg developers
  
    built with gcc 5.2.0 (GCC)
  
    configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libdcadec --enable-libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libschroedinger --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-libzimg --enable-lzma --enable-decklink --enable-zlib
  
    libavutil      55.  6.100 / 55.  6.100
  
    libavcodec     57. 15.100 / 57. 15.100
  
    libavformat    57. 14.100 / 57. 14.100
  
    libavdevice    57.  0.100 / 57.  0.100
  
    libavfilter     6. 15.100 /  6. 15.100
  
    libswscale      4.  0.100 /  4.  0.100
  
    libswresample   2.  0.101 /  2.  0.101
  
    libpostproc    54.  0.100 / 54.  0.100
  
  Input #0, avi, from '720p50_mobcal_ter.avi':
  
    Metadata:
  
      encoder         : Lavf57.14.100
  
    Duration: 00:00:10.08, start: 0.000000, bitrate: 552974 kb/s
  
      Stream #0:0: Video: rawvideo (I420 / 0x30323449), yuv420p, 1280x720, 554059 kb/s, SAR 1:1 DAR 16:9, 50 fps, 50 tbr, 50 tbn, 50 tbc
  
  Input #1, mpegvideo, from 'CUT-720p50_mobcal_ter.mpg':
  
    Duration: N/A, bitrate: N/A
  
      Stream #1:0: Video: mpeg2video (Main), yuv420p(tv), 1280x720 [SAR 1:1 DAR 16:9], max. 104857 kb/s, 50 fps, 50 tbr, 1200k tbn, 100 tbc
  
  [libx264 @ 000002784dbeb980] using SAR=1/1
  
  [libx264 @ 000002784dbeb980] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 AVX2 LZCNT BMI2
  
  [libx264 @ 000002784dbeb980] profile High, level 3.2
  
  [mpeg @ 000002784dbeaf20] VBV buffer size not set, using default size of 130KB
  
  If you want the mpeg file to be compliant to some specification
  
  Like DVD, VCD or others, make sure you set the correct buffer size
  
  Output #0, mpeg, to 'D:\DOWNLOADS\TMP\Video TDI\AVI\DIFF-720p50_mobcal_ter.mpg':
  
    Metadata:
  
      encoder         : Lavf57.14.100
  
      Stream #0:0: Video: h264 (libx264), yuv420p, 1280x720 [SAR 1:1 DAR 16:9], q=-1--1, 50 fps, 90k tbn, 50 tbc (default)
  
      Metadata:
  
        encoder         : Lavc57.15.100 libx264
  
  Stream mapping:
  
    Stream #0:0 (rawvideo) -> blend:top
  
    Stream #1:0 (mpeg2video) -> blend:bottom
  
    hue -> Stream #0:0 (libx264)
  
  Press [q] to stop, [?] for help
  
  frame=  504 fps= 39 q=-1.0 Lsize=   32182kB time=00:00:10.04 bitrate=26258.5kbits/s
  
  video:32061kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.377054%
  
  [libx264 @ 000002784dbeb980] frame I:30    Avg QP:19.69  size:149974
  
  [libx264 @ 000002784dbeb980] frame P:299   Avg QP:23.28  size: 69423
  
  [libx264 @ 000002784dbeb980] frame B:175   Avg QP:24.48  size: 43280
  
  [libx264 @ 000002784dbeb980] consecutive B-frames: 30.6% 69.4%  0.0%  0.0%
  
  [libx264 @ 000002784dbeb980] mb I  I16..4: 18.3% 51.4% 30.4%
  
  [libx264 @ 000002784dbeb980] mb P  I16..4:  0.6%  5.6%  2.4%  P16..4: 35.9% 22.9% 15.6%  0.0%  0.0%    skip:17.0%
  
  [libx264 @ 000002784dbeb980] mb B  I16..4:  0.2%  0.5%  0.3%  B16..8: 49.5% 12.4%  5.6%  direct:15.5%  skip:16.1%  L0:47.8% L1:42.1% BI:10.1%
  
  [libx264 @ 000002784dbeb980] 8x8 transform intra:57.5% inter:38.5%
  
  [libx264 @ 000002784dbeb980] coded y,uvDC,uvAC intra: 90.7% 0.0% 0.0% inter: 50.3% 0.0% 0.0%
  
  [libx264 @ 000002784dbeb980] i16 v,h,dc,p: 32% 23% 35% 10%
  
  [libx264 @ 000002784dbeb980] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 11% 11% 41%  7%  5%  6%  5%  6%  8%
  
  [libx264 @ 000002784dbeb980] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 18% 14% 23%  8%  7%  7%  7%  7%  8%
  
  [libx264 @ 000002784dbeb980] i8c dc,h,v,p: 100%  0%  0%  0%
  
  [libx264 @ 000002784dbeb980] Weighted P-Frames: Y:33.8% UV:0.0%
  
  [libx264 @ 000002784dbeb980] ref P L0: 58.1% 16.3% 14.2%  9.4%  2.0%
  
  [libx264 @ 000002784dbeb980] ref B L0: 79.3% 20.7%
  
  [libx264 @ 000002784dbeb980] kb/s:26056.02

  The second command made everything work while the second one in the first part didn’t (the one with the -ss option), so I could be quite happy about it but I’m not that sure if FFMPEG duplicates the first frame for every video or if it’s just related to the one I’m using now, so it could be better to start off with a compressed video that has the same frame count of the original one.

  So let’s get to one final question : why does FFMPEG add a duplicated first frame at the beginning of the compressed video and how can I avoid that ?

• using ffmpeg as multiple downloads

  26 avril 2013, par user2321982

  well guys, I'm having problems with my application.
  well I'll explain more, I'm using the plugin uploader uploads multiple videos and I'm using the ffmpeg extension to my php version.

  <code class="echappe-js">&lt;script type=&quot;text/javascript&quot;&gt;<br />
  
  // Convert divs to queue widgets when the DOM is ready<br />
  
  $(function() {<br />
  
      $(&quot;#uploader&quot;).pluploadQueue({<br />
  
          // General settings<br />
  
          runtimes : &amp;#39;gears,flash,silverlight,browserplus,html5&amp;#39;,<br />
  
          url : &amp;#39;upload.php?id=&amp;lt;?= $login_usuario; ?&gt;&amp;amp;name=&amp;lt;?= $name_user; ?&gt;&amp;#39;,<br />
  
          flash_swf_url : &amp;#39;plugins/plupload/plupload.flash.swf&amp;#39;,<br />
  
          containers: &amp;#39;plupload&amp;#39;,<br />
  
          multipart: true,<br />
  
          urlstream_upload: true,<br />
  
          multipart_params:{directory:&amp;#39;uploads&amp;#39;},<br />
  
          multi_selection: true,<br />
  
  <br />
  
          max_file_size : &amp;#39;500mb&amp;#39;,<br />
  
          chunk_size : &amp;#39;1mb&amp;#39;,<br />
  
          unique_names : true,<br />
  
  <br />
  
          // Specify what files to browse for<br />
  
          filters : [<br />
  
              {title : &quot;Video Files&quot;, extensions : &quot;avi,mpg,wmv,flv,3gp,mpeg,mpeg4,mpg4,mp4&quot;}<br />
  
          ],<br />
  
          // Silverlight settings<br />
  
          silverlight_xap_url : &amp;#39;plugins/plupload/plupload.silverlight.xap&amp;#39;<br />
  
      });<br />
  
  <br />
  
      uploader.ini();<br />
  
  <br />
  
   // Client side form validation<br />
  
          $(&amp;#39;form&amp;#39;).submit(function(e) {<br />
  
              var uploader = $(&amp;#39;#uploader&amp;#39;).plupload(&amp;#39;getUploader&amp;#39;);<br />
  
  <br />
  
              // Files in queue upload them first<br />
  
              if (uploader.files.length &gt; 0) {<br />
  
                  // When all files are uploaded submit form<br />
  
                  uploader.bind(&amp;#39;StateChanged&amp;#39;, function() {<br />
  
                      if (uploader.files.length === (uploader.total.uploaded + uploader.total.failed)) {<br />
  
                          $(&amp;#39;form&amp;#39;)[0].submit();<br />
  
                      }<br />
  
                  });<br />
  
  <br />
  
                  uploader.start();<br />
  
              } else<br />
  
                  alert(&amp;#39;You must at least upload one file.&amp;#39;);<br />
  
  <br />
  
              return false;<br />
  
          });<br />
  
      });<br />
  
  &lt;/script&gt;
  
                              
  You browser doesn't have Flash, Silverlight, Gears, BrowserPlus or HTML5 support.
  
  
  

  well he calls javascript in a php file, in case it will upload the videos.

  what I want is to get the length, resolution, file size and take a screenshot of the video randomly, so far so good, the problem is that it only works with only one upload at a time.
  When sending more than one he does the procedure with ffmpeg, besides the most is not taking a screenshot of the video.
  below is my code

  <?php
  
  ini_set('max_execution_time', 300); //300 seconds = 5 minutes
  
  if (!extension_loaded ('ffmpeg') ) exit ( 'ffmpeg não foi carregado!' );
  
  // HTTP headers for no cache etc
  
  header("Expires: Mon, 26 Jul 1997 05:00:00 GMT");
  
  header("Last-Modified: " . gmdate("D, d M Y H:i:s") . " GMT");
  
  header("Cache-Control: no-store, no-cache, must-revalidate");
  
  header("Cache-Control: post-check=0, pre-check=0", false);
  
  header("Pragma: no-cache");
  
  
  
  include("includes/seguranca.php");
  
  include("includes/classes/class.mysql.php");
  
  include("includes/funcoes/sql_inject.php");
  
  
  
  $id_user = anti_injection($_GET['id']);
  
  session_start();
  
  
  
  // Settings
  
  //$targetDir = ini_get("upload_tmp_dir") . DIRECTORY_SEPARATOR . "plupload";
  
  $targetDir = 'uploads/';
  
  
  
  //$cleanupTargetDir = false; // Remove old files
  
  //$maxFileAge = 60 * 60; // Temp file age in seconds
  
  
  
  // 5 minutes execution time
  
  @set_time_limit(5 * 60);
  
  
  
  // Uncomment this one to fake upload time
  
  // usleep(5000);
  
  
  
  // Get parameters
  
  $chunk = isset($_REQUEST["chunk"]) ? $_REQUEST["chunk"] : 0;
  
  $chunks = isset($_REQUEST["chunks"]) ? $_REQUEST["chunks"] : 0;
  
  $fileName = isset($_REQUEST["name"]) ? $_REQUEST["name"] : '';
  
  
  
  // Clean the fileName for security reasons
  
  $fileName = preg_replace('/[^\w\._]+/', '', $fileName);
  
  
  
  // Make sure the fileName is unique but only if chunking is disabled
  
  if ($chunks < 2 && file_exists($targetDir . DIRECTORY_SEPARATOR . $fileName)) {
  
      $ext = strrpos($fileName, '.');
  
      $fileName_a = substr($fileName, 0, $ext);
  
      $fileName_b = substr($fileName, $ext);
  
  
  
      $count = 1;
  
      while (file_exists($targetDir . DIRECTORY_SEPARATOR . $fileName_a . '_' . $count . $fileName_b))
  
          $count++;
  
  
  
      $fileName = $fileName_a . '_' . $count . $fileName_b;
  
  
  
  
  
  }
  
  
  
  // Create target dir
  
  if (!file_exists($targetDir))
  
      @mkdir($targetDir);
  
  
  
  // Look for the content type header
  
  if (isset($_SERVER["HTTP_CONTENT_TYPE"]))
  
      $contentType = $_SERVER["HTTP_CONTENT_TYPE"];
  
  
  
  if (isset($_SERVER["CONTENT_TYPE"]))
  
      $contentType = $_SERVER["CONTENT_TYPE"];
  
  
  
  // Handle non multipart uploads older WebKit versions didn't support multipart in HTML5
  
  if (strpos($contentType, "multipart") !== false) {
  
      if (isset($_FILES['file']['tmp_name']) && is_uploaded_file($_FILES['file']['tmp_name'])) {
  
  
  
  
  
          // Open temp file
  
          $out = fopen($targetDir . DIRECTORY_SEPARATOR . $fileName, $chunk == 0 ? "wb" : "ab");
  
          if ($out) {
  
              // Read binary input stream and append it to temp file
  
              $in = fopen($_FILES['file']['tmp_name'], "rb");
  
  
  
              if ($in) {
  
                  while ($buff = fread($in, 4096))
  
                      fwrite($out, $buff);
  
              } else
  
                  die('{"jsonrpc" : "2.0", "error" : {"code": 101, "message": "Failed to open input stream."}, "id" : "id"}');
  
              fclose($in);
  
              fclose($out);
  
              @unlink($_FILES['file']['tmp_name']);
  
  
  
  
  
  
  
          } else
  
              die('{"jsonrpc" : "2.0", "error" : {"code": 102, "message": "Failed to open output stream."}, "id" : "id"}');
  
      } else
  
          die('{"jsonrpc" : "2.0", "error" : {"code": 103, "message": "Failed to move uploaded file."}, "id" : "id"}');
  
  } else {
  
      // Open temp file
  
      $out = fopen($targetDir . DIRECTORY_SEPARATOR . $fileName, $chunk == 0 ? "wb" : "ab");
  
      if ($out) {
  
          // Read binary input stream and append it to temp file
  
          $in = fopen("php://input", "rb");
  
  
  
          if ($in) {
  
              while ($buff = fread($in, 4096))
  
                  fwrite($out, $buff);
  
          } else
  
              die('{"jsonrpc" : "2.0", "error" : {"code": 101, "message": "Failed to open input stream."}, "id" : "id"}');
  
  
  
          fclose($in);
  
          fclose($out);
  
      } else
  
          die('{"jsonrpc" : "2.0", "error" : {"code": 102, "message": "Failed to open output stream."}, "id" : "id"}');
  
  }
  
  $photoName = $_FILES['file']['name'];
  
  
  
  $exploded_photoName = explode('.', $photoName);
  
  
  
  $user_id = $_SESSION['SESS_MEMBER_ID'];
  
  
  
  if(!isset($_SESSION[$photoName])) {
  
  
  
      $_SESSION[$photoName] = '1';
  
  }
  
  
  
  if($chunk==1){
  
  
  
  $movie_file = realpath("/uploads/".$fileName);
  
  
  
  // instancia a classe ffmpeg_movie para pegarmos as informações que queremos o vídeo
  
  $movie = new ffmpeg_movie($movie_file);
  
  // pegamos a duranção do video em segundos
  
  $duration = round ( $movie->getDuration() , 0 );
  
  // recebemos o número de frames do vídeo
  
  $totalFrames = $movie->getFrameCount();
  
  // recebemos a altura do vídeo em pixels
  
  $height = $movie->getFrameHeight ();
  
  // recebemos a largura do vídeo em pixels
  
  $width = $movie->getFrameWidth ();
  
  
  
  $thumbnailOf = $movie->getFrameRate() * 5;
  
  
  
  $thumbnailOf = round ( $movie->getFrameCount() / 2 );
  
  
  
  // precisamos criar uma imagem GD para o ffmpeg-php trabalhar nela
  
  $image = imagecreatetruecolor ($width,$height ) ;
  
  // criamos a instancia do frame com a classe ffmpeg_frame
  
  $frame = new ffmpeg_frame ($image);
  
  // escolhemos o frame que queremos salvar como jpeg
  
  $thumbnailOf = rand (1,$movie->getFrameCount());
  
  // recebe o frame
  
  $frame = $movie->getFrame ( $thumbnailOf );
  
  // converte para uma imagem GD
  
  $image = $frame->toGDImage ();
  
  
  
  $size = filesize("uploads/".$fileName);
  
  
  
  $valuea = rand(0,100);
  
  $valueb = rand(0,100);
  
  $valuec = rand(0,10);
  
  
  
  $nome = @md5(date('now') * $valuea - $valueb / $valuec);
  
  
  
  $dir = realpath("uploads/snapshots/$nome.jpg");
  
  //salva no HD.
  
  imagejpeg($image, $dir, 100);
  
  
  
  
  
  $resolu = $width."x".$height;
  
  
  
      mysql_query("INSERT INTO video 
  
  (poster_id,duration,video,titulo,resolucao,tamanho) 
  
      VALUES
  
  ('$id_user','$duration','$fileName','$exploded_photoName[0]','$resolu','$size')") or die(mysql_error());
  
  
  
  }
  
  // Return JSON-RPC response
  
  die('{"jsonrpc" : "2.0", "result" : null, "id" : "id"}');
  
  
  
  ?>

  I did another method not so effective to do what I want but it only works if I open the page individually.

  I removed the code from ffmpeg extension and put an include to that page.

  <?
  
  ini_set('max_execution_time', 300); //300 seconds = 5 minutes
  
  if (!extension_loaded ('ffmpeg') ) exit ( 'ffmpeg não foi carregado!' );
  
  
  
  include("includes/seguranca.php");
  
  include("includes/classes/class.mysql.php");
  
  include("includes/funcoes/sql_inject.php");
  
  
  
  $id_user = @anti_injection($_GET['id']);
  
  
  
  class process{
  
      public $videos;
  
      public $target;
  
      public $id_vid;
  
  
  
  public function screen(){
  
  
  
  $videos = $this->videos;
  
  $target = $this->target;
  
  
  
  $movie_file = realpath($videos);
  
  // instancia a classe ffmpeg_movie para pegarmos as informações que queremos o vídeo
  
  $movie = new ffmpeg_movie($movie_file);
  
  $totalFrames = $movie->getFrameCount();
  
  $thumbnailOf = $movie->getFrameRate() * 5;
  
  $thumbnailOf = round ( $movie->getFrameCount() / 2 );
  
  
  
  // criamos a instancia do frame com a classe ffmpeg_frame
  
  $frame = new ffmpeg_frame ( $image );
  
  // escolhemos o frame que queremos salvar como jpeg
  
  
  
  $thumbnailOf = rand (1,$movie->getFrameCount());
  
  // recebe o frame
  
  $frame = $movie->getFrame ( $thumbnailOf );
  
  // converte para uma imagem GD
  
  $image = $frame->toGDImage ();
  
  $valuea = rand(0,100);
  
  $valueb = rand(0,100);
  
  $valuec = rand(0,10);
  
  
  
  $nome = @md5(date('now') * $valuea - $valueb / $valuec);
  
  
  
  $dir = $target."snapshots/".$nome.".jpeg";
  
  //salva no HD.
  
  imagejpeg($image,$dir, 100);
  
  
  
  $q = new Query;
  
  $q  ->update('video')
  
      ->set(
  
          array(
  
             'screen'=>$nome.".jpeg"
  
          )
  
      )
  
          ->where_equal_to(
  
                  array(
  
                          'id_video'=>$this->id_vid
  
                  )
  
          )
  
          ->limit(1)
  
  
  
      ->run();
  
  
  
  }
  
  
  
  
  
  public function duration(){
  
  
  
  $videos = $this->videos;    
  
  $movie_file = realpath($videos);
  
  // instancia a classe ffmpeg_movie para pegarmos as informações que queremos o vídeo
  
  $movie = new ffmpeg_movie($movie_file);
  
  // pegamos a duranção do video em segundos
  
  $duration = round ( $movie->getDuration() , 0 );
  
  
  
  $q = new Query;
  
  $q  ->update('video')
  
      ->set(
  
          array(
  
             'duration'=>$duration
  
          )
  
      )
  
          ->where_equal_to(
  
                  array(
  
                          'id_video'=>$this->id_vid
  
                  )
  
          )
  
          ->limit(1)
  
  
  
      ->run();
  
  }
  
  
  
  
  
  public function resolution(){
  
  
  
  $videos = $this->videos;    
  
  $movie_file = realpath($videos);
  
  // instancia a classe ffmpeg_movie para pegarmos as informações que queremos o vídeo
  
  $movie = new ffmpeg_movie($movie_file);
  
  // recebemos a altura do vídeo em pixels
  
  $height = $movie->getFrameHeight ();
  
  // recebemos a largura do vídeo em pixels
  
  $width = $movie->getFrameWidth ();
  
  $resolucao =  $width."x".$height;
  
  
  
  
  
  $q = new Query;
  
  $q  ->update('video')
  
      ->set(
  
          array(
  
             'resolucao'=>$resolucao
  
          )
  
      )
  
      ->where_equal_to(
  
                  array(
  
                          'id_video'=>$this->id_vid
  
                  )
  
          )
  
          ->limit(1)
  
  
  
      ->run();
  
  }
  
  
  
  final public function checar($a){
  
  
  
  $q = new Query;
  
  $q  ->update('video')
  
      ->set(
  
          array(
  
             'process'=>$a
  
          )
  
      )
  
      ->where_equal_to(
  
                  array(
  
                          'id_video'=>$this->id_vid
  
                  )
  
          )
  
          ->limit(1)
  
  
  
      ->run();
  
  
  
  }
  
  
  
  }
  
  
  
  $q=new Query;
  
  $q->select(
  
                  array(
  
                          'id_video',
  
                          'video',
  
                          'dir',
  
                          'screen',
  
                          'poster_id',
  
                          'resolucao',
  
                          'duration'
  
                  )
  
          )
  
          ->from('video')
  
  
  
  
  
  
  
          ->run();
  
  if($q){
  
          $users=$q->get_selected();
  
          foreach($users as $user){
  
           $c = new process;
  
  
  
           $c->videos = $user['video'];
  
           $c->target = $user['dir'];
  
           $c->id_vid = $user['id_video'];
  
  
  
          if(($user['screen'] == 'NULL') or ($user['duration'] == 'NULL') or ($user['resolucao'] == 'NULL')){
  
                  $c->checar(0);
  
  
  
                  if($user['screen'] == 'NULL'){      
  
                  $c->screen();
  
                  }
  
  
  
                  if($user['duration'] == 'NULL'){
  
                  $c->duration(); 
  
                  }
  
  
  
                  if($user['resolucao'] == 'NULL'){
  
                  $c->resolution();   
  
                  }
  
  
  
          }else{
  
  
  
          $c->checar(1);
  
  
  
          }
  
  
  
          }
  
  }
  
  else{
  
          echo 'Sorry, no users found.';
  
  }
  
  
  
  
  
  
  
  ?>