Recherche avancée

Sur d’autres sites (11406)

• How to blend/merge two videos in android programmatically

  25 octobre 2015, par endryha

  As description says I am trying to create a video which consists of background video and semi-transparent video overlay on top of it.

  My initial attempt was to use ffmpeg for android https://github.com/WritingMinds/ffmpeg-android-java and use blend filter in overlay mode.

  But it turned out that ffmpeg android library is built on top of ffmpeg 2.4 but blend filter is available since ffmpeg 2.6. So far ffmpeg failed for me and I am looking for alternative solution.

  Any advices are warmly appreciated.

  UPDATE#1

  I finally managed to build ffmpeg 2.6.4 for android which contains blend filter but another issue appeared. When it start video processing it just stops in the beginning and never ends, there is not output from ffmpeg tool, no errors, no warnings, there is nothing that can help me to trace down the problem.

  On android device it runs following command :

  /data/user/0/com.test.app/files/ffmpeg 
  
  -i /storage/emulated/0/Android/data/com.test.app/files/video/vid1.mp4 
  
  -i /storage/emulated/0/Android/data/com.test.app/files/video/overlay.mp4 
  
  -filter_complex blend=all_mode='overlay':all_opacity=0.8" 
  
  -strict -2 /storage/emulated/0/Android/data/com.test.app/files/video/blended.mp4

  And there is following output :

  ffmpeg version n2.6.4 Copyright (c) 2000-2015 the FFmpeg developers
  
     built with gcc 4.8 (GCC)
  
     configuration: --target-os=linux --cross-prefix=/media/ubuntu/data/ffmpeg-android/toolchain-android/bin/arm-linux-androideabi- --arch=arm --cpu=cortex-a8 --enable-runtime-cpudetect --sysroot=/media/ubuntu/data/ffmpeg-android/toolchain-android/sysroot --enable-pic --enable-libx264 --enable-libass --enable-libfreetype --enable-libfribidi --enable-fontconfig --enable-pthreads --disable-debug --disable-ffserver --enable-version3 --enable-hardcoded-tables --disable-ffplay --disable-ffprobe --enable-gpl --enable-yasm --disable-doc --disable-shared --enable-static --pkg-config=/media/ubuntu/data/ffmpeg-android/ffmpeg-pkg-config --prefix=/media/ubuntu/data/ffmpeg-android/build/armeabi-v7a-neon --extra-cflags='-I/media/ubuntu/data/ffmpeg-android/toolchain-android/include -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -fno-strict-overflow -fstack-protector-all -mfpu=neon' --extra-ldflags='-L/media/ubuntu/data/ffmpeg-android/toolchain-android/lib -Wl,-z,relro -Wl,-z,now -pie' --extra-libs='-lpng -lexpat -lm' --extra-cxxflags=
  
     libavutil      54. 20.100 / 54. 20.100
  
     libavcodec     56. 26.100 / 56. 26.100
  
     libavformat    56. 25.101 / 56. 25.101
  
     libavdevice    56.  4.100 / 56.  4.100
  
     libavfilter     5. 11.102 /  5. 11.102
  
     libswscale      3.  1.101 /  3.  1.101
  
     libswresample   1.  1.100 /  1.  1.100
  
     libpostproc    53.  3.100 / 53.  3.100
  
   [h264 @ 0xb5e03000] no frame!
  
   [aac @ 0xb5e03400] Input buffer exhausted before END element found
  
   Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/storage/emulated/0/Android/data/com.test.app/files/video/vid1.mp4':
  
     Metadata:
  
       major_brand     : mp42
  
       minor_version   : 0
  
       compatible_brands: isommp42
  
       creation_time   : 2015-08-30 17:19:07
  
     Duration: 00:00:05.03, start: 0.000000, bitrate: 3449 kb/s
  
       Stream #0:0(eng): Video: h264 (Baseline) (avc1 / 0x31637661), yuv420p, 640x640, 3381 kb/s, SAR 1:1 DAR 1:1, 30 fps, 30 tbr, 90k tbn, 180k tbc (default)
  
       Metadata:
  
         creation_time   : 2015-08-30 17:19:07
  
         handler_name    : VideoHandle
  
       Stream #0:1(eng): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, mono, fltp, 63 kb/s (default)
  
       Metadata:
  
         creation_time   : 2015-08-30 17:19:07
  
         handler_name    : SoundHandle
  
   [h264 @ 0xb5e03800] no frame!
  
   [aac @ 0xb5e04400] Input buffer exhausted before END element found
  
   Input #1, mov,mp4,m4a,3gp,3g2,mj2, from '/storage/emulated/0/Android/data/com.test.app/files/video/overlay.mp4':
  
     Metadata:
  
       major_brand     : mp42
  
       minor_version   : 0
  
       compatible_brands: isommp42
  
       creation_time   : 2015-08-30 17:19:07
  
     Duration: 00:00:05.03, start: 0.000000, bitrate: 3449 kb/s
  
       Stream #1:0(eng): Video: h264 (Baseline) (avc1 / 0x31637661), yuv420p, 640x640, 3381 kb/s, SAR 1:1 DAR 1:1, 30 fps, 30 tbr, 90k tbn, 180k tbc (default)
  
       Metadata:
  
         creation_time   : 2015-08-30 17:19:07
  
         handler_name    : VideoHandle
  
       Stream #1:1(eng): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, mono, fltp, 63 kb/s (default)
  
       Metadata:
  
         creation_time   : 2015-08-30 17:19:07
  
         handler_name    : SoundHandle

  After this output ffmpeg process is still running but it doesn’t provide any response... I am not sure how to deal with such issue, maybe I can try to use different codecs which works better on android or enable some debugging logging in ffmpeg.
  Any advices would help.

  UPDATE#2

  Thank you

• Delays on ffmpeg with rtsp streaming

  23 octobre 2015, par User New

  I have a command

  ffmpeg -threads 0 -i rtsp://user:pass@10.10.10.1 -threads 0 -i rtsp://user:pass@10.10.10.2 -map 0:1 -map 1:1  -filter_complex amix=inputs=2:duration=first:dropout_transition=3 -muxdelay 0 -ar 22050 -vn -f flv rtmp://10.10.10.3:1935/live/stream1 -map 0:0 -map 0:1 -muxdelay 0 -ar 22050 -f flv rtmp://10.10.10.3:1935/live/stream4 -map 1:0 -map 1:1 -muxdelay 0 -ar 22050 -f flv rtmp://10.10.10.3:1935/live/stream5

  It does 3 things :
  1) takes audio from both ip cameras (10.10.10.1 and 10.10.10.2) - and muxes them in one mp3 stream (stream1).
  2) takes audio and video from cam 10.10.10.1 and streams it to rtmp ://10.10.10.3:1935/live/stream4
  3) takes audio and video from cam 10.10.10.2 and streams it to rtmp ://10.10.10.3:1935/live/stream5

  Problem : Delays :
  1) Delay from reality : I smile in Cam1 and I see my smile on the Stream4 in 4-5 seconds.
  2) different delays on different cameras. Both cameras look at me, I say "Hello". First camera shows my "Hello", then in 4-5 seconds the second camera shows "Hello", and in 2-3 second I hear "Hello" on the Stream1.

  The most important and disturbing problem is the second one. Please help solving it. I want them to be simultaneous - both cameras and audioStream.

  Thank you in advance.

  P.S. Full output
  
  
  
  [root@minjust ~]# ffmpeg -threads 0 -i rtsp://user:pass@172.22.5.201 -threads 0 -i rtsp://user:pass@172.22.5.202 -map 0:1 -map 1:1  -filter_complex amix=inputs=2:duration=first:dropout_transition=3 -muxdelay 0 -ar 22050 -vn -f flv rtmp://172.22.45.38:1935/live/stream1 -map 0:0 -map 0:1 -muxdelay 0 -ar 22050 -f flv rtmp://172.22.45.38:1935/live/stream4 -map 1:0 -map 1:1 -muxdelay 0 -ar 22050 -f flv rtmp://172.22.45.38:1935/live/stream5
  
  ffmpeg version N-76031-g9099079 Copyright (c) 2000-2015 the FFmpeg developers
  
    built with gcc 4.4.7 (GCC) 20120313 (Red Hat 4.4.7-16)
  
    configuration:
  
    libavutil      55.  4.100 / 55.  4.100
  
    libavcodec     57.  6.100 / 57.  6.100
  
    libavformat    57.  4.100 / 57.  4.100
  
    libavdevice    57.  0.100 / 57.  0.100
  
    libavfilter     6. 11.100 /  6. 11.100
  
    libswscale      4.  0.100 /  4.  0.100
  
    libswresample   2.  0.100 /  2.  0.100
  
  Input #0, rtsp, from 'rtsp://user:pass@172.22.5.201':
  
    Metadata:
  
      title           : Media Presentation
  
    Duration: N/A, start: 0.073000, bitrate: N/A
  
      Stream #0:0: Video: h264 (Main), yuv420p(tv, bt709), 1280x720, 10 fps, 25 tbr, 90k tbn, 20 tbc
  
      Stream #0:1: Audio: mp2, 16000 Hz, mono, s16p, 32 kb/s
  
  Input #1, rtsp, from 'rtsp://user:pass@172.22.5.202':
  
    Metadata:
  
      title           : Media Presentation
  
    Duration: N/A, start: 0.064000, bitrate: N/A
  
      Stream #1:0: Video: h264 (Baseline), yuv420p, 704x576, 12 fps, 25 tbr, 90k tbn, 24 tbc
  
      Stream #1:1: Audio: adpcm_g726, 8000 Hz, mono, s16, 16 kb/s
  
      Stream #1:2: Data: none
  
  Output #0, flv, to 'rtmp://172.22.45.38:1935/live/stream1':
  
    Metadata:
  
      title           : Media Presentation
  
      encoder         : Lavf57.4.100
  
      Stream #0:0: Audio: adpcm_swf ([1][0][0][0] / 0x0001), 22050 Hz, mono, s16, 88 kb/s (default)
  
      Metadata:
  
        encoder         : Lavc57.6.100 adpcm_swf
  
  Output #1, flv, to 'rtmp://172.22.45.38:1935/live/stream4':
  
    Metadata:
  
      title           : Media Presentation
  
      encoder         : Lavf57.4.100
  
      Stream #1:0: Video: flv1 (flv) ([2][0][0][0] / 0x0002), yuv420p, 1280x720, q=2-31, 200 kb/s, 10 fps, 1k tbn, 10 tbc
  
      Metadata:
  
        encoder         : Lavc57.6.100 flv
  
      Stream #1:1: Audio: adpcm_swf ([1][0][0][0] / 0x0001), 22050 Hz, mono, s16, 88 kb/s
  
      Metadata:
  
        encoder         : Lavc57.6.100 adpcm_swf
  
  Output #2, flv, to 'rtmp://172.22.45.38:1935/live/stream5':
  
    Metadata:
  
      title           : Media Presentation
  
      encoder         : Lavf57.4.100
  
      Stream #2:0: Video: flv1 (flv) ([2][0][0][0] / 0x0002), yuv420p, 704x576, q=2-31, 200 kb/s, 12 fps, 1k tbn, 12 tbc
  
      Metadata:
  
        encoder         : Lavc57.6.100 flv
  
      Stream #2:1: Audio: adpcm_swf ([1][0][0][0] / 0x0001), 22050 Hz, mono, s16, 88 kb/s
  
      Metadata:
  
        encoder         : Lavc57.6.100 adpcm_swf
  
  Stream mapping:
  
    Stream #0:1 (mp2) -> amix:input0 (graph 0)
  
    Stream #1:1 (g726) -> amix:input1 (graph 0)
  
    amix (graph 0) -> Stream #0:0 (adpcm_swf)
  
    Stream #0:0 -> #1:0 (h264 (native) -> flv1 (flv))
  
    Stream #0:1 -> #1:1 (mp2 (native) -> adpcm_swf (native))
  
    Stream #1:0 -> #2:0 (h264 (native) -> flv1 (flv))
  
    Stream #1:1 -> #2:1 (adpcm_g726 (g726) -> adpcm_swf (native))
  
  Press [q] to stop, [?] for help
  
  [rtsp @ 0x35af820] Thread message queue blocking; consider raising the thread_queue_size option (current value: 8)
  
  [rtsp @ 0x34e1b60] Thread message queue blocking; consider raising the thread_queue_size option (current value: 8)
  
  Past duration 0.930214 too large
  
  Past duration 0.647987 too large
  
  Past duration 0.730217 too large
  
  ...

• FFMPEG : extract images from video with fixed interval, first few frames messed up

  22 octobre 2015, par Imperishable Night

  I wanted to extract some frames from a video with a fixed interval, so I used command lines like :

  ffmpeg.exe -i input.mp4 -r 5 results\%d.jpg`

  However, the interval between the first few frames are different from that of the rest.

  For example, if I do both ffmpeg.exe -i input.mp4 -r 25 -t 5 test\%d.jpg and ffmpeg.exe -i input.mp4 -r 5 -t 5 test2\%d.jpg (for a fps 25 video), I would expect that the results in test2 is a subsequence of the results in test with interval 5. However what I got are :
  Screenshot of results

  From the thumbnails, it is obvious that images 112 125 in test does not appear in test2. Some close inspection reveals that the correspondence between the two set of results are as follows :

  test  | test2
  
    1&2 |   1&2 (Those two frames are identical)
  
    3   |   3
  
    4   |   4
  
    9   |   5
  
   14   |   6
  
   19   |   7
  
  ...   | ...
  
  104   |  24
  
  109   |  25

  (Actually, when comparing the last frames, I just realized the results in test had too much mosaic. I fixed this by adding the option -q:v 1.)

  As can be seen, the first few frames from test2 actually have interval 1, instead of the expected value 5.

  What is the reason for this behavior, and how to fix it ?

  In case someone want to see the ffmpeg outputs :

  PS C:\Users\<username>\Documents\New folder> ffmpeg.exe -i input.mp4 -r 25 -t 5 test\%d.jpg
  
  ffmpeg version N-50911-g9efcfbe Copyright (c) 2000-2013 the FFmpeg developers
  
    built on Mar 13 2013 21:26:48 with gcc 4.7.2 (GCC)
  
    configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-avisynth --enable-bzlib --enable-fontconfi
  
  g --enable-frei0r --enable-gnutls --enable-libass --enable-libbluray --enable-libcaca --enable-libfreetype --enable-libg
  
  sm --enable-libilbc --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --ena
  
  ble-libopus --enable-librtmp --enable-libschroedinger --enable-libsoxr --enable-libspeex --enable-libtheora --enable-lib
  
  twolame --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libxa
  
  vs --enable-libxvid --enable-zlib
  
    libavutil      52. 19.100 / 52. 19.100
  
    libavcodec     55.  0.100 / 55.  0.100
  
    libavformat    55.  0.100 / 55.  0.100
  
    libavdevice    54.  4.100 / 54.  4.100
  
    libavfilter     3. 45.103 /  3. 45.103
  
    libswscale      2.  2.100 /  2.  2.100
  
    libswresample   0. 17.102 /  0. 17.102
  
    libpostproc    52.  2.100 / 52.  2.100
  
  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'input.mp4':
  
    Metadata:
  
      major_brand     : mp42
  
      minor_version   : 0
  
      compatible_brands: isommp42
  
      creation_time   : 2015-05-05 04:46:16
  
    Duration: 00:49:04.96, start: 0.000000, bitrate: 386 kb/s
  
      Stream #0:0(und): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuv420p, 524x360 [SAR 1:1 DAR 131:90], 287
  
   kb/s, 25 fps, 25 tbr, 25 tbn, 50 tbc
  
      Metadata:
  
        handler_name    : VideoHandler
  
      Stream #0:1(und): Audio: aac (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 96 kb/s
  
      Metadata:
  
        creation_time   : 2015-05-05 04:46:21
  
        handler_name    : IsoMedia File Produced by Google, 5-11-2011
  
  Output #0, image2, to 'test\%d.jpg':
  
    Metadata:
  
      major_brand     : mp42
  
      minor_version   : 0
  
      compatible_brands: isommp42
  
      encoder         : Lavf55.0.100
  
      Stream #0:0(und): Video: mjpeg, yuvj420p, 524x360 [SAR 1:1 DAR 131:90], q=2-31, 200 kb/s, 90k tbn, 25 tbc
  
      Metadata:
  
        handler_name    : VideoHandler
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (h264 -> mjpeg)
  
  Press [q] to stop, [?] for help
  
  frame=  125 fps=0.0 q=0.0 Lsize=N/A time=00:00:05.00 bitrate=N/A
  
  video:1140kB audio:0kB subtitle:0 global headers:0kB muxing overhead -100.001884%
  
  PS C:\Users\<username>\Documents\New folder> ffmpeg.exe -i input.mp4 -r 5 -t 5 test2\%d.jpg
  
  ffmpeg version N-50911-g9efcfbe Copyright (c) 2000-2013 the FFmpeg developers
  
    built on Mar 13 2013 21:26:48 with gcc 4.7.2 (GCC)
  
    configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-avisynth --enable-bzlib --enable-fontconfi
  
  g --enable-frei0r --enable-gnutls --enable-libass --enable-libbluray --enable-libcaca --enable-libfreetype --enable-libg
  
  sm --enable-libilbc --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --ena
  
  ble-libopus --enable-librtmp --enable-libschroedinger --enable-libsoxr --enable-libspeex --enable-libtheora --enable-lib
  
  twolame --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libxa
  
  vs --enable-libxvid --enable-zlib
  
    libavutil      52. 19.100 / 52. 19.100
  
    libavcodec     55.  0.100 / 55.  0.100
  
    libavformat    55.  0.100 / 55.  0.100
  
    libavdevice    54.  4.100 / 54.  4.100
  
    libavfilter     3. 45.103 /  3. 45.103
  
    libswscale      2.  2.100 /  2.  2.100
  
    libswresample   0. 17.102 /  0. 17.102
  
    libpostproc    52.  2.100 / 52.  2.100
  
  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'input.mp4':
  
    Metadata:
  
      major_brand     : mp42
  
      minor_version   : 0
  
      compatible_brands: isommp42
  
      creation_time   : 2015-05-05 04:46:16
  
    Duration: 00:49:04.96, start: 0.000000, bitrate: 386 kb/s
  
      Stream #0:0(und): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuv420p, 524x360 [SAR 1:1 DAR 131:90], 287
  
   kb/s, 25 fps, 25 tbr, 25 tbn, 50 tbc
  
      Metadata:
  
        handler_name    : VideoHandler
  
      Stream #0:1(und): Audio: aac (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 96 kb/s
  
      Metadata:
  
        creation_time   : 2015-05-05 04:46:21
  
        handler_name    : IsoMedia File Produced by Google, 5-11-2011
  
  Output #0, image2, to 'test2\%d.jpg':
  
    Metadata:
  
      major_brand     : mp42
  
      minor_version   : 0
  
      compatible_brands: isommp42
  
      encoder         : Lavf55.0.100
  
      Stream #0:0(und): Video: mjpeg, yuvj420p, 524x360 [SAR 1:1 DAR 131:90], q=2-31, 200 kb/s, 90k tbn, 5 tbc
  
      Metadata:
  
        handler_name    : VideoHandler
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (h264 -> mjpeg)
  
  Press [q] to stop, [?] for help
  
  frame=   25 fps=0.0 q=0.0 Lsize=N/A time=00:00:05.00 bitrate=N/A dup=0 drop=88
  
  video:375kB audio:0kB subtitle:0 global headers:0kB muxing overhead -100.005728%
  
  </username></username>