Recherche avancée

Sur d’autres sites (4194)

• How to include audio in an overlay ffmpeg command ?

  27 avril 2021, par gilad s

  Using ffmpeg I add a video overlay successfully over an origin video (origin has audio, overlay doesn't). However the audio of the origin video doesn't appear in the result video.

  


    ffmpeg  -i source.mp4 -i overlay.mp4 -filter_complex "[0:v]setpts=PTS-STARTPTS, scale=1280x720[top]; 
  [1:v]setpts=PTS-STARTPTS, scale=1280x720, format=yuva420p, 
  colorchannelmixer=aa=0.2[bottom]; [top][bottom]overlay=shortest=1" 
  -shortest -acodec copy -vcodec libx264 result1.mp4


  


  Even if I execute the following separate command on the result of the previous command - still no audio appears in the new result video.

  


    ffmpeg -i result1.mp4 -i audio.mp3 -c:v copy -c:a aac result2.mp4


  


  Here is the log :

  


  ffmpeg version 4.4 Copyright (c) 2000-2021 the FFmpeg developers
  built with Apple clang version 11.0.0 (clang-1100.0.33.17)
  configuration: --prefix=/usr/local/Cellar/ffmpeg/4.4 --enable-shared --enable-pthreads --enable-version3 --enable-avresample --cc=clang --host-cflags= --host-ldflags= --enable-ffplay --enable-gnutls --enable-gpl --enable-libaom --enable-libbluray --enable-libdav1d --enable-libmp3lame --enable-libopus --enable-librav1e --enable-librubberband --enable-libsnappy --enable-libsrt --enable-libtesseract --enable-libtheora --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libxvid --enable-lzma --enable-libfontconfig --enable-libfreetype --enable-frei0r --enable-libass --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libspeex --enable-libsoxr --enable-libzmq --enable-libzimg --disable-libjack --disable-indev=jack --enable-videotoolbox
  libavutil      56. 70.100 / 56. 70.100
  libavcodec     58.134.100 / 58.134.100
  libavformat    58. 76.100 / 58. 76.100
  libavdevice    58. 13.100 / 58. 13.100
  libavfilter     7.110.100 /  7.110.100
  libavresample   4.  0.  0 /  4.  0.  0
  libswscale      5.  9.100 /  5.  9.100
  libswresample   3.  9.100 /  3.  9.100
  libpostproc    55.  9.100 / 55.  9.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'course/final_video/3008_01_01_01_audio.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf58.76.100
  Duration: 00:06:01.48, start: 0.000000, bitrate: 215 kb/s
  Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 1280x720 [SAR 1:1 DAR 16:9], 141 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default)
    Metadata:
      handler_name    : VideoHandler
      vendor_id       : [0][0][0][0]
  Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 22050 Hz, mono, fltp, 70 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
      vendor_id       : [0][0][0][0]
Input #1, mov,mp4,m4a,3gp,3g2,mj2, from 'images/overlay.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf58.76.100
  Duration: 00:24:00.38, start: 0.000000, bitrate: 575 kb/s
  Stream #1:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt709), 1280x720 [SAR 1:1 DAR 16:9], 442 kb/s, 24 fps, 24 tbr, 12288 tbn, 48 tbc (default)
    Metadata:
      handler_name    : ISO Media file produced by Google Inc. Created on: 11/22/2020.
      vendor_id       : [0][0][0][0]
  Stream #1:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)
    Metadata:
      handler_name    : ISO Media file produced by Google Inc. Created on: 11/22/2020.
      vendor_id       : [0][0][0][0]
Stream mapping:
  Stream #0:0 (h264) -> setpts
  Stream #1:0 (h264) -> setpts
  overlay -> Stream #0:0 (libx264)
  Stream #1:1 -> #0:1 (copy)
Press [q] to stop, [?] for help
[swscaler @ 0x10c590000] No accelerated colorspace conversion found from yuva420p to argb.
[libx264 @ 0x7fc532813200] using SAR=1/1
[libx264 @ 0x7fc532813200] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 0x7fc532813200] profile High, level 3.1, 4:2:0, 8-bit
[libx264 @ 0x7fc532813200] 264 - core 161 r3049 55d517b - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to 'course/final_video/3008_01_01_01_overlay.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf58.76.100
  Stream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(progressive), 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 25 fps, 12800 tbn (default)
    Metadata:
      encoder         : Lavc58.134.100 libx264
    Side data:
      cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
  Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)
    Metadata:
      handler_name    : ISO Media file produced by Google Inc. Created on: 11/22/2020.
      vendor_id       : [0][0][0][0]

Stream mapping:
  Stream #0:0 (h264) -> setpts
  Stream #1:0 (h264) -> setpts
  overlay -> Stream #0:0 (libx264)
  Stream #1:1 -> #0:1 (copy)
Press [q] to stop, [?] for help
[swscaler @ 0x10c590000] No accelerated colorspace conversion found from yuva420p to argb.
[libx264 @ 0x7fc532813200] using SAR=1/1
[libx264 @ 0x7fc532813200] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 0x7fc532813200] profile High, level 3.1, 4:2:0, 8-bit
[libx264 @ 0x7fc532813200] 264 - core 161 r3049 55d517b - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to 'course/final_video/3008_01_01_01_overlay.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf58.76.100
  Stream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(progressive), 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 25 fps, 12800 tbn (default)
    Metadata:
      encoder         : Lavc58.134.100 libx264
    Side data:
      cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
  Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)
    Metadata:
      handler_name    : ISO Media file produced by Google Inc. Created on: 11/22/2020.
      vendor_id       : [0][0][0][0]
frame= 9037 fps= 32 q=-1.0 Lsize=   20954kB time=00:06:01.62 bitrate= 474.7kbits/s speed=1.26x    
video:15006kB audio:5651kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 1.439596%
[libx264 @ 0x7fc532813200] frame I:37    Avg QP:14.51  size:123799
[libx264 @ 0x7fc532813200] frame P:2277  Avg QP:16.97  size:  3221
[libx264 @ 0x7fc532813200] frame B:6723  Avg QP:24.31  size:   513
[libx264 @ 0x7fc532813200] consecutive B-frames:  0.8%  0.0%  0.0% 99.2%
[libx264 @ 0x7fc532813200] mb I  I16..4:  8.3% 64.9% 26.9%
[libx264 @ 0x7fc532813200] mb P  I16..4:  0.5%  1.1%  0.2%  P16..4: 16.1%  3.1%  2.3%  0.0%  0.0%    skip:76.7%
[libx264 @ 0x7fc532813200] mb B  I16..4:  0.0%  0.0%  0.0%  B16..8: 10.5%  0.1%  0.0%  direct: 0.2%  skip:89.2%  L0:45.2% L1:54.7% BI: 0.1%
[libx264 @ 0x7fc532813200] 8x8 transform intra:63.6% inter:83.0%
[libx264 @ 0x7fc532813200] coded y,uvDC,uvAC intra: 56.4% 61.0% 42.7% inter: 1.9% 1.9% 0.0%
[libx264 @ 0x7fc532813200] i16 v,h,dc,p: 29% 18% 18% 35%
[libx264 @ 0x7fc532813200] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 24% 19% 31%  4%  4%  4%  4%  5%  5%
[libx264 @ 0x7fc532813200] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 32% 22% 15%  4%  5%  6%  5%  5%  5%
[libx264 @ 0x7fc532813200] i8c dc,h,v,p: 51% 29% 14%  6%
[libx264 @ 0x7fc532813200] Weighted P-Frames: Y:0.0% UV:0.0%
[libx264 @ 0x7fc532813200] ref P L0: 66.0%  6.9% 17.0% 10.1%
[libx264 @ 0x7fc532813200] ref B L0: 77.2% 20.6%  2.2%
[libx264 @ 0x7fc532813200] ref B L1: 90.2%  9.8%
[libx264 @ 0x7fc532813200] kb/s:340.06


  


• ffmpeg : changing framerate breaks mp3 audio in mp4

  31 juillet 2022, par S. Doe

  What I'm going to do : I'd like to join a set of (46) images and a (1.8 second) mp3 file to a mp4 file.

  


  What works : When I use ffmpeg -framerate 25 -i img%09d.bmp -i audio.mp3 -c:v libx264 -vf scale=1280:-2,format=yuv420p -c:a copy -movflags +faststart output.mp4 (more or less the statement from https://superuser.com/a/852252 ), then ffmpeg creates the mp4 file and everything is fine : there is audio and video in a player like VLC.

  


  What does not work : When I use a framerate of 30 (instead of 25), VLC shows video only, but does not play audio.

  


  Question : What can I do to get it to work with framerate 30 (even when there are not enough images to cover the whole mp3 duration) ?

  


  Additional information :

  


  When I copy images so that there are 60 of them (2 seconds at framerate 30), then VLC plays the mp4 with audio and video.

  


  When I add the -shortest option like this ffmpeg -framerate 30 -i img%09d.bmp -i audio.mp3 -c:v libx264 -vf scale=1280:-2,format=yuv420p -c:a copy -movflags +faststart -shortest output.mp4 then VLC plays only audio and not video.

  


  This is how the output for framerate 30 looks like. It is nearly the same for framerate 25 (but "30" instead of "25" and some other durations/times/ids).

  


  ffmpeg version 4.4.2-0ubuntu0.22.04.1 Copyright (c) 2000-2021 the FFmpeg developers
  built with gcc 11 (Ubuntu 11.2.0-19ubuntu1)
  configuration: --prefix=/usr --extra-version=0ubuntu0.22.04.1 --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --arch=amd64 --enable-gpl --disable-stripping --enable-gnutls --enable-ladspa --enable-libaom --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libcodec2 --enable-libdav1d --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libjack --enable-libmp3lame --enable-libmysofa --enable-libopenjpeg --enable-libopenmpt --enable-libopus --enable-libpulse --enable-librabbitmq --enable-librubberband --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libssh --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzimg --enable-libzmq --enable-libzvbi --enable-lv2 --enable-omx --enable-openal --enable-opencl --enable-opengl --enable-sdl2 --enable-pocketsphinx --enable-librsvg --enable-libmfx --enable-libdc1394 --enable-libdrm --enable-libiec61883 --enable-chromaprint --enable-frei0r --enable-libx264 --enable-shared
  libavutil      56. 70.100 / 56. 70.100
  libavcodec     58.134.100 / 58.134.100
  libavformat    58. 76.100 / 58. 76.100
  libavdevice    58. 13.100 / 58. 13.100
  libavfilter     7.110.100 /  7.110.100
  libswscale      5.  9.100 /  5.  9.100
  libswresample   3.  9.100 /  3.  9.100
  libpostproc    55.  9.100 / 55.  9.100
Input #0, image2, from 'img%09d.bmp':
  Duration: 00:00:01.57, start: 0.000000, bitrate: N/A
  Stream #0:0: Video: bmp, bgr24, 480x480, 30 fps, 30 tbr, 30 tbn, 30 tbc
[mp3 @ 0x5557d053efc0] Estimating duration from bitrate, this may be inaccurate
Input #1, mp3, from 'audio.mp3':
  Duration: 00:00:01.03, start: 0.000000, bitrate: 32 kb/s
  Stream #1:0: Audio: mp3, 24000 Hz, mono, fltp, 32 kb/s
File 'output.mp4' already exists. Overwrite? [y/N] y
Stream mapping:
  Stream #0:0 -> #0:0 (bmp (native) -> h264 (libx264))
  Stream #1:0 -> #0:1 (copy)
Press [q] to stop, [?] for help
[image2 @ 0x5557d0536e00] Thread message queue blocking; consider raising the thread_queue_size option (current value: 8)
[libx264 @ 0x5557d0550340] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX
[libx264 @ 0x5557d0550340] profile High, level 4.0, 4:2:0, 8-bit
[libx264 @ 0x5557d0550340] 264 - core 163 r3060 5db6aa6 - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=4 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to 'output.mp4':
  Metadata:
    encoder         : Lavf58.76.100
  Stream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, progressive), 1280x1280, q=2-31, 30 fps, 15360 tbn
    Metadata:
      encoder         : Lavc58.134.100 libx264
    Side data:
      cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
  Stream #0:1: Audio: mp3 (mp4a / 0x6134706D), 24000 Hz, mono, fltp, 32 kb/s
[mp4 @ 0x5557d054f640] Starting second pass: moving the moov atom to the beginning of the file
frame=   47 fps= 15 q=-1.0 Lsize=     259kB time=00:00:01.46 bitrate=1446.3kbits/s speed=0.454x    
video:253kB audio:4kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.892266%
[libx264 @ 0x5557d0550340] frame I:1     Avg QP:18.97  size:186405
[libx264 @ 0x5557d0550340] frame P:16    Avg QP:19.79  size:  2808
[libx264 @ 0x5557d0550340] frame B:30    Avg QP:23.61  size:   889
[libx264 @ 0x5557d0550340] consecutive B-frames:  4.3%  0.0% 95.7%  0.0%
[libx264 @ 0x5557d0550340] mb I  I16..4:  3.0% 82.4% 14.6%
[libx264 @ 0x5557d0550340] mb P  I16..4:  0.1%  0.3%  0.0%  P16..4:  7.1%  1.2%  1.4%  0.0%  0.0%    skip:90.0%
[libx264 @ 0x5557d0550340] mb B  I16..4:  0.0%  0.0%  0.0%  B16..8: 10.5%  0.2%  0.1%  direct: 0.2%  skip:89.0%  L0:22.9% L1:75.6% BI: 1.5%
[libx264 @ 0x5557d0550340] 8x8 transform intra:81.7% inter:83.0%
[libx264 @ 0x5557d0550340] coded y,uvDC,uvAC intra: 90.3% 94.8% 82.0% inter: 0.8% 1.6% 0.2%
[libx264 @ 0x5557d0550340] i16 v,h,dc,p:  0% 46%  4% 50%
[libx264 @ 0x5557d0550340] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 12% 18% 10%  8%  9%  8% 10% 10% 14%
[libx264 @ 0x5557d0550340] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 16% 14%  7%  8% 15% 11% 10%  9% 10%
[libx264 @ 0x5557d0550340] i8c dc,h,v,p: 53% 20% 15% 11%
[libx264 @ 0x5557d0550340] Weighted P-Frames: Y:0.0% UV:0.0%
[libx264 @ 0x5557d0550340] ref P L0: 86.6%  3.5%  7.2%  2.7%
[libx264 @ 0x5557d0550340] ref B L0: 79.9% 19.4%  0.7%
[libx264 @ 0x5557d0550340] kb/s:1317.43


  


• Hardware acceleration FFMPEG not speeding up rendering at the moment

  13 août 2021, par AlphaDjango

  I currently have ffmpeg running on a computer (ubuntu server 20.04) with a nvidia MSI GTX 1660 6GB GAMING X TWIN FORZ 7 GRAPHICS CARD and a Ryzen 5 3600 cpu. I have installed the nvidia drivers for linux for it.

  


  Currently when enabling and disabling hardware acceleration the rendering takes the same amount of time which is around 1 minute to render per 1 minute of footage.

  


  When using a similar setup in davinci resolve it takes 1/4 of the time to apply similar background effects and concating the clips which makes me question if I am using hardware acceleration of if my ffmpeg command is not optimised for it ?

  


  This is the code which takes in around 50 mp4 clips and joins them together, scales them in size and applies a background blur on the sides of clips

  


  ffmpeg  -hwaccel cuda  -f concat -safe 0 -i /home/anon/project/MEDIAFILES/work_ffmpeg_space/concat_file_user_root_projectId_1.txt  -s 1920x1080 -filter_complex '[0:v]scale=ih*16/9:-1:flags=bicubic,boxblur=luma_radius=min(h\,w)/20:luma_power=2:chroma_radius=min(cw\,ch)/20:chroma_power=1[bg];[bg][0:v]overlay=(W-w)/2:(H-h)/2,crop=h=iw*9/16' -af aselect=concatdec_select,aresample=async=1  /home/anon/project/MEDIAFILES/created_videos/finalvideo_user_root_projectId_1.mp4


  


  Any tips or ways to optimise the code to use hardware acceleration will be greatly appreciated !

  


  This is my ffmpeg configuration

  


    ffmpeg version N-103221-gc3ef9e0277 Copyright (c) 2000-2021 the FFmpeg developers
  built with gcc 9 (Ubuntu 9.3.0-17ubuntu1~20.04)
  configuration: --pkg-config-flags=--static --enable-nonfree --enable-gpl --enable-version3 --enable-libmp3lame --enable-libvpx --enable-libopus --enable-opencl --enable-libxcb --enable-opengl --enable-nvenc --enable-vaapi --enable-vdpau --enable-ffplay --enable-ffprobe --enable-libxvid --enable-libx264 --enable-libx265 --enable-openal --enable-openssl --enable-cuda-nvcc --enable-cuvid --extra-cflags=-I/usr/lcal/cuda/include --extra-ldflags=-L/usr/local/cuda/lib64 --extra-libs=-lpthread
  libavutil      57.  3.100 / 57.  3.100
  libavcodec     59.  4.101 / 59.  4.101
  libavformat    59.  4.101 / 59.  4.101
  libavdevice    59.  0.100 / 59.  0.100
  libavfilter     8.  1.103 /  8.  1.103
  libswscale      6.  0.100 /  6.  0.100
  libswresample   4.  0.100 /  4.  0.100
  libpostproc    56.  0.100 / 56.  0.100