Recherche avancée

Sur d’autres sites (11245)

• Cannot encode vp9 video with alpha to ivf container

  28 juillet 2022, par Jakob Košir

  I'm trying to convert a vp8/webm video with transparency to vp9 and ivf container. I can encode the video to vp9 into webm container with the following command which correctly produces a vp9 video with transparency :

  


  ffmpeg -c:v libvpx -i dancer1.webm -c:v libvpx-vp9 dancer_vp9.webm


  


  So basically forcing libvpx encoders instead of ffmpeg native ones to support alpha.

  


  However if I try to use ivf container instead of webm the resulting video does not have transparency :

  


  ffmpeg -c:v libvpx -i dancer1.webm -c:v libvpx-vp9 dancer_vp9.ivf


  


  Does not have transparency when played with VLC, when converting frames to PNG using ffmpeg (ffmpeg -c:v libvpx-vp9 -i dancer_vp9.ivf -vf "select=eq(n\,0)" frame.png) and when played in Chrome (using webcodecs API). Does ivf not support alpha channel somehow or am I doing something wrong ?

  


  I also tried copying the stream with alpha from webm container to ivf (ffmpeg -i dancer1_vp9.webm -c copy dancer1_vp9_copy.ivf) which produces the same result, no transparency.

  


  Curiously if I force or don't force libvpx decoder (which is required to support transparency, ffmpeg native one seems to just discard the alpha channel) when reading vp8/vp9 webm video it produces the same result when outputting to ivf container, while when outputting to webm container the resulting video has alpha when using libvpx decoder and not when using native ffmepg decoder.

  


  ffprobe output of created ivf file :

  


  ffprobe version 5.0.1 Copyright (c) 2007-2022 the FFmpeg developers
  built with Apple clang version 13.1.6 (clang-1316.0.21.2.5)
  configuration: --prefix=/opt/homebrew/Cellar/ffmpeg/5.0.1_3 --enable-shared --enable-pthreads --enable-version3 --cc=clang --host-cflags= --host-ldflags= --enable-ffplay --enable-gnutls --enable-gpl --enable-libaom --enable-libbluray --enable-libdav1d --enable-libmp3lame --enable-libopus --enable-librav1e --enable-librist --enable-librubberband --enable-libsnappy --enable-libsrt --enable-libtesseract --enable-libtheora --enable-libvidstab --enable-libvmaf --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libxvid --enable-lzma --enable-libfontconfig --enable-libfreetype --enable-frei0r --enable-libass --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libspeex --enable-libsoxr --enable-libzmq --enable-libzimg --disable-libjack --disable-indev=jack --enable-videotoolbox --enable-neon
  libavutil      57. 17.100 / 57. 17.100
  libavcodec     59. 18.100 / 59. 18.100
  libavformat    59. 16.100 / 59. 16.100
  libavdevice    59.  4.100 / 59.  4.100
  libavfilter     8. 24.100 /  8. 24.100
  libswscale      6.  4.100 /  6.  4.100
  libswresample   4.  3.100 /  4.  3.100
  libpostproc    56.  3.100 / 56.  3.100
Input #0, ivf, from 'dancer_vp9.ivf':
  Duration: 00:01:02.87, start: 0.000000, bitrate: 249 kb/s
  Stream #0:0: Video: vp9 (Profile 0) (VP90 / 0x30395056), yuv420p(tv), 640x360, 30 tbr, 30 tbn


  


• ffmpeg : Combining two A/V streams results in out of sync audio in VLC play but not QuickTime [closed]

  24 juillet 2022, par Alex

  I have two files (one audio, one video, both mp4) I want to combine into a single mp4 without re-encoding the streams. They both have the same duration (well, technically one is 0.05s longer than the other, but it's close enough for my application). The command I am using to combine them is :

  


  ffmpeg -i audio.mp4 -i video.mp4 -c:v copy -c:a copy test.mp4

  


  When I play test.mp4 in VLC player, the audio is way out of sync. The video duration is correct, but the sound is all happening too soon and it gets more out of sync as it continues. However, if I play back the same file using QuickTime, it's perfect !

  


  What is going on here ? Is there a way for me to ensure correct playback regardless of video player, without re-encoding the streams ?

  


  Here's the full output of the command :

  


  % ffmpeg -i audio.mp4 -i video.mp4 -c:v copy -c:a copy test.mp4
ffmpeg version 5.0.1 Copyright (c) 2000-2022 the FFmpeg developers
  built with Apple clang version 13.1.6 (clang-1316.0.21.2.5)
  configuration: --prefix=/opt/homebrew/Cellar/ffmpeg/5.0.1_2 --enable-shared --enable-pthreads --enable-version3 --cc=clang --host-cflags= --host-ldflags= --enable-ffplay --enable-gnutls --enable-gpl --enable-libaom --enable-libbluray --enable-libdav1d --enable-libmp3lame --enable-libopus --enable-librav1e --enable-librist --enable-librubberband --enable-libsnappy --enable-libsrt --enable-libtesseract --enable-libtheora --enable-libvidstab --enable-libvmaf --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libxvid --enable-lzma --enable-libfontconfig --enable-libfreetype --enable-frei0r --enable-libass --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libspeex --enable-libsoxr --enable-libzmq --enable-libzimg --disable-libjack --disable-indev=jack --enable-videotoolbox --enable-neon
  libavutil      57. 17.100 / 57. 17.100
  libavcodec     59. 18.100 / 59. 18.100
  libavformat    59. 16.100 / 59. 16.100
  libavdevice    59.  4.100 / 59.  4.100
  libavfilter     8. 24.100 /  8. 24.100
  libswscale      6.  4.100 /  6.  4.100
  libswresample   4.  3.100 /  4.  3.100
  libpostproc    56.  3.100 / 56.  3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'audio.mp4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: mp42mp41isomiso2
    creation_time   : 2022-07-24T22:23:15.000000Z
  Duration: 00:00:27.17, start: 0.000000, bitrate: 129 kb/s
  Stream #0:0[0x1](und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)
    Metadata:
      creation_time   : 2022-07-24T22:23:15.000000Z
      handler_name    : SoundHandler
      vendor_id       : [0][0][0][0]
Input #1, mov,mp4,m4a,3gp,3g2,mj2, from 'video.mp4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: mp42mp41isomiso2
    creation_time   : 2022-07-24T22:23:15.000000Z
  Duration: 00:00:27.12, start: 0.000000, bitrate: 7662 kb/s
  Stream #1:0[0x1](und): Video: hevc (Main) (hvc1 / 0x31637668), yuv420p(tv), 1280x720, 7653 kb/s, SAR 1:1 DAR 16:9, 103.75 fps, 120 tbr, 12k tbn (default)
    Metadata:
      creation_time   : 2022-07-24T22:23:15.000000Z
      handler_name    : VideoHandler
      vendor_id       : [0][0][0][0]
Output #0, mp4, to 'test.mp4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: mp42mp41isomiso2
    encoder         : Lavf59.16.100
  Stream #0:0(und): Video: hevc (Main) (hvc1 / 0x31637668), yuv420p(tv), 1280x720 [SAR 1:1 DAR 16:9], q=2-31, 7653 kb/s, 103.75 fps, 120 tbr, 12k tbn (default)
    Metadata:
      creation_time   : 2022-07-24T22:23:15.000000Z
      handler_name    : VideoHandler
      vendor_id       : [0][0][0][0]
  Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 127 kb/s (default)
    Metadata:
      creation_time   : 2022-07-24T22:23:15.000000Z
      handler_name    : SoundHandler
      vendor_id       : [0][0][0][0]
Stream mapping:
  Stream #1:0 -> #0:0 (copy)
  Stream #0:0 -> #0:1 (copy)
Press [q] to stop, [?] for help
[mp4 @ 0x148708150] Non-monotonous DTS in output stream 0:0; previous: 29308, current: 29308; changing to 29309. This may result in incorrect timestamps in the output file.
[mp4 @ 0x148708150] Non-monotonous DTS in output stream 0:0; previous: 111505, current: 111505; changing to 111506. This may result in incorrect timestamps in the output file.
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x148704fe0] Invalid timestamps stream=0, pts=128503, dts=128504, size=6321
[mp4 @ 0x148708150] Invalid DTS: 128504 PTS: 128503 in output stream 0:0, replacing by guess
[mp4 @ 0x148708150] Non-monotonous DTS in output stream 0:0; previous: 128504, current: 128504; changing to 128505. This may result in incorrect timestamps in the output file.
frame= 2814 fps=0.0 q=-1.0 Lsize=   25817kB time=00:00:27.16 bitrate=7784.7kbits/s speed=1.5e+03x    
video:25340kB audio:424kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.201361%


  


• ffmpeg - drawtext filter producing file with no streams

  24 juillet 2022, par yarrichar

  I am trying to get ffmpeg's drawtext filter working in an AWS lambda. Other operations like concatenating and trimming files works. But drawtext fails for some reason. I run the exact same command on my local machine and it runs fine.

  


  The output is below. The first line shows the parameters passed to ffmpeg.
You can see at the end of the following output that it's only processing 3 frames before exiting.

  


  Any help would be greatly appreciated.

  


  2022-07-24T00:38:12.120Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    About to execute step:  [
  '-y',
  '-v',
  'repeat+level+verbose',
  '-i',
  '/tmp/out_0.mp4',
  '-vf',
  "drawtext=fontfile=DejaVuSans.ttf:text='Helloooo':fontcolor=white:fontsize=24:box=1:boxcolor=black@0.7:boxborderw=5:x=10:y=h-th-10",
  '-c:a',
  'copy',
  '/tmp/out_1.mp4'
]
2022-07-24T00:38:12.440Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    [info] ffmpeg version N-62110-g4d45f5acbd-static https://johnvansickle.com/ffmpeg/  Copyright (c) 2000-2022 the FFmpeg developers
[info]   built with gcc 8 (Debian 8.3.0-6)
[info]   configuration: --enable-gpl --enable-version3 --enable-static --disable-debug --disable-ffplay --disable-indev=sndio --disable-outdev=sndio --cc=gcc --enable-fontconfig --enable-frei0r --enable-gnutls --enable-gmp --enable-libgme --enable-gray --enable-libaom --enable-libfribidi --enable-libass --enable-libvmaf --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-librubberband --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libvorbis --enable-libopus --enable-libtheora --enable-libvidstab --enable-libvo-amrwbenc --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libdav1d --enable-libxvid --enable-libzvbi --enable-libzimg
[info]   libavutil      57. 26.100 / 57. 26.100
[info]   libavcodec     59. 33.100 / 59. 33.100
[info]   libavformat    59. 24.100 / 59. 24.100
[info]   libavdevice    59.  6.100 / 59.  6.100
[info]   libavfilter     8. 40.100 /  8. 40.100
[info]   libswscale      6.  6.100 /  6.  6.100
[info]   libswresample   4.  6.100 /  4.  6.100
[info]   libpostproc    56.  5.100 / 56.  5.100

2022-07-24T00:38:12.682Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    [h264 @ 0x63bc000] [verbose] Reinit context to 1920x1088, pix_fmt: yuv420p

2022-07-24T00:38:13.321Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    [info] Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/tmp/out_0.mp4':
[info]   Metadata:
[info]     major_brand     : isom
[info]     minor_version   : 512
[info]     compatible_brands: isomiso2avc1mp41
[info]     encoder         : Lavf59.24.100
[info]   Duration: 00:00:30.02, start: 0.000000, bitrate: 5135 kb/s
[info]   Stream #0:0[0x1](und): Video: h264 (High), 1 reference frame (avc1 / 0x31637661), yuv420p(tv, smpte170m, progressive, left), 1920x1080 (1920x1088) [SAR 1:1 DAR 16:9], 4998 kb/s, 
2022-07-24T00:38:13.321Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    29.98 fps, 30 tbr, 90k tbn (default)
[info]     Metadata:
[info]       handler_name    : VideoHandler
[info]       vendor_id       : [0][0][0][0]

2022-07-24T00:38:13.341Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    [info]   Stream #0:1[0x2](und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 127 kb/s (default)
[info]     Metadata:
[info]       handler_name    : SoundHandler
[info]       vendor_id       : [0][0][0][0]

2022-07-24T00:38:13.440Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    [info] Stream mapping:
[info]   Stream #0:0 -> #0:0 (h264 (native) -> h264 (libx264))
[info]   Stream #0:1 -> #0:1 (copy)
[info] Press [q] to stop, [?] for help

2022-07-24T00:38:13.440Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    [h264 @ 0x63e57c0] [verbose] Reinit context to 1920x1088, pix_fmt: yuv420p

2022-07-24T00:38:15.321Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    [graph 0 input from stream 0:0 @ 0x6699840] [verbose] w:1920 h:1080 pixfmt:yuv420p tb:1/90000 fr:30/1 sar:1/1

2022-07-24T00:38:16.121Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    [libx264 @ 0x63c1140] [info] using SAR=1/1

2022-07-24T00:38:16.222Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    [libx264 @ 0x63c1140] [info] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2

2022-07-24T00:38:16.341Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    [libx264 @ 0x63c1140] [info] profile High, level 4.0, 4:2:0, 8-bit
[libx264 @ 0x63c1140] [info] 
2022-07-24T00:38:16.360Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    264 - core 164 r3095 baee400 - H.264/MPEG-4 AVC codec - Copyleft 2003-2022 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=3 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00

2022-07-24T00:38:16.642Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    [info] Output #0, mp4, to '/tmp/out_1.mp4':
[info]   Metadata:
[info]     major_brand     : isom
[info]     minor_version   : 512
[info]     compatible_brands: isomiso2avc1mp41
[info]     encoder         : Lavf59.24.100

2022-07-24T00:38:16.881Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    [info]   Stream #0:0(und): Video: h264, 1 reference frame (avc1 / 0x31637661), yuv420p(tv, smpte170m, progressive, left), 1920x1080 (0x0) [SAR 1:1 DAR 16:9], q=2-31, 30 fps, 15360 tbn (default)
[info]     Metadata:
[info]       handler_name    : VideoHandler
[info]       vendor_id       : [0][0][0][0]
[info]       encoder         : Lavc59.33.100 libx264
[info]     Side data:
[info]       cpb: 
2022-07-24T00:38:16.900Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A

2022-07-24T00:38:16.960Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    [info]   Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 127 kb/s (default)
[info]     Metadata:
[info]       handler_name    : SoundHandler
[info]       vendor_id       : [0][0][0][0]

2022-07-24T00:38:17.321Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    [info] frame=    1 fps=0.9 q=0.0 size=       0kB time=00:00:00.07 bitrate=   5.1kbits/s speed=0.0708x    
2022-07-24T00:38:17.502Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    [info] frame=    1 fps=0.3 q=0.0 size=       0kB time=00:00:00.09 bitrate=   4.0kbits/s speed=0.0247x    
2022-07-24T00:38:23.920Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    [info] frame=    2 fps=0.3 q=0.0 size=       0kB time=00:00:00.13 bitrate=   2.8kbits/s speed=0.0204x    
2022-07-24T00:38:38.942Z    8812cc07-d9e4-4750-8c74-1f987b7ca873    INFO    Close: Exit code:  null