Sur d’autres sites (11503)

• How to enable LHLS in FFMPEG 4.1 ?

  27 décembre 2020, par mehdi.r

  I am trying to create a low latency CMAF video stream using FFMPEG.
To do so, I would like to enable the lhls option in FFMPEG in order to have the #EXT-X-PREFETCH tag written in the HLS manifest.

  



  From the FFMPEG doc :

  



  https://www.ffmpeg.org/ffmpeg-all.html

  



  


  Enable Low-latency HLS(LHLS). Adds #EXT-X-PREFETCH tag with current >segment’s URI. Apple doesn’t have an official spec for LHLS. Meanwhile >hls.js player folks are trying to standardize a open LHLS spec. The >draft spec is available in https://github.com/video-dev/hlsjs->rfcs/blob/lhls-spec/proposals/0001-lhls.md This option will also try >to comply with the above open spec, till Apple’s spec officially >supports it. Applicable only when streaming and hls_playlist options >are enabled. This is an experimental feature.

  


  



  I am using the following command with FFMPEG 4.1 :

  



  ffmpeg -re -i ~/Documents/videos/BigBuckBunny.mp4 \
    -map 0 -map 0 -map 0 -c:a aac -c:v libx264 -tune zerolatency \
    -b:v:0 2000k -s:v:0 1280x720 -profile:v:0 high \
    -b:v:1 1500k -s:v:1 640x340  -profile:v:1 main \
    -b:v:2 500k -s:v:2 320x170  -profile:v:2 baseline \
    -bf 1 \
    -keyint_min 24 -g 24 -sc_threshold 0 -b_strategy 0 -ar:a:1 22050 -use_timeline 1 -use_template 1 \
    -window_size 5 -adaptation_sets "id=0,streams=v id=1,streams=a" \
    -hls_playlist 1 -seg_duration 1 -streaming 1  -strict experimental -lhls 1 -remove_at_exit 1 \
    -f dash manifest.mpd



  



  The kind of HLS manifest I obtained for a specific resolution :

  



  #EXTM3U
#EXT-X-VERSION:6
#EXT-X-TARGETDURATION:1
#EXT-X-MEDIA-SEQUENCE:8
#EXT-X-MAP:URI="init-stream0.mp4"
#EXTINF:0.998458,
#EXT-X-PROGRAM-DATE-TIME:2019-06-21T18:13:56.966+0900
chunk-stream0-00008.mp4
#EXTINF:0.998458,
#EXT-X-PROGRAM-DATE-TIME:2019-06-21T18:13:57.964+0900
chunk-stream0-00009.mp4
#EXTINF:0.998458,
#EXT-X-PROGRAM-DATE-TIME:2019-06-21T18:13:58.963+0900
chunk-stream0-00010.mp4
#EXTINF:0.998458,
#EXT-X-PROGRAM-DATE-TIME:2019-06-21T18:13:59.961+0900
chunk-stream0-00011.mp4
#EXTINF:1.021678,
#EXT-X-PROGRAM-DATE-TIME:2019-06-21T18:14:00.960+0900
chunk-stream0-00012.mp4
...



  



  As you can see the #EXT-X-PREFETCH tag is missing.

  



  Any help would be highly appreciated.

  



  Edit

  



  I also compiled FFmpeg from its master branch by doing the following :

  



  nasm

  



  sudo apt-get install nasm mingw-w64


  



  Codecs

  



  sudo apt-get install libx265-dev libnuma-dev libx264-dev libvpx-dev libfdk-aac-dev libmp3lame-dev libopus-dev


  



  FFmpeg

  



  mkdir lhls
cd lhls 
git init 
git clone https://github.com/FFmpeg/FFmpeg.git
cd FFmpeg 
git checkout master


  



  AOM (inside FFmpeg dir)

  



  git -C aom pull 2> /dev/null || git clone --depth 1 https://aomedia.googlesource.com/aom && \
mkdir -p aom_build && \
cd aom_build && \
PATH="$HOME/bin:$PATH" cmake -G "Unix Makefiles" -DCMAKE_INSTALL_PREFIX="$HOME/ffmpeg_build" -DENABLE_SHARED=off -DENABLE_NASM=on ../aom && \
PATH="$HOME/bin:$PATH" make && \
make install
cd..


  



  Compiling

  



  PATH="$HOME/bin:$PATH" PKG_CONFIG_PATH="$HOME/ffmpeg_build/lib/pkgconfig" ./configure \
  --prefix="$HOME/ffmpeg_build" \
  --pkg-config-flags="--static" \
  --extra-cflags="-I$HOME/ffmpeg_build/include" \
  --extra-ldflags="-L$HOME/ffmpeg_build/lib" \
  --extra-libs="-lpthread -lm" \
  --bindir="$HOME/bin" \
  --enable-gpl \
  --enable-libaom \
  --enable-libass \
  --enable-libfdk-aac \
  --enable-libfreetype \
  --enable-libmp3lame \
  --enable-libopus \
  --enable-libvorbis \
  --enable-libvpx \
  --enable-libx264 \
  --enable-libx265 \
  --enable-nonfree && \
PATH="$HOME/bin:$PATH" make 


  



  Unfortunately, the #EXT-X-PREFETCH is still missing in the HLS Manifest.

  



  I also tried nightly builds from https://ffmpeg.zeranoe.com/builds/ , same result.

  



  Any help would be highly appreciated.

  



  EDIT 2 :resolved

  



  Thanks to @aergistal and @Gyan , the #EXT-X-PREFETCH tag is now present in my HLS manifest.

  



  Here the FFMPEG command I am using :

  



  ./ffmpeg -re -i ~/videos/BigBuckBunny.mp4 -loglevel debug \
  -map 0 -map 0 -map 0 -c:a aac -c:v libx264 -tune zerolatency \
  -b:v:0 2000k -s:v:0 1280x720 -profile:v:0 high -b:v:1 1500k -s:v:1 640x340  -profile:v:1 main -b:v:2 500k -s:v:2 320x170  -profile:v:2 baseline -bf 1 \
 -keyint_min 24 -g 24 -sc_threshold 0 -b_strategy 0 -ar:a:1 22050 -use_timeline 1 -use_template 1 -window_size 5 \
 -adaptation_sets "id=0,streams=v id=1,streams=a" -hls_playlist 1 -seg_duration 3 -streaming 1 \
 -strict experimental -lhls 1 -remove_at_exit 0 -master_m3u8_publish_rate 3 \
 -f dash -method PUT -http_persistent 1  https://example.com/manifest.mpd


  



  Apparently the mime types are not passed to the server & FFmpeg seems to ignore the -headers option.

  


• How to concate videos which some have audio and some haven't audio in FFMPEG [duplicate]

  21 juin 2019, par Nikunj Paradva

  This question already has an answer here :

  • FFmpeg : concat multiple videos, some with audio, some without
    
    1 answer
    
  • FFmpeg concatenation, no Audio in Final Output
    
    1 answer
    

  What i am doing :->

  I am currently concat videos using FFMPEG. while selecting input videos I don’t know videos have audio stream or not. then i concate that videos with this command which is written below,

  I got this error because of one input have no sound stream

  What i have to do :->

  • how to check that input video have audio or not ?
  • how to concate this video inputs ?(one with audio another with no audio)
  • if possible all this thing in single command ?

  FFMPEG Command :-

   [-y,
  
     -i, /storage/emulated/0/Received/MP4_20190220_114210.mp4,
  
     -i, /storage/emulated/0/Received/VID-20190404-WA0010.mp4,
  
     -strict, experimental,
  
     -filter_complex, [0:v]scale=iw*min(854/iw\,480/ih):ih*min(854/iw\,480/ih), pad=854:480:(854-iw*min(854/iw\,480/ih))/2:(480-ih*min(854/iw\,480/ih))/2,setsar=1:1[v0];
  
                      [1:v]scale=iw*min(854/iw\,480/ih):ih*min(854/iw\,480/ih), pad=854:480:(854-iw*min(854/iw\,480/ih))/2:(480-ih*min(854/iw\,480/ih))/2,setsar=1:1[v1];
  
                      [v0][0:a][v1][1:a] concat=n=2:v=1:a=1,
  
     -preset, ultrafast,
  
     /storage/emulated/0/Video/Video_1561115811161.mp4]

  I got this Error While Executing.

  ffmpeg version n4.0-39-gda39990 Copyright (c) 2000-2018 the FFmpeg developers
  
        built with gcc 4.9.x (GCC) 20150123 (prerelease)
  
        configuration: --target-os=linux --cross-prefix=/root/bravobit/ffmpeg-android/toolchain-android/bin/arm-linux-androideabi- --arch=arm --cpu=cortex-a8 --enable-runtime-cpudetect --sysroot=/root/bravobit/ffmpeg-android/toolchain-android/sysroot --enable-pic --enable-libx264 --enable-ffprobe --enable-libopus --enable-libvorbis --enable-libfdk-aac --enable-libfreetype --enable-libfribidi --enable-libmp3lame --enable-fontconfig --enable-libvpx --enable-libass --enable-yasm --enable-pthreads --disable-debug --enable-version3 --enable-hardcoded-tables --disable-ffplay --disable-linux-perf --disable-doc --disable-shared --enable-static --enable-runtime-cpudetect --enable-nonfree --enable-network --enable-avresample --enable-avformat --enable-avcodec --enable-indev=lavfi --enable-hwaccels --enable-ffmpeg --enable-zlib --enable-gpl --enable-small --enable-nonfree --pkg-config=pkg-config --pkg-config-flags=--static --prefix=/root/bravobit/ffmpeg-android/build/armeabi-v7a --extra-cflags='-I/root/bravobit/ffmpeg-android/toolchain-android/include -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -fno-strict-overflow -fstack-protector-all' --extra-ldflags='-L/root/bravobit/ffmpeg-android/toolchain-android/lib -Wl,-z,relro -Wl,-z,now -pie' --extra-cxxflags=
  
        libavutil      56. 14.100 / 56. 14.100
  
        libavcodec     58. 18.100 / 58. 18.100
  
        libavformat    58. 12.100 / 58. 12.100
  
        libavdevice    58.  3.100 / 58.  3.100
  
        libavfilter     7. 16.100 /  7. 16.100
  
        libavresample   4.  0.  0 /  4.  0.  0
  
        libswscale      5.  1.100 /  5.  1.100
  
        libswresample   3.  1.100 /  3.  1.100
  
        libpostproc    55.  1.100 / 55.  1.100
  
      Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/storage/emulated/0/Received/MP4_20190220_114210.mp4':
  
        Metadata:
  
          major_brand     : iso6
  
          minor_version   : 1
  
          compatible_brands: mp42iso6avc1isom
  
          creation_time   : 2019-02-20T06:12:15.000000Z
  
        Duration: 00:00:23.46, start: 0.000000, bitrate: 309 kb/s
  
          Stream #0:0(und): Video: h264 (avc1 / 0x31637661), yuv420p, 426x426, 243 kb/s, 24 fps, 24 tbr, 12288 tbn, 48 tbc (default)
  
          Stream #0:1(eng): Audio: aac (mp4a / 0x6134706D), 32000 Hz, stereo, fltp, 64 kb/s (default)
  
      Input #1, mov,mp4,m4a,3gp,3g2,mj2, from '/storage/emulated/0/Received/VID-20190404-WA0010.mp4':
  
        Metadata:
  
          major_brand     : mp42
  
          minor_version   : 1
  
          compatible_brands: mp41mp42isom
  
          creation_time   : 2018-11-24T20:20:48.000000Z
  
        Duration: 00:00:59.51, start: 0.066667, bitrate: 649 kb/s
  
          Stream #1:0(und): Video: h264 (avc1 / 0x31637661), yuv420p(tv, bt709), 640x640, 646 kb/s, 29.98 fps, 30 tbr, 15360 tbn, 60 tbc (default)
  
          Metadata:
  
            creation_time   : 2018-11-24T20:20:48.000000Z
  
            handler_name    : Core Media Video
  
      Stream specifier ':a' in filtergraph description [0:v]scale=iw*min(854/iw\,480/ih):ih*min(854/iw\,480/ih), pad=854:480:(854-iw*min(854/iw\,480/ih))/2:(480-ih*min(854/iw\,480/ih))/2,setsar=1:1[v0];[1:v]scale=iw*min(854/iw\,480/ih):ih*min(854/iw\,480/ih), pad=854:480:(854-iw*min(854/iw\,480/ih))/2:(480-ih*min(854/iw\,480/ih))/2,setsar=1:1[v1];[v0][0:a][v1][1:a] concat=n=2:v=1:a=1 matches no streams.

  Your help would be appreciated.

• Audio stuttering every couple of seconds

  27 juin 2019, par Glutch

  I’m merging a video (recorded with ffmpeg, good quality, all solid), with a musicfile.mp3. However every couple of seconds the music stutters and skips slightly. Which seems very strange since simply adding music on top of a video sounds like the engine could relax and take its time, creating no artifacts. (In comparison to recording live desktop footage). Can anyone help me sort this out ?

  System : MacOS MBP 2015, 16gb ram 2.7ghz i5

  ffmpeg -i "temp/1561246948349.mkv" -i "music/happy.mp3" -vcodec copy -filter_complex amix -map 0:v -map 0:a -map 1:a -shortest -b:a 144k "finished/2019-06-22/1561246948349/output.mkv"
  
  ffmpeg version 4.1.3 Copyright (c) 2000-2019 the FFmpeg developers
  
    built with Apple LLVM version 10.0.1 (clang-1001.0.46.4)
  
    configuration: --prefix=/usr/local/Cellar/ffmpeg/4.1.3_1 --enable-shared --enable-pthreads --enable-version3 --enable-hardcoded-tables --enable-avresample --cc=clang --host-cflags='-I/Library/Java/JavaVirtualMachines/adoptopenjdk-11.0.2.jdk/Contents/Home/include -I/Library/Java/JavaVirtualMachines/adoptopenjdk-11.0.2.jdk/Contents/Home/include/darwin' --host-ldflags= --enable-ffplay --enable-gnutls --enable-gpl --enable-libaom --enable-libbluray --enable-libmp3lame --enable-libopus --enable-librubberband --enable-libsnappy --enable-libtesseract --enable-libtheora --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-libxvid --enable-lzma --enable-libfontconfig --enable-libfreetype --enable-frei0r --enable-libass --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-librtmp --enable-libspeex --enable-videotoolbox --disable-libjack --disable-indev=jack --enable-libaom --enable-libsoxr
  
    libavutil      56. 22.100 / 56. 22.100
  
    libavcodec     58. 35.100 / 58. 35.100
  
    libavformat    58. 20.100 / 58. 20.100
  
    libavdevice    58.  5.100 / 58.  5.100
  
    libavfilter     7. 40.101 /  7. 40.101
  
    libavresample   4.  0.  0 /  4.  0.  0
  
    libswscale      5.  3.100 /  5.  3.100
  
    libswresample   3.  3.100 /  3.  3.100
  
    libpostproc    55.  3.100 / 55.  3.100
  
  Input #0, matroska,webm, from 'temp/1561246948349.mkv':
  
    Metadata:
  
      ENCODER         : Lavf58.20.100
  
    Duration: 00:00:21.50, start: 0.000000, bitrate: 5834 kb/s
  
      Stream #0:0: Video: h264 (High 4:4:4 Predictive), yuv422p(progressive), 2880x1800, 30 fps, 30 tbr, 1k tbn, 2000k tbc (default)
  
      Metadata:
  
        ENCODER         : Lavc58.35.100 libx264
  
        DURATION        : 00:00:21.467000000
  
      Stream #0:1: Audio: vorbis, 44100 Hz, stereo, fltp (default)
  
      Metadata:
  
        ENCODER         : Lavc58.35.100 libvorbis
  
        DURATION        : 00:00:21.496000000
  
  Input #1, mp3, from 'music/happy.mp3':
  
    Metadata:
  
      album           : Random
  
      genre           : Jazz & Blues
  
    Duration: 00:15:59.84, start: 0.025057, bitrate: 186 kb/s
  
      Stream #1:0: Audio: mp3, 44100 Hz, stereo, fltp, 186 kb/s
  
      Metadata:
  
        encoder         : LAME3.100
  
  Stream mapping:
  
    Stream #0:1 (vorbis) -> amix:input0
  
    Stream #1:0 (mp3float) -> amix:input1
  
    amix -> Stream #0:0 (libvorbis)
  
    Stream #0:0 -> #0:1 (copy)
  
  Press [q] to stop, [?] for help
  
  Output #0, matroska, to 'finished/2019-06-22/1561246948349/output.mkv':
  
    Metadata:
  
      encoder         : Lavf58.20.100
  
      Stream #0:0: Audio: vorbis (libvorbis) (oV[0][0] / 0x566F), 44100 Hz, stereo, fltp, 144 kb/s (default)
  
      Metadata:
  
        encoder         : Lavc58.35.100 libvorbis
  
      Stream #0:1: Video: h264 (High 4:4:4 Predictive) (H264 / 0x34363248), yuv422p(progressive), 2880x1800, q=2-31, 30 fps, 30 tbr, 1k tbn, 1k tbc (default)
  
      Metadata:
  
        ENCODER         : Lavc58.35.100 libx264
  
        DURATION        : 00:00:21.467000000
  
  frame=  640 fps=0.0 q=-1.0 Lsize=   15227kB time=00:00:21.46 bitrate=5810.3kbits/s speed=33.8x    
  
  video:14888kB audio:318kB subtitle:0kB other streams:0kB global headers:4kB muxing overhead: 0.139864%