Sur d’autres sites (3074)

• How to enable LHLS in FFMPEG 4.1 ?

  27 décembre 2020, par mehdi.r

  I am trying to create a low latency CMAF video stream using FFMPEG.
To do so, I would like to enable the lhls option in FFMPEG in order to have the #EXT-X-PREFETCH tag written in the HLS manifest.

  



  From the FFMPEG doc :

  



  https://www.ffmpeg.org/ffmpeg-all.html

  



  


  Enable Low-latency HLS(LHLS). Adds #EXT-X-PREFETCH tag with current >segment’s URI. Apple doesn’t have an official spec for LHLS. Meanwhile >hls.js player folks are trying to standardize a open LHLS spec. The >draft spec is available in https://github.com/video-dev/hlsjs->rfcs/blob/lhls-spec/proposals/0001-lhls.md This option will also try >to comply with the above open spec, till Apple’s spec officially >supports it. Applicable only when streaming and hls_playlist options >are enabled. This is an experimental feature.

  


  



  I am using the following command with FFMPEG 4.1 :

  



  ffmpeg -re -i ~/Documents/videos/BigBuckBunny.mp4 \
    -map 0 -map 0 -map 0 -c:a aac -c:v libx264 -tune zerolatency \
    -b:v:0 2000k -s:v:0 1280x720 -profile:v:0 high \
    -b:v:1 1500k -s:v:1 640x340  -profile:v:1 main \
    -b:v:2 500k -s:v:2 320x170  -profile:v:2 baseline \
    -bf 1 \
    -keyint_min 24 -g 24 -sc_threshold 0 -b_strategy 0 -ar:a:1 22050 -use_timeline 1 -use_template 1 \
    -window_size 5 -adaptation_sets "id=0,streams=v id=1,streams=a" \
    -hls_playlist 1 -seg_duration 1 -streaming 1  -strict experimental -lhls 1 -remove_at_exit 1 \
    -f dash manifest.mpd



  



  The kind of HLS manifest I obtained for a specific resolution :

  



  #EXTM3U
#EXT-X-VERSION:6
#EXT-X-TARGETDURATION:1
#EXT-X-MEDIA-SEQUENCE:8
#EXT-X-MAP:URI="init-stream0.mp4"
#EXTINF:0.998458,
#EXT-X-PROGRAM-DATE-TIME:2019-06-21T18:13:56.966+0900
chunk-stream0-00008.mp4
#EXTINF:0.998458,
#EXT-X-PROGRAM-DATE-TIME:2019-06-21T18:13:57.964+0900
chunk-stream0-00009.mp4
#EXTINF:0.998458,
#EXT-X-PROGRAM-DATE-TIME:2019-06-21T18:13:58.963+0900
chunk-stream0-00010.mp4
#EXTINF:0.998458,
#EXT-X-PROGRAM-DATE-TIME:2019-06-21T18:13:59.961+0900
chunk-stream0-00011.mp4
#EXTINF:1.021678,
#EXT-X-PROGRAM-DATE-TIME:2019-06-21T18:14:00.960+0900
chunk-stream0-00012.mp4
...



  



  As you can see the #EXT-X-PREFETCH tag is missing.

  



  Any help would be highly appreciated.

  



  Edit

  



  I also compiled FFmpeg from its master branch by doing the following :

  



  nasm

  



  sudo apt-get install nasm mingw-w64


  



  Codecs

  



  sudo apt-get install libx265-dev libnuma-dev libx264-dev libvpx-dev libfdk-aac-dev libmp3lame-dev libopus-dev


  



  FFmpeg

  



  mkdir lhls
cd lhls 
git init 
git clone https://github.com/FFmpeg/FFmpeg.git
cd FFmpeg 
git checkout master


  



  AOM (inside FFmpeg dir)

  



  git -C aom pull 2> /dev/null || git clone --depth 1 https://aomedia.googlesource.com/aom && \
mkdir -p aom_build && \
cd aom_build && \
PATH="$HOME/bin:$PATH" cmake -G "Unix Makefiles" -DCMAKE_INSTALL_PREFIX="$HOME/ffmpeg_build" -DENABLE_SHARED=off -DENABLE_NASM=on ../aom && \
PATH="$HOME/bin:$PATH" make && \
make install
cd..


  



  Compiling

  



  PATH="$HOME/bin:$PATH" PKG_CONFIG_PATH="$HOME/ffmpeg_build/lib/pkgconfig" ./configure \
  --prefix="$HOME/ffmpeg_build" \
  --pkg-config-flags="--static" \
  --extra-cflags="-I$HOME/ffmpeg_build/include" \
  --extra-ldflags="-L$HOME/ffmpeg_build/lib" \
  --extra-libs="-lpthread -lm" \
  --bindir="$HOME/bin" \
  --enable-gpl \
  --enable-libaom \
  --enable-libass \
  --enable-libfdk-aac \
  --enable-libfreetype \
  --enable-libmp3lame \
  --enable-libopus \
  --enable-libvorbis \
  --enable-libvpx \
  --enable-libx264 \
  --enable-libx265 \
  --enable-nonfree && \
PATH="$HOME/bin:$PATH" make 


  



  Unfortunately, the #EXT-X-PREFETCH is still missing in the HLS Manifest.

  



  I also tried nightly builds from https://ffmpeg.zeranoe.com/builds/ , same result.

  



  Any help would be highly appreciated.

  



  EDIT 2 :resolved

  



  Thanks to @aergistal and @Gyan , the #EXT-X-PREFETCH tag is now present in my HLS manifest.

  



  Here the FFMPEG command I am using :

  



  ./ffmpeg -re -i ~/videos/BigBuckBunny.mp4 -loglevel debug \
  -map 0 -map 0 -map 0 -c:a aac -c:v libx264 -tune zerolatency \
  -b:v:0 2000k -s:v:0 1280x720 -profile:v:0 high -b:v:1 1500k -s:v:1 640x340  -profile:v:1 main -b:v:2 500k -s:v:2 320x170  -profile:v:2 baseline -bf 1 \
 -keyint_min 24 -g 24 -sc_threshold 0 -b_strategy 0 -ar:a:1 22050 -use_timeline 1 -use_template 1 -window_size 5 \
 -adaptation_sets "id=0,streams=v id=1,streams=a" -hls_playlist 1 -seg_duration 3 -streaming 1 \
 -strict experimental -lhls 1 -remove_at_exit 0 -master_m3u8_publish_rate 3 \
 -f dash -method PUT -http_persistent 1  https://example.com/manifest.mpd


  



  Apparently the mime types are not passed to the server & FFmpeg seems to ignore the -headers option.

  


• FFMPEG command works on Mac but not on Windows [duplicate]

  24 décembre 2019, par Arthur

  This question is an exact duplicate of :

  • Creating video from images produces black screen video for certain image formats [duplicate]
    
    1 answer
    

  Hi I’m working on a project which needs to create animations by playing 2000 charts in 50 fps using FFMPEG, the command is :

  ffmpeg -y -framerate 50 -i img-%04d.png -vb 40M -vcodec h264 esez.mp4

  charts are located in the same folder with name as img-0001.png img-2000.png

  It worked well on my Mac. On Windows, the command can run and generate a mp4 file. But the animation is just black screen on Windows media player. I also tried open with VLC, it has some image, but not proper at all.

  log from Windows CMD :

  ffmpeg version git-2019-12-11-4110029 Copyright (c) 2000-2019 the FFmpeg developers
  
    built with gcc 9.2.1 (GCC) 20191125
  
    configuration: --enable-gpl --enable-version3 --enable-sdl2 --enable-fontconfig --enable-gnutls --enable-iconv --enable-libass --enable-libdav1d --enable-libbluray --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libtheora --enable-libtwolame --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libzimg --enable-lzma --enable-zlib --enable-gmp --enable-libvidstab --enable-libvorbis --enable-libvo-amrwbenc --enable-libmysofa --enable-libspeex --enable-libxvid --enable-libaom --enable-libmfx --enable-ffnvcodec --enable-cuvid --enable-d3d11va --enable-nvenc --enable-nvdec --enable-dxva2 --enable-avisynth --enable-libopenmpt --enable-amf
  
    libavutil      56. 36.101 / 56. 36.101
  
    libavcodec     58. 64.101 / 58. 64.101
  
    libavformat    58. 35.101 / 58. 35.101
  
    libavdevice    58.  9.101 / 58.  9.101
  
    libavfilter     7. 68.100 /  7. 68.100
  
    libswscale      5.  6.100 /  5.  6.100
  
    libswresample   3.  6.100 /  3.  6.100
  
    libpostproc    55.  6.100 / 55.  6.100
  
  Input #0, image2, from 'img-%04d.png':
  
    Duration: 00:00:40.18, start: 0.000000, bitrate: N/A
  
      Stream #0:0: Video: png, rgba(pc), 1000x800, 50 fps, 50 tbr, 50 tbn, 50 tbc
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (png (native) -> h264 (libx264))
  
  Press [q] to stop, [?] for help
  
  [libx264 @ 00000242aaacc6c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
  
  [libx264 @ 00000242aaacc6c0] profile High 4:4:4 Predictive, level 3.2, 4:4:4, 8-bit
  
  [libx264 @ 00000242aaacc6c0] 264 - core 158 - H.264/MPEG-4 AVC codec - Copyleft 2003-2019 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=4 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=abr mbtree=1 bitrate=40000 ratetol=1.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
  
  Output #0, mp4, to 'esez.mp4':
  
    Metadata:
  
      encoder         : Lavf58.35.101
  
      Stream #0:0: Video: h264 (libx264) (avc1 / 0x31637661), yuv444p, 1000x800, q=-1--1, 40000 kb/s, 50 fps, 12800 tbn, 50 tbc
  
      Metadata:
  
        encoder         : Lavc58.64.101 libx264
  
      Side data:
  
        cpb: bitrate max/min/avg: 0/0/40000000 buffer size: 0 vbv_delay: N/A
  
  frame= 2009 fps= 90 q=-1.0 Lsize=    7569kB time=00:00:40.12 bitrate=1545.6kbits/s speed= 1.8x
  
  video:7545kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.322921%
  
  [libx264 @ 00000242aaacc6c0] frame I:9     Avg QP: 0.35  size: 60878
  
  [libx264 @ 00000242aaacc6c0] frame P:511   Avg QP: 0.74  size:  5275
  
  [libx264 @ 00000242aaacc6c0] frame B:1489  Avg QP: 4.35  size:  3010
  
  [libx264 @ 00000242aaacc6c0] consecutive B-frames:  0.7%  0.7%  2.2% 96.4%
  
  [libx264 @ 00000242aaacc6c0] mb I  I16..4: 85.1%  1.6% 13.3%
  
  [libx264 @ 00000242aaacc6c0] mb P  I16..4:  0.7%  0.0%  0.2%  P16..4:  1.3%  0.8%  0.4%  0.0%  0.0%    skip:96.7%
  
  [libx264 @ 00000242aaacc6c0] mb B  I16..4:  0.0%  0.0%  0.0%  B16..8:  1.6%  0.7%  0.2%  direct: 0.1%  skip:97.2%  L0:48.2% L1:39.0% BI:12.8%
  
  [libx264 @ 00000242aaacc6c0] final ratefactor: -35.51
  
  [libx264 @ 00000242aaacc6c0] 8x8 transform intra:2.6% inter:5.9%
  
  [libx264 @ 00000242aaacc6c0] coded y,u,v intra: 12.9% 2.5% 2.6% inter: 0.9% 0.5% 0.6%
  
  [libx264 @ 00000242aaacc6c0] i16 v,h,dc,p: 84% 14%  2%  0%
  
  [libx264 @ 00000242aaacc6c0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 18%  2% 77%  0%  1%  1%  0%  0%  0%
  
  [libx264 @ 00000242aaacc6c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 36% 22% 19%  4%  4%  4%  4%  6%  2%
  
  [libx264 @ 00000242aaacc6c0] Weighted P-Frames: Y:0.0% UV:0.0%
  
  [libx264 @ 00000242aaacc6c0] ref P L0: 60.2%  0.7% 21.4% 17.7%
  
  [libx264 @ 00000242aaacc6c0] ref B L0: 72.6% 20.2%  7.3%
  
  [libx264 @ 00000242aaacc6c0] ref B L1: 88.4% 11.6%
  
  [libx264 @ 00000242aaacc6c0] kb/s:1538.15

  Could anybody please help me with this problem ?

  Happy Holiday to all !

• How to get audio peaks with FFmpeg ?

  2 septembre 2020, par hmak.me

  I am working on a music app and need to generate audio spectrum for my files. Like this one :

  



  

  



  So I tried using audiowaveform like this :

  



  audiowaveform -i music.mp3 --pixels-per-second 1 -o out.dat


  



  which gives me the following results[correct results] : [the first 10 words are meta data]

  



  0000000 0001 0000 0000 0000 bb80 0000 bb80 0000
0000020 00f9 0000 df3e 1fa2 e22c 1ef3 e0bb 1e5a
0000040 e099 1e88 dfcf 1c33 e29f 1d4c e055 1f80
0000060 df63 1e3a e1b4 1f31 e271 1d81 e0e5 1b1c
0000100 e06d 1be4 dee2 1cb0 e118 1da1 e026 1dea
0000120 e055 1dac df9b 1dbf e0c3 2063 ded4 21b2
0000140 dec9 1f8d de5b 20c8 e02d 216a dd7e 21af
0000160 dea1 20ac de6c 2170 de80 1e12 de6f 1fb9
0000200 dde3 2106 e0d9 21be de88 218c de81 1f9f
0000220 decb 20ff deb2 1edc df32 20c4 dde7 ...


  



  But when I do this kind of job with FFmpeg :

  



  ffmpeg -y -i music.mp3 -acodec pcm_s16le -f s16le -ac 1 -ar 1 -v quiet out.pcm


  



  that gives the following results, which is not same at all :

  



  0000000 0001 fffe fffe fffe 0000 ffff fffd 0000
0000020 ffff ffff fffe 0001 0001 fffd 0001 fffe
0000040 0002 fffe fffc 0002 ffff fffc fffe 000b
0000060 0007 fffb 0004 0001 ffff fffd ffff 0002
0000100 0008 0006 fffe ffff 0001 0000 0003 000a
0000120 fffd ffff 0004 ffff 0001 ffff fffd ffff
0000140 fffe ffff 0001 fffd fffe 0000 fffb 0002
0000160 0002 0000 fffe 0000 fffb fffe fffe 0000
0000200 ffff 0000 ffff fffc 0002 0003 0005 0003
0000220 0002 fffb fffb fffa fffa 0004 0009 ...


  



  You may wonder that why am i doing -ar 1 or --pixels-per-second 1 ? This is because I want to draw a line for each second, so I need to get peak for each second. . I don't know what am I missing there but I expect to get the same results from FFmpeg.