Sur d’autres sites (7118)

• what FFMPEG performance settings to use for processing videos for the web

  19 juin 2015, par eAbi

  I have a few questions regarding usage of ffmpeg for processing videos for the web. I’m a beginner so please bear with me (although I read some docs on the internet)

  Performance

  • First of all, given the fact that FFMPEG utilizes all cores at 100%, what is the actual parallelism efficiency ?

  Let’s assume the following scenario. I have a video (fullHD, doesn’t matter what encoders / compression format was used to obtain the video) and I want to resize (downscale) to various sizes (e.g. 240px, 480px and 720px height) using mp4 format (thus using libx264 with aac codecs).

  Using ffmpeg, I see that all of my laptop’s cores (8) are used at 100% and I was wondering what scenarios can improve the overall performance of the whole processing task. So this leads us to basically 2 scenarios : Assuming the video mentioned above as input, for obtaining the 3 output videos (@ 240px, 480px and 720px height sizes), we :

  1. Process input video and obtain 1 output video at a time, and let all the cores work at the same time at 100% ;
  2. Process the video to obtain all output videos in parallel, by bounding each output video to a single processor core which’ll work at 100% ;

  So the question is actually reduced to the parallelism efficiency of the ffmpeg program.

  This means that letting ffmpeg process the task procVideo - which takes 1 input video to produce 1 single output video (transcoding/downscaling and so on) - on N processor cores doesn’t mean it finish the task N times faster than letting it run the same task bound to a single core. So if the efficiency is smaller than 100%, it’s better to have N procVideo tasks in parallel, each bound to a single core, rather than doing the task sequentially for each output video.

  ---

  Codecs

  Other than the above performance problem, the usage of codecs bugs me. I am trying to obtain mp4 videos because of the wide implementation of the format in html5 browsers.

  So having a video as input in any format, I want to convert it to mp4. So I’m using libx264 codec with aac.

  • Use libx264, x264 or h264 for video encoding/decoding ?
  • Use libfdk_aac, libaacplus or aac for audio encoding/decoding to aac ?

  Also, I would like to know what are the licesing fees for each of the above codec, as the online resources on these are quite limited / hard to understand.

  If anyone could shed some light on those questions, I would really be grateful ! Thanks for your time !

• ffmpeg audio out of sync with video stacking

  3 avril 2024, par s0mbre

  The problem

  


  When trying to do horizontal stacking of two videos in ffmpeg, the combined audio track loses sync with the video on the second input. As far as I've look it up, this problem is very common, not to say notorious with ffmpeg.

  


  I do hstack muxing like this :

  


  ffmpeg -i 1.mp4 -i 2.mp4 -filter_complex \
"[0:v]scale=1280:-2,crop=w=640:h=720:x=0[v1]; \
[1:v]scale=1280:-2,crop=w=640:h=720:x=0[v2]; \
[v1][v2]hstack=shortest=1[v]; \
[0:a][1:a]amix=duration=shortest[a]" \
-map [v] -map [a] -c:v libx264 -c:a libmp3lame -r 30 -y stuff/out.mp4


  


  It encodes just fine as far as the hsplit goes. But the resulting video is out of sync with the audio : the second input (located on the right side in the resulting split) demonstrates about 3 sec. audio off-syncking, where the audio track is ahead of the picture. I realize this is somehow connected with the source videos' timestamps, but no popular remediation recipes helped (see below).

  


  What I expect

  


  I'd expect a resulting stacked video where the audio track is muxed with exact correspondence to the original input pictures.

  


  What I tried (all in vain !)

  


  Something I've tried but to no avail :

  


  

  1. Appending -async 1 option as suggested here and here

  


  2. Using the aresample=async=1 or aresample=async=1000 filter on each audio input as suggested here and here

  


  3. Padding each audio track with apad as suggested here

  


  4. Using the adelay=0 and adelay=[delay]s filters on the failing input

  


  5. Changing the audio codec to a number of alternatives (aac etc.)

  


  6. Infinite combinations of 1-5 above...

  


  


  What seems indeed to work is manual passing a delay value to the -itsoffset filter as suggested here and in the docs and using the offset track as an extra (pure audio) input. But how do I find the exact offset with a different set of videos ?

  


  In short, I am at a standstill after 7+ days of ravenous search-and-try.

  


• Grey squared artifacts after HEVC 10-bit encoding using FFmpeg's NVENC encoder

  20 juillet 2017, par Cryman

  Recently I purchased a brand new GPU - AORUS GeForce GTX 1080 Ti. I found out that it supports HEVC 10-bit encoding, so I wanted to give that a try. Unfortunately, after encoding I noticed some artifacts, which occur in dark scenes and last one frame of the video. You can see them on these screenshots :

  

  

  I was wondering if someone could help me figure out what might be the cause of these artifacts and how I can get rid of them.

  Here is the MI of the source video :

  ID                                       : 1
  
  Format                                   : AVC
  
  Format/Info                              : Advanced Video Codec
  
  Format profile                           : High@L4.1
  
  Format settings, CABAC                   : Yes
  
  Format settings, ReFrames                : 4 frames
  
  Codec ID                                 : V_MPEG4/ISO/AVC
  
  Duration                                 : 2 h 2 min
  
  Bit rate mode                            : Variable
  
  Bit rate                                 : 29.5 Mb/s
  
  Maximum bit rate                         : 37.0 Mb/s
  
  Width                                    : 1 920 pixels
  
  Height                                   : 1 080 pixels
  
  Display aspect ratio                     : 16:9
  
  Frame rate mode                          : Constant
  
  Frame rate                               : 23.976 (24000/1001) FPS
  
  Color space                              : YUV
  
  Chroma subsampling                       : 4:2:0
  
  Bit depth                                : 8 bits
  
  Scan type                                : Progressive
  
  Bits/(Pixel*Frame)                       : 0.593
  
  Stream size                              : 25.2 GiB (66%)
  
  Language                                 : English
  
  Default                                  : Yes
  
  Forced                                   : No

  And here is the MI of the encoded video :

  ID                                       : 1
  
  Format                                   : HEVC
  
  Format/Info                              : High Efficiency Video Coding
  
  Format profile                           : Main 10@L4@Main
  
  Codec ID                                 : V_MPEGH/ISO/HEVC
  
  Duration                                 : 2 h 2 min
  
  Bit rate                                 : 3 689 kb/s
  
  Width                                    : 1 920 pixels
  
  Height                                   : 800 pixels
  
  Display aspect ratio                     : 2.40:1
  
  Frame rate mode                          : Constant
  
  Frame rate                               : 23.976 (24000/1001) FPS
  
  Standard                                 : Component
  
  Color space                              : YUV
  
  Chroma subsampling                       : 4:2:0
  
  Bit depth                                : 10 bits
  
  Bits/(Pixel*Frame)                       : 0.100
  
  Stream size                              : 3.15 GiB (95%)
  
  Default                                  : Yes
  
  Forced                                   : No
  
  Color range                              : Limited

  The command I’m using for encoding :

  ffmpeg -hide_banner -i "" -map 0:v:0 -map_chapters -1 -map_metadata -1 -vf "crop=1920:800:0:140" -vcodec hevc_nvenc -pix_fmt p010le -preset hq -profile:v main10 -rc constqp -global_quality 21 -rc-lookahead 32 -g 240 -f matroska Video_CQP21_LAF32_GOP240.mkv