Recherche avancée

Sur d’autres sites (7562)

• lavfi/vf_libplacebo : allow fps conversion

  7 mai 2023, par Niklas Haas

  lavfi/vf_libplacebo : allow fps conversion
  This exposes libplacebo's frame mixing functionality to vf_libplacebo,
  
  by allowing users to specify a desired target fps to output at. Incoming
  
  frames will be smoothly resampled (in a manner determined by the
  
  `frame_mixer` option, to be added in the next commit).
  To generate a consistently timed output stream, we directly use the
  
  desired framerate as the timebase, and simply output frames in
  
  sequential order (tracked by the number of frames output so far).
  

  • [DH] doc/filters.texi
  • [DH] libavfilter/vf_libplacebo.c

• Using 'overlay_cuda' in ffmpeg with transparency in input frames

  16 mai 2023, par time4tea

  I'm trying to overlay a full frame image on top of an MP4, in ffmpeg, using as much hardware-assistance as possible.

  


  This is for https://github.com/time4tea/gopro-dashboard-overlay

  


  I have the non-GPU overlay working totally fine, and would like to take advantage of the GPU now.

  


  The inputs to ffmpeg are :

  


  

  • a stream from an MP4 file - with 1 audio and 1 video stream

  


  • frames from the dashboard software, which are supplied as raw RGBA frames, at the same frame size as the movie.

  


  


  I've managed to get the overlay sort of working using the nvidia extensions, but it doesn't work as it uses nv12 frame formats which don't have any idea of transparency (AFAIK) so the overlaid frame completely obscures the movie frame - makes sense.

  


  The incantation that does this is (put on separate lines to try to keep the different sections - inputs / transforms / outputs - obvious) :

  


  ffmpeg -y -report -hide_banner -loglevel info 
-hwaccel cuda -hwaccel_output_format cuda 
-i movie.mp4 
-f rawvideo -framerate 10.0 -s 1024x576 -pix_fmt rgba -i - 
-filter_complex [0:v]null[mp4_stream];[1:v]format=nv12,hwupload_cuda[overlay_stream];[mp4_stream][overlay_stream]overlay_cuda,hwdownload,format=nv12 
-vcodec h264_nvenc 
-rc:v cbr -b:v 20M -bf:v 3 -profile:v high -spatial-aq true 
-movflags faststart 
output.mp4


  


  When i try to use yuva420p (which I believe is the correct format, but happy to be corrected) - in all various different places, for example :

  


  ffmpeg -y -report -hide_banner -loglevel info 
-hwaccel cuda -hwaccel_output_format yuva420p 
-i movie.mp4 
-f rawvideo -framerate 10.0 -s 1024x576 -pix_fmt rgba -i - 
-filter_complex [0:v]null[mp4_stream];[1:v]format=yuva420p,hwupload_cuda[overlay_stream];[mp4_stream][overlay_stream]overlay_cuda,hwdownload,format=yuva420p -vcodec h264_nvenc 
-rc:v cbr -b:v 20M -bf:v 3 -profile:v high -spatial-aq true -movflags faststart output.mp4



  


  I get flavours of the same error message :

  


  Impossible to convert between the formats supported by the filter 'Parsed_null_0' and the filter 'auto_scaler_1'

  


  AIUI - auto scalers are inserted into the pipeline when things don't match resolutions or formats - but here everything should match ?

  


  Using a filter_complex of [1:v]format=yuva420p,hwupload_cuda[overlay_stream];[0:v][overlay_stream]overlay_cuda,hwdownload,format=yuva420p i.e not using a null filter, which I put in just to make quickly changing filters easy, has the same error.

  


  Impossible to convert between the formats supported by the filter 'graph 0 input from stream 0:0' and the filter 'auto_scaler_1'

  


  I have looked at the suggested similar questions, and they don't appear to solve the problem for me.

  


  Thanks for any suggestions !

  


• Programming filter_complex graph in ffmpeg to enable 'overaly_cuda' with transparency in input frames [closed]

  16 mai 2023, par time4tea

  I'm trying to overlay a full frame image on top of an MP4, in ffmpeg, using as much hardware-assistance as possible.

  


  This is for https://github.com/time4tea/gopro-dashboard-overlay

  


  I have the non-GPU overlay working totally fine, and would like to take advantage of the GPU now.

  


  The inputs to ffmpeg are :

  


  

  • a stream from an MP4 file - with 1 audio and 1 video stream

  


  • frames from the dashboard software, which are supplied as raw RGBA frames, at the same frame size as the movie.

  


  


  I've managed to get the overlay sort of working using the nvidia extensions, but it doesn't work as it uses nv12 frame formats which don't have any idea of transparency (AFAIK) so the overlaid frame completely obscures the movie frame - makes sense.

  


  The incantation that does this is (put on separate lines to try to keep the different sections - inputs / transforms / outputs - obvious) :

  


  ffmpeg -y -report -hide_banner -loglevel info 
-hwaccel cuda -hwaccel_output_format cuda 
-i movie.mp4 
-f rawvideo -framerate 10.0 -s 1024x576 -pix_fmt rgba -i - 
-filter_complex [0:v]null[mp4_stream];[1:v]format=nv12,hwupload_cuda[overlay_stream];[mp4_stream][overlay_stream]overlay_cuda,hwdownload,format=nv12 
-vcodec h264_nvenc 
-rc:v cbr -b:v 20M -bf:v 3 -profile:v high -spatial-aq true 
-movflags faststart 
output.mp4


  


  When i try to use yuva420p (which I believe is the correct format, but happy to be corrected) - in all various different places, for example :

  


  ffmpeg -y -report -hide_banner -loglevel info 
-hwaccel cuda -hwaccel_output_format yuva420p 
-i movie.mp4 
-f rawvideo -framerate 10.0 -s 1024x576 -pix_fmt rgba -i - 
-filter_complex [0:v]null[mp4_stream];[1:v]format=yuva420p,hwupload_cuda[overlay_stream];[mp4_stream][overlay_stream]overlay_cuda,hwdownload,format=yuva420p -vcodec h264_nvenc 
-rc:v cbr -b:v 20M -bf:v 3 -profile:v high -spatial-aq true -movflags faststart output.mp4


  


  I get flavours of the same error message :

  


  Impossible to convert between the formats supported by the filter 'Parsed_null_0' and the filter 'auto_scaler_1'


  


  AIUI - auto scalers are inserted into the pipeline when things don't match resolutions or formats - but here everything should match ?

  


  Using a filter_complex of [1:v]format=yuva420p,hwupload_cuda[overlay_stream];[0:v][overlay_stream]overlay_cuda,hwdownload,format=yuva420p i.e not using a null filter, which I put in just to make quickly changing filters easy, has the same error.

  


  Impossible to convert between the formats supported by the filter 'graph 0 input from stream 0:0' and the filter 'auto_scaler_1'