Recherche avancée

Sur d’autres sites (11987)

• avfilter/dnn : Refactor DNN parameter configuration system

  7 mai 2024, par Zhao Zhili

  avfilter/dnn : Refactor DNN parameter configuration system
  This patch trying to resolve mulitiple issues related to parameter
  
  configuration :
  Firstly, each DNN filters duplicate DNN_COMMON_OPTIONS, which should
  
  be the common options of backend.
  Secondly, backend options are hidden behind the scene. It's a
  
  AV_OPT_TYPE_STRING backend_configs for user, and parsed by each
  
  backend. We don't know each backend support what kind of options
  
  from the help message.
  Third, DNN backends duplicate DNN_BACKEND_COMMON_OPTIONS.
  Last but not the least, pass backend options via AV_OPT_TYPE_STRING
  
  makes it hard to pass AV_OPT_TYPE_BINARY to backend, if not impossible.
  This patch puts backend common options and each backend options inside
  
  DnnContext to reduce code duplication, make options user friendly, and
  
  easy to extend for future usecase.
  For example,
  ./ffmpeg -h filter=dnn_processing
  dnn_processing AVOptions :
  
     dnn_backend       <int>        ..FV....... DNN backend (from INT_MIN to INT_MAX) (default tensorflow)
  
       tensorflow      1            ..FV....... tensorflow backend flag
  
       openvino        2            ..FV....... openvino backend flag
  
       torch           3            ..FV....... torch backend flag
  dnn_base AVOptions :
  
     model             <string>     ..F........ path to model file
  
     input             <string>     ..F........ input name of the model
  
     output            <string>     ..F........ output name of the model
  
     backend_configs   <string>     ..F.......P backend configs (deprecated)
  
     options           <string>     ..F.......P backend configs (deprecated)
  
     nireq             <int>        ..F........ number of request (from 0 to INT_MAX) (default 0)
  
     async             <boolean>    ..F........ use DNN async inference (default true)
  
     device            <string>     ..F........ device to run model
  dnn_tensorflow AVOptions :
  
     sess_config       <string>     ..F........ config for SessionOptions
  dnn_openvino AVOptions :
  
     batch_size        <int>        ..F........ batch size per request (from 1 to 1000) (default 1)
  
     input_resizable   <boolean>    ..F........ can input be resizable or not (default false)
  
     layout            <int>        ..F........ input layout of model (from 0 to 2) (default none)
  
       none            0            ..F........ none
  
       nchw            1            ..F........ nchw
  
       nhwc            2            ..F........ nhwc
  
     scale             <float>      ..F........ Add scale preprocess operation. Divide each element of input by specified value. (from INT_MIN to INT_MAX) (default 0)
  
     mean              <float>      ..F........ Add mean preprocess operation. Subtract specified value from each element of input. (from INT_MIN to INT_MAX) (default 0)
  dnn_th AVOptions :
  
     optimize          <int>        ..F........ turn on graph executor optimization (from 0 to 1) (default 0)
  Signed-off-by : Zhao Zhili <zhilizhao@tencent.com>
  
  Reviewed-by : Wenbin Chen <wenbin.chen@intel.com>
  
  Reviewed-by : Guo Yejun <yejun.guo@intel.com>
  

  • [DH] libavfilter/dnn/dnn_backend_common.h
  • [DH] libavfilter/dnn/dnn_backend_openvino.c
  • [DH] libavfilter/dnn/dnn_backend_tf.c
  • [DH] libavfilter/dnn/dnn_backend_torch.cpp
  • [DH] libavfilter/dnn/dnn_interface.c
  • [DH] libavfilter/dnn_filter_common.c
  • [DH] libavfilter/dnn_filter_common.h
  • [DH] libavfilter/dnn_interface.h
  • [DH] libavfilter/vf_derain.c
  • [DH] libavfilter/vf_dnn_classify.c
  • [DH] libavfilter/vf_dnn_detect.c
  • [DH] libavfilter/vf_dnn_processing.c
  • [DH] libavfilter/vf_sr.c

• D3D11 hardware screen recording with ffmpeg using Intel H264 QSV hardware encoding

  13 mai 2024, par Cactus

  I'm trying to screen record using ffmpeg and having it all done via hardware on my Intel integrated graphics.

  


  Specs

  


  For reference, here are my specs :

  


  

  • Windows 11 Pro Version 10.0.22631 Build 22631

  


  • Model : Dell Inc. OptiPlex 3090

  


  • Processor : 11th Gen Intel(R) Core(TM) i3-1115G4 @ 3.00GHz, 2995 Mhz, 2 Core(s), 4 Logical Processor(s)

  


  • Terminal : Windows Terminal using Windows Powershell

  


  


  In this wiki, it looked like I could use the "Windows 8+ Desktop Duplication API" to be "directly encoded by a compatible hardware encoder" — so I thought that I could use h264_qsv to encode, allowing me to record without much performance overhead costs.

  


  Attempt 1

  


  I've tried copying one of the command examples, but it didn't work :

  


  ffmpeg -init_hw_device d3d11va -filter_complex ddagrab=0 


  


  Output :

  


  ffmpeg version 2024-05-02-git-71669f2ad5-full_build-www.gyan.dev Copyright (c) 2000-2024 the FFmpeg developers
  built with gcc 13.2.0 (Rev5, Built by MSYS2 project)
  configuration: --enable-gpl --enable-version3 --enable-static --disable-w32threads --disable-autodetect --enable-fontconfig --enable-iconv --enable-gnutls --enable-libxml2 --enable-gmp --enable-bzlib --enable-lzma --enable-libsnappy --enable-zlib --enable-librist --enable-libsrt --enable-libssh --enable-libzmq --enable-avisynth --enable-libbluray --enable-libcaca --enable-sdl2 --enable-libaribb24 --enable-libaribcaption --enable-libdav1d --enable-libdavs2 --enable-libuavs3d --enable-libxevd --enable-libzvbi --enable-librav1e --enable-libsvtav1 --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxeve --enable-libxvid --enable-libaom --enable-libjxl --enable-libopenjpeg --enable-libvpx --enable-mediafoundation --enable-libass --enable-frei0r --enable-libfreetype --enable-libfribidi --enable-libharfbuzz --enable-liblensfun --enable-libvidstab --enable-libvmaf --enable-libzimg --enable-amf --enable-cuda-llvm --enable-cuvid --enable-dxva2 --enable-d3d11va --enable-d3d12va --enable-ffnvcodec --enable-libvpl --enable-nvdec --enable-nvenc --enable-vaapi --enable-libshaderc --enable-vulkan --enable-libplacebo --enable-opencl --enable-libcdio --enable-libgme --enable-libmodplug --enable-libopenmpt --enable-libopencore-amrwb --enable-libmp3lame --enable-libshine --enable-libtheora --enable-libtwolame --enable-libvo-amrwbenc --enable-libcodec2 --enable-libilbc --enable-libgsm --enable-libopencore-amrnb --enable-libopus --enable-libspeex --enable-libvorbis --enable-ladspa --enable-libbs2b --enable-libflite --enable-libmysofa --enable-librubberband --enable-libsoxr --enable-chromaprint
  libavutil      59. 16.101 / 59. 16.101
  libavcodec     61.  5.103 / 61.  5.103
  libavformat    61.  3.103 / 61.  3.103
  libavdevice    61.  2.100 / 61.  2.100
  libavfilter    10.  2.101 / 10.  2.101
  libswscale      8.  2.100 /  8.  2.100
  libswresample   5.  2.100 /  5.  2.100
  libpostproc    58.  2.100 / 58.  2.100
Stream mapping:
  ddagrab:default -> Stream #0:0 (h264_qsv)
Press [q] to stop, [?] for help
Impossible to convert between the formats supported by the filter 'Parsed_ddagrab_0' and the filter 'auto_scale_0'
[fc#0 @ 000001e4ed4393c0] Error configuring filter graph: Function not implemented
[fc#0 @ 000001e4ed4393c0] Task finished with error code: -40 (Function not implemented)
[fc#0 @ 000001e4ed4393c0] Terminating thread with return code -40 (Function not implemented)
[vost#0:0/h264_qsv @ 000001e4ed454000] Could not open encoder before EOF
[vost#0:0/h264_qsv @ 000001e4ed454000] Task finished with error code: -22 (Invalid argument)
[vost#0:0/h264_qsv @ 000001e4ed454000] Terminating thread with return code -22 (Invalid argument)
[out#0/matroska @ 000001e4ed453280] Nothing was written into output file, because at least one of its streams received no packets.
frame=    0 fps=0.0 q=0.0 Lsize=       0KiB time=N/A bitrate=N/A speed=N/A
Conversion failed!


  


  Attempt 2

  


  I then tried copying one of the command examples in the linked ddagrab wiki page, but also no luck.

  


  ffmpeg -f lavfi -i ddagrab -c:v h264_qsv output.mkv


  


  Output :

  


  ffmpeg version 2024-05-02-git-71669f2ad5-full_build-www.gyan.dev Copyright (c) 2000-2024 the FFmpeg developers
  built with gcc 13.2.0 (Rev5, Built by MSYS2 project)
  configuration: --enable-gpl --enable-version3 --enable-static --disable-w32threads --disable-autodetect --enable-fontconfig --enable-iconv --enable-gnutls --enable-libxml2 --enable-gmp --enable-bzlib --enable-lzma --enable-libsnappy --enable-zlib --enable-librist --enable-libsrt --enable-libssh --enable-libzmq --enable-avisynth --enable-libbluray --enable-libcaca --enable-sdl2 --enable-libaribb24 --enable-libaribcaption --enable-libdav1d --enable-libdavs2 --enable-libuavs3d --enable-libxevd --enable-libzvbi --enable-librav1e --enable-libsvtav1 --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxeve --enable-libxvid --enable-libaom --enable-libjxl --enable-libopenjpeg --enable-libvpx --enable-mediafoundation --enable-libass --enable-frei0r --enable-libfreetype --enable-libfribidi --enable-libharfbuzz --enable-liblensfun --enable-libvidstab --enable-libvmaf --enable-libzimg --enable-amf --enable-cuda-llvm --enable-cuvid --enable-dxva2 --enable-d3d11va --enable-d3d12va --enable-ffnvcodec --enable-libvpl --enable-nvdec --enable-nvenc --enable-vaapi --enable-libshaderc --enable-vulkan --enable-libplacebo --enable-opencl --enable-libcdio --enable-libgme --enable-libmodplug --enable-libopenmpt --enable-libopencore-amrwb --enable-libmp3lame --enable-libshine --enable-libtheora --enable-libtwolame --enable-libvo-amrwbenc --enable-libcodec2 --enable-libilbc --enable-libgsm --enable-libopencore-amrnb --enable-libopus --enable-libspeex --enable-libvorbis --enable-ladspa --enable-libbs2b --enable-libflite --enable-libmysofa --enable-librubberband --enable-libsoxr --enable-chromaprint
  libavutil      59. 16.101 / 59. 16.101
  libavcodec     61.  5.103 / 61.  5.103
  libavformat    61.  3.103 / 61.  3.103
  libavdevice    61.  2.100 / 61.  2.100
  libavfilter    10.  2.101 / 10.  2.101
  libswscale      8.  2.100 /  8.  2.100
  libswresample   5.  2.100 /  5.  2.100
  libpostproc    58.  2.100 / 58.  2.100
Input #0, lavfi, from 'ddagrab':
  Duration: N/A, start: 0.000000, bitrate: N/A
  Stream #0:0: Video: wrapped_avframe, d3d11, 1920x1080 [SAR 1:1 DAR 16:9], 30 fps, 30 tbr, 1000k tbn
File 'output.mkv' already exists. Overwrite? [y/N] y
Stream mapping:
  Stream #0:0 -> #0:0 (wrapped_avframe (native) -> h264 (h264_qsv))
Press [q] to stop, [?] for help
Impossible to convert between the formats supported by the filter 'Parsed_null_0' and the filter 'auto_scale_0'
[vf#0:0 @ 00000115e105bd40] Error reinitializing filters!
[vf#0:0 @ 00000115e105bd40] Task finished with error code: -40 (Function not implemented)
[vf#0:0 @ 00000115e105bd40] Terminating thread with return code -40 (Function not implemented)
[vost#0:0/h264_qsv @ 00000115e105aa00] Could not open encoder before EOF
[vost#0:0/h264_qsv @ 00000115e105aa00] Task finished with error code: -22 (Invalid argument)
[vost#0:0/h264_qsv @ 00000115e105aa00] Terminating thread with return code -22 (Invalid argument)
[out#0/matroska @ 00000115e1054b80] Nothing was written into output file, because at least one of its streams received no packets.
frame=    0 fps=0.0 q=0.0 Lsize=       0KiB time=N/A bitrate=N/A speed=N/A
Conversion failed!


  


  My main problem is that I don't know how to use really any of these encoders and the examples I've found above don't work with me. What command should I use to screen record all with hardware acceleration on my Intel system ? I don't care about any presets or other options at the moment.

  


  Is there also a way to record audio ? When I tried to use -f dshow -i audio="Stereo Mix (Realtek(R) Audio)" by itself, which I made sure was turned on in Windows' settings and named correctly, it didn't work (is it because I'm using Bluetooth headphones that isn't connected to Realtek's system ?). Should this question be made separately than this one ?

  


• Is ffmpeg a good upscaler from SD to HD ? [closed]

  15 août 2014, par user3928079

  Is ffmpeg a good upscaler to convert SD videos to HD ?

  I use the AVANTI GUI. I installed it and put the ffmpeg and ffplay exe into the folder ffmpeg in the program folder. What I know is that you can only preserve the detail when you upscale from SD to HD. You don’t really gain any additional information. TV companies like Samsung, Sony, LG, Panasonic, Sharp, and others refuse to think so and push the boundaries of upscaling so that additional information can be added when the image is upscaled from SD to HD and HD to 4K and so on and so forth. I’ve run a test through the AVANTI ffmpeg GUI.

  Codec : XVID to H.264
  Bitrate : 1640 kbps to 6000 kbps
  Resolution : 640x480 to 1440x1080
  Format : AVI to M4V
  Audio Codec : AC3 to AAC
  Audio Bitrate : 192 kbps
  Audio Frequency : 48000 Hz
  Upscale method : Spline

  Will this upscale method work in any way with converting SD video to HD video. There’s a lot of SD content out that haven’t made the transition to, or probably never will be, HD.