Recherche avancée

Sur d’autres sites (4553)

• Audio/Video out of sync when recording

  26 avril 2021, par spindi598

  I am recording the desktop with gdigrab and the audio with dshow, but they are out of sync.

  



  This is the first thing I tried, there was always about the same delay (about 20-30 frames) :

  



  // Command
ffmpeg -f dshow -i audio="Microphone (NVIDIA RTX Voice)" -f gdigrab -framerate 60 -offset_x 0 -offset_y 0 -video_size 1920x1080 -i desktop -c:v h264 -preset ultrafast -qp 0 C:\Videos\test2.mp4

// Bottom of debug log
Input file #0 (audio=Microphone (NVIDIA RTX Voice)):
  Input stream #0:0 (audio): 15 packets read (1323000 bytes); 15 frames decoded (330750 samples);
  Total: 15 packets (1323000 bytes) demuxed
Input file #1 (desktop):
  Input stream #1:0 (video): 223 packets read (1849663242 bytes); 223 frames decoded;
  Total: 223 packets (1849663242 bytes) demuxed
Output file #0 (C:\Videos\test2.mp4):
  Output stream #0:0 (video): 243 frames encoded; 243 packets muxed (211227447 bytes);
  Output stream #0:1 (audio): 322 frames encoded (329728 samples); 323 packets muxed (120103 bytes);
  Total: 566 packets (211347550 bytes) muxed
238 frames successfully decoded, 0 decoding errors
[AVIOContext @ 0000028163c9c040] Statistics: 2 seeks, 810 writeouts


  



  The second thing I tried I believe fixed the audio sync issue, but I can really tell because it made the recording very laggy :

  



  // Command
ffmpeg -f gdigrab -framerate 60 -offset_x 0 -offset_y 0 -video_size 1920x1080 -i desktop -f dshow -i audio="Microphone (NVIDIA RTX Voice)" -c:v h264 -preset ultrafast -qp 0 C:\Videos\test2.mp4

// Bottom of debug log
Input file #0 (desktop):
  Input stream #0:0 (video): 112 packets read (928978848 bytes); 112 frames decoded;
  Total: 112 packets (928978848 bytes) demuxed
Input file #1 (audio=Microphone (NVIDIA RTX Voice)):
  Input stream #1:0 (audio): 12 packets read (1058400 bytes); 12 frames decoded (264600 samples);
  Total: 12 packets (1058400 bytes) demuxed
Output file #0 (C:\Videos\test2.mp4):
  Output stream #0:0 (video): 388 frames encoded; 388 packets muxed (109408287 bytes);
  Output stream #0:1 (audio): 258 frames encoded (264192 samples); 259 packets muxed (96404 bytes);
  Total: 647 packets (109504691 bytes) muxed
124 frames successfully decoded, 0 decoding errors
[AVIOContext @ 0000019da713c040] Statistics: 2 seeks, 421 writeouts


  



  How can I sync the audio and video ?

  



  It turns out it is only the microphone that has the delay, I tried using virtual-audio-capturer device and the audio synced perfectly, but that is only the desktop audio and not the mic.

  


• FFmpeg Impossible to convert between the formats supported by the filter

  17 avril 2020, par Changer098

  I'm trying to do GPU accelerated HDR tonemapping (HDR->SDR) with ffmpeg and opencl, but I keep running into this error : Impossible to convert between the formats supported by the filter 'Parsed_hwupload_1' and the filter 'auto_scaler_1'.
  
I've tried using the documentation filtergraph with this command

  



  ffmpeg -loglevel debug -y -hwaccel cuvid -init_hw_device opencl:0.0 -threads 1 -i \ 
hdr.mkv -filter_complex
"format=p010,hwupload,tonemap_opencl=t=bt2020:tonemap=linear:format=p010, \
hwdownload,format=p010" \
-c:a copy -scodec copy -c:v hevc_nvenc -preset slow -level 5.1 -rc:v vbr_hq -cq:v \
 19 -b:v 17500k \
-maxrate:v 22000k ~/Desktop/sdr.mkv


  



  which results in this log

  



  Applying option init_hw_device (initialise hardware device) with argument opencl:0.0.
[AVHWDeviceContext @ 0x5587b5542fc0] 1 OpenCL platforms found.
[AVHWDeviceContext @ 0x5587b5542fc0] 1 OpenCL devices found on platform "NVIDIA CUDA".
[AVHWDeviceContext @ 0x5587b5542fc0] 0.0: NVIDIA CUDA / Graphics Device
[AVHWDeviceContext @ 0x5587b5542fc0] The cl_intel_va_api_media_sharing extension is required for QSV to OpenCL mapping.
[AVHWDeviceContext @ 0x5587b5542fc0] QSV to OpenCL mapping not usable.
{{ Shortened }}
[hevc @ 0x5587b60c8e00] Initializing CUDA frames context: sw_format = yuv420p10le, width = 3840, height = 2160
[AVHWFramesContext @ 0x5587b7573f00] Pixel format 'yuv420p10le' is not supported
[hevc @ 0x5587b60c8e00] Error initializing a CUDA frame pool
cuvid hwaccel requested for input stream #0:0, but cannot be initialized.
[hevc @ 0x5587b60c8e00] Error parsing NAL unit #6.
Error while decoding stream #0:0: Operation not permitted
{{ Shortened }}
[Parsed_format_0 @ 0x5587b6330c40] Setting 'pix_fmts' to value 'p010'
[Parsed_tonemap_opencl_2 @ 0x5587b632d3c0] Setting 't' to value 'bt2020'
[Parsed_tonemap_opencl_2 @ 0x5587b632d3c0] Setting 'tonemap' to value 'linear'
[Parsed_tonemap_opencl_2 @ 0x5587b632d3c0] Setting 'format' to value 'p010'
[Parsed_format_4 @ 0x5587b6331d40] Setting 'pix_fmts' to value 'p010'
[graph 0 input from stream 0:0 @ 0x5587b6359f40] Setting 'video_size' to value '3840x2160'
[graph 0 input from stream 0:0 @ 0x5587b6359f40] Setting 'pix_fmt' to value '64'
[graph 0 input from stream 0:0 @ 0x5587b6359f40] Setting 'time_base' to value '1/1000'
[graph 0 input from stream 0:0 @ 0x5587b6359f40] Setting 'pixel_aspect' to value '1/1'
[graph 0 input from stream 0:0 @ 0x5587b6359f40] Setting 'frame_rate' to value '24000/1001'
[graph 0 input from stream 0:0 @ 0x5587b6359f40] w:3840 h:2160 pixfmt:yuv420p10le tb:1/1000 fr:24000/1001 sar:1/1
[format @ 0x5587b6359e00] Setting 'pix_fmts' to value 'yuv420p|nv12|p010le|yuv444p|p016le|yuv444p16le|bgr0|rgb0|cuda'
[auto_scaler_0 @ 0x5587b7581a00] w:iw h:ih flags:'bilinear' interl:0
[Parsed_format_0 @ 0x5587b6330c40] auto-inserting filter 'auto_scaler_0' between the filter 'graph 0 input from stream 0:0' and the filter 'Parsed_format_0'
[auto_scaler_1 @ 0x5587b634e8c0] w:iw h:ih flags:'bilinear' interl:0
[Parsed_tonemap_opencl_2 @ 0x5587b632d3c0] auto-inserting filter 'auto_scaler_1' between the filter 'Parsed_hwupload_1' and the filter 'Parsed_tonemap_opencl_2'
Impossible to convert between the formats supported by the filter 'Parsed_hwupload_1' and the filter 'auto_scaler_1'
Error reinitializing filters!
Failed to inject frame into filter network: Function not implemented
Error while processing the decoded data for stream #0:0


  



  I'm using cuvid because I haven't been able to get ffmpeg to compile with nvdec support even though my GPU supports it. Any help would be appreciated !

  


• FFMPEG RTX 8000 out of memory

  23 juin 2020, par Mahdi Adnan

  I have an RTX 8000 and I'm using FFMPEG to transcode multiple streams concurrently.
Each stream consume around 575MiB, and when the memory usage reaches around 28000MiB, FFMPEG throw the following message when starting a new transcode session :

  



  [h264_nvenc @ 0x55cd1d574800] dl_fn->cuda_dl->cuCtxCreate(&ctx->cu_context_internal, 0, cu_device) failed -> CUDA_ERROR_OUT_OF_MEMORY : out of memory
[h264_nvenc @ 0x55cd1d574800] No NVENC capable devices found
Error initializing output stream 2:0 — Error while opening encoder for output stream #2:0 - maybe incorrect parameters such as bit_rate, rate, width or height

  



  The machine is running Ubuntu 20.04
FFMPEG is a snap package from Ubuntu repo "version 4.2.2-1ubuntu1"
nVidia driver nvidia-driver-435 installed from Ubuntu repo

  



  command used for the transcode :
ffmpeg -i SRC -c:v h264_cuvid -vcodec h264_nvenc -preset:v medium -profile:v main -vf "scale=1920 :-2" -hls_flags delete_segments -hls_init_time 4 -hls_time 4 -maxrate 6000k -g 100 -bufsize 12000k -b:v 3000k -start_number 1 -async 1 -c:a aac -b:a 128k 1080.m3u8

  



  Is the RTX 8000 have any limitation on the Memory usage ? are the parameters I'm using causing this issue ?

  



  Thanks