Sur d’autres sites (6300)

• when ffpmeg drops frames some things aren't played back in real time

  8 février 2024, par Alex028502

  I am trying to run a bunch of ffpmeg processes that act as simulators for cameras, and something funny is happening when I the processor can't keep up with the configured frame rate.

  


  I have replaced the rtsp stream with an output file, and managed to reproduce the issue, so will just show that to keep it simple.

  


  First here is a makefile that creates my source movie :

  


  clock.mp4: Makefile
    rm -f $@
    ffmpeg -f lavfi -i color=c=black:s=4096x2160:r=25 -vf \
"drawtext=fontfile=/usr/share/fonts/truetype/dejavu/DejaVuSans-Bold.ttf:fontsize=72:fontcolor=white:x=(w-text_w)/2:y=(h-text_h)/2: \
text='%{eif\:trunc(n/25)\:d}':start_number=0:rate=25" \
-t 60 -r 25 $@


  


  that gives me a one minute long movie that prints the second number to the screen. I have tested it out and the seconds are close enough. I put a lot of pixels to make it easier to jam up my CPU.

  


  Here is the script that creates a processes similar to the one I am trying to debug (called experiment.sh)

  


  I am actually using H.264, but H.265 is easier to overwhelm the processor with

  


  #! /usr/bin/env bash

set -e

echo starting > message$1.txt

rm -f superclock$1.mp4
ffmpeg -re -stream_loop -1 -i clock.mp4 \
       -an -vcodec libx265 -preset ultrafast -sc_threshold -1 -x265-params repeat-headers=1 \
       -vf "drawtext=fontfile=/usr/share/fonts/truetype/dejavu/DejaVuSans-Bold.ttf:fontsize=24:fontcolor=white:x=10:y=10:text='%{localtime\:%X}', \
            drawtext=fontfile=/usr/share/fonts/truetype/dejavu/DejaVuSans-Bold.ttf:fontsize=24:fontcolor=white:x=10:y=(h-text_h-10):textfile=message$1.txt:reload=1, \
            scale=1920x1080,fps=25" \
       -b:v 3M -minrate 3M -maxrate 3M \
       -bufsize 6M -g 25 superclock$1.mp4 &
pid=$!

for x in $(seq 0 10)
do
    echo $x > message$1.txt
    sleep 10
done

kill -INT $pid || true


  


  It should

  


  

  • put the second in the middle of the screen - 'cause it gets it from the source video

  


  • put the approximate sixth of minute in the lower left corner
(only approximate because of the sleep but close enough)

  


  • put the the wall clock time in the upper left corner

  


  


  and it works

  


  make clock.mpg
./experiment.sh 0
vlc superclock0.mp4


  


  shows something like this


  


  Now here is the interesting part

  


  If I run the script in four different terminals at the same time

  


  ./experiment.sh 1
./experiment.sh 2
./experiment.sh 3
./experiment.sh 4


  


  It can't keep up with the frame rate, and I see this in the output :

  


  frame= 1515 fps= 16 q=0.0 size=     768kB time=00:00:59.96 bitrate= 104.9k


  


  I was hoping the end result would all look ok when I watch it except with fewer frames, but the timestamps of the frames would make it all work as expected

  


  However...

  


  

  • The time in the middle, that is inherited from the source video, the seconds in the middle of the screen, stays in sync with VLC's clock.

  


  • the wall clock in the upper left seems play at 150% speed

  


  • the every ten seconds incrementor in the lower left seems to increment every 7 seconds

  


  • the video is only 1:25 long even though it was recording for at least 1:40 according to sleeps

  


  • the wall clock in the upper right hand corner makes it more than 1'40" and then counter in the lower left makes it to 10.

  


  


  

  


  Here are four states to compare

  


  |                  | Start    | 30" in   | end      |
|------------------+----------+----------|----------|
| Video Time       | 00:00    | 00:30    | 01:24    |
| Wall Clock Time  | 15:05:50 | 15:06:39 | 15:07:39 |
| sixth of minute  | 0        | 4        | 10       |
| seconds counter  | 0        | 30       | 24       |


  


  

  


  So you can see the vlc clock keeps pace with the original clock from the source movie.. even when it is only able to produce frames at 2/3 of the rate. However, the it is taking 50% long to get through the whole source movie I guess ?

  


  I am having trouble coming up with a theory that can explain exactly how this happens.

  


  Does anybody know how I can "correct" this ? (make it so that the movie is played at the same rate that it is recorded)

  


  I am thinking of using a lower frame rate and size as the input video.. but it would be nice to have something that will always work as expected, just with a lower frame rate, no matter how busy the processor is.

  


• scale_vulkan : add support for basic Debayering

  11 juillet, par Lynne

  scale_vulkan : add support for basic Debayering
  

  • [DH] libavfilter/vf_scale_vulkan.c
  • [DH] libavfilter/vulkan/Makefile
  • [DH] libavfilter/vulkan/debayer.comp

• Subprocess doesn't return expected result

  8 avril 2023, par Gren Man

  Subprocess doesn't return expected result

  


  I have been trying getting info from video files using ffprobe

  


  But I stumbled upon unexpected results, here are some test I've done

  


  First test

  


  # ffprobe -v error -select_streams v:0 -show_entries stream=height,width -of csv=s=x:p=0 
proc = subprocess.Popen(['ffprobe', '-v', 'error', '-select_streams', 'v:0', '-show_entries', 
       'stream=height,width', '-of', 'csv=s=x:p=0 ', video_path],
       stdout=subprocess.PIPE, stdin=subprocess.PIPE)

# proc.stdout.read() Returns  b'widthXheightt\r\n'
v_resolution = proc.stdout.read().decode('utf-8').replace('\r', '').replace('\n', '')
# Result 'widthXheight'


  


  First test was successful.

  


  Second test

  


  # ffprobe -v error -select_streams v:0 -show_entries stream=display_aspect_ratio -of default=noprint_wrappers=1:nokey=1
proc = subprocess.Popen(['ffprobe', '-v', 'error', '-select_streams', 'v:0', '-show_entries',
       'stream=display_aspect_ratio','-of default=noprint_wrappers=1:nokey=1', video_path],
       stdout=subprocess.PIPE, stdin=subprocess.PIPE)

# proc.stdout.read() Returns b''
a_r = proc.stdout.read().decode('utf-8').replace('\r', '').replace('\n', '')
# Result ''


  


  Hmm, this doesn't sounds right I thought result should be e.g. 16:9

  


  I tried putting code to CMD which returned aforementioned result

  


  Third test

  


  # ffprobe -v error -select_streams v -of default=noprint_wrappers=1:nokey=1 -show_entries stream=r_frame_rate
proc = subprocess.Popen(['ffprobe', '-v', 'error', '-select_streams', 'v', '-of',
       'default=noprint_wrappers=1:nokey=1','-show_entries', 'stream=r_frame_rate',
       video_path], stdout=subprocess.PIPE, stdin=subprocess.PIPE)

# proc.stdout.read() Returns b'30/1'
fps = proc.stdout.read().decode('utf-8').replace('\r', '').replace('\n', '') + ' fps'
# Result 30/1 fps


  


  Just as expected this returned subarashi result

  


  But what happened in a second test ? Can somebody explain it to me ? I used stderr which returned :

  


  Failed to set value 'foo.mp4' for option 'of default=noprint_wrappers=1:nokey=1': Option not found


  


  Result of python code