Recherche avancée

Sur d’autres sites (7108)

• Multiple format changes in FFmpeg for thermal camera

  6 février 2023, par Greynol4

  I'm having trouble generating a command to process output from a uvc thermal camera's raw data so that it can be colorized and then output to a virtual device with the intention of streaming it over rtsp. This is on a raspberry pi 3B+ with 32bit bullseye.

  


  The original code that works perfectly for previewing it is :

  


  ffmpeg -input_format yuyv422 -video_size 256x384 -i /dev/video0 -vf 'crop=h=(ih/2):y=(ih/2)' -pix_fmt yuyv422 -f rawvideo - | ffplay -pixel_format gray16le -video_size 256x192 -f rawvideo -i - -vf 'normalize=smoothing=10, format=pix_fmts=rgb48, pseudocolor=p=inferno'


  


  Essentially what this is doing is taking the raw data, cutting the useful portion out, then piping it to ffplay where it is seen as 16bit grayscale (in this case gray16le), then it is normalized, formatted to 48 bit rgb and then a pseudocolor filter is applied.

  


  I haven't been able to get this to translate into ffmpeg-only because it throws codec errors or format errors or converts the 16bit to 10bit even though I need the 16bit. I have tried using v4l2loopback and two instances of ffmpeg in separate windows to see if I could figure out where the error was actually occuring but I suspect that is introducing more format issues that are distracting from the original problem. The closest I have been able to get is

  


  ffmpeg -input_format yuyv422 -video_size 256x384 -i /dev/video0 -vf 'crop=h=(ih/2):y=(ih/2)' -pix_fmt yuyv422 -f rawvideo /dev/video3

  


  Followed by

  


  ffmpeg -video_size 256x192 -i /dev/video3  -f rawvideo -pix_fmt gray16le -vf 'normalize=smoothing=10,format=pix_fmts=rgb48, pseudocolor=p=inferno' -f rawvideo -f v4l2 /dev/video4

  


  This results in a non colorized but somewhat useful image with certain temperatures showing as missing pixels as opposed to the command with ffplay where it shows a properly colorized stream without missing pixels.

  


  I'll include my configuration and log from the preview command but the log doesn't show errors unless I try to modify parameters and presumably mess up the syntax.

  


   ffmpeg -input_format yuyv422 -video_size 256x384 -i /dev/video0 -vf 'crop=h=(ih/2):y=(ih/2)' -pix_fmt yuyv422 -f rawvideo - | ffplay -pixel_format gray16le -video_size 256x192 -f rawvideo -i - -vf 'normalize=smoothing=10, format=pix_fmts=rgb48, pseudocolor=p=inferno'
ffplay version N-109758-gbdc76f467f Copyright (c) 2003-2023 the FFmpeg developers
  built with gcc 10 (Raspbian 10.2.1-6+rpi1)
  configuration: --prefix=/usr/local --enable-nonfree --enable-gpl --enable-hardcoded-tables --disable-ffprobe --disable-ffplay --enable-libx264 --enable-libx265 --enable-sdl --enable-sdl2 --enable-ffplay
  libavutil      57. 44.100 / 57. 44.100
  libavcodec     59. 63.100 / 59. 63.100
  libavformat    59. 38.100 / 59. 38.100
  libavdevice    59.  8.101 / 59.  8.101
  libavfilter     8. 56.100 /  8. 56.100
  libswscale      6.  8.112 /  6.  8.112
  libswresample   4.  9.100 /  4.  9.100
  libpostproc    56.  7.100 / 56.  7.100
ffmpeg version N-109758-gbdc76f467f Copyright (c) 2000-2023 the FFmpeg developers
  built with gcc 10 (Raspbian 10.2.1-6+rpi1)
  configuration: --prefix=/usr/local --enable-nonfree --enable-gpl --enable-hardcoded-tables --disable-ffprobe --disable-ffplay --enable-libx264 --enable-libx265 --enable-sdl --enable-sdl2 --enable-ffplay
  libavutil      57. 44.100 / 57. 44.100
  libavcodec     59. 63.100 / 59. 63.100
  libavformat    59. 38.100 / 59. 38.100
  libavdevice    59.  8.101 / 59.  8.101
  libavfilter     8. 56.100 /  8. 56.100
  libswscale      6.  8.112 /  6.  8.112
  libswresample   4.  9.100 /  4.  9.100
  libpostproc    56.  7.100 / 56.  7.100
Input #0, video4linux2,v4l2, from '/dev/video0':B sq=    0B f=0/0   
  Duration: N/A, start: 242.040935, bitrate: 39321 kb/s
  Stream #0:0: Video: rawvideo (YUY2 / 0x32595559), yuyv422, 256x384, 39321 kb/s, 25 fps, 25 tbr, 1000k tbn
Stream mapping:.000 fd=   0 aq=    0KB vq=    0KB sq=    0B f=0/0   
  Stream #0:0 -> #0:0 (rawvideo (native) -> rawvideo (native))
Press [q] to stop, [?] for help
Output #0, rawvideo, to 'pipe:':   0KB vq=    0KB sq=    0B f=0/0   
  Metadata:
    encoder         : Lavf59.38.100
  Stream #0:0: Video: rawvideo (YUY2 / 0x32595559), yuyv422(tv, progressive), 256x192, q=2-31, 19660 kb/s, 25 fps, 25 tbn
    Metadata:
      encoder         : Lavc59.63.100 rawvideo
frame=    0 fps=0.0 q=0.0 size=       0kB time=-577014:32:22.77 bitrate=  -0.0kbInput #0, rawvideo, from 'fd:':    0KB vq=    0KB sq=    0B f=0/0   
  Duration: N/A, start: 0.000000, bitrate: 19660 kb/s
  Stream #0:0: Video: rawvideo (Y1[0][16] / 0x10003159), gray16le, 256x192, 19660 kb/s, 25 tbr, 25 tbn
frame=   13 fps=0.0 q=-0.0 size=    1152kB time=00:00:00.52 bitrate=18148.4kbitsframe=   25 fps= 24 q=-0.0 size=    2304kB time=00:00:01.00 bitrate=18874.4kbitsframe=   39 fps= 25 q=-0.0 size=    3648kB time=00:00:01.56 bitrate=19156.7kbitsframe=   51 fps= 24 q=-0.0 size=    4800kB time=00:00:02.04 bitrate=19275.3kbitsframe=   64 fps= 24 q=-0.0 size=    6048kB time=00:00:02.56 bitrate=19353.6kbitsframe=   78 fps= 25 q=-0.0 size=    7392kB time=00:00:03.12 bitrate=19408.7kbits




  


  I'd also like to use the correct option so it isn't scrolling though every frame in the log as well as links to resources for adapting a command to a script for beginners even though that's outside the purview of this question so any direction on those would be much appreciated.

  


• How do I fade out the edge of a video with ffmpeg ?

  11 décembre 2020, par Jared

  I have a transparent .mov and I want to "fade out" only one edge of the video into transparency using ffmpeg.

  


  My video is transparent 1000x1000 (black is transparent) :

  



  I am trying this command :

  


   ffmpeg -i movie.mov -b:v 700K -filter_complex "[0]split[v0][v1];[v0]format=yuva420p,geq=r=0:g=0:b=0:a=255*(Y/H),scale=w=1*iw:h=200[fg];[v1][fg]overlay=0:800:shortest=1" converted.mov


  


  This half works as the image has the gradient fade out but loses all transparency :

  



  What am I doing wrong ?

  


  Full output log of command :

  


  ffmpeg version 4.2.3 Copyright (c) 2000-2020 the FFmpeg developers
  built with gcc 9.3.1 (GCC) 20200523
  configuration: --enable-gpl --enable-version3 --enable-sdl2 --enable-fontconfig --enable-gnutls --enable-iconv --enable-libass --enable-libdav1d --enable-libbluray --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libtheora --enable-libtwolame --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libzimg --enable-lzma --enable-zlib --enable-gmp --enable-libvidstab --enable-libvorbis --enable-libvo-amrwbenc --enable-libmysofa --enable-libspeex --enable-libxvid --enable-libaom --enable-libmfx --enable-amf --enable-ffnvcodec --enable-cuvid --enable-d3d11va --enable-nvenc --enable-nvdec --enable-dxva2 --enable-avisynth --enable-libopenmpt
  libavutil      56. 31.100 / 56. 31.100
  libavcodec     58. 54.100 / 58. 54.100
  libavformat    58. 29.100 / 58. 29.100
  libavdevice    58.  8.100 / 58.  8.100
  libavfilter     7. 57.100 /  7. 57.100
  libswscale      5.  5.100 /  5.  5.100
  libswresample   3.  5.100 /  3.  5.100
  libpostproc    55.  5.100 / 55.  5.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'movie_014.mov':
  Metadata:
    major_brand     : qt
    minor_version   : 0
    compatible_brands: qt
    creation_time   : 2020-12-10T04:36:09.000000Z
  Duration: 00:00:10.03, start: 0.000000, bitrate: 142307 kb/s
    Stream #0:0(und): Video: prores (XQ) (ap4x / 0x78347061), yuva444p12le(tv, bt709, progressive), 1000x1000, 142222 kb/s, SAR 1:1 DAR 1:1, 30 fps, 30 tbr, 30k tbn, 30k tbc (default)
    Metadata:
      creation_time   : 2020-12-10T04:36:09.000000Z
      handler_name    : Core Media Video
      encoder         : Apple ProRes 4444 XQ
File 'converted.mov' already exists. Overwrite ? [y/N] y
Stream mapping:
  Stream #0:0 (prores) -> split
  overlay -> Stream #0:0 (libx264)
Press [q] to stop, [?] for help
[swscaler @ 0000019691457fc0] No accelerated colorspace conversion found from yuva420p to gbrap.
[libx264 @ 000001968c30f5c0] using SAR=1/1
[libx264 @ 000001968c30f5c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 000001968c30f5c0] profile High, level 3.2, 4:2:0, 8-bit
[libx264 @ 000001968c30f5c0] 264 - core 160 - H.264/MPEG-4 AVC codec - Copyleft 2003-2020 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=abr mbtree=1 bitrate=700 ratetol=1.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mov, to 'converted.mov':
  Metadata:
    major_brand     : qt
    minor_version   : 0
    compatible_brands: qt
    encoder         : Lavf58.29.100
    Stream #0:0: Video: h264 (libx264) (avc1 / 0x31637661), yuv420p, 1000x1000 [SAR 1:1 DAR 1:1], q=-1--1, 700 kb/s, 30 fps, 15360 tbn, 30 tbc (default)
    Metadata:
      encoder         : Lavc58.54.100 libx264
    Side data:
      cpb: bitrate max/min/avg: 0/0/700000 buffer size: 0 vbv_delay: -1
frame=  301 fps= 22 q=-1.0 Lsize=     843kB time=00:00:09.93 bitrate= 695.3kbits/s speed=0.716x
video:839kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.515537%
[libx264 @ 000001968c30f5c0] frame I:2     Avg QP:24.02  size: 22224
[libx264 @ 000001968c30f5c0] frame P:76    Avg QP:24.00  size:  6595
[libx264 @ 000001968c30f5c0] frame B:223   Avg QP:27.38  size:  1402
[libx264 @ 000001968c30f5c0] consecutive B-frames:  1.0%  0.7%  0.0% 98.3%
[libx264 @ 000001968c30f5c0] mb I  I16..4: 36.6% 56.1%  7.4%
[libx264 @ 000001968c30f5c0] mb P  I16..4:  0.5%  1.4%  0.2%  P16..4: 16.0%  7.4%  3.6%  0.0%  0.0%    skip:70.9%
[libx264 @ 000001968c30f5c0] mb B  I16..4:  0.0%  0.0%  0.0%  B16..8: 18.7%  1.3%  0.1%  direct: 0.1%  skip:79.7%  L0:39.1% L1:58.3% BI: 2.6%
[libx264 @ 000001968c30f5c0] final ratefactor: 24.27
[libx264 @ 000001968c30f5c0] 8x8 transform intra:60.1% inter:78.0%
[libx264 @ 000001968c30f5c0] coded y,uvDC,uvAC intra: 30.9% 22.8% 8.2% inter: 3.7% 1.7% 0.0%
[libx264 @ 000001968c30f5c0] i16 v,h,dc,p: 65% 24%  4%  7%
[libx264 @ 000001968c30f5c0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 18% 16% 36%  4%  6%  7%  4%  5%  4%
[libx264 @ 000001968c30f5c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 24% 12% 23%  7%  9%  8%  6%  8%  5%
[libx264 @ 000001968c30f5c0] i8c dc,h,v,p: 79% 10%  9%  2%
[libx264 @ 000001968c30f5c0] Weighted P-Frames: Y:0.0% UV:0.0%
[libx264 @ 000001968c30f5c0] ref P L0: 66.4% 21.6%  9.5%  2.6%
[libx264 @ 000001968c30f5c0] ref B L0: 92.1%  6.8%  1.1%
[libx264 @ 000001968c30f5c0] ref B L1: 97.6%  2.4%
[libx264 @ 000001968c30f5c0] kb/s:684.29


  


• FFMpeg conversions from avi to mp4 does not succeed with video for safari and IE browsers

  24 septembre 2020, par user27240

  The ffmpeg command below does convert mp4 file from avi file successfully for chrome browser, but with browsers such as 
safari and IE(I have not tested with other browsers yet.) I can not see the video and I only can hear the audio 
which simply means that safari and IE browsers do not accept the conversion of video from avi file to mp4 file.

  



  for i in /xxxxxx/xxxxxxx/xxxxxxx/*.avi; do ffmpeg -i "$i" -pix_fmt yuvj422p "/xxxxxx/xxxxxxx/xxxxxxx/$(basename "$i" .avi).mp4"; done    


  



  By the way, when I tried from flv file to mp4 with the same ffmpeg command both video and audio were successfully converted for chrome, safari, and IE.(I have not tested yet with others.)

  



  The avi file is the one I shot with my camera, and flv file is the one I downloaded from web.

  



  Can anyone please help me out ?

  



  The log file below is for the ffmpeg command from avi to mp4.(avi file is the one I shot with my camera)

  



  [root@server-xxxxxxx-x ~]# for i in /xxxxxx/xxxxxxx/xxxxxxx/09190100_5ba1211c6905e.avi;  do ffmpeg -i "$i" -pix_fmt yuvj422p "/xxxxxx/xxxxxxx/xxxxxxx/$(basename "$i" .avi).mp4"; done
ffmpeg version N-46948-g776cdd1dc8-static https://johnvansickle.com/ffmpeg/  Copyright  (c) 2000-2018 the FFmpeg developers
  built with gcc 6.3.0 (Debian 6.3.0-18+deb9u1) 20170516
  configuration: --enable-gpl --enable-version3 --enable-static --disable-debug --  disable-ffplay --disable-indev=sndio --disable-outdev=sndio --cc=gcc-6 --enable-fontconfig --enable-frei0r --enable-gnutls --enable-gray --enable-libaom --enable-libfribidi --enable-libass --enable-libvmaf --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-librubberband --enable-libsoxr --enable-libspeex --enable-libvorbis --enable-libopus --enable-libtheora --enable-libvidstab --enable-libvo-amrwbenc --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 -- enable-libxml2 --enable-libxvid --enable-libzimg
  libavutil      56. 19.101 / 56. 19.101
  libavcodec     58. 30.100 / 58. 30.100
  libavformat    58. 18.100 / 58. 18.100
  libavdevice    58.  4.103 / 58.  4.103
  libavfilter     7. 31.100 /  7. 31.100
  libswscale      5.  2.100 /  5.  2.100
  libswresample   3.  2.100 /  3.  2.100
  libpostproc    55.  2.100 / 55.  2.100
  Guessed Channel Layout for Input Stream #0.1 : mono
  Input #0, avi, from '/xxxxxx/xxxxxxx/xxxxxxx/09190100_5ba1211c6905e.avi':
   Metadata:
    creation_time   : 2018-09-14 00:18:07
    encoder         : CanonMVI06
    Duration: 00:00:04.20, start: 0.000000, bitrate: 12999 kb/s
     Stream #0:0: Video: mjpeg (MJPG / 0x47504A4D), yuvj422p(pc,   bt470bg/unknown/unknown), 640x480, 12384 kb/s, 30 fps, 30 tbr, 30 tbn, 30 tbc
      Stream #0:1: Audio: pcm_s16le ([1][0][0][0] / 0x0001), 44100 Hz, mono, s16, 705 kb/s
  Stream mapping:
   Stream #0:0 -> #0:0 (mjpeg (native) -> h264 (libx264))
   Stream #0:1 -> #0:1 (pcm_s16le (native) -> aac (native))
  Press [q] to stop, [?] for help
  [libx264 @ 0x66f7c40] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2   AVX2
  [libx264 @ 0x66f7c40] profile High 4:2:2, level 3.0, 4:2:2, 8-bit
  [libx264 @ 0x66f7c40] 264 - core 157 r2932 303c484 - H.264/MPEG-4 AVC codec - Copyleft     2003-2018 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0   analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1   trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=3    lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0    constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0    weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf    mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
  Output #0, mp4, to '/xxxxxx/xxxxxxx/xxxxxxx/09190100_5ba1211c6905e.mp4':
   Metadata:
     encoder         : Lavf58.18.100
     Stream #0:0: Video: h264 (libx264) (avc1 / 0x31637661), yuvj422p(pc), 640x480, q=-1- -1, 30 fps, 1000k tbn, 30 tbc
     Metadata:
       encoder         : Lavc58.30.100 libx264
      Side data:
        cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1
      Stream #0:1: Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, mono, fltp, 69 kb/s
      Metadata:
        encoder         : Lavc58.30.100 aac
  frame=  126 fps= 42 q=-1.0 Lsize=     243kB time=00:00:04.20 bitrate= 474.3kbits/s    speed= 1.4x
video:203kB audio:35kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead:    2.440238%
[libx264 @ 0x66f7c40] frame I:1     Avg QP:24.22  size: 16730
[libx264 @ 0x66f7c40] frame P:32    Avg QP:24.48  size:  4020
[libx264 @ 0x66f7c40] frame B:93    Avg QP:25.83  size:   662
[libx264 @ 0x66f7c40] consecutive B-frames:  1.6%  0.0%  0.0% 98.4%
[libx264 @ 0x66f7c40] mb I  I16..4: 11.2% 86.4%  2.4%
[libx264 @ 0x66f7c40] mb P  I16..4:  1.0%  0.8%  0.0%  P16..4: 54.9%  7.1%  6.3%  0.0%     0.0%    skip:29.8%
[libx264 @ 0x66f7c40] mb B  I16..4:  0.1%  0.1%  0.0%  B16..8: 26.0%  0.2%  0.0%  direct:     1.1%  skip:72.5%  L0:47.1% L1:52.0% BI: 1.0%
[libx264 @ 0x66f7c40] 8x8 transform intra:68.3% inter:88.6%
[libx264 @ 0x66f7c40] coded y,uvDC,uvAC intra: 51.1% 78.4% 10.4% inter: 4.8% 24.4% 0.1%
[libx264 @ 0x66f7c40] i16 v,h,dc,p: 17% 26%  5% 52%
[libx264 @ 0x66f7c40] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 21% 32% 22%  3%  4%  2%  6%  5%  5%
[libx264 @ 0x66f7c40] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 31% 25% 12%  1% 12%  3% 10%  4%  2%
[libx264 @ 0x66f7c40] i8c dc,h,v,p: 48% 23% 25%  4%
[libx264 @ 0x66f7c40] Weighted P-Frames: Y:3.1% UV:3.1%
[libx264 @ 0x66f7c40] ref P L0: 45.3%  9.1% 32.9% 12.4%  0.3%
[libx264 @ 0x66f7c40] ref B L0: 74.7% 20.7%  4.7%
[libx264 @ 0x66f7c40] ref B L1: 88.4% 11.6%
[libx264 @ 0x66f7c40] kb/s:394.12