Recherche avancée

Sur d’autres sites (11099)

• ffmpeg generate thumbnails on GPU

  22 juin 2018, par Oleksandr Kyrpa

  I try to generate thumbnails with acceleration on GPU, so compile ffmpeg 3.4.1 and run command :

  ./ffmpeg  -i ~/Videos/1080.mp4 -vf "hwupload_cuda,thumbnail_cuda=100,scale_cuda=107:60,hwdownload,format=yuv420p" -vframes 1 -y ~/Videos/thumbs/thumb%03d.jpg

  But I get wrong output picture (the color of thumbnail is green) :

  

  Correct image must be black.
  How to make first image with correct color ?

  

  log : -loglevel verbose

  ffmpeg version N-89707-g89b84cb Copyright (c) 2000-2018 the FFmpeg developers
  
    built with gcc 4.8 (Ubuntu 4.8.4-2ubuntu1~14.04.3)
  
    configuration: --cpu=native --enable-pthreads --extra-version=hd --enable-gnutls --enable-vaapi --enable-vdpau --enable-nonfree --enable-gpl --enable-swscale --enable-libx264 --enable-version3 --enable-nvenc --enable-libnpp --enable-cuda --enable-cuvid --enable-cuda-sdk --enable-filter=scale_cuda --enable-filter=thumbnail_cuda --extra-cflags=-I/usr/local/cuda-8.0/include --extra-ldflags=-L/usr/local/cuda-8.0/lib64
  
    libavutil      56.  7.100 / 56.  7.100
  
    libavcodec     58.  9.100 / 58.  9.100
  
    libavformat    58.  3.100 / 58.  3.100
  
    libavdevice    58.  0.100 / 58.  0.100
  
    libavfilter     7. 11.100 /  7. 11.100
  
    libswscale      5.  0.101 /  5.  0.101
  
    libswresample   3.  0.101 /  3.  0.101
  
    libpostproc    55.  0.100 / 55.  0.100
  
  [h264 @ 0x392ed40] Reinit context to 1920x1088, pix_fmt: yuv420p
  
  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/home/alex/Videos/1080.mp4':
  
    Metadata:
  
      major_brand     : mp42
  
      minor_version   : 0
  
      compatible_brands: isommp42
  
      creation_time   : 2012-05-30T20:01:34.000000Z
  
    Duration: 00:01:14.21, start: 0.000000, bitrate: 5476 kb/s
  
      Stream #0:0(und): Video: h264 (High), 1 reference frame (avc1 / 0x31637661), yuv420p(left), 1920x1080 (1920x1088), 5321 kb/s, 29.97 fps, 29.97 tbr, 60k tbn, 59.94 tbc (default)
  
      Metadata:
  
        creation_time   : 1970-01-01T00:00:00.000000Z
  
        handler_name    : VideoHandler
  
      Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 152 kb/s (default)
  
      Metadata:
  
        creation_time   : 2012-05-30T20:01:34.000000Z
  
        handler_name    : IsoMedia File Produced by Google, 5-11-2011
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native))
  
  Press [q] to stop, [?] for help
  
  [h264 @ 0x3a38280] Reinit context to 1920x1088, pix_fmt: yuv420p
  
  [Parsed_thumbnail_cuda_1 @ 0x4e3d8c0] batch size: 100 frames
  
  [graph 0 input from stream 0:0 @ 0x4e8b640] w:1920 h:1080 pixfmt:yuv420p tb:1/60000 fr:30000/1001 sar:0/1 sws_param:flags=2
  
  [auto_scaler_0 @ 0x4e8ca00] w:iw h:ih flags:'bicubic' interl:0
  
  [format @ 0x4e8b540] auto-inserting filter 'auto_scaler_0' between the filter 'Parsed_format_4' and the filter 'format'
  
  [Parsed_scale_cuda_2 @ 0x4e89380] w:1920 h:1080 -> w:107 h:60
  
  [swscaler @ 0x4ebf0c0] deprecated pixel format used, make sure you did set range correctly
  
  [auto_scaler_0 @ 0x4e8ca00] w:107 h:60 fmt:yuv420p sar:0/1 -> w:107 h:60 fmt:yuvj420p sar:0/1 flags:0x4
  
  Output #0, image2, to '/home/alex/Videos/thumbs/thumb%03d.jpg':
  
    Metadata:
  
      major_brand     : mp42
  
      minor_version   : 0
  
      compatible_brands: isommp42
  
      encoder         : Lavf58.3.100
  
      Stream #0:0(und): Video: mjpeg, 1 reference frame, yuvj420p(pc, left), 107x60, q=2-31, 200 kb/s, 29.97 fps, 29.97 tbn, 29.97 tbc (default)
  
      Metadata:
  
        creation_time   : 1970-01-01T00:00:00.000000Z
  
        handler_name    : VideoHandler
  
        encoder         : Lavc58.9.100 mjpeg
  
      Side data:
  
        cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: -1
  
  [Parsed_thumbnail_cuda_1 @ 0x4e3d8c0] frame id #76 (pts_time=2.535867) selected from a set of 100 images
  
  No more output streams to write to, finishing.
  
  frame=    1 fps=0.9 q=3.1 Lsize=N/A time=00:00:02.56 bitrate=N/A speed=2.26x    
  
  video:2kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
  
  Input file #0 (/home/alex/Videos/1080.mp4):
  
    Input stream #0:0 (video): 115 packets read (134655 bytes); 101 frames decoded; 
  
    Input stream #0:1 (audio): 1 packets read (9 bytes); 
  
    Total: 116 packets (134664 bytes) demuxed
  
  Output file #0 (/home/alex/Videos/thumbs/thumb%03d.jpg):
  
    Output stream #0:0 (video): 1 frames encoded; 1 packets muxed (1864 bytes); 
  
    Total: 1 packets (1864 bytes) muxed

  UPDATE, working !
  Add format=nv12 before hwupload

  -vf "format=nv12,hwupload_cuda,thumbnail_cuda,scale_cuda=1280:72‌​0,hwdownload,format=‌​nv12"

• Anomalie #4138 : Compatibilité avec PHP 7.2

  14 mai 2018, par - Equipement

  Ci-joint le résultat du test avec SPIP 3.2.1 svn du 14/05/2018.
  L’outil utilisé est github.com/wimg/PHPCompatibility

• FFMPEG : RTSP re-stream dies randomly

  14 mai 2018, par stevendesu

  I have a security camera streaming RTSP, and I wish to re-stream this to an RTMP ingest server. For now I’m using my laptop as an ffmpeg proxy, but eventually I’ll use a raspberry pi or something similar (cheap/small)

  Here’s the command I’m using (pretty simple) :

  ffmpeg -i rtsp://@10.0.0.16:554/1/h264major -c:v libx264 -c:a none -f flv rtmp://output/camera_stream

  This works but after a minute or two the stream dies. Here’s the output :

  ffmpeg version N-90057-g7c82e0f Copyright (c) 2000-2018 the FFmpeg developers
  
    built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.6) 20160609
  
    configuration: --prefix=/home/sbarnett/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/sbarnett/ffmpeg_build/include --extra-ldflags=-L/home/sbarnett/ffmpeg_build/lib --extra-libs='-lpthread -lm' --bindir=/home/sbarnett/bin --enable-gpl --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libtheora --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-libspeex --enable-nonfree
  
    libavutil      56.  7.101 / 56.  7.101
  
    libavcodec     58. 11.101 / 58. 11.101
  
    libavformat    58.  9.100 / 58.  9.100
  
    libavdevice    58.  1.100 / 58.  1.100
  
    libavfilter     7. 12.100 /  7. 12.100
  
    libswscale      5.  0.101 /  5.  0.101
  
    libswresample   3.  0.101 /  3.  0.101
  
    libpostproc    55.  0.100 / 55.  0.100
  
  Input #0, rtsp, from 'rtsp://@10.0.0.16:554/1/h264major':
  
    Metadata:
  
      title           : h264major
  
      comment         : h264major
  
    Duration: N/A, start: 0.360000, bitrate: N/A
  
      Stream #0:0: Video: h264 (Main), yuvj420p(pc, bt709, progressive), 720x480, 25 fps, 25 tbr, 90k tbn, 50 tbc
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (h264 (native) -> h264 (libx264))
  
  Press [q] to stop, [?] for help
  
  [libx264 @ 0x38843c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
  
  [libx264 @ 0x38843c0] profile High, level 3.0
  
  [libx264 @ 0x38843c0] 264 - core 155 - H.264/MPEG-4 AVC codec - Copyleft 2003-2018 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
  
  Output #0, flv, to 'rtmp://output/camera_stream':
  
    Metadata:
  
      title           : h264major
  
      comment         : h264major
  
      encoder         : Lavf58.9.100
  
      Stream #0:0: Video: h264 (libx264) ([7][0][0][0] / 0x0007), yuvj420p(pc), 720x480, q=-1--1, 25 fps, 1k tbn, 25 tbc
  
      Metadata:
  
        encoder         : Lavc58.11.101 libx264
  
      Side data:
  
        cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1
  
  Past duration 0.999992 too large
  
      Last message repeated 29 times
  
  [rtsp @ 0x3847600] max delay reached. need to consume packet
  
  [rtsp @ 0x3847600] RTP: missed 48 packets
  
  Past duration 0.999992 too large
  
      Last message repeated 4 times
  
  frame=   44 fps=0.0 q=0.0 size=       0kB time=00:00:00.00 bitrate=N/A dup=0 drop=5 speed=   0x    
  
  frame=   57 fps= 54 q=28.0 size=      43kB time=00:00:00.16 bitrate=2186.4kbits/s dup=0 drop=5 speed=0.153x    
  
  ... (lots of similar messages) ...   
  
  frame= 1163 fps= 26 q=28.0 size=    1341kB time=00:00:44.84 bitrate= 245.0kbits/s dup=0 drop=5 speed=0.99x    
  
  frame= 1177 fps= 26 q=28.0 size=    1353kB time=00:00:45.40 bitrate= 244.2kbits/s dup=0 drop=5 speed=0.99x    
  
  [rtsp @ 0x3847600] max delay reached. need to consume packet
  
  [rtsp @ 0x3847600] RTP: missed 2 packets
  
  frame= 1190 fps= 26 q=28.0 size=    1370kB time=00:00:45.92 bitrate= 244.4kbits/s dup=0 drop=5 speed=0.99x    
  
  [h264 @ 0x38c08c0] Increasing reorder buffer to 1
  
  frame= 1201 fps= 26 q=28.0 size=    1381kB time=00:00:46.36 bitrate= 244.0kbits/s dup=0 drop=5 speed=0.989x    
  
  frame= 1214 fps= 26 q=28.0 size=    1393kB time=00:00:46.88 bitrate= 243.4kbits/s dup=0 drop=5 speed=0.989x    
  
  ... (lots of similar messages) ...    
  
  frame= 1761 fps= 25 q=28.0 size=    2030kB time=00:01:08.80 bitrate= 241.7kbits/s dup=0 drop=5 speed=0.993x    
  
  frame= 1774 fps= 25 q=28.0 size=    2041kB time=00:01:09.32 bitrate= 241.2kbits/s dup=0 drop=5 speed=0.993x    
  
  [flv @ 0x3884900] Failed to update header with correct duration.
  
  [flv @ 0x3884900] Failed to update header with correct filesize.
  
  frame= 1782 fps= 25 q=-1.0 Lsize=    2127kB time=00:01:11.64 bitrate= 243.2kbits/s dup=0 drop=5 speed=1.02x    
  
  video:2092kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 1.679417%
  
  [libx264 @ 0x38843c0] frame I:8     Avg QP:16.89  size: 42446
  
  [libx264 @ 0x38843c0] frame P:1672  Avg QP:19.54  size:  1065
  
  [libx264 @ 0x38843c0] frame B:102   Avg QP:23.00  size:   205
  
  [libx264 @ 0x38843c0] consecutive B-frames: 92.4%  0.0%  0.0%  7.6%
  
  [libx264 @ 0x38843c0] mb I  I16..4: 12.9% 36.2% 50.9%
  
  [libx264 @ 0x38843c0] mb P  I16..4:  0.2%  0.2%  0.0%  P16..4: 16.7%  0.7%  1.0%  0.0%  0.0%    skip:81.1%
  
  [libx264 @ 0x38843c0] mb B  I16..4:  0.1%  0.1%  0.0%  B16..8: 11.7%  0.1%  0.0%  direct: 1.5%  skip:86.5%  L0:62.2% L1:35.3% BI: 2.5%
  
  [libx264 @ 0x38843c0] 8x8 transform intra:40.8% inter:47.4%
  
  [libx264 @ 0x38843c0] coded y,uvDC,uvAC intra: 46.5% 53.0% 17.2% inter: 3.9% 8.7% 0.0%
  
  [libx264 @ 0x38843c0] i16 v,h,dc,p: 21% 56%  8% 15%
  
  [libx264 @ 0x38843c0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 23% 33% 31%  1%  2%  3%  2%  2%  3%
  
  [libx264 @ 0x38843c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 25% 39%  9%  3%  3%  4%  5%  3%  8%
  
  [libx264 @ 0x38843c0] i8c dc,h,v,p: 43% 33% 21%  3%
  
  [libx264 @ 0x38843c0] Weighted P-Frames: Y:0.0% UV:0.0%
  
  [libx264 @ 0x38843c0] ref P L0: 88.0%  1.4%  6.6%  4.0%
  
  [libx264 @ 0x38843c0] ref B L0: 99.4%  0.5%  0.1%
  
  [libx264 @ 0x38843c0] ref B L1: 99.4%  0.6%
  
  [libx264 @ 0x38843c0] kb/s:238.73

  The camera is pretty cheap (from China) so it’s likely I’m getting bad data from it or it’s cutting out for a few seconds at a time. Ideally I would need ffmpeg to handle this well (ignore bad data, wait as long as necessary for good data to resume encoding)

  Using ffplay to check out the RTSP stream, I get output like the following :

  $> ffplay -i rtsp://@10.0.0.16:554/1/h264major
  
  ffplay version N-90057-g7c82e0f Copyright (c) 2003-2018 the FFmpeg developers
  
    built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.6) 20160609
  
    configuration: --prefix=/home/sbarnett/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/sbarnett/ffmpeg_build/include --extra-ldflags=-L/home/sbarnett/ffmpeg_build/lib --extra-libs='-lpthread -lm' --bindir=/home/sbarnett/bin --enable-gpl --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libtheora --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-libspeex --enable-nonfree
  
    libavutil      56.  7.101 / 56.  7.101
  
    libavcodec     58. 11.101 / 58. 11.101
  
    libavformat    58.  9.100 / 58.  9.100
  
    libavdevice    58.  1.100 / 58.  1.100
  
    libavfilter     7. 12.100 /  7. 12.100
  
    libswscale      5.  0.101 /  5.  0.101
  
    libswresample   3.  0.101 /  3.  0.101
  
    libpostproc    55.  0.100 / 55.  0.100
  
  Input #0, rtsp, from 'rtsp://@10.0.0.16:554/1/h264major':0B f=0/0
  
    Metadata:
  
      title           : h264major
  
      comment         : h264major
  
    Duration: N/A, start: 0.320000, bitrate: N/A
  
      Stream #0:0: Video: h264 (Main), yuvj420p(pc, bt709, progressive), 720x480, 25 fps, 25 tbr, 90k tbn, 50 tbc
  
  [swscaler @ 0x7f6bbc093180] deprecated pixel format used, make sure you did set range correctly
  
  [rtsp @ 0x7f6bc0000940] max delay reached. need to consume packet
  
  [rtsp @ 0x7f6bc0000940] RTP: missed 2 packets
  
  [h264 @ 0x7f6bc0041080] error while decoding MB 44 28, bytestream -37
  
  [h264 @ 0x7f6bc0041080] concealing 95 DC, 95 AC, 95 MV errors in I frame
  
  [rtsp @ 0x7f6bc0000940] max delay reached. need to consume packet
  
  [rtsp @ 0x7f6bc0000940] RTP: missed 1 packets
  
  [h264 @ 0x7f6bc0041080] error while decoding MB 43 29, bytestream -49
  
  [h264 @ 0x7f6bc0041080] concealing 51 DC, 51 AC, 51 MV errors in I frame
  
  [rtsp @ 0x7f6bc0000940] max delay reached. need to consume packet
  
  [rtsp @ 0x7f6bc0000940] RTP: missed 2 packets
  
  [h264 @ 0x7f6bc0041080] Increasing reorder buffer to 1
  
  [rtsp @ 0x7f6bc0000940] max delay reached. need to consume packet
  
  [rtsp @ 0x7f6bc0000940] RTP: missed 3 packets
  
  [h264 @ 0x7f6bc02c3600] error while decoding MB 27 29, bytestream -24
  
  [h264 @ 0x7f6bc02c3600] concealing 67 DC, 67 AC, 67 MV errors in I frame
  
  [rtsp @ 0x7f6bc0000940] max delay reached. need to consume packet
  
  [rtsp @ 0x7f6bc0000940] RTP: missed 2 packets
  
  [rtsp @ 0x7f6bc0000940] max delay reached. need to consume packet
  
  [rtsp @ 0x7f6bc0000940] RTP: missed 42 packets
  
  [rtsp @ 0x7f6bc0000940] max delay reached. need to consume packet
  
  [rtsp @ 0x7f6bc0000940] RTP: missed 2 packets

  Then eventually the video just freezes. The first time it froze after around 5 minutes, but I wasn’t able to say definitively if it froze the instant 44 packets were dropped or if it froze randomly later. So the second time I stared intently.... for 21 minutes. Then I got bored of it not freezing, turned to pet my cat, and when I looked back 15 seconds later it was frozen. I think it only breaks when no one is watching it.

  What I can say definitively is :

  • While running normally, M-V hovers around 0 (anywhere between -0.01 and +0.01)
  • Once frozen, M-V begins to count down into negative numbers without stopping - although at a rate slower than -1 per second
  • While running normally, aq is 0KB and vq is a positive number (I think it was 30KB or so ?)
  • Once frozen, vq is also 0KB

  It’s a really cheap camera with a crummy power supply that goes out if you breathe on it, so it’s likely the camera is going temporarily offline during this time — but I’d like ffmpeg to wait out a timeout and resume streaming when it sees the camera again.