Sur d’autres sites (7907)

• Encoding of two full hd streams in Linux + GPU with Intel HD4000 / VA API / FFMPEG / OpenGL

  27 juin 2017, par qknight

  i want to encode/stream two full hd streams in realtime from my laptop to a remote location using linux/xorg on the host.

  VA API

  for this i’ve been playing with the VA API but the performance is pretty bad with 5.59 fps (see paste below).

  FFMPEG

  using ffmpeg with CPU encoding i get about 200 fps but then all cores of my Intel(R) Core(TM) i7-3520M CPU @ 2.90GHz are busy and the fan turns on.

  future plans

  i want GPU support in encoding and later integrate this into a program which streams a virtual xorg ’screen’, see https://lastlog.de/wiki/index.php/Raspberry_PI_virtual_screen for more details on my plans.

  maybe h264 isn’t even what i want ? so if someone advices towards a different implementation, i’d welcome that.

  besides VA API there seems to be QuickSync but i didn’t experiment with that yet as it is not packaged on NixOS just yet.

  note : i need a library to have a smooth integration into the code.

  h264encode -w 1920 -h 1080 —profile MPSource frame is 1920x1080 and will code clip to 1920x1088 with crop
  INPUT:Try to encode H264...
  
  INPUT : Resolution : 1920x1080, 60 frames
  
  INPUT : FrameRate : 30
  
  INPUT : Bitrate : 14929920
  
  INPUT : Slieces : 1
  
  INPUT : IntraPeriod : 30
  
  INPUT : IDRPeriod : 60
  
  INPUT : IpPeriod : 1
  
  INPUT : Initial QP : 26
  
  INPUT : Min QP : 0
  
  INPUT : Source YUV : AUTO generated
  
  INPUT : Coded Clip : /tmp/test.264
  
  INPUT : Rec   Clip : Not save reconstructed frame
  libva info : VA-API version 0.38.1
  
  libva info : va_getDriverName() returns 0
  
  libva info : Trying to open /run/opengl-driver/lib/dri/i965_drv_video.so
  
  libva info : Found init function __vaDriverInit_0_38
  
  libva info : va_openDriver() returns 0
  
  Use profile VAProfileH264Main
  
  Support rate control mode (0x12):CBR CQP 
  
  RateControl mode : CQP
  
  Support VAConfigAttribEncPackedHeaders
  
  Support packed sequence headers
  
  Support packed picture headers
  
  Support packed slice headers
  
  Support packed misc headers
  
  Support 1 RefPicList0 and 1 RefPicList1
  
  Loading data into surface 15.....Complete surface loading
  
        \00000059(054456 bytes coded)
  PERFORMANCE :   Frame Rate : 5.59 fps (60 frames, 10730 ms (178.83 ms per frame))
  
  PERFORMANCE :   Compression ratio : 51:1
  
  PERFORMANCE :     UploadPicture : 10467 ms (174.45, 97.55% percent)
  
  PERFORMANCE :     vaBeginPicture : 0 ms (0.00, 0.00% percent)
  
  PERFORMANCE :     vaRenderHeader : 1 ms (0.02, 0.01% percent)
  
  PERFORMANCE :     vaEndPicture : 42 ms (0.70, 0.39% percent)
  
  PERFORMANCE :     vaSyncSurface : 244 ms (4.07, 2.27% percent)
  
  PERFORMANCE :     SavePicture : 7 ms (0.12, 0.07% percent)
  
  PERFORMANCE :     Others : -31 ms (71582787.75, 40027653.91% percent)
  
  (Multithread enabled, the timing is only for reference)
  

  i’ve seen https://www.reddit.com/r/linux/comments/1qk1yu/is_there_currently_opensource_software_to_encode/ though but i’m not sure what do do with it.

• Efficiently write a movie directly from np.array using pipes

  16 juin 2017, par Matt Billman

  I have a 4D numpy array of movie frames. I’m looking for a function to write them to a movie, at a given framerate. I have FFMPEG installed on my OS, and as I can see from these answers, the most efficient way to do so is via pipes.

  However, I have very little experience using pipes, and the explanations in the link above make little sense to me. Furthermore, very few of the answers seem actually implement pipes, and the one that does uses mencoder, not FFMPEG. I am relatively inexperienced with FFMPEG, so am not sure how to modify the command string from the mencoder answer to make it work in FFMPEG.

  WHAT I WOULD LIKE :

  A function of the following form :

  animate_np_array(4d_array, framerate) -> output.mp4 (or other video codec)

  Which implements pipes to send frames one after the other to FFMPEG, and which I can copy-paste into my existing code.

  Furthermore, it is absolutely necessary that this function never actually plots any of the frames, as calls to the matplotlib.imshow() function (as I have most typically seen used) slow things down considerably.

• FFMPEG : create movie from timestamped images

  28 mai 2017, par HyperDevil

  Im trying to make a small movie file from a folder with webcam images.

  They are named like this :
  00-00-38.jpg
  00-05-37.jpg
  00-10-37.jpg
  00-15-37.jpg

  H-M-S.jpg format

  Although i tried patterntype glob and simpler commands i cannot get it to work.

  This is what i tried :

  ffmpeg -r 1 -pattern_type glob -i '*.jpg' -scale=720:-1 -c:v libx264 out.mp4 
  
  (got only one image)
  
  ffmpeg -r 25 -i *.jpg -vf "scale=720:-1" output.mp4
  
  (same size as a jpg file but no video)

  Console output :

  ffmpeg -framerate 1 -pattern_type glob -i "*.jpg" -vf scale=720:-1 -c:v libx264 -pix_fmt yuv420p out.mp4
  
      ffmpeg version 1.0.10 Copyright (c) 2000-2014 the FFmpeg developers  built on Jul 25 2014 07:50:40 with gcc 4.7 (Debian 4.7.2-5)
  
        configuration: --prefix=/usr --extra-cflags='-g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security ' 
  
      --extra-ldflags='-Wl,-z,relro' --cc='ccache cc' --enable-shared --enable-libmp3lame --enable-gpl --enable-nonfree --enable-libvorbis 
  
      --enable-pthreads --enable-libfaac --enable-libxvid --enable-postproc --enable-x11grab --enable-libgsm --enable-libtheora --enable-li
  
      bopencore-amrnb --enable-libopencore-amrwb --enable-libx264 --enable-libspeex --enable-nonfree --disable-stripping --enable-libvpx --
  
      enable-libschroedinger --disable-encoder=libschroedinger --enable-version3 --enable-libopenjpeg --enable-librtmp --enable-avfilter --
  
      enable-libfreetype --enable-libvo-aacenc --disable-decoder=amrnb --enable-libvo-amrwbenc --enable-libaacplus --libdir=/usr/lib/x86_64
  
      -linux-gnu --disable-vda --enable-libbluray --enable-libcdio --enable-gnutls --enable-frei0r --enable-openssl --enable-libass --enabl
  
      e-libopus --enable-fontconfig --enable-libfdk-aac --enable-libdc1394 --disable-altivec --dis
  
        libavutil      51. 73.101 / 51. 73.101
  
        libavcodec     54. 59.100 / 54. 59.100
  
        libavformat    54. 29.104 / 54. 29.104
  
        libavdevice    54.  2.101 / 54.  2.101
  
        libavfilter     3. 17.100 /  3. 17.100
  
        libswscale      2.  1.101 /  2.  1.101
  
        libswresample   0. 15.100 /  0. 15.100
  
        libpostproc    52.  0.100 / 52.  0.100
  
      [image2 @ 0x1d53f00] max_analyze_duration 5000000 reached at 5000000
  
      Input #0, image2, from '*.jpg':
  
        Duration: 00:04:48.00, start: 0.000000, bitrate: N/A
  
          Stream #0:0: Video: mjpeg, yuvj420p, 800x593 [SAR 96:96 DAR 800:593], 1 fps, 1 tbr, 1 tbn, 1 tbc
  
      [libx264 @ 0x1d35bc0] using SAR=1780/1779
  
      [libx264 @ 0x1d35bc0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX XOP FMA4 FMA3 SSEMisalign LZCNT BMI1
  
      [libx264 @ 0x1d35bc0] profile High, level 2.2
  
      [libx264 @ 0x1d35bc0] 264 - core 132 - H.264/MPEG-4 AVC codec - Copyleft 2003-2013 - http://www.videolan.org/x264.html - options:  ca
  
      bac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dc
  
      t=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=
  
      0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 key
  
      int_min=1 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=
  
      1:1.00
  
      Output #0, mp4, to 'out.mp4':
  
        Metadata:
  
          encoder         : Lavf54.29.104
  
          Stream #0:0: Video: h264 ([33][0][0][0] / 0x0021), yuv420p, 720x534 [SAR 1780:1779 DAR 800:593], q=-1--1, 1 tbn, 1 tbc
  
      Stream mapping:
  
        Stream #0:0 -> #0:0 (mjpeg -> libx264)
  
      Press [q] to stop, [?] for help
  
      frame=  288 fps=145 q=32763.0 Lsize=     349kB time=00:04:46.00 bitrate=  10.0kbits/s
  
      video:345kB audio:0kB subtitle:0 global headers:0kB muxing overhead 1.208469%
  
      [libx264 @ 0x1d35bc0] frame I:2     Avg QP: 2.80  size:130328
  
      [libx264 @ 0x1d35bc0] frame P:73    Avg QP: 4.70  size:  1167
  
      [libx264 @ 0x1d35bc0] frame B:213   Avg QP:17.33  size:    30
  
      [libx264 @ 0x1d35bc0] consecutive B-frames:  1.4%  0.0%  0.0% 98.6%
  
      [libx264 @ 0x1d35bc0] mb I  I16..4: 20.2% 24.9% 55.0%
  
      [libx264 @ 0x1d35bc0] mb P  I16..4:  0.0%  0.0%  0.0%  P16..4:  4.3%  0.1%  0.2%  0.0%  0.0%    skip:95.5%
  
      [libx264 @ 0x1d35bc0] mb B  I16..4:  0.0%  0.0%  0.0%  B16..8:  0.8%  0.0%  0.0%  direct: 0.0%  skip:99.2%  L0: 5.4% L1:94.5% BI: 0.0
  
      %
  
      [libx264 @ 0x1d35bc0] 8x8 transform intra:24.9% inter:51.5%
  
      [libx264 @ 0x1d35bc0] coded y,uvDC,uvAC intra: 99.4% 0.0% 0.0% inter: 0.6% 0.0% 0.0%
  
      [libx264 @ 0x1d35bc0] i16 v,h,dc,p:  5% 19% 52% 25%
  
      [libx264 @ 0x1d35bc0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 10% 28% 21%  4%  6%  4%  8%  5% 15%
  
      [libx264 @ 0x1d35bc0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 14% 27% 13%  6%  8%  5%  9%  6% 12%
  
      [libx264 @ 0x1d35bc0] i8c dc,h,v,p: 100%  0%  0%  0%
  
      [libx264 @ 0x1d35bc0] Weighted P-Frames: Y:0.0% UV:0.0%
  
      [libx264 @ 0x1d35bc0] ref P L0: 98.1%  0.0%  1.7%  0.2%
  
      [libx264 @ 0x1d35bc0] ref B L0: 52.0% 48.0%
  
      [libx264 @ 0x1d35bc0] ref B L1: 73.0% 27.0%
  
      [libx264 @ 0x1d35bc0] kb/s:9.78

  The video is 364KB without any video.