Recherche avancée

Sur d’autres sites (8913)

• Pipe opencv frames into ffmpeg

  25 juin 2023, par Dmytro Soltusyuk

  I am trying to pipe opencv frames into ffmpeg, but it does not work.

  


  After the research, I found this answer (https://stackoverflow.com/a/62807083/10676682) to work the best for me, so I have the following :

  


  def start_streaming_process(rtmp_url, width, height, fps):
    # fmt: off
    cmd = ['ffmpeg',
           '-y',
           '-f', 'rawvideo',
           '-vcodec', 'rawvideo',
           '-pix_fmt', 'bgr24',
           '-s', "{}x{}".format(width, height),
           '-r', str(fps),
           '-i', '-',
           '-c:v', 'libx264',
           '-pix_fmt', 'yuv420p',
           '-preset', 'ultrafast',
           '-f', 'flv',
           '-flvflags', 'no_duration_filesize',
           rtmp_url]
    # fmt: on

    return subprocess.Popen(cmd, stdin=subprocess.PIPE)


  


  def main():
    width, height, fps = get_video_size(SOURCE_VIDEO_PATH)
    streaming_process = start_streaming_process(
        TARGET_VIDEO_PATH,
        width,
        height,
        fps,
    )

    model = load_yolo(WEIGHTS_PATH)
    frame_iterator = read_frames(video_source=SOURCE_VIDEO_PATH)
    processed_frames_iterator = process_frames(
        model, frame_iterator, ball_target_area=400
    )

    for processed_frame in processed_frames_iterator:
        streaming_process.communicate(processed_frame.tobytes())

    streaming_process.kill()


  


  processed_frame here is an annotated OpenCV frame.

  


  However, after I do my first streaming_process.communicate call, the ffmpeg process exits with code 0 (meaning everything was ok), but it is not. I can not feed the rest of the frames into ffmpeg, because the process exited.

  


  Here are the logs :

  


  Input #0, rawvideo, from 'fd:':
  Duration: N/A, start: 0.000000, bitrate: 663552 kb/s
  Stream #0:0: Video: rawvideo (BGR[24] / 0x18524742), bgr24, 1280x720, 663552 kb/s, 30 tbr, 30 tbn
Stream mapping:
  Stream #0:0 -> #0:0 (rawvideo (native) -> h264 (libx264))
[libx264 @ 0x132e05570] using cpu capabilities: ARMv8 NEON
[libx264 @ 0x132e05570] profile High, level 3.1, 4:2:0, 8-bit
[libx264 @ 0x132e05570] 264 - core 164 r3095 baee400 - H.264/MPEG-4 AVC codec - Copyleft 2003-2022 - h
ttp://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme
=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 
fast_pskip=1 chroma_qp_offset=-2 threads=15 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 inter
laced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=
1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbt
ree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, flv, to 'rtmp://global-live.mux.com:5222/app/9428e064-e5d3-0bee-dc67-974ba53ce164':
  Metadata:
    encoder         : Lavf60.3.100
  Stream #0:0: Video: h264 ([7][0][0][0] / 0x0007), yuv420p(tv, progressive), 1280x720, q=2-31, 30 fps
, 1k tbn
    Metadata:
      encoder         : Lavc60.3.100 libx264
    Side data:
      cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
frame=    1 fps=0.0 q=29.0 Lsize=      41kB time=00:00:00.00 bitrate=N/A speed=   0x    eed=N/A    
video:40kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.678311%
[libx264 @ 0x132e05570] frame I:1     Avg QP:25.22  size: 40589
[libx264 @ 0x132e05570] mb I  I16..4: 37.7% 33.4% 28.9%
[libx264 @ 0x132e05570] 8x8 transform intra:33.4%
[libx264 @ 0x132e05570] coded y,uvDC,uvAC intra: 51.1% 53.2% 14.4%
[libx264 @ 0x132e05570] i16 v,h,dc,p: 32% 38% 20% 10%
[libx264 @ 0x132e05570] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 16% 36% 28%  3%  2%  2%  3%  3%  6%
[libx264 @ 0x132e05570] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 18% 37% 17%  4%  4%  4%  5%  4%  7%
[libx264 @ 0x132e05570] i8c dc,h,v,p: 46% 37% 12%  4%
[libx264 @ 0x132e05570] kb/s:9741.36


  


  That's all. Exit code 0.

  


• ffmpeg android unable to build

  2 janvier 2014, par nmxprime

  My goal is to build ffmpeg static libraries so that i can use them with jni and call directly the functions defined in ffmpeg to encode series of images as h264 video stream and render it on screen using GLSurfaceVIew in android 2.3.6.

  Using https://www.ffmpeg.org/doxygen/0.6/api-example_8c-source.html i came to know that by having the required .so files and headers i can do that.

  I followed Android NDK & FFMPEG build and many others. Everywhere i found reference to the build scripts by roman10.

  I use Ubunthu 12.0.4 LTS with android-ndk-r9 and ffmpeg-0.10 source !

  Below is the built script i used !

  NDK=~/android-ndk-r9
  
  PLATFORM=$NDK/platforms/android-8/arch-arm/
  
  #PREBUILT=$NDK/toolchains/arm-linux-androideabi-4.7/prebuilt/windows
  
  PREBUILT=$NDK/toolchains/arm-linux-androideabi-4.8/prebuilt/linux-x86
  
  
  
  function build_one
  
  {
  
  ./configure --target-os=linux \
  
  --prefix=$PREFIX \
  
  --enable-cross-compile \
  
  --extra-libs="-lgcc" \
  
  --arch=arm \
  
  --cc=$PREBUILT/bin/arm-linux-androideabi-gcc-4.8 \
  
  --cross-prefix=$PREBUILT/bin/arm-linux-androideabi- \   
  
  --nm=$PREBUILT/bin/arm-linux-androideabi-nm \
  
  --sysroot=$PLATFORM \
  
  --extra-cflags=" -O3 -fpic -DANDROID -DHAVE_SYS_UIO_H=1 -Dipv6mr_interface=ipv6mr_ifindex -fasm -Wno-psabi -fno-short-enums -fno-strict-aliasing -finline-limit=300 $OPTIMIZE_CFLAGS " \
  
  --disable-shared \
  
  --enable-static \
  
  --extra-ldflags="-Wl,-rpath-link=$PLATFORM/usr/lib -L$PLATFORM/usr/lib -nostdlib -lc -lm -ldl -llog" \
  
  --disable-everything \
  
  --enable-demuxer=mov \
  
  --enable-demuxer=h264 \
  
  --disable-ffplay \
  
  --enable-protocol=file \
  
  --enable-avformat \
  
  --enable-avcodec \
  
  --enable-decoder=rawvideo \
  
  --enable-decoder=mjpeg \
  
  --enable-decoder=h263 \
  
  --enable-decoder=mpeg4 \
  
  --enable-decoder=h264 \
  
  --enable-parser=h264 \
  
  --disable-network \
  
  --enable-zlib \
  
  --disable-avfilter \
  
  --disable-avdevice \
  
  --disable-asm \
  
  $ADDITIONAL_CONFIGURE_FLAG
  
  
  
  make clean
  
  make  -j4 install
  
  $PREBUILT/bin/arm-linux-androideabi-ar d libavcodec/libavcodec.a inverse.o
  
  $PREBUILT/bin/arm-linux-androideabi-ld -rpath-link=$PLATFORM/usr/lib -L$PLATFORM/usr/lib  -soname libffmpeg.so -shared -nostdlib  -z,noexecstack -Bsymbolic --whole-archive --no-undefined -o $PREFIX/libffmpeg.so libavcodec/libavcodec.a libavformat/libavformat.a libavutil/libavutil.a libswscale/libswscale.a -lc -lm -lz -ldl -llog  --warn-once  --dynamic-linker=/system/bin/linker $PREBUILT/lib/gcc/arm-linux-androideabi/4.4.3/libgcc.a
  
  }
  
  
  
  
  
  #arm v7vfpv3
  
  CPU=armv7-a
  
  OPTIMIZE_CFLAGS="-mfloat-abi=softfp -mfpu=vfpv3-d16 -marm -march=$CPU "
  
  PREFIX=./android/$CPU
  
  ADDITIONAL_CONFIGURE_FLAG=
  
  build_one

  When i run the script( test_build.sh) i get following

  Unknown option "".
  
  See ./configure --help for available options.
  
  ./test_build.sh: line 34: --nm=/home/user/android-ndk-r9/toolchains/arm-linux-androideabi-4.8/prebuilt/linux-x86/bin/arm-linux-androideabi-nm: No such file or directory
  
  CC      ffmpeg.o
  
  CC      cmdutils.o
  
  CC      libavdevice/alldevices.o
  
  CC      libavdevice/avdevice.o
  
  CC      libavdevice/dv1394.o
  
  ffmpeg.c: In function âopt_input_fileâ:
  
  ffmpeg.c:3698:9: warning: âloop_inputâ is deprecated (declared at libavformat/avformat.h:1049) [-Wdeprecated-declarations]
  
  ffmpeg.c: In function âopt_output_fileâ:
  
  ffmpeg.c:4483:9: warning: âloop_outputâ is deprecated (declared at libavformat/avformat.h:1025) [-Wdeprecated-declarations]
  
  CC      libavdevice/fbdev.o
  
  CC      libavdevice/lavfi.o
  
  CC      libavdevice/oss_audio.o
  
  CC      libavdevice/v4l2.o
  
  CC      libavfilter/af_aconvert.o
  
  libavfilter/af_aconvert.c:53:5: warning: function declaration isnât a prototype[-Wstrict-prototypes]
  
  libavfilter/af_aconvert.c:105:5: warning: function declaration isnât a prototype[-Wstrict-prototypes]
  
  CC      libavfilter/af_aformat.o
  
  CC      libavfilter/af_amerge.o
  
  CC      libavfilter/af_anull.o
  
  CC      libavfilter/af_aresample.o
  
  CC      libavfilter/af_ashowinfo.o
  
  CC      libavfilter/af_asplit.o
  
  CC      libavfilter/af_astreamsync.o
  
  CC      libavfilter/af_earwax.o
  
  CC      libavfilter/af_pan.o
  
  CC      libavfilter/af_silencedetect.o
  
  CC      libavfilter/af_volume.o
  
  CC      libavfilter/allfilters.o
  
  CC      libavfilter/asink_anullsink.o
  
  libavfilter/af_volume.c: In function âfilter_samplesâ:
  
  ./libavutil/arm/intmath.h:104:5: error: invalid 'asm': invalid operand code 'R'
  
  ./libavutil/arm/intmath.h:104:5: error: invalid 'asm': invalid operand code 'R'
  
  make: *** [libavfilter/af_volume.o] Error 1
  
  make: *** Waiting for unfinished jobs....
  
  ./test_build.sh: line 61: /home/user/android-ndk-r9/toolchains/arm-linux-androideabi-4.8/prebuilt/linux-x86/bin/arm-linux-androideabi-ar: cannot execute binary file
  
  ./test_build.sh: line 62: /home/user/android-ndk-r9/toolchains/arm-linux-androideabi-4.8/prebuilt/linux-x86/bin/arm-linux-androideabi-ld: cannot  binary file

  How can i get it work, or am i trying in wrong way ? Any help is appriciated !!

  Also if some one point me out the reason for errors. I dont' know why nm is showing error although it exist on specified path !
  Thank You

• Prevent output in error log when ffmpeg job is initiated via PHP's shell_exec()

  19 janvier 2016, par Jake

  I’m getting the entire output of the ffmpeg command printed to my server’s error.log — but as far as I can tell, the jobs complete successfully with no error.

  Is there any way to suppress the output ? I have seen people append stuff like >/dev/null 2>/dev/null & to their command, however that forces the command to return immediately and the job runs in the background. Unfortunately, I need the job to run in the foreground, because I need to do stuff with the output once the job is done.

  Here’s the command I am running...

  shell_exec('ffmpeg -i input.mp4 -f mp4 -c:v libx264 -preset slow -crf 24 -s 1280x720 -c:a libfdk_aac -profile:a aac_he -ar 22050 -b:a 64k -movflags +faststart output-1280x720.mp4');

  Here’s the output I am seeing...

  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX] ffmpeg version N-77432-gc0f67e1 Copyright (c) 2000-2015 the FFmpeg developers
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]   built with gcc 4.4.5 (Debian 4.4.5-8)
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]   configuration: --prefix=/usr --enable-nonfree --enable-libfreetype --enable-gpl --enable-libx264 --enable-x11grab --enable-zlib --enable-libvpx --enable-libtheora --enable-libvorbis --enable-libfdk-aac --enable-libmp3lame --enable-libopus
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]   libavutil      55. 11.100 / 55. 11.100
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]   libavcodec     57. 19.100 / 57. 19.100
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]   libavformat    57. 20.100 / 57. 20.100
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]   libavdevice    57.  0.100 / 57.  0.100
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]   libavfilter     6. 21.100 /  6. 21.100
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]   libswscale      4.  0.100 /  4.  0.100
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]   libswresample   2.  0.101 /  2.  0.101
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]   libpostproc    54.  0.100 / 54.  0.100
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX] Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'test-video.mp4':
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]   Metadata:
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]     major_brand     : mp42
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]     minor_version   : 0
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]     compatible_brands: mp42mp41
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]     creation_time   : 2015-07-14 22:13:20
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]   Duration: 00:00:10.51, start: 0.000000, bitrate: 17178 kb/s
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]     Stream #0:0(eng): Video: h264 (High) (avc1 / 0x31637661), yuv420p(tv, bt709), 1920x1080 [SAR 1:1 DAR 16:9], 17170 kb/s, 23.98 fps, 23.98 tbr, 24k tbn, 47.95 tbc (default)
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]     Metadata:
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]       creation_time   : 2015-07-14 22:13:20
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]       handler_name    : Alias Data Handler
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]       encoder         : AVC Coding
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX] Codec AVOption b (set bitrate (in bits/s)) specified for output file #0 (test-video-480p.mp4) has not been used for any stream. The most likely reason is either wrong type (e.g. a video option with no video streams) or that it is a private option of some encoder which was not actually used for any stream.
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX] Codec AVOption profile () specified for output file #0 (test-video-480p.mp4) has not been used for any stream. The most likely reason is either wrong type (e.g. a video option with no video streams) or that it is a private option of some encoder which was not actually used for any stream.
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX] [libx264 @ 0x4518ea0] using SAR=1280/1281
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX] [libx264 @ 0x4518ea0] using cpu capabilities: MMX2 SSE2Fast SSSE3 FastShuffle SSE4.2 AVX
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX] [libx264 @ 0x4518ea0] profile High, level 3.0
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX] [libx264 @ 0x4518ea0] 264 - core 120 r2151 a3f4407 - H.264/MPEG-4 AVC codec - Copyleft 2003-2011 - http://www.videolan.org/x264.html - options: cabac=1 ref=5 deblock=1:0:0 analyse=0x3:0x113 me=umh subme=8 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=6 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=2 b_bias=0 direct=3 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=23 scenecut=40 intra_refresh=0 rc_lookahead=50 rc=crf mbtree=1 crf=24.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX] Output #0, mp4, to 'test-video-480p.mp4':
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]   Metadata:
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]     major_brand     : mp42
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]     minor_version   : 0
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]     compatible_brands: mp42mp41
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]     encoder         : Lavf57.20.100
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]     Stream #0:0(eng): Video: h264 (libx264) ([33][0][0][0] / 0x0021), yuv420p, 854x480 [SAR 1280:1281 DAR 16:9], q=-1--1, 23.98 fps, 24k tbn, 23.98 tbc (default)
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]     Metadata:
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]       creation_time   : 2015-07-14 22:13:20
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]       handler_name    : Alias Data Handler
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]       encoder         : Lavc57.19.100 libx264
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]     Side data:
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]       unknown side data type 10 (24 bytes)
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX] Stream mapping:
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX]   Stream #0:0 -> #0:0 (h264 (native) -> h264 (libx264))
  
  [Tue Jan 19 17:10:59 2016] [error] [client XXX.XXX.XXX.XXX] Press [q] to stop, [?] for help
  
  [Tue Jan 19 17:11:00 2016] [error] [client XXX.XXX.XXX.XXX] frame=   24 fps=0.0 q=0.0 size=       0kB time=00:00:00.00 bitrate=N/A speed=   0x    \r
  
  [Tue Jan 19 17:11:00 2016] [error] [client XXX.XXX.XXX.XXX] frame=   53 fps= 51 q=0.0 size=       0kB time=00:00:00.00 bitrate=N/A speed=   0x    \r
  
  [Tue Jan 19 17:11:02 2016] [error] [client XXX.XXX.XXX.XXX] frame=   62 fps= 25 q=29.0 size=      75kB time=00:00:00.00 bitrate=N/A speed=   0x    \r
  
  [Tue Jan 19 17:11:02 2016] [error] [client XXX.XXX.XXX.XXX] frame=   68 fps= 20 q=29.0 size=      90kB time=00:00:00.25 bitrate=2946.8kbits/s speed=0.0745x    \r
  
  [Tue Jan 19 17:11:03 2016] [error] [client XXX.XXX.XXX.XXX] frame=   74 fps= 18 q=29.0 size=     103kB time=00:00:00.50 bitrate=1689.9kbits/s speed=0.12x    \r
  
  [Tue Jan 19 17:11:04 2016] [error] [client XXX.XXX.XXX.XXX] frame=   80 fps= 16 q=29.0 size=     115kB time=00:00:00.75 bitrate=1258.5kbits/s speed=0.148x    \r
  
  [Tue Jan 19 17:11:05 2016] [error] [client XXX.XXX.XXX.XXX] frame=   86 fps= 15 q=29.0 size=     128kB time=00:00:01.00 bitrate=1049.4kbits/s speed=0.175x    \r
  
  [Tue Jan 19 17:11:05 2016] [error] [client XXX.XXX.XXX.XXX] frame=   92 fps= 15 q=29.0 size=     140kB time=00:00:01.25 bitrate= 917.2kbits/s speed=0.201x    \r
  
  [Tue Jan 19 17:11:06 2016] [error] [client XXX.XXX.XXX.XXX] frame=   94 fps= 14 q=29.0 size=     146kB time=00:00:01.33 bitrate= 895.4kbits/s speed=0.196x    \r
  
  [Tue Jan 19 17:11:07 2016] [error] [client XXX.XXX.XXX.XXX] frame=  100 fps= 13 q=29.0 size=     158kB time=00:00:01.58 bitrate= 816.6kbits/s speed=0.211x    \r