Recherche avancée

Sur d’autres sites (12476)

• Ffmpeg Android - First image is skipped while making a slideshow

  17 mars 2021, par M. Bilal Asif

  Issue : I have 7 images in a list (with different size, resolution and format). I am adding an mp3 audio file and fade effect while making a slideshow with them, as i am trying to do it by following command

  


  val inputCommandinitial = arrayOf("-y", "-framerate", "1/5")&#xA;val arrTop = ArrayList<string>()&#xA;&#xA; //Add all paths&#xA;    for (i in images!!.indices) {&#xA;        arrTop.add("-loop")&#xA;        arrTop.add("1")&#xA;        arrTop.add("-t")&#xA;        arrTop.add("5")            &#xA;        arrTop.add("-i")&#xA;        arrTop.add(images!![i].path)&#xA;    }&#xA;&#xA;    //Apply filter graph&#xA;    arrTop.add("-i")&#xA;    arrTop.add(audio!!.path)&#xA;    arrTop.add("-filter_complex")&#xA;&#xA;    val stringBuilder = StringBuilder()&#xA;&#xA;    for (i in images!!.indices) {&#xA;        stringBuilder.append("[$i:v]scale=720:1280:force_original_aspect_ratio=decrease,pad=720:1280:(ow-iw)/2:(oh-ih)/2,setsar=1,fade=t=in:st=0:d=1,fade=t=out:st=5:d=1[v$i];")&#xA;    }&#xA;&#xA;    for (i in images!!.indices) {&#xA;        stringBuilder.append("[v$i]")&#xA;    }&#xA;&#xA;    //Concat command&#xA;    stringBuilder.append("concat=n=${images!!.size}:v=1:a=0,fps=25,format=yuv420p[v]")&#xA;&#xA;    val endcommand = arrayOf("-map", "[v]", "-map", "${images!!.size}:a", "-c:a", "copy", "-preset", "ultrafast", "-shortest", outputLocation.path)&#xA;    val finalCommand = (inputCommandinitial &#x2B; arrTop &#x2B; stringBuilder.toString() &#x2B; endcommand)&#xA;</string>

  


  But, it skips the first image and shows the rest 6 images and video output duration is 30 seconds, i've been trying since 3 days now

  


  Requirement :
making a slideshow with different format, size, resolution etc, i.e. picked by user from gallery and show in slideshow adding an audio behind, with fade effect

  


  Here is the complete log :

  


  I/mobile-ffmpeg: Loading mobile-ffmpeg.
 I/mobile-ffmpeg: Loaded mobile-ffmpeg-full-gpl-x86-4.4-lts-20200803.
 D/mobile-ffmpeg: Callback thread started.
 I/mobile-ffmpeg: ffmpeg version v4.4-dev-416
 I/mobile-ffmpeg:  Copyright (c) 2000-2020 the FFmpeg developers
 I/mobile-ffmpeg:   built with Android (6454773 based on r365631c2) clang version 9.0.8 (https://android.googlesource.com/toolchain/llvm-project 98c855489587874b2a325e7a516b99d838599c6f) (based on LLVM 9.0.8svn)
 I/mobile-ffmpeg:   configuration: --cross-prefix=i686-linux-android- --sysroot=/files/android-sdk/ndk/21.3.6528147/toolchains/llvm/prebuilt/linux-x86_64/sysroot --prefix=/home/taner/Projects/mobile-ffmpeg/prebuilt/android-x86/ffmpeg --pkg-config=/usr/bin/pkg-config --enable-version3 --arch=i686 --cpu=i686 --cc=i686-linux-android16-clang --cxx=i686-linux-android16-clang++ --extra-libs='-L/home/taner/Projects/mobile-ffmpeg/prebuilt/android-x86/cpu-features/lib -lndk_compat' --target-os=android --disable-neon --disable-asm --disable-inline-asm --enable-cross-compile --enable-pic --enable-jni --enable-optimizations --enable-swscale --enable-shared --enable-v4l2-m2m --disable-outdev=fbdev --disable-indev=fbdev --enable-small --disable-openssl --disable-xmm-clobber-test --disable-debug --enable-lto --disable-neon-clobber-test --disable-programs --disable-postproc --disable-doc --disable-htmlpages --disable-manpages --disable-podpages --disable-txtpages --disable-static --disable-sndio --disable-schannel --disable-securetransport --disable-xlib --disable-cuda --disable-cuvid --disable-nvenc --disable-vaapi --disable-vdpau --disable-videotoolbox --disable-audiotoolbox --disable-appkit --disable-alsa --disable-cuda --disable-cuvid --disable-nvenc --disable-vaapi --disable-vdpau --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-gmp --enable-gnutls --enable-libmp3lame --enable-libass --enable-iconv --enable-libtheora --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libxml2 --enable-libopencore-amrnb --enable-libshine --enable-libspeex --enable-libwavpack --enable-libkvazaar --enable-libx264 --enable-gpl --enable-libxvid --enable-gpl --enable-libx265 --enable-gpl --enable-libvidstab --enable-gpl --enable-libilbc --enable-libopus --enable-libsnappy --enable-libsoxr --enable-libaom --enable-libtwolame --disable-sdl2 --enable-libvo-amrwbenc --enable-zlib --enable-mediacodec
 I/mobile-ffmpeg:   libavutil      56. 55.100 / 56. 55.100
 I/mobile-ffmpeg:   libavcodec     58. 96.100 / 58. 96.100
 I/mobile-ffmpeg:   libavformat    58. 48.100 / 58. 48.100
 I/mobile-ffmpeg:   libavdevice    58. 11.101 / 58. 11.101
 I/mobile-ffmpeg:   libavfilter     7. 87.100 /  7. 87.100
 I/mobile-ffmpeg:   libswscale      5.  8.100 /  5.  8.100
 I/mobile-ffmpeg:   libswresample   3.  8.100 /  3.  8.100
 I/mobile-ffmpeg: Input #0, png_pipe, from '/storage/emulated/0/FFMpeg Example/image1.png':
 I/mobile-ffmpeg:   Duration:
 I/mobile-ffmpeg: N/A
 I/mobile-ffmpeg: , bitrate:
 I/mobile-ffmpeg: N/A
 I/mobile-ffmpeg:     Stream #0:0
 I/mobile-ffmpeg: : Video: png, rgb24(pc), 800x500 [SAR 11811:11811 DAR 8:5]
 I/mobile-ffmpeg: ,
 I/mobile-ffmpeg: 0.20 tbr,
 I/mobile-ffmpeg: 0.20 tbn,
 I/mobile-ffmpeg: 0.20 tbc
 W/mobile-ffmpeg: [png_pipe @ 0xe1a8ec00] Stream #0: not enough frames to estimate rate; consider increasing probesize
 I/mobile-ffmpeg: Input #1, png_pipe, from '/storage/emulated/0/FFMpeg Example/image2.png':
 I/mobile-ffmpeg:   Duration:
 I/mobile-ffmpeg: N/A
 I/mobile-ffmpeg: , bitrate:
 I/mobile-ffmpeg: N/A
 I/mobile-ffmpeg:     Stream #1:0
 I/mobile-ffmpeg: : Video: png, rgb24(pc), 1920x1080 [SAR 3779:3779 DAR 16:9]
 I/mobile-ffmpeg: ,
 I/mobile-ffmpeg: 25 tbr,
 I/mobile-ffmpeg: 25 tbn,
 I/mobile-ffmpeg: 25 tbc
 I/mobile-ffmpeg: Input #2, png_pipe, from '/storage/emulated/0/FFMpeg Example/one.png':
 I/mobile-ffmpeg:   Duration:
 I/mobile-ffmpeg: N/A
 I/mobile-ffmpeg: , bitrate:
 I/mobile-ffmpeg: N/A
 I/mobile-ffmpeg:     Stream #2:0
 I/mobile-ffmpeg: : Video: png, rgba(pc), 720x1280
 I/mobile-ffmpeg: ,
 I/mobile-ffmpeg: 25 fps,
 I/mobile-ffmpeg: 25 tbr,
 I/mobile-ffmpeg: 25 tbn,
 I/mobile-ffmpeg: 25 tbc
 I/mobile-ffmpeg: Input #3, image2, from '/storage/emulated/0/FFMpeg Example/two.png':
 I/mobile-ffmpeg:   Duration:
 I/mobile-ffmpeg: 00:00:00.04
 I/mobile-ffmpeg: , start:
 I/mobile-ffmpeg: 0.000000
 I/mobile-ffmpeg: , bitrate:
 I/mobile-ffmpeg: 7955 kb/s
 I/mobile-ffmpeg:     Stream #3:0
 I/mobile-ffmpeg: : Video: mjpeg, yuvj420p(pc, bt470bg/unknown/unknown), 564x1002 [SAR 72:72 DAR 94:167]
 I/mobile-ffmpeg: ,
 I/mobile-ffmpeg: 25 fps,
 I/mobile-ffmpeg: 25 tbr,
 I/mobile-ffmpeg: 25 tbn,
 I/mobile-ffmpeg: 25 tbc
 W/mobile-ffmpeg: [png_pipe @ 0xe1a90a00] Stream #0: not enough frames to estimate rate; consider increasing probesize
 I/mobile-ffmpeg: Input #4, png_pipe, from '/storage/emulated/0/FFMpeg Example/image3.png':
 I/mobile-ffmpeg:   Duration:
 I/mobile-ffmpeg: N/A
 I/mobile-ffmpeg: , bitrate:
 I/mobile-ffmpeg: N/A
 I/mobile-ffmpeg:     Stream #4:0
 I/mobile-ffmpeg: : Video: png, rgb24(pc), 1820x1024
 I/mobile-ffmpeg: ,
 I/mobile-ffmpeg: 25 tbr,
 I/mobile-ffmpeg: 25 tbn,
 I/mobile-ffmpeg: 25 tbc
 I/mobile-ffmpeg: Input #5, png_pipe, from '/storage/emulated/0/FFMpeg Example/image4.png':
 I/mobile-ffmpeg:   Duration:
 I/mobile-ffmpeg: N/A
 I/mobile-ffmpeg: , bitrate:
 I/mobile-ffmpeg: N/A
 I/mobile-ffmpeg:     Stream #5:0
 I/mobile-ffmpeg: : Video: png, rgb24(pc), 1920x800 [SAR 2835:2835 DAR 12:5]
 I/mobile-ffmpeg: ,
 I/mobile-ffmpeg: 25 fps,
 I/mobile-ffmpeg: 25 tbr,
 I/mobile-ffmpeg: 25 tbn,
 I/mobile-ffmpeg: 25 tbc
 I/mobile-ffmpeg: Input #6, image2, from '/storage/emulated/0/FFMpeg Example/image5.png':
 I/mobile-ffmpeg:   Duration:
 I/mobile-ffmpeg: 00:00:00.04
 I/mobile-ffmpeg: , start:
 I/mobile-ffmpeg: 0.000000
 I/mobile-ffmpeg: , bitrate:
 I/mobile-ffmpeg: 159573 kb/s
 I/mobile-ffmpeg:     Stream #6:0
 I/mobile-ffmpeg: : Video: mjpeg, yuvj444p(pc, bt470bg/unknown/unknown), 1600x900
 I/mobile-ffmpeg: ,
 I/mobile-ffmpeg: 25 fps,
 I/mobile-ffmpeg: 25 tbr,
 I/mobile-ffmpeg: 25 tbn,
 I/mobile-ffmpeg: 25 tbc
 W/mobile-ffmpeg: [mp3 @ 0xe1a92800] Estimating duration from bitrate, this may be inaccurate
 I/mobile-ffmpeg: Input #7, mp3, from '/storage/emulated/0/FFMpeg Example/shortmusic.mp3':
 I/mobile-ffmpeg:   Metadata:
 I/mobile-ffmpeg:     track           :
 I/mobile-ffmpeg: 25
 I/mobile-ffmpeg:     artist          :
 I/mobile-ffmpeg: longzijun
 I/mobile-ffmpeg:     title           :
 I/mobile-ffmpeg: Memoryne Music Box Version
 I/mobile-ffmpeg:     album_artist    :
 I/mobile-ffmpeg: longzijun
 I/mobile-ffmpeg:     genre           :
 I/mobile-ffmpeg: Soundtrack
 I/mobile-ffmpeg:     date            :
 I/mobile-ffmpeg: 2012
 I/mobile-ffmpeg:   Duration:
 I/mobile-ffmpeg: 00:00:57.70
 I/mobile-ffmpeg: , start:
 I/mobile-ffmpeg: 0.000000
 I/mobile-ffmpeg: , bitrate:
 I/mobile-ffmpeg: 320 kb/s
 I/mobile-ffmpeg:     Stream #7:0
 I/mobile-ffmpeg: : Audio: mp3, 48000 Hz, stereo, fltp, 320 kb/s
 I/mobile-ffmpeg: Stream mapping:
 I/mobile-ffmpeg:   Stream #0:0 (png) -> scale
 I/mobile-ffmpeg:   Stream #1:0 (png) -> scale
 I/mobile-ffmpeg:   Stream #2:0 (png) -> scale
 I/mobile-ffmpeg:   Stream #3:0 (mjpeg) -> scale
 I/mobile-ffmpeg:   Stream #4:0 (png) -> scale
 I/mobile-ffmpeg:   Stream #5:0 (png) -> scale
 I/mobile-ffmpeg:   Stream #6:0 (mjpeg) -> scale
 I/mobile-ffmpeg:   format
 I/mobile-ffmpeg:  -> Stream #0:0 (libx264)
 I/mobile-ffmpeg:   Stream #7:0 -> #0:1
 I/mobile-ffmpeg:  (copy)
 I/mobile-ffmpeg: Press [q] to stop, [?] for help
 I/mobile-ffmpeg: frame=    0 fps=0.0 q=0.0 size=       0kB time=-577014:32:22.77 bitrate=  -0.0kbits/s speed=N/A
 W/mobile-ffmpeg: [graph 0 input from stream 0:0 @ 0xe1a1bec0] sws_param option is deprecated and ignored
 W/mobile-ffmpeg: [graph 0 input from stream 1:0 @ 0xe1a1bf20] sws_param option is deprecated and ignored
 W/mobile-ffmpeg: [graph 0 input from stream 2:0 @ 0xe1a1bfe0] sws_param option is deprecated and ignored
 W/mobile-ffmpeg: [graph 0 input from stream 3:0 @ 0xe1a1c0a0] sws_param option is deprecated and ignored
 W/mobile-ffmpeg: [graph 0 input from stream 4:0 @ 0xe1a1c160] sws_param option is deprecated and ignored
 W/mobile-ffmpeg: [graph 0 input from stream 5:0 @ 0xe1a1c220] sws_param option is deprecated and ignored
 W/mobile-ffmpeg: [graph 0 input from stream 6:0 @ 0xe1a1c2e0] sws_param option is deprecated and ignored
 W/mobile-ffmpeg: [swscaler @ 0xbf684840] deprecated pixel format used, make sure you did set range correctly
 W/mobile-ffmpeg: [swscaler @ 0xbf68fec0] deprecated pixel format used, make sure you did set range correctly
 I/mobile-ffmpeg: [libx264 @ 0xe1ad4400] using SAR=1/1
 I/mobile-ffmpeg: [libx264 @ 0xe1ad4400] using cpu capabilities: none!
 I/mobile-ffmpeg: [libx264 @ 0xe1ad4400] profile Constrained Baseline, level 3.1, 4:2:0, 8-bit
 I/mobile-ffmpeg: [libx264 @ 0xe1ad4400] 264 - core 160 - H.264/MPEG-4 AVC codec - Copyleft 2003-2020 - http://www.videolan.org/x264.html - options: cabac=0 ref=1 deblock=0:0:0 analyse=0:0 me=dia subme=0 psy=1 psy_rd=1.00:0.00 mixed_ref=0 me_range=16 chroma_me=1 trellis=0 8x8dct=0 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=0 threads=4 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=0 weightp=0 keyint=250 keyint_min=25 scenecut=0 intra_refresh=0 rc=crf mbtree=0 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=0
 I/mobile-ffmpeg: Output #0, mp4, to '/storage/emulated/0/FFMpeg Example/video/movie_1615954349867.mp4':
 I/mobile-ffmpeg:   Metadata:
 I/mobile-ffmpeg:     encoder         :
 I/mobile-ffmpeg: Lavf58.48.100
 I/mobile-ffmpeg:     Stream #0:0
 I/mobile-ffmpeg: : Video: h264 (libx264) (avc1 / 0x31637661), yuv420p, 720x1280 [SAR 1:1 DAR 9:16], q=-1--1
 I/mobile-ffmpeg: ,
 I/mobile-ffmpeg: 25 fps,
 I/mobile-ffmpeg: 12800 tbn,
 I/mobile-ffmpeg: 25 tbc
 I/mobile-ffmpeg:  (default)
 I/mobile-ffmpeg:     Metadata:
 I/mobile-ffmpeg:       encoder         :
 I/mobile-ffmpeg: Lavc58.96.100 libx264
 I/mobile-ffmpeg:     Side data:
 I/mobile-ffmpeg:
 I/mobile-ffmpeg: cpb:
 I/mobile-ffmpeg: bitrate max/min/avg: 0/0/0 buffer size: 0
 I/mobile-ffmpeg: vbv_delay: N/A
 I/mobile-ffmpeg:     Stream #0:1
 I/mobile-ffmpeg: : Audio: mp3 (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 320 kb/s
 I/mobile-ffmpeg: frame=    0 fps=0.0 q=0.0 size=       0kB time=00:00:00.00 bitrate=N/A speed=   0x
 I/mobile-ffmpeg: frame=    7 fps=3.8 q=20.0 size=       0kB time=00:00:00.04 bitrate=   9.6kbits/s speed=0.0215x
 I/mobile-ffmpeg: frame=   15 fps=6.3 q=22.0 size=       0kB time=00:00:00.36 bitrate=   1.1kbits/s speed=0.151x
 I/mobile-ffmpeg: frame=   24 fps=8.2 q=23.0 size=     256kB time=00:00:00.72 bitrate=2912.9kbits/s speed=0.245x
 I/mobile-ffmpeg: frame=   33 fps=9.5 q=14.0 size=     512kB time=00:00:01.08 bitrate=3883.7kbits/s speed=0.31x
 I/mobile-ffmpeg: frame=   44 fps= 11 q=12.0 size=     512kB time=00:00:01.52 bitrate=2759.5kbits/s speed=0.379x
 I/mobile-ffmpeg: frame=   55 fps= 12 q=12.0 size=     512kB time=00:00:01.96 bitrate=2140.1kbits/s speed=0.432x
 I/mobile-ffmpeg: frame=   68 fps= 13 q=12.0 size=     768kB time=00:00:02.48 bitrate=2537.0kbits/s speed=0.491x
 I/mobile-ffmpeg: frame=   77 fps= 14 q=12.0 size=     768kB time=00:00:02.84 bitrate=2215.4kbits/s speed=0.499x
 I/mobile-ffmpeg: frame=   84 fps= 13 q=12.0 size=     768kB time=00:00:03.12 bitrate=2016.6kbits/s speed=0.499x
 I/mobile-ffmpeg: frame=   94 fps= 14 q=12.0 size=     768kB time=00:00:03.52 bitrate=1787.4kbits/s speed=0.52x
 I/mobile-ffmpeg: frame=  102 fps= 14 q=12.0 size=     768kB time=00:00:03.84 bitrate=1638.5kbits/s speed=0.525x
 I/mobile-ffmpeg: frame=  116 fps= 15 q=12.0 size=     768kB time=00:00:04.40 bitrate=1429.9kbits/s speed=0.556x
 I/mobile-ffmpeg: frame=  127 fps= 15 q=12.0 size=     768kB time=00:00:04.84 bitrate=1299.9kbits/s speed=0.574x
 I/mobile-ffmpeg: frame=  134 fps= 15 q=21.0 size=     768kB time=00:00:05.12 bitrate=1228.9kbits/s speed=0.571x
 I/mobile-ffmpeg: frame=  140 fps= 15 q=22.0 size=    1024kB time=00:00:05.36 bitrate=1565.1kbits/s speed=0.56x
 I/mobile-ffmpeg: frame=  145 fps= 14 q=23.0 size=    1024kB time=00:00:05.56 bitrate=1508.8kbits/s speed=0.55x
 I/mobile-ffmpeg: frame=  151 fps= 14 q=23.0 size=    1280kB time=00:00:05.80 bitrate=1807.9kbits/s speed=0.546x
 I/mobile-ffmpeg: frame=  164 fps= 15 q=12.0 size=    1536kB time=00:00:06.32 bitrate=1991.0kbits/s speed=0.567x
 I/mobile-ffmpeg: frame=  172 fps= 15 q=12.0 size=    1536kB time=00:00:06.64 bitrate=1895.1kbits/s speed=0.569x
 I/mobile-ffmpeg: frame=  186 fps= 15 q=12.0 size=    1536kB time=00:00:07.20 bitrate=1747.7kbits/s speed=0.592x
 I/mobile-ffmpeg: frame=  207 fps= 16 q=12.0 size=    1536kB time=00:00:08.04 bitrate=1565.1kbits/s speed=0.634x
 I/mobile-ffmpeg: frame=  229 fps= 17 q=12.0 size=    1792kB time=00:00:08.92 bitrate=1645.8kbits/s speed=0.677x
 I/mobile-ffmpeg: frame=  249 fps= 18 q=12.0 size=    1792kB time=00:00:09.72 bitrate=1510.3kbits/s speed=0.71x
 I/mobile-ffmpeg: frame=  270 fps= 19 q=21.0 size=    2048kB time=00:00:10.56 bitrate=1588.8kbits/s speed=0.744x
 I/mobile-ffmpeg: frame=  296 fps= 20 q=12.0 size=    2304kB time=00:00:11.60 bitrate=1627.1kbits/s speed=0.789x
 I/mobile-ffmpeg: frame=  319 fps= 21 q=12.0 size=    2304kB time=00:00:12.52 bitrate=1507.6kbits/s speed=0.823x
 I/mobile-ffmpeg: frame=  337 fps= 21 q=12.0 size=    2304kB time=00:00:13.24 bitrate=1425.6kbits/s speed=0.839x
 I/mobile-ffmpeg: frame=  347 fps= 21 q=12.0 size=    2304kB time=00:00:13.64 bitrate=1383.8kbits/s speed=0.835x
 I/mobile-ffmpeg: frame=  360 fps= 21 q=12.0 size=    2560kB time=00:00:14.16 bitrate=1481.1kbits/s speed=0.841x
 I/mobile-ffmpeg: frame=  382 fps= 22 q=19.0 size=    2560kB time=00:00:15.04 bitrate=1394.4kbits/s speed=0.866x
 I/mobile-ffmpeg: frame=  395 fps= 22 q=22.0 size=    2816kB time=00:00:15.56 bitrate=1482.6kbits/s speed=0.869x
 I/mobile-ffmpeg: frame=  407 fps= 22 q=15.0 size=    3072kB time=00:00:16.04 bitrate=1569.0kbits/s speed=0.872x
 I/mobile-ffmpeg: frame=  421 fps= 22 q=12.0 size=    3072kB time=00:00:16.60 bitrate=1516.0kbits/s speed=0.875x
 I/mobile-ffmpeg: frame=  432 fps= 22 q=12.0 size=    3072kB time=00:00:17.04 bitrate=1476.9kbits/s speed=0.875x
 I/mobile-ffmpeg: frame=  446 fps= 22 q=12.0 size=    3072kB time=00:00:17.60 bitrate=1429.9kbits/s speed=0.88x
 I/mobile-ffmpeg: frame=  458 fps= 22 q=12.0 size=    3328kB time=00:00:18.08 bitrate=1507.9kbits/s speed=0.879x
 I/mobile-ffmpeg: frame=  472 fps= 22 q=12.0 size=    3328kB time=00:00:18.64 bitrate=1462.6kbits/s speed=0.884x
 I/mobile-ffmpeg: frame=  489 fps= 23 q=12.0 size=    3328kB time=00:00:19.32 bitrate=1411.1kbits/s speed=0.894x
 I/mobile-ffmpeg: frame=  509 fps= 23 q=19.0 size=    3328kB time=00:00:20.12 bitrate=1355.0kbits/s speed=0.909x
 I/mobile-ffmpeg: frame=  531 fps= 23 q=15.0 size=    3584kB time=00:00:21.00 bitrate=1398.1kbits/s speed=0.928x
 I/mobile-ffmpeg: frame=  555 fps= 24 q=12.0 size=    3840kB time=00:00:21.96 bitrate=1432.5kbits/s speed=0.949x
 I/mobile-ffmpeg: frame=  577 fps= 24 q=12.0 size=    3840kB time=00:00:22.84 bitrate=1377.3kbits/s speed=0.966x
 I/mobile-ffmpeg: frame=  599 fps= 25 q=12.0 size=    3840kB time=00:00:23.72 bitrate=1326.2kbits/s speed=0.981x
 I/mobile-ffmpeg: frame=  620 fps= 25 q=12.0 size=    3840kB time=00:00:24.56 bitrate=1280.8kbits/s speed=0.995x
 I/mobile-ffmpeg: frame=  630 fps= 25 q=18.0 size=    3840kB time=00:00:24.96 bitrate=1260.3kbits/s speed=0.99x
 I/mobile-ffmpeg: frame=  640 fps= 25 q=21.0 size=    4096kB time=00:00:25.36 bitrate=1323.1kbits/s speed=0.985x
 I/mobile-ffmpeg: frame=  652 fps= 25 q=22.0 size=    4352kB time=00:00:25.84 bitrate=1379.7kbits/s speed=0.984x
 I/mobile-ffmpeg: frame=  665 fps= 25 q=12.0 size=    4608kB time=00:00:26.36 bitrate=1432.1kbits/s speed=0.984x
 I/mobile-ffmpeg: frame=  678 fps= 25 q=12.0 size=    4608kB time=00:00:26.88 bitrate=1404.4kbits/s speed=0.984x
 I/mobile-ffmpeg: frame=  690 fps= 25 q=12.0 size=    4608kB time=00:00:27.36 bitrate=1379.7kbits/s speed=0.983x
 I/mobile-ffmpeg: frame=  703 fps= 25 q=12.0 size=    4608kB time=00:00:27.88 bitrate=1354.0kbits/s speed=0.983x
 I/mobile-ffmpeg: frame=  716 fps= 25 q=12.0 size=    4608kB time=00:00:28.40 bitrate=1329.2kbits/s speed=0.983x
 I/mobile-ffmpeg: frame=  729 fps= 25 q=12.0 size=    4608kB time=00:00:28.92 bitrate=1305.3kbits/s speed=0.983x
 I/mobile-ffmpeg: frame=  742 fps= 25 q=12.0 size=    4608kB time=00:00:29.44 bitrate=1282.2kbits/s speed=0.983x
 I/mobile-ffmpeg: frame=  749 fps= 25 q=-1.0 Lsize=    4883kB time=00:00:29.95 bitrate=1335.5kbits/s speed=0.988x
 I/mobile-ffmpeg: video:3696kB audio:1171kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead:
 I/mobile-ffmpeg: 0.326516%
 I/mobile-ffmpeg: [libx264 @ 0xe1ad4400] frame I:3     Avg QP:13.33  size:  2725
 I/mobile-ffmpeg: [libx264 @ 0xe1ad4400] frame P:746   Avg QP:13.98  size:  5062
 I/mobile-ffmpeg: [libx264 @ 0xe1ad4400] mb I  I16..4: 100.0%  0.0%  0.0%
 I/mobile-ffmpeg: [libx264 @ 0xe1ad4400] mb P  I16..4:  7.1%  0.0%  0.0%  P16..4:  8.2%  0.0%  0.0%  0.0%  0.0%    skip:84.7%
 I/mobile-ffmpeg: [libx264 @ 0xe1ad4400] coded y,uvDC,uvAC intra: 14.5% 19.0% 6.9% inter: 5.1% 5.4% 1.4%
 I/mobile-ffmpeg: [libx264 @ 0xe1ad4400] i16 v,h,dc,p: 65% 18%  7%  9%
 I/mobile-ffmpeg: [libx264 @ 0xe1ad4400] i8c dc,h,v,p: 71% 19%  6%  4%
 I/mobile-ffmpeg: [libx264 @ 0xe1ad4400] kb/s:1010.47
 I/mobile-ffmpeg: Async command execution completed successfully.


  


  and here is command is ffmpeg syntax

  


  "-y"
"-framerate"
"1/5"
"-loop"
"1"
"-t"
"5"
"-i"
"/storage/emulated/0/FFMpeg Example/image1.png"
"-loop"
"1"
"-t"
"5"
"-i"
 "/storage/emulated/0/FFMpeg Example/image2.png"
 "-loop"
 "1"
 "-t"
 "5"
 "-i"
 "/storage/emulated/0/FFMpeg Example/one.png"
 "-loop"
 "1"
 "-t"
 "5"
 "-i"
 "/storage/emulated/0/FFMpeg Example/two.png"
 "-loop"
 "1"
 "-t"
 "5"
 "-i"
 "/storage/emulated/0/FFMpeg Example/image3.png"
 "-loop"
 "1"
 "-t"
 "5"
 "-i"
 "/storage/emulated/0/FFMpeg Example/image4.png"
 "-loop"
 "1"
 "-t"
 "5"
 "-i"
 "/storage/emulated/0/FFMpeg Example/image5.png"
 "-i"
 "/storage/emulated/0/FFMpeg Example/shortmusic.mp3"
 "-filter_complex"
 "[0:v]scale=720:1280:force_original_aspect_ratio=decrease,pad=720:1280:(ow-iw)/2:(oh-ih)/2,setsar=1,fade=t=in:st=0:d=1,fade=t=out:st=5:d=1[v0];
[1:v]scale=720:1280:force_original_aspect_ratio=decrease,pad=720:1280:(ow-iw)/2:(oh-ih)/2,setsar=1,fade=t=in:st=0:d=1,fade=t=out:st=5:d=1[v1];
[2:v]scale=720:1280:force_original_aspect_ratio=decrease,pad=720:1280:(ow-iw)/2:(oh-ih)/2,setsar=1,fade=t=in:st=0:d=1,fade=t=out:st=5:d=1[v2];
[3:v]scale=720:1280:force_original_aspect_ratio=decrease,pad=720:1280:(ow-iw)/2:(oh-ih)/2,setsar=1,fade=t=in:st=0:d=1,fade=t=out:st=5:d=1[v3];
[4:v]scale=720:1280:force_original_aspect_ratio=decrease,pad=720:1280:(ow-iw)/2:(oh-ih)/2,setsar=1,fade=t=in:st=0:d=1,fade=t=out:st=5:d=1[v4];
[5:v]scale=720:1280:force_original_aspect_ratio=decrease,pad=720:1280:(ow-iw)/2:(oh-ih)/2,setsar=1,fade=t=in:st=0:d=1,fade=t=out:st=5:d=1[v5];
[6:v]scale=720:1280:force_original_aspect_ratio=decrease,pad=720:1280:(ow-iw)/2:(oh-ih)/2,setsar=1,fade=t=in:st=0:d=1,fade=t=out:st=5:d=1[v6];
[v0][v1][v2][v3][v4][v5][v6]concat=n=7:v=1:a=0,fps=25,format=yuv420p[v]"
 "-map"
 "[v]"
 "-map"
 "7:a"
 "-c:a"
 "copy"
 "-preset"
 "ultrafast"
 "-shortest"
 "/storage/emulated/0/FFMpeg Example/video/movie_1615955101725.mp4"


  


• FFMPEG - Converting any kind of file to Mp4 compatible with IOS and Flash

  14 février 2021, par jax

  I am struggling with FFmpeg within Drupal Video Module to produce files to MP4 that is compatible with IOS and Flash Player10 and up.
I have used the following commands so far, please note that the variables starting with " !" are placeholders and will be replaces with the proper items :

  


  FFmpeg -strict experimental -y -i !videofile -pass 1 -s !widthx!height -b:v 500k -threads 0 -vcodec libx264 -vf "pad=!paddingwidth:!paddingheight:!paddingleft:!paddingtop:000000" -preset slow -an !convertfile

FFmpeg -strict experimental -y -i !videofile -pass 2 -s !widthx!height -b:v 500k -threads 0 -vcodec libx264 -vf "pad=!paddingwidth:!paddingheight:!paddingleft:!paddingtop:000000" -preset slow -acodec aac -ab 128k !convertfile


  


  The above command produce an error as :

  


  error executing command for rendering preset HTML5 MP4, command #1 :

  


  nice -n 19 /usr/bin/ffmpeg/ffmpeg -y -i '80137db8c3_1334836277_int_tr_19.mp4' -s 176x100 -b:v 500k -threads 0 -vcodec libx264 -preset slow -acodec aac -ab 128k '/converted/80137db8c3_1334836277_int_tr_19.mp4' 2>&1

Output:

ffmpeg version git-2013-02-01-5a67e30 Copyright (c) 2000-2013 the FFmpeg developers
  built on Feb  1 2013 14:23:14 with gcc 4.6 (Ubuntu/Linaro 4.6.3-1ubuntu5)
  configuration: --enable-gpl --enable-libass --enable-libfaac --enable-libfdk-aac --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-librtmp --enable-libtheora --enable-libvorbis --enable-libvpx --enable-libx264 --enable-nonfree --enable-version3
  libavutil      52. 17.100 / 52. 17.100
  libavcodec     54. 91.100 / 54. 91.100
  libavformat    54. 61.104 / 54. 61.104
  libavdevice    54.  3.103 / 54.  3.103
  libavfilter     3. 35.100 /  3. 35.100
  libswscale      2.  2.100 /  2.  2.100
  libswresample   0. 17.102 /  0. 17.102
  libpostproc    52.  2.100 / 52.  2.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '80137db8c3_1334836277_int_tr_19.mp4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: isommp42
    creation_time   : 2011-03-28 00:12:26
  Duration: 00:02:01.14, start: 0.000000, bitrate: 703 kb/s
    Stream #0:0(und): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuv420p, 640x360 [SAR 1:1 DAR 16:9], 601 kb/s, 29.96 fps, 29.92 tbr, 1k tbn, 59.83 tbc
    Metadata:
      creation_time   : 1970-01-01 00:00:00
      handler_name    : VideoHandler
    Stream #0:1(und): Audio: aac (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 96 kb/s
    Metadata:
      creation_time   : 2011-03-28 00:12:27
      handler_name    : (C) 2007 Google Inc. v08.13.2007.
[libx264 @ 0x34ec060] using SAR=100/99
[libx264 @ 0x34ec060] using cpu capabilities: MMX2 SSE2Fast SSSE3 FastShuffle SSE4.2 AVX
[libx264 @ 0x34ec060] profile High, level 2.0
[libx264 @ 0x34ec060] 264 - core 129 r2245 bc13772 - H.264/MPEG-4 AVC codec - Copyleft 2003-2013 - http://www.videolan.org/x264.html - options: cabac=1 ref=5 deblock=1:0:0 analyse=0x3:0x113 me=umh subme=8 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=2 b_bias=0 direct=3 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=50 rc=abr mbtree=1 bitrate=500 ratetol=1.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
The encoder 'aac' is experimental but experimental codecs are not enabled, add '-strict -2' if you want to use it.
Alternatively use the non experimental encoder 'libfaac'.


  


  Another command that I used is :

  


  FFmpeg -i !videofile -an -pass 1 -vcodec libx264 -preset slow -b 500k -threads auto !convertfile

FFMpeg -y -i !videofile -acodec libfaac -ab 128k -pass 2 -vcodec libx264 -preset slow -b 500k -threads auto !convertfile


  


  Output for the first pass :

  


  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'comiccon.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: mp41
    creation_time   : 2012-08-15 17:12:37
  Duration: 01:17:15.93, start: 0.000000, bitrate: 706 kb/s
    Stream #0:0(eng): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuv420p, 640x360 [SAR 1:1 DAR 16:9], 636 kb/s, 30 fps, 30 tbr, 90k tbn, 60 tbc
    Metadata:
      creation_time   : 2012-08-15 17:12:37
      handler_name    : VideoHandler
    Stream #0:1(eng): Audio: aac (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 63 kb/s
    Metadata:
      creation_time   : 2012-08-15 17:12:37
      handler_name    : SoundHandler
Please use -b:a or -b:v, -b is ambiguous

using SAR=1/1
[libx264 @ 0x1c39be0] using cpu capabilities: MMX2 SSE2Fast SSSE3 FastShuffle SSE4.2 AVX
[libx264 @ 0x1c39be0] profile Main, level 3.0
[libx264 @ 0x1c39be0] 264 - core 129 r2245 bc13772 - H.264/MPEG-4 AVC codec - Copyleft 2003-2013 - http://www.videolan.org/x264.html - options: cabac=1 ref=1 deblock=1:0:0 analyse=0x1:0 me=dia subme=2 psy=1 psy_rd=1.00:0.00 mixed_ref=0 me_range=16 chroma_me=1 trellis=0 8x8dct=0 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=0 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=2 b_bias=0 direct=3 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=50 rc=abr mbtree=1 bitrate=500 ratetol=1.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to 'comiccon.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: mp41
    encoder         : Lavf54.61.104
    Stream #0:0(eng): Video: h264 ([33][0][0][0] / 0x0021), yuv420p, 640x360 [SAR 1:1 DAR 16:9], q=-1--1, pass 1, 500 kb/s, 15360 tbn, 30 tbc
    Metadata:
      creation_time   : 2012-08-15 17:12:37
      handler_name    : VideoHandler
Stream mapping:
  Stream #0:0 -> #0:0 (h264 -> libx264)
Press [q] to stop, [?] for help
frame=139078 fps=279 q=32766.0 Lsize=  286145kB time=01:17:15.86 bitrate= 505.6kbits/s    
video:284758kB audio:0kB subtitle:0 global headers:0kB muxing overhead 0.487000%
[libx264 @ 0x1c39be0] frame I:656   Avg QP:19.51  size: 21457
[libx264 @ 0x1c39be0] frame P:76006 Avg QP:22.19  size:  3141
[libx264 @ 0x1c39be0] frame B:62416 Avg QP:26.38  size:   621
[libx264 @ 0x1c39be0] consecutive B-frames: 32.3% 17.5% 18.6% 31.6%
[libx264 @ 0x1c39be0] mb I  I16..4: 24.5%  0.0% 75.5%
[libx264 @ 0x1c39be0] mb P  I16..4:  7.5%  0.0%  0.0%  P16..4: 40.5%  0.0%  0.0%  0.0%  0.0%    skip:52.1%
[libx264 @ 0x1c39be0] mb B  I16..4:  1.4%  0.0%  0.0%  B16..8: 12.0%  0.0%  0.0%  direct: 2.9%  skip:83.7%  L0:41.1% L1:41.6% BI:17.3%
[libx264 @ 0x1c39be0] final ratefactor: 23.45
[libx264 @ 0x1c39be0] direct mvs  spatial:95.3% temporal:4.7%
[libx264 @ 0x1c39be0] coded y,uvDC,uvAC intra: 37.6% 42.8% 11.8% inter: 8.9% 8.2% 0.5%
[libx264 @ 0x1c39be0] i16 v,h,dc,p: 43% 28% 19% 10%
[libx264 @ 0x1c39be0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 36% 21% 11%  6%  4%  5%  4%  6%  6%
[libx264 @ 0x1c39be0] i8c dc,h,v,p: 57% 19% 20%  4%
[libx264 @ 0x1c39be0] Weighted P-Frames: Y:1.4% UV:0.5%
[libx264 @ 0x1c39be0] kb/s:503.18


  


  output for the second pass :

  


  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'comiccon.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: mp41
    creation_time   : 2012-08-15 17:12:37
  Duration: 01:17:15.93, start: 0.000000, bitrate: 706 kb/s
    Stream #0:0(eng): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuv420p, 640x360 [SAR 1:1 DAR 16:9], 636 kb/s, 30 fps, 30 tbr, 90k tbn, 60 tbc
    Metadata:
      creation_time   : 2012-08-15 17:12:37
      handler_name    : VideoHandler
    Stream #0:1(eng): Audio: aac (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 63 kb/s
    Metadata:
      creation_time   : 2012-08-15 17:12:37
      handler_name    : SoundHandler
Please use -b:a or -b:v, -b is ambiguous
[libx264 @ 0x3247f80] using SAR=1/1
[libx264 @ 0x3247f80] using cpu capabilities: MMX2 SSE2Fast SSSE3 FastShuffle SSE4.2 AVX
[libx264 @ 0x3247f80] profile High, level 3.0
[libx264 @ 0x3247f80] 264 - core 129 r2245 bc13772 - H.264/MPEG-4 AVC codec - Copyleft 2003-2013 - http://www.videolan.org/x264.html - options: cabac=1 ref=5 deblock=1:0:0 analyse=0x3:0x113 me=umh subme=8 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=2 b_bias=0 direct=3 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=50 rc=2pass mbtree=1 bitrate=500 ratetol=1.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 cplxblur=20.0 qblur=0.5 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to 'comiccon.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: mp41
    encoder         : Lavf54.61.104
    Stream #0:0(eng): Video: h264 ([33][0][0][0] / 0x0021), yuv420p, 640x360 [SAR 1:1 DAR 16:9], q=-1--1, pass 2, 500 kb/s, 15360 tbn, 30 tbc
    Metadata:
      creation_time   : 2012-08-15 17:12:37
      handler_name    : VideoHandler
    Stream #0:1(eng): Audio: aac ([64][0][0][0] / 0x0040), 44100 Hz, stereo, s16, 128 kb/s
    Metadata:
      creation_time   : 2012-08-15 17:12:37
      handler_name    : SoundHandler
Stream mapping:
  Stream #0:0 -> #0:0 (h264 -> libx264)
  Stream #0:1 -> #0:1 (aac -> libfaac)
Press [q] to stop, [?] for help
frame=139078 fps=206 q=32766.0 Lsize=  357252kB time=01:17:15.93 bitrate= 631.3kbits/s    
video:282992kB audio:69592kB subtitle:0 global headers:0kB muxing overhead 1.324238%
[libx264 @ 0x3247f80] frame I:656   Avg QP:19.61  size: 20433
[libx264 @ 0x3247f80] frame P:76006 Avg QP:23.07  size:  2996
[libx264 @ 0x3247f80] frame B:62416 Avg QP:26.23  size:   780
[libx264 @ 0x3247f80] consecutive B-frames: 32.3% 17.5% 18.6% 31.6%
[libx264 @ 0x3247f80] mb I  I16..4: 17.2% 37.8% 44.9%
[libx264 @ 0x3247f80] mb P  I16..4:  2.9%  3.7%  1.2%  P16..4: 30.3%  6.1%  3.4%  0.0%  0.0%    skip:52.5%
[libx264 @ 0x3247f80] mb B  I16..4:  0.5%  0.6%  0.3%  B16..8: 25.9%  2.2%  0.5%  direct: 0.9%  skip:69.3%  L0:51.4% L1:43.0% BI: 5.7%
[libx264 @ 0x3247f80] 8x8 transform intra:45.9% inter:51.5%
[libx264 @ 0x3247f80] direct mvs  spatial:85.5% temporal:14.5%
[libx264 @ 0x3247f80] coded y,uvDC,uvAC intra: 47.3% 49.2% 13.5% inter: 9.0% 9.4% 0.5%
[libx264 @ 0x3247f80] i16 v,h,dc,p: 38% 27% 13% 22%
[libx264 @ 0x3247f80] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 29% 16% 14%  5%  5%  7%  7%  8%  9%
[libx264 @ 0x3247f80] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 31% 15%  9%  6%  7%  8%  7%  8%  8%
[libx264 @ 0x3247f80] i8c dc,h,v,p: 49% 22% 20%  8%
[libx264 @ 0x3247f80] Weighted P-Frames: Y:1.4% UV:0.5%
[libx264 @ 0x3247f80] ref P L0: 79.3% 10.4%  6.8%  1.6%  1.2%  0.7%  0.0%
[libx264 @ 0x3247f80] ref B L0: 93.6%  4.8%  1.2%  0.3%
[libx264 @ 0x3247f80] ref B L1: 96.6%  3.4%
[libx264 @ 0x3247f80] kb/s:500.06


  


  The above command produces the file correctly however it cannot be played in flash player. One thing that I noticed is this may happen if the input file is mp4 as well. This command is executed for users uploading files, so the input file could be any format.

  


  Below is the information about my FFmpeg version :
> ffmpeg version git-2013-02-01-5a67e30 Copyright (c) 2000-2013 the
> FFmpeg developers built on Feb 1 2013 14:23:14 with gcc 4.6
> (Ubuntu/Linaro 4.6.3-1ubuntu5) configuration : —enable-gpl
> —enable-libass —enable-libfaac —enable-libfdk-aac —enable-libmp3lame —enable-libopencore-amrnb —enable-libopencore-amrwb —enable-librtmp —enable-libtheora —enable-libvorbis —enable-libvpx —enable-libx264 —enable-nonfree —enable-version3 libavutil 52. 17.100 / 52. 17.100
  
libavcodec 54. 91.100 / 54. 91.100
  
libavformat 54. 61.104 / 54. 61.104
  
libavdevice 54. 3.103 / 54. 3.103
  
libavfilter 3. 35.100 / 3. 35.100
  
libswscale 2. 2.100 / 2. 2.100
  
libswresample 0. 17.102 / 0. 17.102
  
libpostproc 52. 2.100 / 52. 2.1

  


• RaspberryPi HLS streaming with nginx and ffmpeg ; v4l2 error : ioctl(VIDIOC_STREAMON) : Protocol error

  22 janvier 2021, par Mirco Weber

  I'm trying to realize a baby monitoring with a Raspberry Pi (Model 4B, 4GB RAM) and an ordinary Webcam (with integrated Mic).
I followed this Tutorial : https://github.com/DeTeam/webcam-stream/blob/master/Tutorial.md

  


  Shortly described :

  


  

  1. I installed and configured an nginx server with rtmp module enabled.

  


  2. I installed ffmpeg with this configuration —enable-gpl —enable-nonfree —enable-mmal —enable-omx-rpi

  


  3. I tried to stream ;)

  


  


  The configuration of nginx seems to be working (sometimes streaming works, the server starts without any complication and when the server is up and running, the webpage is displayed).
The configuration of ffmpeg seems to be fine as well, since streaming sometimes works...

  


  I was trying a couple of different ffmpeg-commands ; all of them are sometimes working and sometimes resulting in an error.
The command looks like following :

  


  ffmpeg -re
-f v4l2
-i /dev/video0
-f alsa
-ac 1
-thread_queue_size 4096
-i hw:CARD=Camera,DEV=0
-profile:v high
-level:v 4.1
-vcodec h264_omx
-r 10
-b:v 512k
-s 640x360
-acodec aac
-strict
-2
-ac 2
-ab 32k
-ar 44100
-f flv
rtmp://localhost/show/stream;


  


  Note : I rearranged the code to make it easier to read. In the terminal, it is all in one line.
Note : There is no difference when using -f video4linux2 instead of -f v4l2

  


  The camera is recognized by the system :

  


  pi@raspberrypi:~ $ v4l2-ctl --list-devices
bcm2835-codec-decode (platform:bcm2835-codec):
    /dev/video10
    /dev/video11
    /dev/video12

bcm2835-isp (platform:bcm2835-isp):
    /dev/video13
    /dev/video14
    /dev/video15
    /dev/video16

HD Web Camera: HD Web Camera (usb-0000:01:00.0-1.2):
    /dev/video0
    /dev/video1


  


  When only using -i /dev/video0, audio transmission never worked.
The output of arecord -L was :

  


  pi@raspberrypi:~ $ arecord -L
default
    Playback/recording through the PulseAudio sound server
null
    Discard all samples (playback) or generate zero samples (capture)
jack
    JACK Audio Connection Kit
pulse
    PulseAudio Sound Server
usbstream:CARD=Headphones
    bcm2835 Headphones
    USB Stream Output
sysdefault:CARD=Camera
    HD Web Camera, USB Audio
    Default Audio Device
front:CARD=Camera,DEV=0
    HD Web Camera, USB Audio
    Front speakers
surround21:CARD=Camera,DEV=0
    HD Web Camera, USB Audio
    2.1 Surround output to Front and Subwoofer speakers
surround40:CARD=Camera,DEV=0
    HD Web Camera, USB Audio
    4.0 Surround output to Front and Rear speakers
surround41:CARD=Camera,DEV=0
    HD Web Camera, USB Audio
    4.1 Surround output to Front, Rear and Subwoofer speakers
surround50:CARD=Camera,DEV=0
    HD Web Camera, USB Audio
    5.0 Surround output to Front, Center and Rear speakers
surround51:CARD=Camera,DEV=0
    HD Web Camera, USB Audio
    5.1 Surround output to Front, Center, Rear and Subwoofer speakers
surround71:CARD=Camera,DEV=0
    HD Web Camera, USB Audio
    7.1 Surround output to Front, Center, Side, Rear and Woofer speakers
iec958:CARD=Camera,DEV=0
    HD Web Camera, USB Audio
    IEC958 (S/PDIF) Digital Audio Output
dmix:CARD=Camera,DEV=0
    HD Web Camera, USB Audio
    Direct sample mixing device
dsnoop:CARD=Camera,DEV=0
    HD Web Camera, USB Audio
    Direct sample snooping device
hw:CARD=Camera,DEV=0
    HD Web Camera, USB Audio
    Direct hardware device without any conversions
plughw:CARD=Camera,DEV=0
    HD Web Camera, USB Audio
    Hardware device with all software conversions
usbstream:CARD=Camera
    HD Web Camera
    USB Stream Output


  


  that's why i added -i hw:CARD=Camera,DEV=0.

  


  As mentioned above, it worked very well a couple of times with this configuration and commands.
But very often, i get the following error message when starting to stream :

  


  pi@raspberrypi:~ $ ffmpeg -re -f video4linux2 -i /dev/video0 -f alsa -ac 1 -thread_queue_size 4096 -i hw:CARD=Camera,DEV=0 -profile:v high -level:v 4.1 -vcodec h264_omx -r 10 -b:v 512k -s 640x360 -acodec aac -strict -2 -ac 2 -ab 32k -ar 44100 -f flv rtmp://localhost/show/stream
ffmpeg version N-100673-g553eb07737 Copyright (c) 2000-2021 the FFmpeg developers
  built with gcc 8 (Raspbian 8.3.0-6+rpi1)
  configuration: --enable-gpl --enable-nonfree --enable-mmal --enable-omx-rpi --extra-ldflags=-latomic
  libavutil      56. 63.101 / 56. 63.101
  libavcodec     58.117.101 / 58.117.101
  libavformat    58. 65.101 / 58. 65.101
  libavdevice    58. 11.103 / 58. 11.103
  libavfilter     7. 96.100 /  7. 96.100
  libswscale      5.  8.100 /  5.  8.100
  libswresample   3.  8.100 /  3.  8.100
  libpostproc    55.  8.100 / 55.  8.100
[video4linux2,v4l2 @ 0x2ea4600] ioctl(VIDIOC_STREAMON): Protocol error
/dev/video0: Protocol error


  


  And when I'm swithing to /dev/video1 (since this was also an output for v4l2-ctl --list-devices), I get the following error message :

  


  pi@raspberrypi:~ $ ffmpeg -re -f v4l2 -i /dev/video1 -f alsa -ac 1 -thread_queue_size 4096 -i hw:CARD=Camera,DEV=0 -profile:v high -level:v 4.1 -vcodec h264_omx -r 10 -b:v 512k -s 640x360 -acodec aac -strict -2 -ac 2 -ab 32k -ar 44100 -f flv rtmp://localhost/show/stream
ffmpeg version N-100673-g553eb07737 Copyright (c) 2000-2021 the FFmpeg developers
  built with gcc 8 (Raspbian 8.3.0-6+rpi1)
  configuration: --enable-gpl --enable-nonfree --enable-mmal --enable-omx-rpi --extra-ldflags=-latomic
  libavutil      56. 63.101 / 56. 63.101
  libavcodec     58.117.101 / 58.117.101
  libavformat    58. 65.101 / 58. 65.101
  libavdevice    58. 11.103 / 58. 11.103
  libavfilter     7. 96.100 /  7. 96.100
  libswscale      5.  8.100 /  5.  8.100
  libswresample   3.  8.100 /  3.  8.100
  libpostproc    55.  8.100 / 55.  8.100
[video4linux2,v4l2 @ 0x1aa4610] ioctl(VIDIOC_G_INPUT): Inappropriate ioctl for device
/dev/video1: Inappropriate ioctl for device


  


  When using the video0 input, the webcam's LED that recognizes an access is constantly on. When using video1not.

  


  After hours and days of googling and tears and whiskey, for the sake of my liver, my marriage and my physical and mental health, I'm very sincerly asking for your help...
What the f**k is happening and what can I do to make it work ???

  


  Thanks everybody :)

  


  UPDATE 1 :

  


  

  1. using the full path to ffmpeg does not change anything...

  


  2. /dev/video0 and /dev/video1 have access rights for everybody

  


  3. sudo ffmpeg ... does not change anything as well

  


  4. the problem seems to be at an "early stage". Stripping the command down to ffmpeg -i /dev/video0 results in the same problem

  


  


  UPDATE 2 :
  
It seems that everything is working when I first start another Application that needs access to the webcam and then ffmpeg...
Might be some driver issue, but when I'm looking for loaded modules with lsmod, there is absolutely no change before and after I started the application...
Any help still appreciated...

  


  UPDATE 3 :
  
I was checking the output of dmesg.
  
When I started the first application I received this message :
  
uvcvideo: Failed to query (GET_DEF) UVC control 12 on unit 2: -32 (exp. 4).

  And when I started ffmpeg, nothing happend but everything worked...