Recherche avancée

Sur d’autres sites (9509)

• Converting mkv to mp4 with ffmpeg sometimes loses video

  9 décembre 2019, par RobertW

  How can I create a universal as possible command line to convert mkv to mp4 ?

  I fixed an issue where sometimes I’d lose audio (I think) and now I’m losing video.
  This is the command I currently use (I’ve used a few, including -analyzeduration 1G -probesize 50M but I always end up with broken videos at some point) :

  if [[ $(pgrep -i ffmpeg) ]] ; then
  
    echo "FFMPEG IS ALREADY RUNNING!"
  
  else 
  
    echo "Starting mkv to mp4 conversion...";
  
      for i in /var/www/html/uploads/Videos/*/*/*/*.mkv;
  
        do name=$(echo "${i//.mkv/}");
  
        echo "$name";
  
        ffmpeg -n -i "$i" -c copy -c:a aac -movflags +faststart "${name}.mp4"; rm -v -f "${name}.mkv";
  
      done
  
  fi

  Output of running that on the specific videos I’m losing picture on :

  Starting mkv to mp4 conversion...
  
  /var/www/html/uploads/Videos/TV/Avatar The Last Airbender/Season 1/Avatar The Last Airbender - S01E02 - The Avatar Returns WEBDL-1080p
  
  ffmpeg version 4.2.1 Copyright (c) 2000-2019 the FFmpeg developers
  
    built with gcc 9 (GCC)
  
    configuration: --prefix=/usr --bindir=/usr/bin --datadir=/usr/share/ffmpeg --docdir=/usr/share/doc/ffmpeg --incdir=/usr/include/ffmpeg --libdir=/usr/lib64 --mandir=/usr/share/man --arch=x86_64 --optflags='-O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection' --extra-ldflags='-Wl,-z,relro -Wl,--as-needed -Wl,-z,now -specs=/usr/lib/rpm/redhat/redhat-hardened-ld ' --extra-cflags=' ' --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libvo-amrwbenc --enable-version3 --enable-bzlib --disable-crystalhd --enable-fontconfig --enable-frei0r --enable-gcrypt --enable-gnutls --enable-ladspa --enable-libaom --enable-libdav1d --enable-libass --enable-libbluray --enable-libcdio --enable-libdrm --enable-libjack --enable-libfreetype --enable-libfribidi --enable-libgsm --enable-libmp3lame --enable-nvenc --enable-openal --enable-opencl --enable-opengl --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librsvg --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libvorbis --enable-libv4l2 --enable-libvidstab --enable-libvmaf --enable-libvpx --enable-libx264 --enable-libx265 --enable-libxvid --enable-libzvbi --enable-avfilter --enable-avresample --enable-postproc --enable-pthreads --disable-static --enable-shared --enable-gpl --disable-debug --disable-stripping --shlibdir=/usr/lib64 --enable-libmfx --enable-runtime-cpudetect
  
    libavutil      56. 31.100 / 56. 31.100
  
    libavcodec     58. 54.100 / 58. 54.100
  
    libavformat    58. 29.100 / 58. 29.100
  
    libavdevice    58.  8.100 / 58.  8.100
  
    libavfilter     7. 57.100 /  7. 57.100
  
    libavresample   4.  0.  0 /  4.  0.  0
  
    libswscale      5.  5.100 /  5.  5.100
  
    libswresample   3.  5.100 /  3.  5.100
  
    libpostproc    55.  5.100 / 55.  5.100
  
  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/var/www/html/uploads/Videos/TV/Avatar The Last Airbender/Season 1/Avatar The Last Airbender - S01E02 - The Avatar Returns WEBDL-1080p.mkv':
  
    Metadata:
  
      major_brand     : isom
  
      minor_version   : 512
  
      compatible_brands: isomiso2mp41
  
      encoder         : Lavf58.29.100
  
    Duration: 00:23:59.11, start: 0.000000, bitrate: 1258 kb/s
  
      Stream #0:0(und): Video: hevc (Main 10) (hev1 / 0x31766568), yuv420p10le(tv), 1440x1080, 1124 kb/s, SAR 1:1 DAR 4:3, 23.98 fps, 23.98 tbr, 16k tbn, 23.98 tbc (default)
  
      Metadata:
  
        handler_name    : VideoHandler
  
      Stream #0:1(eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 128 kb/s (default)
  
      Metadata:
  
        handler_name    : SoundHandler
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (copy)
  
    Stream #0:1 -> #0:1 (aac (native) -> aac (native))
  
  Press [q] to stop, [?] for help
  
  Output #0, mp4, to '/var/www/html/uploads/Videos/TV/Avatar The Last Airbender/Season 1/Avatar The Last Airbender - S01E02 - The Avatar Returns WEBDL-1080p.mp4':
  
    Metadata:
  
      major_brand     : isom
  
      minor_version   : 512
  
      compatible_brands: isomiso2mp41
  
      encoder         : Lavf58.29.100
  
      Stream #0:0(und): Video: hevc (Main 10) (hev1 / 0x31766568), yuv420p10le(tv), 1440x1080 [SAR 1:1 DAR 4:3], q=2-31, 1124 kb/s, 23.98 fps, 23.98 tbr, 16k tbn, 16k tbc (default)
  
      Metadata:
  
        handler_name    : VideoHandler
  
      Stream #0:1(eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 128 kb/s (default)
  
      Metadata:
  
        handler_name    : SoundHandler
  
        encoder         : Lavc58.54.100 aac
  
  [mp4 @ 0x5583e9bdb8c0] Starting second pass: moving the moov atom to the beginning of the file
  
  frame=34504 fps=1260 q=-1.0 Lsize=  221105kB time=00:23:59.08 bitrate=1258.6kbits/s speed=52.5x
  
  video:197477kB audio:22515kB subtitle:0kB other streams:0kB global headers:2kB muxing overhead: 0.506059%
  
  [aac @ 0x5583e9b3f140] Qavg: 562.538

  Edit :

  The below command worked on similar files which the above command did not :

    ffmpeg -n -i "$i" -c:v libx264 -c:a aac -movflags +faststart 

  Output :

  Starting mkv to mp4 conversion...
  
  /var/www/html/uploads/Videos/TV/Avatar The Last Airbender/Season 1/Avatar The Last Airbender - S01E03 - The Southern Air Temple WEBDL-1080p
  
  ffmpeg version 4.2.1 Copyright (c) 2000-2019 the FFmpeg developers
  
    built with gcc 9 (GCC)
  
    configuration: --prefix=/usr --bindir=/usr/bin --datadir=/usr/share/ffmpeg --docdir=/usr/share/doc/ffmpeg --incdir=/usr/include/ffmpeg --libdir=/usr/lib64 --mandir=/usr/share/man --arch=x86_64 --optflags='-O2 -g -pipe -Wall -Werror=format-security -Wp,-D_FORTIFY_SOURCE=2 -Wp,-D_GLIBCXX_ASSERTIONS -fexceptions -fstack-protector-strong -grecord-gcc-switches -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -specs=/usr/lib/rpm/redhat/redhat-annobin-cc1 -m64 -mtune=generic -fasynchronous-unwind-tables -fstack-clash-protection -fcf-protection' --extra-ldflags='-Wl,-z,relro -Wl,--as-needed -Wl,-z,now -specs=/usr/lib/rpm/redhat/redhat-hardened-ld ' --extra-cflags=' ' --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libvo-amrwbenc --enable-version3 --enable-bzlib --disable-crystalhd --enable-fontconfig --enable-frei0r --enable-gcrypt --enable-gnutls --enable-ladspa --enable-libaom --enable-libdav1d --enable-libass --enable-libbluray --enable-libcdio --enable-libdrm --enable-libjack --enable-libfreetype --enable-libfribidi --enable-libgsm --enable-libmp3lame --enable-nvenc --enable-openal --enable-opencl --enable-opengl --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-librsvg --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libvorbis --enable-libv4l2 --enable-libvidstab --enable-libvmaf --enable-libvpx --enable-libx264 --enable-libx265 --enable-libxvid --enable-libzvbi --enable-avfilter --enable-avresample --enable-postproc --enable-pthreads --disable-static --enable-shared --enable-gpl --disable-debug --disable-stripping --shlibdir=/usr/lib64 --enable-libmfx --enable-runtime-cpudetect
  
    libavutil      56. 31.100 / 56. 31.100
  
    libavcodec     58. 54.100 / 58. 54.100
  
    libavformat    58. 29.100 / 58. 29.100
  
    libavdevice    58.  8.100 / 58.  8.100
  
    libavfilter     7. 57.100 /  7. 57.100
  
    libavresample   4.  0.  0 /  4.  0.  0
  
    libswscale      5.  5.100 /  5.  5.100
  
    libswresample   3.  5.100 /  3.  5.100
  
    libpostproc    55.  5.100 / 55.  5.100
  
  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/var/www/html/uploads/Videos/TV/Avatar The Last Airbender/Season 1/Avatar The Last Airbender - S01E03 - The Southern Air Temple WEBDL-1080p.mkv':
  
    Metadata:
  
      major_brand     : isom
  
      minor_version   : 512
  
      compatible_brands: isomiso2mp41
  
      encoder         : Lavf58.29.100
  
    Duration: 00:24:10.74, start: 0.000000, bitrate: 1354 kb/s
  
      Stream #0:0(und): Video: hevc (Main 10) (hev1 / 0x31766568), yuv420p10le(tv), 1440x1080, 1124 kb/s, SAR 1:1 DAR 4:3, 23.98 fps, 23.98 tbr, 16k tbn, 23.98 tbc (default)
  
      Metadata:
  
        handler_name    : VideoHandler
  
      Stream #0:1(eng): Audio: eac3 (ec-3 / 0x332D6365), 48000 Hz, stereo, fltp, 224 kb/s (default)
  
      Metadata:
  
        handler_name    : SoundHandler
  
      Side data:
  
        audio service type: main
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (hevc (native) -> h264 (libx264))
  
    Stream #0:1 -> #0:1 (eac3 (native) -> aac (native))
  
  Press [q] to stop, [?] for help
  
  [libx264 @ 0x563ef7ad5a40] using SAR=1/1
  
  [libx264 @ 0x563ef7ad5a40] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2
  
  [libx264 @ 0x563ef7ad5a40] profile High 10, level 4.0, 4:2:0, 10-bit
  
  [libx264 @ 0x563ef7ad5a40] 264 - core 157 r2980 34c06d1 - H.264/MPEG-4 AVC codec - Copyleft 2003-2019 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=34 lookahead_threads=5 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=23 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=81 qpstep=4 ip_ratio=1.40 aq=1:1.00
  
  Output #0, mp4, to '/var/www/html/uploads/Videos/TV/Avatar The Last Airbender/Season 1/Avatar The Last Airbender - S01E03 - The Southern Air Temple WEBDL-1080p.mp4':
  
    Metadata:
  
      major_brand     : isom
  
      minor_version   : 512
  
      compatible_brands: isomiso2mp41
  
      encoder         : Lavf58.29.100
  
      Stream #0:0(und): Video: h264 (libx264) (avc1 / 0x31637661), yuv420p10le, 1440x1080 [SAR 1:1 DAR 4:3], q=-1--1, 23.98 fps, 24k tbn, 23.98 tbc (default)
  
      Metadata:
  
        handler_name    : VideoHandler
  
        encoder         : Lavc58.54.100 libx264
  
      Side data:
  
        cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1
  
      Stream #0:1(eng): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 128 kb/s (default)
  
      Metadata:
  
        handler_name    : SoundHandler
  
        encoder         : Lavc58.54.100 aac
  
      Side data:
  
        audio service type: main
  
  frame=   37 fps=0.0 q=0.0 size=       0kB time=00:00:02.09 bitrate=   0.2kbits/sframe=   72 fps= 72 q=0.0 size=       0kB time=00:00:03.54 bitrate=   0.1kbits/sframe=  103 fps= 68 q=40.0 size=       0kB time=00:00:04.84 bitrate=   0.1kbits/frame=  128 fps= 64 q=40.0 size=       0kB time=00:00:05.90 bitrate=   0.1kbits/frame=  169 fps= 66 q=40.0 size=     256kB time=00:00:07.59 bitrate= 276.2kbits/frame=  194 fps= 63 q=40.0 size=     512kB time=00:00:08.66 bitrate= 484.3kbits/frame=  241 fps= 68 q=40.0 size=     512kB time=00:00:10.60 bitrate= 395.6kbits/frame=  262 fps= 64 q=40.0 size=     512kB time=00:00:11.47 bitrate= 365.5kbits/frame=  284 fps= 62 q=40.0 size=     768kB time=00:00:12.37 bitrate= 508.5kbits/frame=  312 fps= 61 q=40.0 size=     768kB time=00:00:13.54 bitrate= 464.5kbits/frame=  341 fps= 61 q=40.0 size=    1024kB time=00:00:14.74 bitrate= 569.1kbits/frame=  373 fps= 61 q=40.0 size=    1280kB time=00:00:16.10 bitrate= 651.0kbits/frame=  398 fps= 60 q=40.0 size=    1280kB time=00:00:17.13 bitrate= 612.1kbits/frame=  419 fps= 59 q=40.0 size=    1536kB time=00:00:18.02 bitrate= 698.0kbits/frame=  433 fps= 56 q=40.0 size=    1792kB time=00:00:18.60 bitrate= 789.2kbits/frame=  456 fps= 55 q=40.0 size=    2048kB time=00:00:19.56 bitrate= 857.6kbits/frame=  469 fps= 53 q=40.0 size=    2304kB time=00:00:20.11 bitrate= 938.2kbits/frame=  486 fps= 52 q=40.0 size=    2816kB time=00:00:20.82 bitrate=1108.0kbits/frame=  504 fps= 51 q=40.0 size=    3328kB time=00:00:21.58 bitrate=1262.8kbits/frame=  522 fps= 51 q=40.0 size=    4096kB time=00:00:22.31 bitrate=1503.7kbits/frame=  545 fps= 50 q=40.0 size=    4608kB time=00:00:23.27 bitrate=1621.9kbits/frame=  570 fps= 50 q=40.0 size=    5120kB time=00:00:24.34 bitrate=1723.1kbits/frame=  597 fps= 50 q=40.0 size=    5632kB time=00:00:25.45 bitrate=1812.8kbits/frame=  619 fps= 50 q=40.0 size=    5888kB time=00:00:26.38 bitrate=1827.8kbits/frame=  650 fps= 50 q=40.0 size=    6400kB time=00:00:27.66 bitrate=1894.8kbits/frame=  674 fps= 50 q=40.0 size=    6656kB time=00:00:28.65 bitrate=1903.1kbits/frame=  701 fps= 50 q=40.0 size=    6656kB time=00:00:29.78 bitrate=1830.9kbits/frame=  734 fps= 51 q=40.0 size=    6912kB time=00:00:31.12 bitrate=1819.2kbits/frame=  754 fps= 50 q=40.0 size=    7168kB time=00:00:31.97 bitrate=1836.2kbits/frame=  778 fps= 50 q=40.0 size=    7168kB time=00:00:33.00 --SNIPPED--
  
  bitrate=1518.4kbits/frame=34775 fps= 58 q=40.0 size=  268800kB time=00:24:10.64 bitrate=1518.0kbits/[mp4 @ 0x563ef7ad45c0] Starting second pass: moving the moov atom to the beginning of the file
  
  frame=34783 fps= 58 q=-1.0 Lsize=  269967kB time=00:24:10.68 bitrate=1524.5kbits/s speed= 2.4x
  
  video:246310kB audio:22689kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.359968%
  
  [libx264 @ 0x563ef7ad5a40] frame I:651   Avg QP:27.80  size: 60711
  
  [libx264 @ 0x563ef7ad5a40] frame P:10705 Avg QP:32.02  size: 14279
  
  [libx264 @ 0x563ef7ad5a40] frame B:23427 Avg QP:37.64  size:  2554
  
  [libx264 @ 0x563ef7ad5a40] consecutive B-frames:  6.9%  8.1%  5.5% 79.6%
  
  [libx264 @ 0x563ef7ad5a40] mb I  I16..4: 29.6% 60.8%  9.6%
  
  [libx264 @ 0x563ef7ad5a40] mb P  I16..4:  7.7% 10.0%  1.1%  P16..4: 20.4%  3.8%  2.2%  0.0%  0.0%    skip:54.8%
  
  [libx264 @ 0x563ef7ad5a40] mb B  I16..4:  0.6%  0.6%  0.1%  B16..8: 13.6%  1.0%  0.2%  direct: 0.7%  skip:83.3%  L0:41.6% L1:55.3% BI: 3.1%
  
  [libx264 @ 0x563ef7ad5a40] 8x8 transform intra:54.2% inter:75.7%
  
  [libx264 @ 0x563ef7ad5a40] coded y,uvDC,uvAC intra: 29.1% 50.3% 11.9% inter: 3.4% 4.5% 0.1%
  
  [libx264 @ 0x563ef7ad5a40] i16 v,h,dc,p: 25% 29%  9% 38%
  
  [libx264 @ 0x563ef7ad5a40] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 27% 18% 25%  4%  5%  5%  5%  5%  5%
  
  [libx264 @ 0x563ef7ad5a40] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 27% 14% 17%  7%  8%  9%  6%  7%  4%
  
  [libx264 @ 0x563ef7ad5a40] i8c dc,h,v,p: 51% 22% 19%  9%
  
  [libx264 @ 0x563ef7ad5a40] Weighted P-Frames: Y:2.7% UV:2.1%
  
  [libx264 @ 0x563ef7ad5a40] ref P L0: 74.1% 16.9%  8.9%  0.1%
  
  [libx264 @ 0x563ef7ad5a40] ref B L0: 85.8% 11.6%  2.6%
  
  [libx264 @ 0x563ef7ad5a40] ref B L1: 96.8%  3.2%
  
  [libx264 @ 0x563ef7ad5a40] kb/s:1390.85
  
  [aac @ 0x563ef7ade100] Qavg: 572.905
  
  removed '/var/www/html/uploads/Videos/TV/Avatar The Last Airbender/Season 1/Avatar The Last Airbender - S01E03 - The Southern Air Temple WEBDL-1080p.mkv'
  
  Done transcoding!

• send h264 video to nginx-rtmp server using ffmpeg API

  11 décembre 2019, par Glen

  I have C++ code that grabs frames from a GigE camera and writes them out to a file. I’m using the libx264 codec and ffmpeg version 4.0.

  Writing to the file works fine, however I would also like to send the video to nginx configured with the nginx-rtmp plug-in to make the video available live via HLS.

  I can use the ffmpeg command line program to stream one of my previously captured files to my nginx server and rebroadcast as HLS, however if I try to stream from my C++ code the nginx server closes the connection after one or two frames are sent.

  To test further, I used the ffmpeg command line program to receive a rtmp stream and write it out to a file. I am able to send video to ffmpeg from my C++ program with rtmp, however every frame generates a warning like this :

  [avi @ 0x1b6b6f0] Non-monotonous DTS in output stream 0:0; previous: 1771, current: 53; changing to 1772. This may result in incorrect timestamps in the output file.
  
  [avi @ 0x1b6b6f0] Non-monotonous DTS in output stream 0:0; previous: 1772, current: 53; changing to 1773. This may result in incorrect timestamps in the output file.
  
  [avi @ 0x1b6b6f0] Non-monotonous DTS in output stream 0:0; previous: 1773, current: 53; changing to 1774. This may result in incorrect timestamps in the output file.
  
  [avi @ 0x1b6b6f0] Non-monotonous DTS in output stream 0:0; previous: 1774, current: 53; changing to 1775. This may result in incorrect timestamps in the output file.
  
  [avi @ 0x1b6b6f0] Non-monotonous DTS in output stream 0:0; previous: 1775, current: 53; changing to 1776. This may result in incorrect timestamps in the output file.
  
  [avi @ 0x1b6b6f0] Non-monotonous DTS in output stream 0:0; previous: 1776, current: 53; changing to 1777. This may result in incorrect timestamps in the output file.
  
  [avi @ 0x1b6b6f0] Non-monotonous DTS in output stream 0:0; previous: 1777, current: 53; changing to 1778. This may result in incorrect timestamps in the output file.
  
  [avi @ 0x1b6b6f0] Non-monotonous DTS in output stream 0:0; previous: 1778, current: 53; changing to 1779. This may result in incorrect timestamps in the output file.
  
  [avi @ 0x1b6b6f0] Non-monotonous DTS in output stream 0:0; previous: 1779, current: 53; changing to 1780. This may result in incorrect timestamps in the output file.

  I printed PTS and DTS for my packet before writing it, and the numbers were monotonous (for example, in this last frame the pts and dts printed from my code were 1780, not the ’current : 53’ that ffmpeg reports>

  also, unless I tell ffmpeg what the output framerate should be I end up with a file that plays 2x speed.

  After ffmpeg receives the rtmp stream and writes it to the file, I am then able to successfully send that file to my nginx server using ffmpeg.

  here is some relevant code :

  //configuring the codec context
  
  // make sure that config.codec is something we support
  
  // for now we are only supporting LIBX264
  
  if (config.codec() != codecs::LIBX264) {
  
      throw std::invalid_argument("currently only libx264 codec is supported");
  
  }
  
  
  
  // lookup specified codec
  
  ffcodec_ = avcodec_find_encoder_by_name(config.codec().c_str());
  
  if (!ffcodec_) {
  
      throw std::invalid_argument("unable to get codec " + config.codec());
  
  }
  
  
  
  // unique_ptr to manage the codec_context
  
  codec_context_ = av_pointer::codec_context(avcodec_alloc_context3(ffcodec_));
  
  
  
  if (!codec_context_) {
  
      throw std::runtime_error("unable to initialize AVCodecContext");
  
  }
  
  
  
  // setup codec_context_
  
  codec_context_->width = frame_width;
  
  codec_context_->height = frame_height;
  
  codec_context_->time_base = (AVRational){1, config.target_fps()};
  
  codec_context_->framerate = (AVRational){config.target_fps(), 1};
  
  codec_context_->global_quality = 0;
  
  codec_context_->compression_level = 0;
  
  codec_context_->bits_per_raw_sample = 8;
  
  codec_context_->gop_size = 1;
  
  codec_context_->max_b_frames = 1;
  
  codec_context_->pix_fmt = AV_PIX_FMT_YUV420P;
  
  
  
  // x264 only settings
  
  if (config.codec() == codecs::LIBX264) {
  
      av_opt_set(codec_context_->priv_data, "preset", config.compression_target().c_str(), 0);
  
      av_opt_set(codec_context_->priv_data, "crf", std::to_string(config.crf()).c_str(), 0);
  
  }
  
  
  
  // Open up the codec
  
  if (avcodec_open2(codec_context_.get(), ffcodec_, NULL) < 0) {
  
      throw std::runtime_error("unable to open ffmpeg codec");
  
  }
  
  
  
  // setup the output format context and stream for RTMP
  
  AVFormatContext *tmp_f_context;
  
  avformat_alloc_output_context2(&tmp_f_context, NULL, "flv", uri.c_str());
  
  rtmp_format_context_ = av_pointer::format_context(tmp_f_context);
  
  rtmp_stream_ = avformat_new_stream(rtmp_format_context_.get(), ffcodec_);
  
  avcodec_parameters_from_context(rtmp_stream_->codecpar, codec_context_.get());
  
  rtmp_stream_->time_base = codec_context_->time_base;
  
  rtmp_stream_->r_frame_rate = codec_context_->framerate;
  
  
  
  /* open the output file */
  
  if (!(rtmp_format_context_->flags & AVFMT_NOFILE)) {
  
      int r = avio_open(&rtmp_format_context_->pb, uri.c_str(), AVIO_FLAG_WRITE);
  
      if (r < 0) {
  
          throw std::runtime_error("unable to open " + uri + " : " + av_err2str(r));
  
      }
  
  }
  
  
  
  if (avformat_write_header(rtmp_format_context_.get(), NULL) < 0) {
  
      throw std::runtime_error("unable to write header");
  
  }
  
  
  
  av_dump_format(rtmp_format_context_.get(), 0,uri.c_str() , 1);

  at this point the av_dump_format produces this output :

  Output #0, flv, to 'rtmp://[MY URI]':
  
    Metadata:
  
      encoder         : Lavf58.12.100
  
      Stream #0:0, 0, 1/1000: Video: h264 (libx264), 1 reference frame ([7][0][0][0] / 0x0007), yuv420p, 800x800 (0x0), 0/1, q=-1--1, 30 tbr, 1k tbn

  encoding and writing the frame :

  // send the frame to the encoder, filtering first if necessary
  
  void VideoWriter::Encode(AVFrame *frame)
  
  {
  
      int rval;
  
      if (!apply_filter_) {
  
          //send frame to encoder
  
          rval = avcodec_send_frame(codec_context_.get(), frame);
  
          if (rval < 0) {
  
              throw std::runtime_error("error sending frame for encoding");
  
          }
  
      } else {
  
          // push frame to filter 
  
          // REMOVED, currently testing without filtering
  
      }
  
  
  
      // get packets from encoder
  
      while (rval >= 0) {
  
          // create smart pointer to allocated packet
  
          av_pointer::packet pkt(av_packet_alloc());
  
          if (!pkt) {
  
              throw std::runtime_error("unable to allocate packet");
  
          }
  
  
  
          rval = avcodec_receive_packet(codec_context_.get(), pkt.get());
  
          if (rval == AVERROR(EAGAIN) || rval == AVERROR_EOF) {
  
              return;
  
          } else if (rval < 0) {
  
              throw std::runtime_error("error during encoding");
  
          }
  
  
  
          // if I print pkt->pts and pkt->dts here, I see sequential numbers
  
  
  
          // write packet
  
          rval = av_interleaved_write_frame(rtmp_format_context_.get(), pkt.get());
  
          if (rval < 0 ) {
  
              std::cerr << av_err2str(rval) << std::endl;
  
          }
  
      }
  
  }

  Since I am able to send video from a previously recorded file to nginx with the ffmpeg command line program, I believe the problem is in my code and not my nginx configuration.

  EDIT : I think it may have to do with SPS/PPS as I see a bunch of these error messages in the nginx log before it closes the stream

  2019/12/11 11:11:31 [error] 10180#0: *4 hls: failed to read 5 byte(s), client: XXX, server: 0.0.0.0:1935
  
  2019/12/11 11:11:31 [error] 10180#0: *4 hls: error appenging SPS/PPS NALs, client: XXX, server: 0.0.0.0:1935

  As I mentioned, this code works fine if I set it up to write to an avi file rather stream to rtmp, and I can stream to ffmpeg listening for rtmp but with lots of warnings about the DTS but if I try to send to nginx, it closes the connection almost immediately. My first thought was that there was something wrong with the frame timestamps, but when I print pts and dts prior to writing the packet to the stream they look okay to me.

  My end goal is to capture video to a file, and also be able to turn on the rtmp stream on demand — but for now I’m just trying to get the rtmp stream working continuously (without writing to a file)

  Thanks for any insights.

• Raspberry Pi 4 live streaming with ffmpeg [closed]

  12 décembre 2019, par Berri

  So speedify created a blog post and youtube video about making an IRL streaming backpack using the Elgato Cam Link 4k, Raspberry Pi 4, and ffmpeg.

  They gave pretty detailed instructions, and included downloads to prebuilt scripts/commands to get it all running once put together.
  Blog post :
  https://speedify.com/blog/how-to/build-irl-streaming-backpack-complete-guide/

  ffmpeg command from post :

  ffmpeg_command = “/home/pi/bin/ffmpeg -nostdin -re -f v4l2 -s ‘1280×720’ -framerate 24 -i /dev/video0 -f alsa -ac 2 -i hw:CARD=Link,DEV=0 -vcodec libx264 -framerate 24 -rtbufsize 1500k -s 1280×720 -preset ultrafast -pix_fmt yuv420p -crf 17 -force_key_frames ‘expr:gte(t,n_forced*2)’ -minrate 850k -maxrate 1000k -b:v 1000k -bufsize 1000k -acodec libmp3lame -rtbufsize 1500k -b 96k -ar 44100 -f flv – | ffmpeg -f flv -i – -c copy -f flv -drop_pkts_on_overflow 1 -attempt_recovery 1 -recovery_wait_time 1 rtmp://live.twitch.tv/app/live_” + streamKey + “‘\n” 

  I replaced -i hw:card=link,dev=0 in that command with -i hw:2,0 because -i hw:card=link,dev=0 gave me "file does not exist" errors in the log. "streamkey" is filled with the appropriate key for my twitch.

  Github Resources + Instructions used :
  https://github.com/speedify/rpi-streaming-experiment

  I’m using all the exact same hardware as outlined in the post, and have gotten everything installed correctly as far as I can tell.
  But when I go to run the ffmpeg command, it seems like nothing actually gets sent over to twitch correctly.

  The log after trying to run it looks like this.
  If anybody has any insight as to what may be going wrong, it would be greatly appreciated.

  Starting ffmpeg
  
  ffmpeg version N-95970-gd5274f8 Copyright (c) 2000-2019 the FFmpeg developers
  
  built with gcc 8 (Raspbian 8.3.0-6+rpi1)  
  
  configuration: --prefix=/home/pi/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/pi/ffmpeg_build/include --extra-ldflags=-L/home/pi/ffmpeg_build/lib --extra-libs='-lpthread -lm' --bindir=/home/pi/bin --enable-gpl --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree  
  
  libavutil 56. 36.101 / 56. 36.101  
  
  libavcodec 58. 64.101 / 58. 64.101  
  
  ffmpeg version N-95970-gd5274f8 libavformat 58. 35.101 / 58. 35.101  
  
  Copyright (c) 2000-2019 the FFmpeg developers libavdevice 58. 9.101 / 58. 9.101  
  
  libavfilter 7. 67.100 / 7. 67.100  
  
  built with gcc 8 (Raspbian 8.3.0-6+rpi1)  
  
  libswscale 5. 6.100 / 5. 6.100  
  
  configuration: --prefix=/home/pi/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/pi/ffmpeg_build/include --extra-ldflags=-L/home/pi/ffmpeg_build/lib --extra-libs='-lpthread -lm' --bindir=/home/pi/bin --enable-gpl --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree  
  
  libswresample 3. 6.100 / 3. 6.100  
  
  libpostproc 55. 6.100 / 55. 6.100  
  
  libavutil 56. 36.101 / 56. 36.101  
  
  libavcodec 58. 64.101 / 58. 64.101  
  
  libavformat 58. 35.101 / 58. 35.101  
  
  libavdevice 58. 9.101 / 58. 9.101  
  
  libavfilter 7. 67.100 / 7. 67.100  
  
  libswscale 5. 6.100 / 5. 6.100  
  
  libswresample 3. 6.100 / 3. 6.100  
  
  libpostproc 55. 6.100 / 55. 6.100  
  
  [video4linux2,v4l2 @ 0x2aac5e0] The V4L2 driver changed the video from 1280x720 to 1920x1080  
  
  [video4linux2,v4l2 @ 0x2aac5e0] The driver changed the time per frame from 1/24 to 117/7013  
  
  [video4linux2,v4l2 @ 0x2aac5e0] Dequeued v4l2 buffer contains 4147200 bytes, but 3110400 were expected. Flags: 0x00012001.  
  
  Input #0, video4linux2,v4l2, from '/dev/video0':  
  
  Duration: N/A, start: 4683.201589, bitrate: 1491503 kb/s  
  
  Stream #0:0: Video: rawvideo (I420 / 0x30323449), yuv420p, 1920x1080, 1491503 kb/s, 59.94 fps, 59.94 tbr, 1000k tbn, 1000k tbc  
  
  Guessed Channel Layout for Input Stream #1.0 : stereo  
  
  Input #1, alsa, from 'hw:2,0':  
  
  Duration: N/A, start: 1576099663.557438, bitrate: 1536 kb/s  
  
  Stream #1:0: Audio: pcm_s16le, 48000 Hz, stereo, s16, 1536 kb/s  
  
  Please use -b:a or -b:v, -b is ambiguous  
  
  Stream mapping:  
  
  Stream #0:0 -> #0:0 (rawvideo (native) -> h264 (libx264))  
  
  Stream #1:0 -> #0:1 (pcm_s16le (native) -> mp3 (libmp3lame))  
  
  [video4linux2,v4l2 @ 0x2aac5e0] Dequeued v4l2 buffer contains 4147200 bytes, but 3110400 were expected. Flags: 0x00012001.  
  
  Last message repeated 9 times
  
  [video4linux2,v4l2 @ 0x2aac5e0] Thread message queue blocking; consider raising the thread_queue_size option (current value: 8)  
  
  [video4linux2,v4l2 @ 0x2aac5e0] Dequeued v4l2 buffer contains 4147200 bytes, but 3110400 were expected. Flags: 0x00012001.  
  
  Last message repeated 28 times  
  
  terminated script  
  
  pipe:: could not find codec parameters  
  
  Exiting normally, received signal 15.  
  
  Last message repeated 15 times  
  
  [alsa @ 0x2aaf2c0] Thread message queue blocking; consider raising the thread_queue_size option (current value: 8)  
  
  Finishing stream 0:0 without any data written to it.  
  
  [libx264 @ 0x2abee40] using cpu capabilities: ARMv6 NEON  
  
  [libx264 @ 0x2abee40] profile Constrained Baseline, level 3.2, 4:2:0, 8-bit  
  
  [libx264 @ 0x2abee40] 264 - core 158 - H.264/MPEG-4 AVC codec - Copyleft 2003-2019 - http://www.videolan.org/x264.html - options: cabac=0 ref=1 deblock=0:0:0 analyse=0:0 me=dia subme=0 psy=1 psy_rd=1.00:0.00 mixed_ref=0 me_range=16 chroma_me=1 trellis=0 8x8dct=0 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=0 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=0 weightp=0 keyint=250 keyint_min=25 scenecut=0 intra_refresh=0 rc_lookahead=0 rc=crf mbtree=0 crf=17.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 vbv_maxrate=1000 vbv_bufsize=1000 crf_max=0.0 nal_hrd=none filler=0 ip_ratio=1.40 aq=0  
  
  Finishing stream 0:1 without any data written to it.  
  
  Output #0, flv, to 'pipe:':  
  
  Metadata:  
  
  encoder : Lavf58.35.101  
  
  Stream #0:0: Video: h264 (libx264) ([7][0][0][0] / 0x0007), yuv420p, 1280x720, q=-1--1, 96 kb/s, 59.94 fps, 1k tbn, 59.94 tbc  
  
  Metadata:  
  
  encoder : Lavc58.64.101 libx264  
  
  Side data:  
  
  cpb: bitrate max/min/avg: 1000000/0/96000 buffer size: 1000000 vbv_delay: N/A  
  
  Stream #0:1: Audio: mp3 (libmp3lame) ([2][0][0][0] / 0x0002), 44100 Hz, stereo, s16p  
  
  Metadata:  
  
  encoder : Lavc58.64.101 libmp3lame  
  
  [flv @ 0x2abda90] Failed to update header with correct duration.  
  
  [flv @ 0x2abda90] Failed to update header with correct filesize.  
  
  Error writing trailer of pipe:: Broken pipe  
  
  frame= 0 fps=0.0 q=0.0 Lsize= 0kB time=00:00:00.00 bitrate=N/A speed= 0x
  
  video:0kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown  
  
  Exiting normally, received signal 15.         

  This message repeats until script is terminated with the Circuit Express button. For length, many instances of this line were cut out.

  [video4linux2,v4l2 @ 0x2aac5e0] Dequeued v4l2 buffer contains 4147200
  
  bytes, but 3110400 were expected. Flags: 0x00012001.
  
  Last message repeated xx times

  Output from v4l2-ctl --list-formats-ext

  ioctl: VIDIOC_ENUM_FMT
  
      Type: Video Capture
  
  
  
      [0]: 'YUYV' (YUYV 4:2:2)
  
          Size: Discrete 1920x1080
  
              Interval: Discrete 0.017s (59.940 fps)
  
      [1]: 'NV12' (Y/CbCr 4:2:0)
  
          Size: Discrete 1920x1080
  
              Interval: Discrete 0.017s (59.940 fps)
  
      [2]: 'YU12' (Planar YUV 4:2:0)
  
          Size: Discrete 1920x1080
  
              Interval: Discrete 0.017s (59.940 fps)

  Log output after ffmpeg command modification.

  Starting ffmpeg
  
  ffmpeg version N-95970-gd5274f8 Copyright (c) 2000-2019 the FFmpeg developers
  
    built with gcc 8 (Raspbian 8.3.0-6+rpi1)
  
    configuration: --prefix=/home/pi/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/pi/ffmpeg_build/include --extra-ldflags=-L/home/pi/ffmpeg_build/lib --extra-libs='-lpthread -lm' --bindir=/home/pi/bin --enable-gpl --enable-libass --enable-libfdk-aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libvorbis --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree
  
    libavutil      56. 36.101 / 56. 36.101
  
    libavcodec     58. 64.101 / 58. 64.101
  
    libavformat    58. 35.101 / 58. 35.101
  
    libavdevice    58.  9.101 / 58.  9.101
  
    libavfilter     7. 67.100 /  7. 67.100
  
    libswscale      5.  6.100 /  5.  6.100
  
    libswresample   3.  6.100 /  3.  6.100
  
    libpostproc    55.  6.100 / 55.  6.100
  
  terminated script
  
  Input #0, video4linux2,v4l2, from '/dev/video0':
  
    Duration: N/A, bitrate: 1491503 kb/s
  
      Stream #0:0: Video: rawvideo (I420 / 0x30323449), yuv420p, 1920x1080, 1491503 kb/s, 59.94 fps, 59.94 tbr, 1000k tbn, 1000k tbc
  
  Guessed Channel Layout for Input Stream #1.0 : stereo
  
  Input #1, alsa, from 'hw:1,0':
  
    Duration: N/A, bitrate: 1536 kb/s
  
      Stream #1:0: Audio: pcm_s16le, 48000 Hz, stereo, s16, 1536 kb/s
  
  [rtmp @ 0x2605cd0] Cannot open connection tcp://live.twitch.tv:1935
  
  rtmp://live.twitch.tv/app/live: Immediate exit requested
  
  Exiting normally, received signal 15.