Recherche avancée

Sur d’autres sites (10159)

• ffmpeg mp4 x264 encoding -> playback causes "pending" in both Chrome and IE causing 10+ seconds delay

  26 novembre 2015, par user1978645

  After encoding a video to mp4(x264 with aac) ; I have the following weird behaviour in both crome and IE :

  Im serving the content from https with spdy enables.

  It takes up to 30 seconds before the video is actually played, in the mean time i cannot reload the page it shows up as "pending". (even after i have visual on the video sometimes it takes 10-20 seconds before i can actually reload the page, or navigate to another url on the same domain)

  After looking at the "network" tab in developer tools, i see the following requests for 1 page/video :

  Path        Method Status   Type         Initiator   Size/content  Time/latency
  
  video.mp4   GET    206 OK   video/mp4    other       32.3KB/32.0kb  600ms/339MS 
  
  video.mp4   GET    206 OK   video/mp4    other       123kb/123b     21.85s/21.46s
  
  video.mp4   GET    206 OK   video/mp4    other       7.1MB/7.2MB    1.4min/2ms

  I tried to isolate the problem, When i use an mp4 video from the internet (for example the demo video of jplayer) and load it from my server, it loads rapidly, without delays.

  So it makes me think the problem lies within the encoding. I tried various things.
  FFmpeg :

  • csr 69 (low quality)

  • various options

  HTML :

  • preload="none"

  • javascript loading/playing of the movie

  • type=’mp4/video’

  • no posterimage

  But i cannot resolve the problem. Does anyone have a clue what is causing this ?

  I have a download speed of 300kb/s and the movie is 6MB.

  After the video starts, the video isn’t fully buffered, so i wonder : What is the html5 videoplayer doing all this time ?

  The problem also blocks the connections. When i press "F5" in both chrome and IE the page beeing reloaded comes up in the network tab as "pending" and it can take 10 to 20 seconds before the page actually reloads.

  ffmpeg command : (i used various commands but this is just 1 example which causes the problem)

  /root/bin/ffmpeg    -threads 1 -y  -i /home/flirtzo/public_html//userfiles/files/94e76a18a7838e62ecb23cf0c374b1b798e7b936  -threads 0 -codec:a libfdk_aac -b:a 128k  -vf "scale=-2:320" -preset veryslow -vcodec h264 -acodec aac -strict -2  /home/flirtzo/public_html/userfiles/files/b2/72/695f4eba95169a3f29564bf9571c703b05f1b5974f5156da633eb139c80a1575452e2858dfc61cc82bfca02d2b156aa64d4503695756481dc2a5d1c673a4cdea-94e76a18a7838e62ecb23cf0c374b1b798e7b936.mp4

  Output :

  ffmpeg version git-2014-04-16-c150e2c Copyright (c) 2000-2014 the FFmpeg developers
  
    built on Sep 28 2014 21:08:17 with gcc 4.4.7 (GCC) 20120313 (Red Hat 4.4.7-4)
  
    configuration: --prefix=/root/ffmpeg_build --extra-cflags=-I/root/ffmpeg_build/include --extra-        ldflags=-L/root/ffmpeg_build/lib --bindir=/root/bin --extra-libs=-ldl --enable-gpl --enable-nonfree -    -enable-libfdk_aac --enable-libmp3lame --enable-libopus --enable-libvorbis --enable-libvpx --enable-    libx264
  
    libavutil      52. 76.100 / 52. 76.100
  
    libavcodec     55. 58.103 / 55. 58.103
  
    libavformat    55. 37.100 / 55. 37.100
  
    libavdevice    55. 13.100 / 55. 13.100
  
    libavfilter     4.  4.100 /  4.  4.100
  
    libswscale      2.  6.100 /  2.  6.100
  
    libswresample   0. 18.100 /  0. 18.100
  
    libpostproc    52.  3.100 / 52.  3.100
  
  Input #0, mpeg, from         '/home/flirtzo/public_html//userfiles/files/94e76a18a7838e62ecb23cf0c374b1b798e7b936':
  
    Duration: 00:00:25.97, start: 0.340078, bitrate: 29004 kb/s
  
      Stream #0:0[0x1e0]: Video: mpeg1video, yuv420p(tv), 352x240 [SAR 200:219 DAR 880:657], 1150     kb/s, 29.97 fps, 29.97 tbr, 90k tbn, 29.97 tbc
  
      Stream #0:1[0x1c0]: Audio: mp2, 44100 Hz, stereo, s16p, 224 kb/s
  
  [libx264 @ 0x2b189c0] using SAR=1199/1314
  
  [libx264 @ 0x2b189c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX
  
  [libx264 @ 0x2b189c0] profile High, level 1.3
  
  [libx264 @ 0x2b189c0] 264 - core 142 r2 d6b4e63 - H.264/MPEG-4 AVC codec - Copyleft 2003-2014 -     http://www.videolan.org/x264.html - options: cabac=1 ref=2 deblock=1:0:0 analyse=0x3:0x113 me=hex     subme=4 psy=1 psy_rd=1.00:0.00 mixed_ref=0 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0     deadzone=21,11 fast_pskip=1 chroma_qp_offset=0 threads=12 lookahead_threads=1 sliced_threads=0 nr=0     decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0     direct=1 weightb=1 open_gop=0 weightp=1 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0     rc_lookahead=20 rc=crf mbtree=1 crf=51.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
  
  Output #0, mp4, to     '/home/flirtzo/public_html/userfiles/files/b2/72/695f4eba95169a3f29564bf9571c703b05f1b5974f5156da633e    b139c80a1575452e2858dfc61cc82bfca02d2b156aa64d4503695756481dc2a5d1c673a4cdea-    94e76a18a7838e62ecb23cf0c374b1b798e7b936.mp4':
  
    Metadata:
  
      encoder         : Lavf55.37.100
  
      Stream #0:0: Video: h264 (libx264) ([33][0][0][0] / 0x0021), yuv420p, 320x218 [SAR 1199:1314        DAR 880:657], q=-1--1, 30k tbn, 29.97 tbc
  
      Stream #0:1: Audio: aac ([64][0][0][0] / 0x0040), 44100 Hz, stereo, fltp, 128 kb/s
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (mpeg1video -> libx264)
  
    Stream #0:1 -> #0:1 (mp2 -> aac)
  
  Press [q] to stop, [?] for help
  
  frame=16127 fps=786 q=-1.0 Lsize=   10559kB time=00:08:58.12 bitrate= 160.7kbits/s dup=12 drop=0
  
  video:1586kB audio:8410kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead:     5.638589%
  
  [libx264 @ 0x2b189c0] frame I:109   Avg QP:50.58  size:   494
  
  [libx264 @ 0x2b189c0] frame P:9537  Avg QP:51.00  size:   138
  
  [libx264 @ 0x2b189c0] frame B:6481  Avg QP:51.00  size:    40
  
  [libx264 @ 0x2b189c0] consecutive B-frames: 21.8% 72.1%  5.4%  0.7%
  
  [libx264 @ 0x2b189c0] mb I  I16..4: 46.1% 53.9%  0.0%
  
  [libx264 @ 0x2b189c0] mb P  I16..4:  6.0%  6.1%  0.0%  P16..4: 12.7%  1.1%  0.1%  0.0%  0.0%        skip:74.1%
  
  [libx264 @ 0x2b189c0] mb B  I16..4:  0.1%  0.1%  0.0%  B16..8:  6.3%  0.0%  0.0%  direct: 0.7%      skip:92.9%  L0:38.6% L1:61.2% BI: 0.2%
  
  [libx264 @ 0x2b189c0] 8x8 transform intra:50.8% inter:85.6%
  
  [libx264 @ 0x2b189c0] coded y,uvDC,uvAC intra: 5.9% 39.5% 0.1% inter: 0.1% 1.0% 0.0%
  
  [libx264 @ 0x2b189c0] i16 v,h,dc,p: 56% 30%  7%  7%
  
  [libx264 @ 0x2b189c0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 12% 11% 62%  3%  3%  3%  3%  2%  2%
  
  [libx264 @ 0x2b189c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 19%  5% 73%  2%  0%  0%  0%  0%  2%
  
  [libx264 @ 0x2b189c0] i8c dc,h,v,p: 97%  1%  2%  0%
  
  [libx264 @ 0x2b189c0] Weighted P-Frames: Y:5.5% UV:2.7%
  
  [libx264 @ 0x2b189c0] ref P L0: 64.8% 35.2%
  
  [libx264 @ 0x2b189c0] ref B L0: 75.2% 24.8%
  
  [libx264 @ 0x2b189c0] ref B L1: 99.3%  0.7%
  
  [libx264 @ 0x2b189c0] kb/s:24.13
  
  ffmpeg version git-2014-04-16-c150e2c Copyright (c) 2000-2014 the FFmpeg developers
  
    built on Sep 28 2014 21:08:17 with gcc 4.4.7 (GCC) 20120313 (Red Hat 4.4.7-4)
  
    configuration: --prefix=/root/ffmpeg_build --extra-cflags=-I/root/ffmpeg_build/include --extra-    ldflags=-L/root/ffmpeg_build/lib --bindir=/root/bin --extra-libs=-ldl --enable-gpl --enable-nonfree -    -enable-libfdk_aac --enable-libmp3lame --enable-libopus --enable-libvorbis --enable-libvpx --enable-    libx264
  
    libavutil      52. 76.100 / 52. 76.100
  
    libavcodec     55. 58.103 / 55. 58.103
  
    libavformat    55. 37.100 / 55. 37.100
  
    libavdevice    55. 13.100 / 55. 13.100
  
    libavfilter     4.  4.100 /  4.  4.100
  
    libswscale      2.  6.100 /  2.  6.100
  
    libswresample   0. 18.100 /  0. 18.100
  
    libpostproc    52.  3.100 / 52.  3.100
  
  Input #0, mpeg, from     '/home/flirtzo/public_html//userfiles/files/94e76a18a7838e62ecb23cf0c374b1b798e7b936':
  
    Duration: 00:00:25.97, start: 0.340078, bitrate: 29004 kb/s
  
      Stream #0:0[0x1e0]: Video: mpeg1video, yuv420p(tv), 352x240 [SAR 200:219 DAR 880:657], 1150         kb/s, 29.97 fps, 29.97 tbr, 90k tbn, 29.97 tbc
  
      Stream #0:1[0x1c0]: Audio: mp2, 44100 Hz, stereo, s16p, 224 kb/s
  
  [libx264 @ 0x300d9c0] using SAR=200/219
  
  [libx264 @ 0x300d9c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX
  
  [libx264 @ 0x300d9c0] profile High, level 2.2
  
  [libx264 @ 0x300d9c0] 264 - core 142 r2 d6b4e63 - H.264/MPEG-4 AVC codec - Copyleft 2003-2014 -                     http://www.videolan.org/x264.html - options: cabac=1 ref=16 deblock=1:0:0 analyse=0x3:0x133 me=umh         subme=10 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=24 chroma_me=1 trellis=2 8x8dct=1 cqm=0     deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=1 sliced_threads=0 nr=0     decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=8 b_pyramid=2 b_adapt=2 b_bias=0     direct=3 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0     rc_lookahead=60 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
  
  Output #0, mp4, to     '/home/flirtzo/public_html/userfiles/files/b2/72/73d4a3245c0b0e174ab7ce0f872ba3f649f8b93f73a6deeab364    4a994009d73638ce61aecc7dc2e0250c4e74ff2d9a4d479ed35cef26b3f6e1a77e8bf5938518-    94e76a18a7838e62ecb23cf0c374b1b798e7b936.mp4':
  
    Metadata:
  
      encoder         : Lavf55.37.100
  
      Stream #0:0: Video: h264 (libx264) ([33][0][0][0] / 0x0021), yuv420p, 352x240 [SAR 200:219     DAR 880:657], q=-1--1, 30k tbn, 29.97 tbc
  
      Stream #0:1: Audio: aac ([64][0][0][0] / 0x0040), 44100 Hz, stereo, fltp, 128 kb/s
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (mpeg1video -> libx264)
  
    Stream #0:1 -> #0:1 (mp2 -> aac)
  
     Press [q] to stop, [?] for help
  
  frame=16127 fps= 88 q=-1.0 Lsize=   29190kB time=00:08:58.12 bitrate= 444.4kbits/s dup=12 drop=0
  
  video:20221kB audio:8410kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead:     1.954086%
  
  [libx264 @ 0x300d9c0] frame I:73    Avg QP:24.31  size:  8024
  
  [libx264 @ 0x300d9c0] frame P:4399  Avg QP:26.97  size:  2600
  
  [libx264 @ 0x300d9c0] frame B:11655 Avg QP:32.51  size:   745
  
  [libx264 @ 0x300d9c0] consecutive B-frames:  3.8%  5.0% 27.2% 18.4%  8.4% 33.9%  1.7%  0.7%  0.9%
  
  [libx264 @ 0x300d9c0] mb I  I16..4: 10.8% 68.5% 20.7%
  
  [libx264 @ 0x300d9c0] mb P  I16..4:  2.9%  7.5%  0.8%  P16..4: 45.1% 18.4% 12.4%  0.5%  0.1%        skip:12.3%
  
  [libx264 @ 0x300d9c0] mb B  I16..4:  0.6%  1.3%  0.1%  B16..8: 40.1%  8.7%  1.7%  direct: 2.1%      skip:45.5%  L0:47.2% L1:41.7% BI:11.1%
  
  [libx264 @ 0x300d9c0] 8x8 transform intra:66.7% inter:76.7%
  
  [libx264 @ 0x300d9c0] direct mvs  spatial:99.9% temporal:0.1%
  
  [libx264 @ 0x300d9c0] coded y,uvDC,uvAC intra: 60.3% 75.8% 16.4% inter: 17.3% 16.8% 0.6%
  
  [libx264 @ 0x300d9c0] i16 v,h,dc,p: 16% 27% 11% 47%
  
  [libx264 @ 0x300d9c0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 13% 13% 18%  6%  9%  9% 11%  9% 11%
  
  [libx264 @ 0x300d9c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 13% 15%  7%  7% 14% 14% 13%  8% 10%
  
  [libx264 @ 0x300d9c0] i8c dc,h,v,p: 26% 32% 20% 22%
  
  [libx264 @ 0x300d9c0] Weighted P-Frames: Y:10.1% UV:6.9%
  
  [libx264 @ 0x300d9c0] ref P L0: 40.6% 12.1% 10.0%  5.2%  5.2%  4.7%  4.6%  3.0%  2.5%  2.1%  1.9%      1.8%  1.7%  1.7%  1.6%  1.3%
  
  [libx264 @ 0x300d9c0] ref B L0: 71.4%  5.6%  3.2%  3.0%  3.1%  2.8%  2.5%  1.8%  1.3%  1.0%  1.1%      1.2%  1.0%  0.7%  0.5%
  
  [libx264 @ 0x300d9c0] ref B L1: 96.3%  3.7%
  
  [libx264 @ 0x300d9c0] kb/s:307.82

• RTSP relay using ffmpeg library

  23 novembre 2015, par kiran_g

  I am implementing an RTSP relay using libavcodec (ffmpeg). Basically, it connects to an IP camera, which is an RTSP server, PULLs the stream and then PUSHes it to wowza. I am finding it very difficult to get any sample implementation for this in the internet. So I started implementing this using bits and pieces from here and there. I took code for code samples to a) read RTSP stream and write to file b)read from file and serve it over RTSP.

  This is the current state of the code :

  /*
  
   * Copyright (c) 2010 Nicolas George
  
   * Copyright (c) 2011 Stefano Sabatini
  
   * Copyright (c) 2014 Andrey Utkin
  
   *
  
   * Permission is hereby granted, free of charge, to any person obtaining a copy
  
   * of this software and associated documentation files (the "Software"), to deal
  
   * in the Software without restriction, including without limitation the rights
  
   * to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
  
   * copies of the Software, and to permit persons to whom the Software is
  
   * furnished to do so, subject to the following conditions:
  
   *
  
   * The above copyright notice and this permission notice shall be included in
  
   * all copies or substantial portions of the Software.
  
   *
  
   * THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
  
   * IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
  
   * FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL
  
   * THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
  
   * LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
  
   * OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
  
   * THE SOFTWARE.
  
   */
  
  
  
  /**
  
   * @file
  
   * API example for demuxing, decoding, filtering, encoding and muxing
  
   * @example transcoding.c
  
   */
  
  
  
  #include <libavcodec></libavcodec>avcodec.h>
  
  #include <libavformat></libavformat>avformat.h>
  
  #include <libavfilter></libavfilter>avfiltergraph.h>
  
  #include <libavfilter></libavfilter>buffersink.h>
  
  #include <libavfilter></libavfilter>buffersrc.h>
  
  #include <libavutil></libavutil>opt.h>
  
  #include <libavutil></libavutil>pixdesc.h>
  
  
  
  static AVFormatContext *ifmt_ctx,*temp;
  
  static AVFormatContext *ofmt_ctx;
  
  typedef struct FilteringContext {
  
      AVFilterContext *buffersink_ctx;
  
      AVFilterContext *buffersrc_ctx;
  
      AVFilterGraph *filter_graph;
  
  } FilteringContext;
  
  static FilteringContext *filter_ctx;
  
  
  
  static int open_input_file(const char *filename)
  
  {
  
      int ret;
  
      unsigned int i;
  
  
  
      ifmt_ctx = NULL;
  
      if ((ret = avformat_open_input(&amp;ifmt_ctx, filename, NULL, NULL)) &lt; 0) {
  
          av_log(NULL, AV_LOG_ERROR, "Cannot open input file\n");
  
          return ret;
  
      }
  
  
  
      if ((ret = avformat_find_stream_info(ifmt_ctx, NULL)) &lt; 0) {
  
          av_log(NULL, AV_LOG_ERROR, "Cannot find stream information\n");
  
          return ret;
  
      }
  
  
  
      for (i = 0; i &lt; ifmt_ctx->nb_streams; i++) {
  
          AVStream *stream;
  
          AVCodecContext *codec_ctx;
  
          stream = ifmt_ctx->streams[i];
  
          codec_ctx = stream->codec;
  
          /* Reencode video &amp; audio and remux subtitles etc. */
  
          if (codec_ctx->codec_type == AVMEDIA_TYPE_VIDEO
  
                  || codec_ctx->codec_type == AVMEDIA_TYPE_AUDIO) {
  
              /* Open decoder */
  
              ret = avcodec_open2(codec_ctx,
  
                      avcodec_find_decoder(codec_ctx->codec_id), NULL);
  
              if (ret &lt; 0) {
  
                  av_log(NULL, AV_LOG_ERROR, "Failed to open decoder for stream #%u\n", i);
  
                  return ret;
  
              }
  
          }
  
      }
  
  
  
      av_dump_format(ifmt_ctx, 0, filename, 0);
  
      return 0;
  
  }
  
  
  
  static int open_output_file(const char *filename)
  
  {
  
      AVStream *out_stream;
  
      AVStream *in_stream;
  
      AVCodecContext *dec_ctx, *enc_ctx;
  
      AVCodec *encoder,*codec;
  
      int ret;
  
      unsigned int i;
  
  
  
      ofmt_ctx = NULL;
  
      avformat_open_input(&amp;temp, "rtsp://localhost:8554/live", NULL, NULL);
  
      avformat_alloc_output_context2(&amp;ofmt_ctx, temp->oformat,"rtsp", filename);
  
      if (!ofmt_ctx) {
  
          av_log(NULL, AV_LOG_ERROR, "Could not create output context\n");
  
          return AVERROR_UNKNOWN;
  
      }
  
  
  
  
  
      for (i = 0; i &lt; ifmt_ctx->nb_streams; i++) {
  
          out_stream = avformat_new_stream(ofmt_ctx, NULL);
  
          if (!out_stream) {
  
              av_log(NULL, AV_LOG_ERROR, "Failed allocating output stream\n");
  
              return AVERROR_UNKNOWN;
  
          }
  
  
  
          in_stream = ifmt_ctx->streams[i];
  
          dec_ctx = in_stream->codec;
  
          enc_ctx = out_stream->codec;
  
  
  
          if (dec_ctx->codec_type == AVMEDIA_TYPE_VIDEO
  
                  || dec_ctx->codec_type == AVMEDIA_TYPE_AUDIO) {
  
              /* in this example, we choose transcoding to same codec */
  
              encoder = avcodec_find_encoder(dec_ctx->codec_id);
  
              printf("codec : %d",dec_ctx->codec_id);
  
              if (!encoder) {
  
                  av_log(NULL, AV_LOG_FATAL, "Necessary encoder not found\n");
  
                  return AVERROR_INVALIDDATA;
  
              }
  
  
  
              /* In this example, we transcode to same properties (picture size,
  
               * sample rate etc.). These properties can be changed for output
  
               * streams easily using filters */
  
              if (dec_ctx->codec_type == AVMEDIA_TYPE_VIDEO) {
  
                  enc_ctx->height = dec_ctx->height;
  
                  enc_ctx->width = dec_ctx->width;
  
                  enc_ctx->sample_aspect_ratio = dec_ctx->sample_aspect_ratio;
  
                  /* take first format from list of supported formats */
  
                  enc_ctx->pix_fmt = encoder->pix_fmts[0];
  
                  //enc_ctx->codec_id = AV_CODEC_ID_H264;
  
                  /* video time_base can be set to whatever is handy and supported by encoder */
  
                  enc_ctx->time_base = dec_ctx->time_base;
  
              } else {
  
                  enc_ctx->sample_rate = dec_ctx->sample_rate;
  
                  enc_ctx->channel_layout = dec_ctx->channel_layout;
  
                  enc_ctx->channels = av_get_channel_layout_nb_channels(enc_ctx->channel_layout);
  
                  /* take first format from list of supported formats */
  
                  enc_ctx->sample_fmt = encoder->sample_fmts[0];
  
                  enc_ctx->pix_fmt =AV_PIX_FMT_RGB24 ;
  
                  enc_ctx->time_base = (AVRational){1, enc_ctx->sample_rate};
  
              }
  
  
  
              /* Third parameter can be used to pass settings to encoder */
  
              //codec = avcodec_find_encoder(AV_CODEC_ID_H264);
  
              ret = avcodec_open2(enc_ctx, encoder, NULL);
  
              if (ret &lt; 0) {
  
                  av_log(NULL, AV_LOG_ERROR, "Cannot open video encoder for stream #%u\n", i);
  
                  return ret;
  
              }
  
          } else if (dec_ctx->codec_type == AVMEDIA_TYPE_UNKNOWN) {
  
              av_log(NULL, AV_LOG_FATAL, "Elementary stream #%d is of unknown type, cannot proceed\n", i);
  
              return AVERROR_INVALIDDATA;
  
          } else {
  
              /* if this stream must be remuxed */
  
              ret = avcodec_copy_context(ofmt_ctx->streams[i]->codec,
  
                      ifmt_ctx->streams[i]->codec);
  
              if (ret &lt; 0) {
  
                  av_log(NULL, AV_LOG_ERROR, "Copying stream context failed\n");
  
                  return ret;
  
              }
  
          }
  
  
  
          if (ofmt_ctx->oformat->flags &amp; AVFMT_GLOBALHEADER)
  
              enc_ctx->flags |= AV_CODEC_FLAG_GLOBAL_HEADER;
  
  
  
      }
  
      av_dump_format(ofmt_ctx, 0, filename, 1);
  
  
  
      if (!(ofmt_ctx->oformat->flags &amp; AVFMT_NOFILE)) {
  
          ret = avio_open(&amp;ofmt_ctx->pb, filename, AVIO_FLAG_WRITE);
  
          if (ret &lt; 0) {
  
              av_log(NULL, AV_LOG_ERROR, "Could not open output file '%s'", filename);
  
              return ret;
  
          }
  
      }
  
  
  
      /* init muxer, write output file header */
  
      ret = avformat_write_header(ofmt_ctx, NULL);
  
      if (ret &lt; 0) {
  
          av_log(NULL, AV_LOG_ERROR, "Error occurred when opening output file\n");
  
          return ret;
  
      }
  
  
  
      return 0;
  
  }
  
  
  
  static int init_filter(FilteringContext* fctx, AVCodecContext *dec_ctx,
  
          AVCodecContext *enc_ctx, const char *filter_spec)
  
  {
  
      char args[512];
  
      int ret = 0;
  
      AVFilter *buffersrc = NULL;
  
      AVFilter *buffersink = NULL;
  
      AVFilterContext *buffersrc_ctx = NULL;
  
      AVFilterContext *buffersink_ctx = NULL;
  
      AVFilterInOut *outputs = avfilter_inout_alloc();
  
      AVFilterInOut *inputs  = avfilter_inout_alloc();
  
      AVFilterGraph *filter_graph = avfilter_graph_alloc();
  
  
  
      if (!outputs || !inputs || !filter_graph) {
  
          ret = AVERROR(ENOMEM);
  
          goto end;
  
      }
  
  
  
      if (dec_ctx->codec_type == AVMEDIA_TYPE_VIDEO) {
  
          buffersrc = avfilter_get_by_name("buffer");
  
          buffersink = avfilter_get_by_name("buffersink");
  
          if (!buffersrc || !buffersink) {
  
              av_log(NULL, AV_LOG_ERROR, "filtering source or sink element not found\n");
  
              ret = AVERROR_UNKNOWN;
  
              goto end;
  
          }
  
  
  
          snprintf(args, sizeof(args),
  
                  "video_size=%dx%d:pix_fmt=%d:time_base=%d/%d:pixel_aspect=%d/%d",
  
                  dec_ctx->width, dec_ctx->height, dec_ctx->pix_fmt,
  
                  dec_ctx->time_base.num, dec_ctx->time_base.den,
  
                  dec_ctx->sample_aspect_ratio.num,
  
                  dec_ctx->sample_aspect_ratio.den);
  
  
  
          ret = avfilter_graph_create_filter(&amp;buffersrc_ctx, buffersrc, "in",
  
                  args, NULL, filter_graph);
  
          if (ret &lt; 0) {
  
              av_log(NULL, AV_LOG_ERROR, "Cannot create buffer source\n");
  
              goto end;
  
          }
  
  
  
          ret = avfilter_graph_create_filter(&amp;buffersink_ctx, buffersink, "out",
  
                  NULL, NULL, filter_graph);
  
          if (ret &lt; 0) {
  
              av_log(NULL, AV_LOG_ERROR, "Cannot create buffer sink\n");
  
              goto end;
  
          }
  
  
  
          ret = av_opt_set_bin(buffersink_ctx, "pix_fmts",
  
                  (uint8_t*)&amp;enc_ctx->pix_fmt, sizeof(enc_ctx->pix_fmt),
  
                  AV_OPT_SEARCH_CHILDREN);
  
          if (ret &lt; 0) {
  
              av_log(NULL, AV_LOG_ERROR, "Cannot set output pixel format\n");
  
              goto end;
  
          }
  
      } else if (dec_ctx->codec_type == AVMEDIA_TYPE_AUDIO) {
  
          buffersrc = avfilter_get_by_name("abuffer");
  
          buffersink = avfilter_get_by_name("abuffersink");
  
          if (!buffersrc || !buffersink) {
  
              av_log(NULL, AV_LOG_ERROR, "filtering source or sink element not found\n");
  
              ret = AVERROR_UNKNOWN;
  
              goto end;
  
          }
  
  
  
          if (!dec_ctx->channel_layout)
  
              dec_ctx->channel_layout =
  
                  av_get_default_channel_layout(dec_ctx->channels);
  
          snprintf(args, sizeof(args),
  
                  "time_base=%d/%d:sample_rate=%d:sample_fmt=%s:channel_layout=0x%"PRIx64,
  
                  dec_ctx->time_base.num, dec_ctx->time_base.den, dec_ctx->sample_rate,
  
                  av_get_sample_fmt_name(dec_ctx->sample_fmt),
  
                  dec_ctx->channel_layout);
  
          ret = avfilter_graph_create_filter(&amp;buffersrc_ctx, buffersrc, "in",
  
                  args, NULL, filter_graph);
  
          if (ret &lt; 0) {
  
              av_log(NULL, AV_LOG_ERROR, "Cannot create audio buffer source\n");
  
              goto end;
  
          }
  
  
  
          ret = avfilter_graph_create_filter(&amp;buffersink_ctx, buffersink, "out",
  
                  NULL, NULL, filter_graph);
  
          if (ret &lt; 0) {
  
              av_log(NULL, AV_LOG_ERROR, "Cannot create audio buffer sink\n");
  
              goto end;
  
          }
  
  
  
          ret = av_opt_set_bin(buffersink_ctx, "sample_fmts",
  
                  (uint8_t*)&amp;enc_ctx->sample_fmt, sizeof(enc_ctx->sample_fmt),
  
                  AV_OPT_SEARCH_CHILDREN);
  
          if (ret &lt; 0) {
  
              av_log(NULL, AV_LOG_ERROR, "Cannot set output sample format\n");
  
              goto end;
  
          }
  
  
  
          ret = av_opt_set_bin(buffersink_ctx, "channel_layouts",
  
                  (uint8_t*)&amp;enc_ctx->channel_layout,
  
                  sizeof(enc_ctx->channel_layout), AV_OPT_SEARCH_CHILDREN);
  
          if (ret &lt; 0) {
  
              av_log(NULL, AV_LOG_ERROR, "Cannot set output channel layout\n");
  
              goto end;
  
          }
  
  
  
          ret = av_opt_set_bin(buffersink_ctx, "sample_rates",
  
                  (uint8_t*)&amp;enc_ctx->sample_rate, sizeof(enc_ctx->sample_rate),
  
                  AV_OPT_SEARCH_CHILDREN);
  
          if (ret &lt; 0) {
  
              av_log(NULL, AV_LOG_ERROR, "Cannot set output sample rate\n");
  
              goto end;
  
          }
  
      } else {
  
          ret = AVERROR_UNKNOWN;
  
          goto end;
  
      }
  
  
  
      /* Endpoints for the filter graph. */
  
      outputs->name       = av_strdup("in");
  
      outputs->filter_ctx = buffersrc_ctx;
  
      outputs->pad_idx    = 0;
  
      outputs->next       = NULL;
  
  
  
      inputs->name       = av_strdup("out");
  
      inputs->filter_ctx = buffersink_ctx;
  
      inputs->pad_idx    = 0;
  
      inputs->next       = NULL;
  
  
  
      if (!outputs->name || !inputs->name) {
  
          ret = AVERROR(ENOMEM);
  
          goto end;
  
      }
  
  
  
      if ((ret = avfilter_graph_parse_ptr(filter_graph, filter_spec,
  
                      &amp;inputs, &amp;outputs, NULL)) &lt; 0)
  
          goto end;
  
  
  
      if ((ret = avfilter_graph_config(filter_graph, NULL)) &lt; 0)
  
          goto end;
  
  
  
      /* Fill FilteringContext */
  
      fctx->buffersrc_ctx = buffersrc_ctx;
  
      fctx->buffersink_ctx = buffersink_ctx;
  
      fctx->filter_graph = filter_graph;
  
  
  
  end:
  
      avfilter_inout_free(&amp;inputs);
  
      avfilter_inout_free(&amp;outputs);
  
  
  
      return ret;
  
  }
  
  
  
  static int init_filters(void)
  
  {
  
      const char *filter_spec;
  
      unsigned int i;
  
      int ret;
  
      filter_ctx = av_malloc_array(ifmt_ctx->nb_streams, sizeof(*filter_ctx));
  
      if (!filter_ctx)
  
          return AVERROR(ENOMEM);
  
  
  
      for (i = 0; i &lt; ifmt_ctx->nb_streams; i++) {
  
          filter_ctx[i].buffersrc_ctx  = NULL;
  
          filter_ctx[i].buffersink_ctx = NULL;
  
          filter_ctx[i].filter_graph   = NULL;
  
          if (!(ifmt_ctx->streams[i]->codec->codec_type == AVMEDIA_TYPE_AUDIO
  
                  || ifmt_ctx->streams[i]->codec->codec_type == AVMEDIA_TYPE_VIDEO))
  
              continue;
  
  
  
  
  
          if (ifmt_ctx->streams[i]->codec->codec_type == AVMEDIA_TYPE_VIDEO)
  
              filter_spec = "null"; /* passthrough (dummy) filter for video */
  
          else
  
              filter_spec = "anull"; /* passthrough (dummy) filter for audio */
  
          ret = init_filter(&amp;filter_ctx[i], ifmt_ctx->streams[i]->codec,
  
                  ofmt_ctx->streams[i]->codec, filter_spec);
  
          if (ret)
  
              return ret;
  
      }
  
      return 0;
  
  }
  
  
  
  static int encode_write_frame(AVFrame *filt_frame, unsigned int stream_index, int *got_frame) {
  
      int ret;
  
      int got_frame_local;
  
      AVPacket enc_pkt;
  
      int (*enc_func)(AVCodecContext *, AVPacket *, const AVFrame *, int *) =
  
          (ifmt_ctx->streams[stream_index]->codec->codec_type ==
  
           AVMEDIA_TYPE_VIDEO) ? avcodec_encode_video2 : avcodec_encode_audio2;
  
  
  
      if (!got_frame)
  
          got_frame = &amp;got_frame_local;
  
  
  
      av_log(NULL, AV_LOG_INFO, "Encoding frame\n");
  
      /* encode filtered frame */
  
      enc_pkt.data = NULL;
  
      enc_pkt.size = 0;
  
      av_init_packet(&amp;enc_pkt);
  
      ret = enc_func(ofmt_ctx->streams[stream_index]->codec, &amp;enc_pkt,
  
              filt_frame, got_frame);
  
      av_frame_free(&amp;filt_frame);
  
      if (ret &lt; 0)
  
          return ret;
  
      if (!(*got_frame))
  
          return 0;
  
  
  
      /* prepare packet for muxing */
  
      enc_pkt.stream_index = stream_index;
  
      av_packet_rescale_ts(&amp;enc_pkt,
  
                           ofmt_ctx->streams[stream_index]->codec->time_base,
  
                           ofmt_ctx->streams[stream_index]->time_base);
  
  
  
      av_log(NULL, AV_LOG_DEBUG, "Muxing frame\n");
  
      /* mux encoded frame */
  
      ret = av_interleaved_write_frame(ofmt_ctx, &amp;enc_pkt);
  
      return ret;
  
  }
  
  
  
  static int filter_encode_write_frame(AVFrame *frame, unsigned int stream_index)
  
  {
  
      int ret;
  
      AVFrame *filt_frame;
  
  
  
      av_log(NULL, AV_LOG_INFO, "Pushing decoded frame to filters\n");
  
      /* push the decoded frame into the filtergraph */
  
      ret = av_buffersrc_add_frame_flags(filter_ctx[stream_index].buffersrc_ctx,
  
              frame, 0);
  
      if (ret &lt; 0) {
  
          av_log(NULL, AV_LOG_ERROR, "Error while feeding the filtergraph\n");
  
          return ret;
  
      }
  
  
  
      /* pull filtered frames from the filtergraph */
  
      while (1) {
  
          filt_frame = av_frame_alloc();
  
          if (!filt_frame) {
  
              ret = AVERROR(ENOMEM);
  
              break;
  
          }
  
          av_log(NULL, AV_LOG_INFO, "Pulling filtered frame from filters\n");
  
          ret = av_buffersink_get_frame(filter_ctx[stream_index].buffersink_ctx,
  
                  filt_frame);
  
          if (ret &lt; 0) {
  
              /* if no more frames for output - returns AVERROR(EAGAIN)
  
               * if flushed and no more frames for output - returns AVERROR_EOF
  
               * rewrite retcode to 0 to show it as normal procedure completion
  
               */
  
              if (ret == AVERROR(EAGAIN) || ret == AVERROR_EOF)
  
                  ret = 0;
  
              av_frame_free(&amp;filt_frame);
  
              break;
  
          }
  
  
  
          filt_frame->pict_type = AV_PICTURE_TYPE_NONE;
  
          ret = encode_write_frame(filt_frame, stream_index, NULL);
  
          if (ret &lt; 0)
  
              break;
  
      }
  
  
  
      return ret;
  
  }
  
  
  
  static int flush_encoder(unsigned int stream_index)
  
  {
  
      int ret;
  
      int got_frame;
  
  
  
      if (!(ofmt_ctx->streams[stream_index]->codec->codec->capabilities &amp;
  
                  AV_CODEC_CAP_DELAY))
  
          return 0;
  
  
  
      while (1) {
  
          av_log(NULL, AV_LOG_INFO, "Flushing stream #%u encoder\n", stream_index);
  
          ret = encode_write_frame(NULL, stream_index, &amp;got_frame);
  
          if (ret &lt; 0)
  
              break;
  
          if (!got_frame)
  
              return 0;
  
      }
  
      return ret;
  
  }
  
  
  
  int main(int argc, char **argv)
  
  {
  
      int ret;
  
      AVPacket packet = { .data = NULL, .size = 0 };
  
      AVFrame *frame = NULL;
  
      enum AVMediaType type;
  
      unsigned int stream_index;
  
      unsigned int i;
  
      int got_frame;
  
      int (*dec_func)(AVCodecContext *, AVFrame *, int *, const AVPacket *);
  
  
  
      if (argc != 3) {
  
          av_log(NULL, AV_LOG_ERROR, "Usage: %s <input file="file" /> <output file="file">\n", argv[0]);
  
          return 1;
  
      }
  
  
  
      av_register_all();
  
      avfilter_register_all();
  
      avformat_network_init();
  
  
  
      if ((ret = open_input_file(argv[1])) &lt; 0)
  
          goto end;
  
      if ((ret = open_output_file(argv[2])) &lt; 0)
  
          goto end;
  
      if ((ret = init_filters()) &lt; 0)
  
          goto end;
  
  
  
      /* read all packets */
  
      while (1) {
  
          if ((ret = av_read_frame(ifmt_ctx, &amp;packet)) &lt; 0)
  
              break;
  
          stream_index = packet.stream_index;
  
          type = ifmt_ctx->streams[packet.stream_index]->codec->codec_type;
  
          av_log(NULL, AV_LOG_DEBUG, "Demuxer gave frame of stream_index %u\n",
  
                  stream_index);
  
  
  
          if (filter_ctx[stream_index].filter_graph) {
  
              av_log(NULL, AV_LOG_DEBUG, "Going to reencode&amp;filter the frame\n");
  
              frame = av_frame_alloc();
  
              if (!frame) {
  
                  ret = AVERROR(ENOMEM);
  
                  break;
  
              }
  
              av_packet_rescale_ts(&amp;packet,
  
                                   ifmt_ctx->streams[stream_index]->time_base,
  
                                   ifmt_ctx->streams[stream_index]->codec->time_base);
  
              dec_func = (type == AVMEDIA_TYPE_VIDEO) ? avcodec_decode_video2 :
  
                  avcodec_decode_audio4;
  
              ret = dec_func(ifmt_ctx->streams[stream_index]->codec, frame,
  
                      &amp;got_frame, &amp;packet);
  
              if (ret &lt; 0) {
  
                  av_frame_free(&amp;frame);
  
                  av_log(NULL, AV_LOG_ERROR, "Decoding failed\n");
  
                  break;
  
              }
  
  
  
              if (got_frame) {
  
                  frame->pts = av_frame_get_best_effort_timestamp(frame);
  
                  ret = filter_encode_write_frame(frame, stream_index);
  
                  av_frame_free(&amp;frame);
  
                  if (ret &lt; 0)
  
                      goto end;
  
              } else {
  
                  av_frame_free(&amp;frame);
  
              }
  
          } else {
  
              /* remux this frame without reencoding */
  
              av_packet_rescale_ts(&amp;packet,
  
                                   ifmt_ctx->streams[stream_index]->time_base,
  
                                   ofmt_ctx->streams[stream_index]->time_base);
  
  
  
              ret = av_interleaved_write_frame(ofmt_ctx, &amp;packet);
  
              if (ret &lt; 0)
  
                  goto end;
  
          }
  
          av_packet_unref(&amp;packet);
  
      }
  
  
  
      /* flush filters and encoders */
  
      for (i = 0; i &lt; ifmt_ctx->nb_streams; i++) {
  
          /* flush filter */
  
          if (!filter_ctx[i].filter_graph)
  
              continue;
  
          ret = filter_encode_write_frame(NULL, i);
  
          if (ret &lt; 0) {
  
              av_log(NULL, AV_LOG_ERROR, "Flushing filter failed\n");
  
              goto end;
  
          }
  
  
  
          /* flush encoder */
  
          ret = flush_encoder(i);
  
          if (ret &lt; 0) {
  
              av_log(NULL, AV_LOG_ERROR, "Flushing encoder failed\n");
  
              goto end;
  
          }
  
      }
  
  
  
      av_write_trailer(ofmt_ctx);
  
  end:
  
      av_packet_unref(&amp;packet);
  
      av_frame_free(&amp;frame);
  
      for (i = 0; i &lt; ifmt_ctx->nb_streams; i++) {
  
          avcodec_close(ifmt_ctx->streams[i]->codec);
  
          if (ofmt_ctx &amp;&amp; ofmt_ctx->nb_streams > i &amp;&amp; ofmt_ctx->streams[i] &amp;&amp; ofmt_ctx->streams[i]->codec)
  
              avcodec_close(ofmt_ctx->streams[i]->codec);
  
          if (filter_ctx &amp;&amp; filter_ctx[i].filter_graph)
  
              avfilter_graph_free(&amp;filter_ctx[i].filter_graph);
  
      }
  
      av_free(filter_ctx);
  
      avformat_close_input(&amp;ifmt_ctx);
  
      if (ofmt_ctx &amp;&amp; !(ofmt_ctx->oformat->flags &amp; AVFMT_NOFILE))
  
          avio_closep(&amp;ofmt_ctx->pb);
  
      avformat_free_context(ofmt_ctx);
  
  
  
      if (ret &lt; 0)
  
          av_log(NULL, AV_LOG_ERROR, "Error occurred: %s\n", av_err2str(ret));
  
  
  
      return ret ? 1 : 0;
  
  }
  
  </output>

  When we run this we are getting this error :

  Input #0, rtsp, from 'rtsp://localhost:8554/live':
  
    Metadata:
  
      title           : Unnamed
  
      comment         : N/A
  
    Duration: N/A, start: 5294.642467, bitrate: N/A
  
      Stream #0:0: Video: h264 (Constrained Baseline), yuv420p, 640x480 [SAR 1:1 DAR 4:3], 30 fps, 30 tbr, 90k tbn, 60 tbc
  
  [libx264 @ 0xe87c80] Specified pixel format -1 is invalid or not supported
  
  Cannot open video encoder for stream #0
  
  codec : 28 and pix :12
  
  Error occurred: Invalid argument

  But I could see that the correct pixel format macro "AV_PIX_FMT_YUV420P" is provided.

  UPDATE 1 :
  This is the section in ffmpeg where the error is thrown from(utils.c line 1547) :

   if (avctx->codec->pix_fmts) {
  
              for (i = 0; avctx->codec->pix_fmts[i] != AV_PIX_FMT_NONE; i++)
  
                  if (avctx->pix_fmt == avctx->codec->pix_fmts[i])
  
                      break;
  
              if (avctx->codec->pix_fmts[i] == AV_PIX_FMT_NONE
  
                  && !((avctx->codec_id == AV_CODEC_ID_MJPEG || avctx->codec_id == AV_CODEC_ID_LJPEG)
  
                       && avctx->strict_std_compliance <= FF_COMPLIANCE_UNOFFICIAL)) {
  
                  char buf[128];
  
                  snprintf(buf, sizeof(buf), "%d", avctx->pix_fmt);
  
                  av_log(avctx, AV_LOG_ERROR, "Specified pixel format %s is invalid or not supported\n",
  
                         (char *)av_x_if_null(av_get_pix_fmt_name(avctx->pix_fmt), buf));
  
                  ret = AVERROR(EINVAL);
  
                  goto free_and_end;
  
              }

  Can someone suggest a solution for this.

  Thanks

• Issue in recording video

  16 novembre 2015, par human123

  I am trying to record video in 480*480 resolution like in vine using javacv. As a starting point I used the sample provided in https://github.com/bytedeco/javacv/blob/master/samples/RecordActivity.java Video is getting recorded (but not in the desired resolution) and saved.

  But the issue is that 480*480 resolution is not supported natively in android. So some pre processing needs to be done to get the video in desired resolution.

  So once I was able to record video using code sample provided by javacv, next challenge was on how to pre process the video. On research it was found that efficient cropping is possible when final image width required is same as recorded image width. Such a solution was provided in the SO question,Recording video on Android using JavaCV (Updated 2014 02 17). I changed onPreviewFrame method as suggested in that answer.

      @Override
  
      public void onPreviewFrame(byte[] data, Camera camera) {
  
          if (audioRecord == null || audioRecord.getRecordingState() != AudioRecord.RECORDSTATE_RECORDING) {
  
              startTime = System.currentTimeMillis();
  
              return;
  
          }
  
          if (RECORD_LENGTH > 0) {
  
              int i = imagesIndex++ % images.length;
  
              yuvImage = images[i];
  
              timestamps[i] = 1000 * (System.currentTimeMillis() - startTime);
  
          }
  
          /* get video data */
  
          imageWidth = 640;
  
          imageHeight = 480    
  
          int finalImageHeight = 360;
  
          if (yuvImage != null && recording) {
  
              ByteBuffer bb = (ByteBuffer)yuvImage.image[0].position(0); // resets the buffer
  
              final int startY = imageWidth*(imageHeight-finalImageHeight)/2;
  
              final int lenY = imageWidth*finalImageHeight;
  
              bb.put(data, startY, lenY);
  
              final int startVU = imageWidth*imageHeight + imageWidth*(imageHeight-finalImageHeight)/4;
  
              final int lenVU = imageWidth* finalImageHeight/2;
  
              bb.put(data, startVU, lenVU);
  
              try {
  
                  long t = 1000 * (System.currentTimeMillis() - startTime);
  
                  if (t > recorder.getTimestamp()) {
  
                      recorder.setTimestamp(t);
  
                  }
  
                  recorder.record(yuvImage);
  
              } catch (FFmpegFrameRecorder.Exception e) {
  
                  Log.e(LOG_TAG, "problem with recorder():", e);
  
              }
  
          }
  
  
  
  
  
      }
  
  }

  Please also note that this solution was provided for an older version of javacv. The resulting video had a yellowish overlay covering 2/3rd part. Also there was empty section on left side as the video was not cropped correctly.

  So my question is what is the most appropriate solution for cropping videos using latest version of javacv ?

  Code after making change as suggested by Alex Cohn

      @Override
  
      public void onPreviewFrame(byte[] data, Camera camera) {
  
          if (audioRecord == null || audioRecord.getRecordingState() != AudioRecord.RECORDSTATE_RECORDING) {
  
              startTime = System.currentTimeMillis();
  
              return;
  
          }
  
          if (RECORD_LENGTH > 0) {
  
              int i = imagesIndex++ % images.length;
  
              yuvImage = images[i];
  
              timestamps[i] = 1000 * (System.currentTimeMillis() - startTime);
  
          }
  
          /* get video data */
  
          imageWidth = 640;
  
          imageHeight = 480;       
  
          destWidth = 480;
  
  
  
          if (yuvImage != null && recording) {
  
              ByteBuffer bb = (ByteBuffer)yuvImage.image[0].position(0); // resets the buffer
  
              int start = 2*((imageWidth-destWidth)/4); // this must be even
  
              for (int row=0; row2; row++) {
  
                  bb.put(data, start, destWidth);
  
                  start += imageWidth;
  
              }
  
              try {
  
                  long t = 1000 * (System.currentTimeMillis() - startTime);
  
                  if (t > recorder.getTimestamp()) {
  
                      recorder.setTimestamp(t);
  
                  }
  
                  recorder.record(yuvImage);
  
              } catch (FFmpegFrameRecorder.Exception e) {
  
                  Log.e(LOG_TAG, "problem with recorder():", e);
  
              }
  
          }
  
  
  
  
  
      }

  Screen shot from video generated with this code (destWidth 480) is

  

  Next I tried capturing a video with destWidth speciified as 639. The result is

  

  When destWidth is 639 video is repeating contents twice. When it is 480, contents are repeated 5 times and the green overlay and distortion is more.

  Also When the destWidth = imageWidth, video is captured properly. ie, for 640*480 there is no repetition of video contents and no green overlay.

  Converting frame to IplImage

  When this question was asked first, I missed to mention that the record method in FFmpegFrameRecorder is now accepting object of type Frame whereas earlier it was IplImage object. So I tried to apply Alex Cohn’s solution by converting Frame to IplImage.

  //---------------------------------------
  
  // initialize ffmpeg_recorder
  
  //---------------------------------------
  
  private void initRecorder() {
  
  
  
      Log.w(LOG_TAG,"init recorder");
  
  
  
      imageWidth = 640;
  
      imageHeight = 480; 
  
  
  
      if (RECORD_LENGTH > 0) {
  
          imagesIndex = 0;
  
          images = new Frame[RECORD_LENGTH * frameRate];
  
          timestamps = new long[images.length];
  
          for (int i = 0; i < images.length; i++) {
  
              images[i] = new Frame(imageWidth, imageHeight, Frame.DEPTH_UBYTE, 2);
  
              timestamps[i] = -1;
  
          }
  
      } else if (yuvImage == null) {
  
          yuvImage = new Frame(imageWidth, imageHeight, Frame.DEPTH_UBYTE, 2);
  
          Log.i(LOG_TAG, "create yuvImage");
  
          OpenCVFrameConverter.ToIplImage converter = new OpenCVFrameConverter.ToIplImage();
  
          yuvIplimage = converter.convert(yuvImage);
  
  
  
      }
  
  
  
      Log.i(LOG_TAG, "ffmpeg_url: " + ffmpeg_link);
  
      recorder = new FFmpegFrameRecorder(ffmpeg_link, imageWidth, imageHeight, 1);
  
      recorder.setFormat("flv");
  
      recorder.setSampleRate(sampleAudioRateInHz);
  
      // Set in the surface changed method
  
      recorder.setFrameRate(frameRate);
  
  
  
      Log.i(LOG_TAG, "recorder initialize success");
  
  
  
      audioRecordRunnable = new AudioRecordRunnable();
  
      audioThread = new Thread(audioRecordRunnable);
  
      runAudioThread = true;
  
  }
  
  
  
  
  
  
  
  @Override
  
      public void onPreviewFrame(byte[] data, Camera camera) {
  
          if (audioRecord == null || audioRecord.getRecordingState() != AudioRecord.RECORDSTATE_RECORDING) {
  
              startTime = System.currentTimeMillis();
  
              return;
  
          }
  
          if (RECORD_LENGTH > 0) {
  
              int i = imagesIndex++ % images.length;
  
              yuvImage = images[i];
  
              timestamps[i] = 1000 * (System.currentTimeMillis() - startTime);
  
          }
  
          /* get video data */
  
          int destWidth = 640;
  
  
  
          if (yuvIplimage != null && recording) {
  
              ByteBuffer bb = yuvIplimage.getByteBuffer(); // resets the buffer
  
              int start = 2*((imageWidth-destWidth)/4); // this must be even
  
              for (int row=0; row2; row++) {
  
                  bb.put(data, start, destWidth);
  
                  start += imageWidth;
  
              }
  
              try {
  
                  long t = 1000 * (System.currentTimeMillis() - startTime);
  
                  if (t > recorder.getTimestamp()) {
  
                      recorder.setTimestamp(t);
  
                  }
  
                  recorder.record(yuvImage);
  
              } catch (FFmpegFrameRecorder.Exception e) {
  
                  Log.e(LOG_TAG, "problem with recorder():", e);
  
              }
  
          }
  
  
  
  
  
      }

  But the videos generated with this method contained only green frames.