Recherche avancée

Sur d’autres sites (10246)

• ffmpeg library performance for decoding h.264 for embedded device

  2 avril 2015, par pasifus

  I have some confuse when tried to compile and run decode h.264 on ARM and MIPS architecture.

  I have two embedded devices. I tired to run simple code that read h264 format from file and decode it to h264 in loop in maximum speed (without sleep between frames)

  I found that it too slow in there devices.
  I tested HD video (720p/25fps)

  1. MIPS32® 1004K (700MHz) it was 4 fps average.
  2. Raspberry Pi Model B (700MHz) it also was 4 fps average. (i know that raspberry have GPU to decoding/encoding)

  A also check it on my virtual machine on ubuntu i686 (1300MHz) and it was 200 fps average.

  The question : why it so different preference ? Somebody know how to increase decoding preference on MIPS32® 1004K architecture ?

  #include 
  
  #include 
  
  #include 
  
  #include 
  
  
  
  #include <sys></sys>time.h>
  
  #include 
  
  
  
  #include "libavcodec/avcodec.h"
  
  #include "libavutil/mathematics.h"
  
  
  
  #define INBUF_SIZE 80000
  
  
  
  
  
  static long get_time_diff(struct timeval time_now) {
  
     struct timeval time_now2;
  
     gettimeofday(&amp;time_now2,0);
  
     return time_now2.tv_sec*1.e6 - time_now.tv_sec*1.e6 + time_now2.tv_usec - time_now.tv_usec;
  
  }
  
  
  
  int main(int argc, char **argv)
  
  {
  
      AVCodec *codec;
  
      AVCodecContext *c= NULL;
  
      AVCodecParserContext *parser = NULL;
  
      int frame, got_picture, len2, len;
  
      const char *filename;
  
      FILE *f;
  
      AVFrame *picture;
  
      char *arghwtf = malloc(INBUF_SIZE);
  
      uint64_t in_len;
  
      int pts, dts;
  
      struct timeval t,t2;
  
      float inv_fps = 1e6/23.98;
  
      AVPacket avpkt;
  
  
  
      // register all the codecs
  
      avcodec_register_all();
  
  
  
      // log level
  
      av_log_set_level(AV_LOG_PANIC|AV_LOG_FATAL|AV_LOG_ERROR|AV_LOG_WARNING);
  
  
  
      filename = argv[1];
  
  
  
      av_init_packet(&amp;avpkt);
  
  
  
      printf("Decoding file %s...\n", filename);
  
  
  
      // find the H.264 video decoder
  
      codec = avcodec_find_decoder(CODEC_ID_H264);
  
      if (!codec)
  
      {
  
          fprintf(stderr, "codec not found\n");
  
          exit(1);
  
      }
  
  
  
      c = avcodec_alloc_context3(codec);
  
      picture = avcodec_alloc_frame();
  
  
  
      // skiploopfilter=all
  
      c->skip_loop_filter = 48;
  
  
  
      AVDictionary* dictionary = NULL;
  
      if (avcodec_open2(c, codec, &amp;dictionary) &lt; 0)
  
      {
  
          fprintf(stderr, "could not open codec\n");
  
          exit(1);
  
      }
  
  
  
      // the codec gives us the frame size, in samples
  
      parser = av_parser_init(c->codec_id);
  
      parser->flags |= PARSER_FLAG_ONCE;
  
  
  
      f = fopen(filename, "rb");
  
      if (!f)
  
      {
  
          fprintf(stderr, "could not open %s\n", filename);
  
          exit(1);
  
      }
  
  
  
      frame = 0;
  
      gettimeofday(&amp;t, 0);
  
      if(fread(arghwtf, 1, INBUF_SIZE, f) == 0)
  
      {
  
          exit(1);
  
      }
  
  
  
      in_len = 80000;
  
      gettimeofday(&amp;t2, 0);
  
      while (in_len > 0 &amp;&amp; !feof(f))
  
      {
  
          len = av_parser_parse2(parser, c, &amp;avpkt.data, &amp;avpkt.size, arghwtf, in_len, pts, dts, AV_NOPTS_VALUE);
  
  
  
          len2 = avcodec_decode_video2(c, picture, &amp;got_picture, &amp;avpkt);
  
          if (len2 &lt; 0) {
  
              fprintf(stderr, "Error while decoding frame %d\n", frame);
  
              exit(1);
  
          }
  
  
  
          if (got_picture)
  
          {
  
              fprintf(stderr, "\rDisplaying %c %dx%d :frame %3d (%02d:%03d)...", av_get_picture_type_char(picture->pict_type), c->width, c->height, frame, (int)(get_time_diff(t)/1000000), (int)((get_time_diff(t)/1000)%1000));
  
              fflush(stderr);
  
  
  
              frame++;
  
          }
  
  
  
          memcpy(arghwtf, arghwtf + len, 80000-len);
  
          fread(arghwtf + 80000 - len, 1, len, f);
  
      }
  
  
  
      fclose(f);
  
      avcodec_close(c);
  
      av_free(c);
  
      av_free(picture);
  
      printf("\n");
  
      printf("Avarage fps: %d\n", (int)(((double)frame)/(double)(get_time_diff(t)/1000)*1000));
  
  
  
      return 0;
  
  }

• Merge commit ’e0046bc9c96150fa06146ace9093f06857dd7b23’

  23 mars 2015, par Michael Niedermayer

  Merge commit ’e0046bc9c96150fa06146ace9093f06857dd7b23’
  * commit ’e0046bc9c96150fa06146ace9093f06857dd7b23’ :
  
    movenc : Write the make and model metadata keys for mov style files
  Conflicts :
  
  	libavformat/movenc.c
  Merged-by : Michael Niedermayer <michaelni@gmx.at>
  

  • [DH] libavformat/movenc.c

• How to join webcam FLVs

  18 mars 2015, par Marc-André Lafortune

  I want my website to join some webcam recordings in FLV files (like this one). This needs to be done on Linux without user input. How do I do this ? For simplicity’s sake, I’ll use the same flv as both inputs in hope of getting a flv that plays the same thing twice in a row.

  That should be easy enough, right ? There’s even a full code example in the ffmpeg FAQ.

  Well, pipes seem to be giving me problems (both on my mac running Leopard and on Ubuntu 8.04) so let’s keep it simple and use normal files. Also, if I don’t specify a rate of 15 fps, the visual part plays extremely fast. The example script thus becomes :

  ffmpeg -i input.flv -vn -f u16le -acodec pcm_s16le -ac 2 -ar 44100 \
  
    - > temp.a < /dev/null
  
  ffmpeg -i input.flv -an -f yuv4mpegpipe - > temp.v < /dev/null
  
  cat temp.v temp.v > all.v
  
  cat temp.a temp.a > all.a
  
  ffmpeg -f u16le -acodec pcm_s16le -ac 2 -ar 44100 -i all.a \
  
    -f yuv4mpegpipe -i all.v -sameq -y output.flv

  Well, using this will work for the audio, but I only get the video the first time around. This seems to be the case for any flv I throw as input.flv, including the movie teasers that come with red5.

  a) Why doesn’t the example script work as advertised, in particular why do I not get all the video I’m expecting ?

  b) Why do I have to specify a framerate while Wimpy player can play the flv at the right speed ?

  The only way I found to join two flvs was to use mencoder. Problem is, mencoder doesn’t seem to join flvs :

  mencoder input.flv input.flv -o output.flv -of lavf -oac copy \
  
  -ovc lavc -lavcopts vcodec=flv

  I get a Floating point exception...

  MEncoder 1.0rc2-4.0.1 (C) 2000-2007 MPlayer Team
  
  CPU: Intel(R) Xeon(R) CPU 5150 @ 2.66GHz (Family: 6, Model: 15, Stepping: 6)
  
  CPUflags: Type: 6 MMX: 1 MMX2: 1 3DNow: 0 3DNow2: 0 SSE: 1 SSE2: 1
  
  Compiled for x86 CPU with extensions: MMX MMX2 SSE SSE2
  
  
  
  success: format: 0 data: 0x0 - 0x45b2f
  
  libavformat file format detected.
  
  [flv @ 0x697160]Unsupported audio codec (6)
  
  [flv @ 0x697160]Could not find codec parameters (Audio: 0x0006, 22050 Hz, mono)
  
  [lavf] Video stream found, -vid 0
  
  [lavf] Audio stream found, -aid 1
  
  VIDEO: [FLV1] 240x180 0bpp 1000.000 fps 0.0 kbps ( 0.0 kbyte/s)
  
  [V] filefmt:44 fourcc:0x31564C46 size:240x180 fps:1000.00 ftime:=0.0010
  
  ** MUXER_LAVF *****************************************************************
  
  REMEMBER: MEncoder's libavformat muxing is presently broken and can generate
  
  INCORRECT files in the presence of B frames. Moreover, due to bugs MPlayer
  
  will play these INCORRECT files as if nothing were wrong!
  
  *******************************************************************************
  
  OK, exit
  
  Opening video filter: [expand osd=1]
  
  Expand: -1 x -1, -1 ; -1, osd: 1, aspect: 0.000000, round: 1
  
  ==========================================================================
  
  Opening video decoder: [ffmpeg] FFmpeg's libavcodec codec family
  
  Selected video codec: [ffflv] vfm: ffmpeg (FFmpeg Flash video)
  
  ==========================================================================
  
  audiocodec: framecopy (format=6 chans=1 rate=22050 bits=16 B/s=0 sample-0)
  
  VDec: vo config request - 240 x 180 (preferred colorspace: Planar YV12)
  
  VDec: using Planar YV12 as output csp (no 0)
  
  Movie-Aspect is undefined - no prescaling applied.
  
  videocodec: libavcodec (240x180 fourcc=31564c46 [FLV1])
  
  VIDEO CODEC ID: 22
  
  AUDIO CODEC ID: 10007, TAG: 0
  
  Writing header...
  
  [NULL @ 0x67d110]codec not compatible with flv
  
  Floating point exception

  c) Is there a way for mencoder to decode and encode flvs correctly ?

  So the only way I’ve found so far to join flvs, is to use ffmpeg to go back and forth between flv and avi, and use mencoder to join the avis :

  ffmpeg -i input.flv -vcodec rawvideo -acodec pcm_s16le -r 15 file.avi
  
  mencoder -o output.avi -oac copy -ovc copy -noskip file.avi file.avi
  
  ffmpeg -i output.avi output.flv

  d) There must be a better way to achieve this... Which one ?

  e) Because of the problem of the framerate, though, only flvs with constant framerate (like the one I recorded through facebook) will be converted correctly to avis, but this won’t work for the flvs I seem to be recording (like this one or this one). Is there a way to do this for these flvs too ?

  Any help would be very appreciated.