Recherche avancée

Sur d’autres sites (4543)

• Anomalie #3227 (Nouveau) : Bug date de publication

  11 juin 2014, par Eric Camus

  SPIP 3.0.16 standard de base (pas de plugins ajouté).

  Si on change à la main (dans le champ) la date de publication en en donnant une erroné ex : 11/06/0014 (erreur sur le 2 de 2014).
  La date une fois validé affiche l’année 14 au lieu de 2014 mais c’est presque normal, la date affiché sur la page "accueil" est 1-1-1970 !! et l’article est toujours en première position.

  Par contre le paramètre "derniere_modif" et uniquement lui dans la base "spip_meta" change à chaque hit sur le site public. Il me semble que cela dé-valide le cache de façon permanente non ?

• drawbox don't work on remote server and works on local

  5 décembre 2015, par efpies

  I’ve got a completely weird problem.

  I need to draw the text over the filled rectangle. The problem is that the command line command that work on my local machine don’t work on the server ! To be precise, only drawbox command don’t work.

  Here’s the command.

  ffmpeg -i shake.mp4 -vf "scale=300:150,setsar=1/1,drawbox=w=300: h=16: x=0: y=134: color=0x1a5757: t=1000000,drawtext=x=5: y=136: fontfile=Arial.ttf: text='fdsf': fontcolor=0xd44e4e"  -c:v h264 -preset medium -b:v 256k  -f mp4 shake_conv.mp4

  Clarification

  It seems, that my question is unclear. Ok, here’s clarification.

  I need to draw the text over the filled rectangle.

  It means, that, at first, I have a video. Then I would like to draw a bar at the [0 ; 134] with width 300px and height 16px, painted with #1A5757 color. And over that bar should be placed a text.

  The problem is that the command line command that work on my local machine don’t work on the server !

  It means that I have 2 environments : local machine (my Mac OS X 10.9.2 with ffmpeg 2.0.2 installed) and the server (Debian 7 with ffmpeg 1.0.8 installed. Quite old, dunno, but no errors were in this case ; can’t find any info about version dependency).

  The last part,

  the command line command that work on my local machine don’t work on the server

  To be precise, only drawbox command don’t work.

  means that the same command above draws the bar I need in my local environment but don’t draw it on the server side. The text is drawed correctly in both cases. One more time : the text is drawed, the bar isn’t drawed. That’s my problem. I need a bar over the video. And there aren’t any bars when I execute this command on server.

  Now, I hope, this is quite clear.

  Here’s the output.

  ffmpeg version 1.0.8 Copyright (c) 2000-2013 the FFmpeg developers
  
    built on Sep 12 2013 11:57:09 with gcc 4.7 (Debian 4.7.2-5)
  
    configuration: --prefix=/usr --extra-cflags='-g -O2 -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security ' --extra-ldflags='-Wl,-z,relro' --cc='ccache cc' --enable-shared --enable-libmp3lame --enable-gpl --enable-nonfree --enable-libvorbis --enable-pthreads --enable-libfaac --enable-libxvid --enable-postproc --enable-x11grab --enable-libgsm --enable-libtheora --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libx264 --enable-libspeex --enable-nonfree --disable-stripping --enable-libvpx --enable-libschroedinger --disable-encoder=libschroedinger --enable-version3 --enable-libopenjpeg --enable-librtmp --enable-avfilter --enable-libfreetype --enable-libvo-aacenc --disable-decoder=amrnb --enable-libvo-amrwbenc --enable-libaacplus --libdir=/usr/lib/x86_64-linux-gnu --disable-vda --enable-libbluray --enable-libcdio --enable-gnutls --enable-frei0r --enable-openssl --enable-libass --enable-libopus --enable-fontconfig --enable-libfdk-aac --enable-libdc1394 --disable-altivec --dis  libavutil      51. 73.101 / 51. 73.101
  
    libavcodec     54. 59.100 / 54. 59.100
  
    libavformat    54. 29.104 / 54. 29.104
  
    libavdevice    54.  2.101 / 54.  2.101
  
    libavfilter     3. 17.100 /  3. 17.100
  
    libswscale      2.  1.101 /  2.  1.101
  
    libswresample   0. 15.100 /  0. 15.100
  
    libpostproc    52.  0.100 / 52.  0.100
  
  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'shake.mp4':
  
    Metadata:
  
      major_brand     : isom
  
      minor_version   : 512
  
      compatible_brands: isomiso2avc1mp41
  
      creation_time   : 1970-01-01 00:00:00
  
      encoder         : Lavf52.40.0
  
    Duration: 00:00:29.24, start: 0.000000, bitrate: 2243 kb/s
  
      Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 1280x720, 2111 kb/s, 25 fps, 25 tbr, 25 tbn, 50 tbc
  
      Metadata:
  
        creation_time   : 1970-01-01 00:00:00
  
        handler_name    : VideoHandler
  
      Stream #0:1(und): Audio: aac (mp4a / 0x6134706D), 44100 Hz, stereo, s16, 127 kb/s
  
      Metadata:
  
        creation_time   : 1970-01-01 00:00:00
  
        handler_name    : SoundHandler
  
  File 'llll.mp4' already exists. Overwrite ? [y/N] y
  
  using SAR=1/1
  
  [libx264 @ 0x229e7a0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX
  
  [libx264 @ 0x229e7a0] profile High, level 1.3
  
  [libx264 @ 0x229e7a0] 264 - core 132 - H.264/MPEG-4 AVC codec - Copyleft 2003-2013 - http://www.videolan.org/x264.html - options:  cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=abr mbtree=1 bitrate=256 ratetol=1.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
  
  Output #0, mp4, to 'llll.mp4':
  
    Metadata:
  
      major_brand     : isom
  
      minor_version   : 512
  
      compatible_brands: isomiso2avc1mp41
  
      encoder         : Lavf54.29.104
  
      Stream #0:0(und): Video: h264 ([33][0][0][0] / 0x0021), yuv420p, 300x150 [SAR 1:1 DAR 2:1], q=-1--1, 256 kb/s, 25 tbn, 25 tbc
  
      Metadata:
  
        creation_time   : 1970-01-01 00:00:00
  
        handler_name    : VideoHandler
  
      Stream #0:1(und): Audio: aac ([64][0][0][0] / 0x0040), 44100 Hz, stereo, s16, 128 kb/s
  
      Metadata:
  
        creation_time   : 1970-01-01 00:00:00
  
        handler_name    : SoundHandler
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (h264 -> libx264)
  
    Stream #0:1 -> #0:1 (aac -> libfaac)
  
  Press [q] to stop, [?] for help
  
  SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  [aac @ 0x228d5c0] SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  [aac @ 0x228d5c0] SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  [aac @ 0x228d5c0] SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  [aac @ 0x228d5c0] SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  [aac @ 0x228d5c0] SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  [aac @ 0x228d5c0] SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  [aac @ 0x228d5c0] SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  [aac @ 0x228d5c0] SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  [aac @ 0x228d5c0] channel element 1.15 is not allocated
  
  Error while decoding stream #0:1: Operation not permitted
  
  [aac @ 0x228d5c0] SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  [aac @ 0x228d5c0] SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  [aac @ 0x228d5c0] SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  [aac @ 0x228d5c0] SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  [aac @ 0x228d5c0] TYPE_FIL: Input buffer exhausted before END element found
  
  Error while decoding stream #0:1: Operation not permitted
  
  Multiple frames in a packet from stream 1
  
  [aac @ 0x228d5c0] channel element 3.11 is not allocated
  
  Error while decoding stream #0:1: Operation not permitted
  
  [aac @ 0x228d5c0] SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  [aac @ 0x228d5c0] SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  [aac @ 0x228d5c0] SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  [aac @ 0x228d5c0] SSR not implemented. Update your FFmpeg version to the newest one from Git. If the problem still occurs, it means that your file has a feature which has not been implemented.
  
  [aac @ 0x228d5c0] If you want to help, upload a sample of this file to ftp://upload.ffmpeg.org/MPlayer/incoming/ and contact the ffmpeg-devel mailing list.
  
  Error while decoding stream #0:1: Operation not permitted
  
  frame=  731 fps=244 q=32766.0 Lsize=    1497kB time=00:00:29.16 bitrate= 420.6kbits/s    
  
  video:1028kB audio:447kB subtitle:0 global headers:0kB muxing overhead 1.533339%
  
  [libx264 @ 0x229e7a0] frame I:5     Avg QP:27.90  size:  6997
  
  [libx264 @ 0x229e7a0] frame P:578   Avg QP:28.74  size:  1732
  
  [libx264 @ 0x229e7a0] frame B:148   Avg QP:25.26  size:   107
  
  [libx264 @ 0x229e7a0] consecutive B-frames: 59.5% 40.5%  0.0%  0.0%
  
  [libx264 @ 0x229e7a0] mb I  I16..4: 25.6%  9.1% 65.4%
  
  [libx264 @ 0x229e7a0] mb P  I16..4:  2.1%  1.1%  3.8%  P16..4: 12.3% 15.3% 15.6%  0.0%  0.0%    skip:49.7%
  
  [libx264 @ 0x229e7a0] mb B  I16..4:  0.8%  0.0%  0.0%  B16..8: 17.6%  3.3%  0.9%  direct: 0.5%  skip:76.9%  L0:39.7% L1:57.5% BI: 2.8%
  
  [libx264 @ 0x229e7a0] final ratefactor: 26.03
  
  [libx264 @ 0x229e7a0] 8x8 transform intra:14.3% inter:23.4%
  
  [libx264 @ 0x229e7a0] coded y,uvDC,uvAC intra: 54.1% 68.9% 58.9% inter: 17.7% 19.5% 10.0%
  
  [libx264 @ 0x229e7a0] i16 v,h,dc,p: 58% 33%  5%  4%
  
  [libx264 @ 0x229e7a0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 21% 12% 22%  6%  6%  8%  7%  9% 10%
  
  [libx264 @ 0x229e7a0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 25% 19% 20%  5%  5%  7%  8%  6%  6%
  
  [libx264 @ 0x229e7a0] i8c dc,h,v,p: 50% 25% 19%  6%
  
  [libx264 @ 0x229e7a0] Weighted P-Frames: Y:2.6% UV:1.7%
  
  [libx264 @ 0x229e7a0] ref P L0: 70.2% 11.0% 10.1%  8.5%  0.1%
  
  [libx264 @ 0x229e7a0] ref B L0: 94.3%  5.7%
  
  [libx264 @ 0x229e7a0] kb/s:287.75

• H.264 muxed to MP4 using libavformat not playing back

  14 mai 2015, par Brad Mitchell

  I am trying to mux H.264 data into a MP4 file. There appear to be no errors in saving this H.264 Annex B data out to an MP4 file, but the file fails to playback.

  I’ve done a binary comparison on the files and the issue seems to be somewhere in what is being written to the footer (trailer) of the MP4 file.

  I suspect it has to be something with the way the stream is being created or something.

  Init :

  AVOutputFormat* fmt = av_guess_format( 0, "out.mp4", 0 );
  
  oc = avformat_alloc_context();
  
  oc->oformat = fmt;
  
  strcpy(oc->filename, filename);

  Part of this prototype app I have is creating a png file for each IFrame. So when the first IFrame is encountered, I create the video stream and write the av header etc :

  void addVideoStream(AVCodecContext* decoder)
  
  {
  
      videoStream = av_new_stream(oc, 0);
  
      if (!videoStream)
  
      {
  
           cout << "ERROR creating video stream" << endl;
  
           return;        
  
      }
  
      vi = videoStream->index;    
  
      videoContext = videoStream->codec;      
  
      videoContext->codec_type = AVMEDIA_TYPE_VIDEO;
  
      videoContext->codec_id = decoder->codec_id;
  
      videoContext->bit_rate = 512000;
  
      videoContext->width = decoder->width;
  
      videoContext->height = decoder->height;
  
      videoContext->time_base.den = 25;
  
      videoContext->time_base.num = 1;    
  
      videoContext->gop_size = decoder->gop_size;
  
      videoContext->pix_fmt = decoder->pix_fmt;       
  
  
  
      if (oc->oformat->flags & AVFMT_GLOBALHEADER)
  
          videoContext->flags |= CODEC_FLAG_GLOBAL_HEADER;
  
  
  
      av_dump_format(oc, 0, filename, 1);
  
  
  
      if (!(oc->oformat->flags & AVFMT_NOFILE))
  
      {
  
          if (avio_open(&oc->pb, filename, AVIO_FLAG_WRITE) < 0) {
  
          cout << "Error opening file" << endl;
  
      }
  
      avformat_write_header(oc, NULL);
  
  }

  I write packets out :

  unsigned char* data = block->getData();
  
  unsigned char videoFrameType = data[4];
  
  int dataLen = block->getDataLen();
  
  
  
  // store pps
  
  if (videoFrameType == 0x68)
  
  {
  
      if (ppsFrame != NULL)
  
      {
  
          delete ppsFrame; ppsFrameLength = 0; ppsFrame = NULL;
  
      }
  
      ppsFrameLength = block->getDataLen();
  
      ppsFrame = new unsigned char[ppsFrameLength];
  
      memcpy(ppsFrame, block->getData(), ppsFrameLength);
  
  }
  
  else if (videoFrameType == 0x67)
  
  {
  
      // sps
  
      if (spsFrame != NULL)
  
      {
  
          delete spsFrame; spsFrameLength = 0; spsFrame = NULL;
  
  }
  
      spsFrameLength = block->getDataLen();
  
      spsFrame = new unsigned char[spsFrameLength];
  
      memcpy(spsFrame, block->getData(), spsFrameLength);                 
  
  }                                           
  
  
  
  if (videoFrameType == 0x65 || videoFrameType == 0x41)
  
  {
  
      videoFrameNumber++;
  
  }
  
  if (videoFrameType == 0x65)
  
  {
  
      decodeIFrame(videoFrameNumber, spsFrame, spsFrameLength, ppsFrame, ppsFrameLength, data, dataLen);
  
  }
  
  
  
  if (videoStream != NULL)
  
  {
  
      AVPacket pkt = { 0 };
  
      av_init_packet(&pkt);
  
      pkt.stream_index = vi;
  
      pkt.flags = 0;                      
  
      pkt.pts = pkt.dts = 0;                                  
  
  
  
      if (videoFrameType == 0x65)
  
      {
  
          // combine the SPS PPS & I frames together
  
          pkt.flags |= AV_PKT_FLAG_KEY;                                                   
  
          unsigned char* videoFrame = new unsigned char[spsFrameLength+ppsFrameLength+dataLen];
  
          memcpy(videoFrame, spsFrame, spsFrameLength);
  
          memcpy(&videoFrame[spsFrameLength], ppsFrame, ppsFrameLength);
  
          memcpy(&videoFrame[spsFrameLength+ppsFrameLength], data, dataLen);
  
  
  
          // overwrite the start code (00 00 00 01 with a 32-bit length)
  
          setLength(videoFrame, spsFrameLength-4);
  
          setLength(&videoFrame[spsFrameLength], ppsFrameLength-4);
  
          setLength(&videoFrame[spsFrameLength+ppsFrameLength], dataLen-4);
  
          pkt.size = dataLen + spsFrameLength + ppsFrameLength;
  
          pkt.data = videoFrame;
  
          av_interleaved_write_frame(oc, &pkt);
  
          delete videoFrame; videoFrame = NULL;
  
      }
  
      else if (videoFrameType != 0x67 && videoFrameType != 0x68)
  
      {   
  
          // Send other frames except pps & sps which are caught and stored                   
  
          pkt.size = dataLen;
  
          pkt.data = data;
  
          setLength(data, dataLen-4);                     
  
          av_interleaved_write_frame(oc, &pkt);
  
      }

  Finally to close the file off :

  av_write_trailer(oc);
  
  int i = 0;
  
  for (i = 0; i < oc->nb_streams; i++)
  
  {
  
      av_freep(&oc->streams[i]->codec);
  
      av_freep(&oc->streams[i]);      
  
  }
  
  
  
  if (!(oc->oformat->flags & AVFMT_NOFILE))
  
  {
  
      avio_close(oc->pb);
  
  }
  
  av_free(oc);

  If I take the H.264 data alone and convert it :

  ffmpeg -i recording.h264 -vcodec copy recording.mp4

  All but the "footer" of the files are the same.

  Output from my program :
  readrec recording.tcp out.mp4
  ** START * 01-03-2013 14:26:01 180000
  Output #0, mp4, to ’out.mp4’ :
  Stream #0:0 : Video : h264, yuv420p, 352x288, q=2-31, 512 kb/s, 90k tbn, 25 tbc
  * END ** 01-03-2013 14:27:01 102000
  Wrote 1499 video frames.

  If I try to convert using ffmpeg the MP4 file created using CODE :

  ffmpeg -i out.mp4 -vcodec copy out2.mp4
  
  ffmpeg version 0.11.1 Copyright (c) 2000-2012 the FFmpeg developers
  
        built on Mar  7 2013 12:49:22 with suncc 0x5110
  
        configuration: --extra-cflags=-KPIC -g --disable-mmx
  
        --disable-protocol=udp --disable-encoder=nellymoser --cc=cc --cxx=CC
  
  libavutil      51. 54.100 / 51. 54.100
  
  libavcodec     54. 23.100 / 54. 23.100
  
  libavformat    54.  6.100 / 54.  6.100
  
  libavdevice    54.  0.100 / 54.  0.100
  
  libavfilter     2. 77.100 /  2. 77.100
  
  libswscale      2.  1.100 /  2.  1.100
  
  libswresample   0. 15.100 /  0. 15.100
  
  h264 @ 12eaac0] no frame!
  
      Last message repeated 1 times
  
  [h264 @ 12eaac0] slice type too large (0) at 0 0
  
  [h264 @ 12eaac0] decode_slice_header error
  
  [h264 @ 12eaac0] no frame!
  
      Last message repeated 23 times
  
  [h264 @ 12eaac0] slice type too large (0) at 0 0
  
  [h264 @ 12eaac0] decode_slice_header error
  
  [h264 @ 12eaac0] no frame!
  
      Last message repeated 74 times
  
  [h264 @ 12eaac0] slice type too large (0) at 0 0
  
  [h264 @ 12eaac0] decode_slice_header error
  
  [h264 @ 12eaac0] no frame!
  
      Last message repeated 64 times
  
  [h264 @ 12eaac0] slice type too large (0) at 0 0
  
  [h264 @ 12eaac0] decode_slice_header error
  
  [h264 @ 12eaac0] no frame!
  
      Last message repeated 34 times
  
  [h264 @ 12eaac0] slice type too large (0) at 0 0
  
  [h264 @ 12eaac0] decode_slice_header error
  
  [h264 @ 12eaac0] no frame!
  
      Last message repeated 49 times
  
  [h264 @ 12eaac0] slice type too large (0) at 0 0
  
  [h264 @ 12eaac0] decode_slice_header error
  
  [h264 @ 12eaac0] no frame!
  
      Last message repeated 24 times
  
  [h264 @ 12eaac0] Partitioned H.264 support is incomplete
  
  [h264 @ 12eaac0] no frame!
  
      Last message repeated 23 times
  
  [h264 @ 12eaac0] sps_id out of range
  
  [h264 @ 12eaac0] no frame!
  
      Last message repeated 148 times
  
  [h264 @ 12eaac0] sps_id (32) out of range
  
      Last message repeated 1 times
  
  [h264 @ 12eaac0] no frame!
  
      Last message repeated 33 times
  
  [h264 @ 12eaac0] slice type too large (0) at 0 0
  
  [h264 @ 12eaac0] decode_slice_header error
  
  [h264 @ 12eaac0] no frame!
  
      Last message repeated 128 times
  
  [h264 @ 12eaac0] sps_id (32) out of range
  
      Last message repeated 1 times
  
  [h264 @ 12eaac0] no frame!
  
      Last message repeated 3 times
  
  [h264 @ 12eaac0] slice type too large (0) at 0 0
  
  [h264 @ 12eaac0] decode_slice_header error
  
  [h264 @ 12eaac0] no frame!
  
      Last message repeated 3 times
  
  [h264 @ 12eaac0] slice type too large (0) at 0 0
  
  [h264 @ 12eaac0] decode_slice_header error
  
  [h264 @ 12eaac0] no frame!
  
      Last message repeated 309 times
  
  [h264 @ 12eaac0] sps_id (32) out of range
  
      Last message repeated 1 times
  
  [h264 @ 12eaac0] no frame!
  
      Last message repeated 192 times
  
  [h264 @ 12eaac0] Partitioned H.264 support is incomplete
  
  [h264 @ 12eaac0] no frame!
  
      Last message repeated 73 times
  
  [h264 @ 12eaac0] sps_id (32) out of range
  
      Last message repeated 1 times
  
  [h264 @ 12eaac0] no frame!
  
      Last message repeated 99 times
  
  [h264 @ 12eaac0] sps_id (32) out of range
  
      Last message repeated 1 times
  
  [h264 @ 12eaac0] no frame!
  
      Last message repeated 197 times
  
  [mov,mp4,m4a,3gp,3g2,mj2 @ 12e3100] decoding for stream 0 failed
  
  [mov,mp4,m4a,3gp,3g2,mj2 @ 12e3100] Could not find codec parameters
  
  (Video: h264 (avc1 / 0x31637661), 393539 kb/s)
  
  out.mp4: could not find codec parameters

  I really do not know where the issue is, except it has to be something to do with the way the streams are being set up. I’ve looked at bits of code from where other people are doing a similar thing, and tried to use this advice in setting up the streams, but to no avail !

  ---

  The final code which gave me a H.264/AAC muxed (synced) file is as follows. First a bit of background information. The data is coming from an IP camera. The data is presented via a 3rd party API as video/audio packets. The video packets are presented as the RTP payload data (no header) and consist of NALU’s that are reconstructed and converted to H.264 video in Annex B format. AAC audio is presented as raw AAC and is converted to adts format to enable playback. These packets have been put into a bitstream format that allows the transmission of the timestamp (64 bit milliseconds since Jan 1 1970) along with a few other things.

  This is more or less a prototype and is not clean in any respects. It probably leaks bad. I do however, hope this helps anyone else out trying to achieve something similar to what I am.

  Globals :

  AVFormatContext* oc = NULL;
  
  AVCodecContext* videoContext = NULL;
  
  AVStream* videoStream = NULL;
  
  AVCodecContext* audioContext = NULL;
  
  AVStream* audioStream = NULL;
  
  AVCodec* videoCodec = NULL;
  
  AVCodec* audioCodec = NULL;
  
  int vi = 0;  // Video stream
  
  int ai = 1;  // Audio stream
  
  
  
  uint64_t firstVideoTimeStamp = 0;
  
  uint64_t firstAudioTimeStamp = 0;
  
  int audioStartOffset = 0;
  
  
  
  char* filename = NULL;
  
  
  
  Boolean first = TRUE;
  
  
  
  int videoFrameNumber = 0;
  
  int audioFrameNumber = 0;

  Main :

  int main(int argc, char* argv[])
  
  {
  
      if (argc != 3)
  
      {   
  
          cout &lt;&lt; argv[0] &lt;&lt; " <stream playback="playback" file="file"> <output mp4="mp4" file="file">" &lt;&lt; endl;
  
          return 0;
  
      }
  
      char* input_stream_file = argv[1];
  
      filename = argv[2];
  
  
  
      av_register_all();    
  
  
  
      fstream inFile;
  
      inFile.open(input_stream_file, ios::in);
  
  
  
      // Used to store the latest pps &amp; sps frames
  
      unsigned char* ppsFrame = NULL;
  
      int ppsFrameLength = 0;
  
      unsigned char* spsFrame = NULL;
  
      int spsFrameLength = 0;
  
  
  
      // Setup MP4 output file
  
      AVOutputFormat* fmt = av_guess_format( 0, filename, 0 );
  
      oc = avformat_alloc_context();
  
      oc->oformat = fmt;
  
      strcpy(oc->filename, filename);
  
  
  
      // Setup the bitstream filter for AAC in adts format.  Could probably also achieve
  
      // this by stripping the first 7 bytes!
  
      AVBitStreamFilterContext* bsfc = av_bitstream_filter_init("aac_adtstoasc");
  
      if (!bsfc)
  
      {       
  
          cout &lt;&lt; "Error creating adtstoasc filter" &lt;&lt; endl;
  
          return -1;
  
      }
  
  
  
      while (inFile.good())
  
      {
  
          TcpAVDataBlock* block = new TcpAVDataBlock();
  
          block->readStruct(inFile);
  
          DateTime dt = block->getTimestampAsDateTime();
  
          switch (block->getPacketType())
  
          {
  
              case TCP_PACKET_H264:
  
              {       
  
                  if (firstVideoTimeStamp == 0)
  
                      firstVideoTimeStamp = block->getTimeStamp();
  
                  unsigned char* data = block->getData();
  
                  unsigned char videoFrameType = data[4];
  
                  int dataLen = block->getDataLen();
  
  
  
                  // pps
  
                  if (videoFrameType == 0x68)
  
                  {
  
                      if (ppsFrame != NULL)
  
                      {
  
                          delete ppsFrame; ppsFrameLength = 0;
  
                          ppsFrame = NULL;
  
                      }
  
                      ppsFrameLength = block->getDataLen();
  
                      ppsFrame = new unsigned char[ppsFrameLength];
  
                      memcpy(ppsFrame, block->getData(), ppsFrameLength);
  
                  }
  
                  else if (videoFrameType == 0x67)
  
                  {
  
                      // sps
  
                      if (spsFrame != NULL)
  
                      {
  
                          delete spsFrame; spsFrameLength = 0;
  
                          spsFrame = NULL;
  
                      }
  
                      spsFrameLength = block->getDataLen();
  
                      spsFrame = new unsigned char[spsFrameLength];
  
                      memcpy(spsFrame, block->getData(), spsFrameLength);                   
  
                  }                                           
  
  
  
                  if (videoFrameType == 0x65 || videoFrameType == 0x41)
  
                  {
  
                      videoFrameNumber++;
  
                  }
  
                  // Extract a thumbnail for each I-Frame
  
                  if (videoFrameType == 0x65)
  
                  {
  
                      decodeIFrame(h264, spsFrame, spsFrameLength, ppsFrame, ppsFrameLength, data, dataLen);
  
                  }
  
                  if (videoStream != NULL)
  
                  {
  
                      AVPacket pkt = { 0 };
  
                      av_init_packet(&amp;pkt);
  
                      pkt.stream_index = vi;
  
                      pkt.flags = 0;           
  
                      pkt.pts = videoFrameNumber;
  
                      pkt.dts = videoFrameNumber;           
  
                      if (videoFrameType == 0x65)
  
                      {
  
                          pkt.flags = 1;                           
  
  
  
                          unsigned char* videoFrame = new unsigned char[spsFrameLength+ppsFrameLength+dataLen];
  
                          memcpy(videoFrame, spsFrame, spsFrameLength);
  
                          memcpy(&amp;videoFrame[spsFrameLength], ppsFrame, ppsFrameLength);
  
  
  
                          memcpy(&amp;videoFrame[spsFrameLength+ppsFrameLength], data, dataLen);
  
                          pkt.data = videoFrame;
  
                          av_interleaved_write_frame(oc, &amp;pkt);
  
                          delete videoFrame; videoFrame = NULL;
  
                      }
  
                      else if (videoFrameType != 0x67 &amp;&amp; videoFrameType != 0x68)
  
                      {                       
  
                          pkt.size = dataLen;
  
                          pkt.data = data;
  
                          av_interleaved_write_frame(oc, &amp;pkt);
  
                      }                       
  
                  }
  
                  break;
  
              }
  
  
  
          case TCP_PACKET_AAC:
  
  
  
              if (firstAudioTimeStamp == 0)
  
              {
  
                  firstAudioTimeStamp = block->getTimeStamp();
  
                  uint64_t millseconds_difference = firstAudioTimeStamp - firstVideoTimeStamp;
  
                  audioStartOffset = millseconds_difference * 16000 / 1000;
  
                  cout &lt;&lt; "audio offset: " &lt;&lt; audioStartOffset &lt;&lt; endl;
  
              }
  
  
  
              if (audioStream != NULL)
  
              {
  
                  AVPacket pkt = { 0 };
  
                  av_init_packet(&amp;pkt);
  
                  pkt.stream_index = ai;
  
                  pkt.flags = 1;           
  
                  pkt.pts = audioFrameNumber*1024;
  
                  pkt.dts = audioFrameNumber*1024;
  
                  pkt.data = block->getData();
  
                  pkt.size = block->getDataLen();
  
                  pkt.duration = 1024;
  
  
  
                  AVPacket newpacket = pkt;                       
  
                  int rc = av_bitstream_filter_filter(bsfc, audioContext,
  
                      NULL,
  
                      &amp;newpacket.data, &amp;newpacket.size,
  
                      pkt.data, pkt.size,
  
                      pkt.flags &amp; AV_PKT_FLAG_KEY);
  
  
  
                  if (rc >= 0)
  
                  {
  
                      //cout &lt;&lt; "Write audio frame" &lt;&lt; endl;
  
                      newpacket.pts = audioFrameNumber*1024;
  
                      newpacket.dts = audioFrameNumber*1024;
  
                      audioFrameNumber++;
  
                      newpacket.duration = 1024;                   
  
  
  
                      av_interleaved_write_frame(oc, &amp;newpacket);
  
                      av_free_packet(&amp;newpacket);
  
                  }   
  
                  else
  
                  {
  
                      cout &lt;&lt; "Error filtering aac packet" &lt;&lt; endl;
  
  
  
                  }
  
              }
  
              break;
  
  
  
          case TCP_PACKET_START:
  
              break;
  
  
  
          case TCP_PACKET_END:
  
              break;
  
          }
  
          delete block;
  
      }
  
      inFile.close();
  
  
  
      av_write_trailer(oc);
  
      int i = 0;
  
      for (i = 0; i &lt; oc->nb_streams; i++)
  
      {
  
          av_freep(&amp;oc->streams[i]->codec);
  
          av_freep(&amp;oc->streams[i]);       
  
      }
  
  
  
      if (!(oc->oformat->flags &amp; AVFMT_NOFILE))
  
      {
  
          avio_close(oc->pb);
  
      }
  
  
  
      av_free(oc);
  
  
  
      delete spsFrame; spsFrame = NULL;
  
      delete ppsFrame; ppsFrame = NULL;
  
  
  
      cout &lt;&lt; "Wrote " &lt;&lt; videoFrameNumber &lt;&lt; " video frames." &lt;&lt; endl;
  
  
  
      return 0;
  
  }
  
  </output></stream>

  The stream stream/codecs are added and the header is created in a function called addVideoAndAudioStream(). This function is called from decodeIFrame() so there are a few assumptions (which aren’t necessarily good)
  1. A video packet comes first
  2. AAC is present

  The decodeIFrame was kind of a separate prototype by where I was creating a thumbnail for each I Frame. The code to generate thumbnails was from : https://gnunet.org/svn/Extractor/src/plugins/thumbnailffmpeg_extractor.c

  The decodeIFrame function passes an AVCodecContext into addVideoAudioStream :

  void addVideoAndAudioStream(AVCodecContext* decoder = NULL)
  
  {
  
      videoStream = av_new_stream(oc, 0);
  
      if (!videoStream)
  
      {
  
          cout << "ERROR creating video stream" << endl;
  
          return;       
  
      }
  
      vi = videoStream->index;   
  
      videoContext = videoStream->codec;       
  
      videoContext->codec_type = AVMEDIA_TYPE_VIDEO;
  
      videoContext->codec_id = decoder->codec_id;
  
      videoContext->bit_rate = 512000;
  
      videoContext->width = decoder->width;
  
      videoContext->height = decoder->height;
  
      videoContext->time_base.den = 25;
  
      videoContext->time_base.num = 1;
  
      videoContext->gop_size = decoder->gop_size;
  
      videoContext->pix_fmt = decoder->pix_fmt;       
  
  
  
      audioStream = av_new_stream(oc, 1);
  
      if (!audioStream)
  
      {
  
          cout << "ERROR creating audio stream" << endl;
  
          return;
  
      }
  
      ai = audioStream->index;
  
      audioContext = audioStream->codec;
  
      audioContext->codec_type = AVMEDIA_TYPE_AUDIO;
  
      audioContext->codec_id = CODEC_ID_AAC;
  
      audioContext->bit_rate = 64000;
  
      audioContext->sample_rate = 16000;
  
      audioContext->channels = 1;
  
  
  
      if (oc->oformat->flags & AVFMT_GLOBALHEADER)
  
      {
  
          videoContext->flags |= CODEC_FLAG_GLOBAL_HEADER;
  
          audioContext->flags |= CODEC_FLAG_GLOBAL_HEADER;
  
      }
  
  
  
      av_dump_format(oc, 0, filename, 1);
  
  
  
      if (!(oc->oformat->flags & AVFMT_NOFILE))
  
      {
  
          if (avio_open(&oc->pb, filename, AVIO_FLAG_WRITE) < 0) {
  
              cout << "Error opening file" << endl;
  
          }
  
      }
  
  
  
      avformat_write_header(oc, NULL);
  
  }

  As far as I can tell, a number of assumptions didn’t seem to matter, for example :
  1. Bit Rate. The actual video bit rate was 262k whereas I specified 512kbit
  2. AAC channels. I specified mono, although the actual output was Stereo from memory

  You would still need to know what the frame rate (time base) is for the video & audio.

  Contrary to a lot of other examples, when setting pts & dts on the video packets, it was not playable. I needed to know the time base (25fps) and then set the pts & dts according to that time base, i.e. first frame = 0 (PPS, SPS, I), second frame = 1 (intermediate frame, whatever its called ;)).

  AAC I also had to make the assumption that it was 16000 hz. 1024 samples per AAC packet (You can also have AAC @ 960 samples I think) to determine the audio "offset". I added this to the pts & dts. So the pts/dts are the sample number that it is to played back at. You also need to make sure that the duration of 1024 is set in the packet before writing also.

  —

  I have found additionally today that Annex B isn’t really compatible with any other player so AVCC format should really be used.

  These URLS helped :
  Problem to Decode H264 video over RTP with ffmpeg (libavcodec)
  http://aviadr1.blogspot.com.au/2010/05/h264-extradata-partially-explained-for.html

  When constructing the video stream, I filled out the extradata & extradata_size :

  // Extradata contains PPS & SPS for AVCC format
  
  int extradata_len = 8 + spsFrameLen-4 + 1 + 2 + ppsFrameLen-4;
  
  videoContext->extradata = (uint8_t*)av_mallocz(extradata_len);
  
  videoContext->extradata_size = extradata_len;
  
  videoContext->extradata[0] = 0x01;
  
  videoContext->extradata[1] = spsFrame[4+1];
  
  videoContext->extradata[2] = spsFrame[4+2];
  
  videoContext->extradata[3] = spsFrame[4+3];
  
  videoContext->extradata[4] = 0xFC | 3;
  
  videoContext->extradata[5] = 0xE0 | 1;
  
  int tmp = spsFrameLen - 4;
  
  videoContext->extradata[6] = (tmp >> 8) & 0x00ff;
  
  videoContext->extradata[7] = tmp & 0x00ff;
  
  int i = 0;
  
  for (i=0;iextradata[8+i] = spsFrame[4+i];
  
  videoContext->extradata[8+tmp] = 0x01;
  
  int tmp2 = ppsFrameLen-4;   
  
  videoContext->extradata[8+tmp+1] = (tmp2 >> 8) & 0x00ff;
  
  videoContext->extradata[8+tmp+2] = tmp2 & 0x00ff;
  
  for (i=0;iextradata[8+tmp+3+i] = ppsFrame[4+i];

  When writing out the frames, don’t prepend the SPS & PPS frames, just write out the I Frame & P frames. In addition, replace the Annex B start code contained in the first 4 bytes (0x00 0x00 0x00 0x01) with the size of the I/P frame.