Recherche avancée

Sur d’autres sites (4405)

• C++ h264 ffmpeg/libav encode/decode(lossless) issues

  1er février 2017, par MrSmith

  Insights to encode/decode video with ffmpeg h264 (lossless)

  So I got something working on the encoding part, encode an avi in 264 however VLC wont play it, however Totem will.
  Decoding the same file proves troublesome. (I want the exact same data/frame going in as going out), I get these ;

  saving frame   5
  
  Video decoding
  
  [h264 @ 0x1d19880] decode_slice_header error
  
  frame :6
  
  saving frame   6
  
  Video decoding
  
  [h264 @ 0x1d19880] error while decoding MB 15 7, bytestream -27
  
  [h264 @ 0x1d19880] concealing 194 DC, 194 AC, 194 MV errors in I frame
  
  frame :7
  
  saving frame   7
  
  Video decoding
  
  [h264 @ 0x1d19880] decode_slice_header error

  and ultimatly this

  [H264 Decoder @ 0x7f1320766040] frame :11
  
  Broken frame packetizing
  
  [h264 @ 0x1d19880] SPS changed in the middle of the frame
  
  [h264 @ 0x1d19880] decode_slice_header error
  
  [h264 @ 0x1d19880] no frame!
  
  Error while decoding frame 11

  GAME OVER.

  Now I suspect that I have to go back to 1. the encoding part, there is problary a good reason VLC wont play it !

  I encode like this.

  void encode(char *Y,char *U,char *V){
  
  av_init_packet(&pkt);
  
  pkt.data = NULL;    // packet data will be allocated by the encoder
  
  pkt.size = 0;
  
  fflush(stdout);
  
  
  
  frame->data[0] = (uint8_t*)Y;
  
  frame->data[1] = (uint8_t*)U;
  
  frame->data[2] = (uint8_t*)V;
  
  frame->pts = ++i;
  
  
  
  ret = avcodec_encode_video2(c, &pkt, frame, &got_output);
  
  if (ret < 0) {
  
      fprintf(stderr, "Error encoding frame\n");
  
      exit (EXIT_FAILURE);
  
  }
  
  if (got_output) {
  
      printf("Write frame %3d (size=%5d)\n", i, pkt.size);
  
      fwrite(pkt.data, 1, pkt.size, f);
  
      av_free_packet(&pkt);
  
  }
  
  }

  And the codec is setup like this :

  AVCodecID dasd = AV_CODEC_ID_H264;
  
  codec = avcodec_find_encoder(dasd);
  
  c = avcodec_alloc_context3(codec);
  
  c->bit_rate = 400000;
  
  c->width = 320;
  
  c->height = 240;
  
  c->time_base= (AVRational){1,25};
  
  c->gop_size = 10; 
  
  c->max_b_frames=1;
  
  c->pix_fmt = AV_PIX_FMT_YUV420P;
  
  av_opt_set(c->priv_data, "preset", "slow", 0);
  
  avcodec_open2(c, codec, NULL);

  Since I am going for lossless i am not dealing with delayed frames(is this a correct assumption ?)
  I may not actually be encoding lossless, it seems like I may have to go with something like

  AVDictionary *param;
  
  av_dict_set(&param, "qp", "0", 0);

  And then open...

  So I guess me questions is these :

  • What are the correct codec params for lossless encoding (and advice if h264 is a terrible idea in this regard).
  • Do I need to handle delayed frames when going for lossless ?
  • Why is VLC mad at me ?

  Thanks.

• Sync Audio/Video in MP4 using AutoGen FFmpeg library

  12 juillet 2016, par williamtroup

  I’m currently having problems making my audio and video streams stay synced.

  These are the AVCodecContexts I’m using :

  For Video :

  AVCodec* videoCodec = ffmpeg.avcodec_find_encoder(AVCodecID.AV_CODEC_ID_H264)
  
  AVCodecContext* videoCodecContext = ffmpeg.avcodec_alloc_context3(videoCodec);
  
  videoCodecContext->bit_rate = 400000;
  
  videoCodecContext->width = 1280;
  
  videoCodecContext->height = 720;
  
  videoCodecContext->gop_size = 12;
  
  videoCodecContext->max_b_frames = 1;
  
  videoCodecContext->pix_fmt = videoCodec->pix_fmts[0];
  
  videoCodecContext->codec_id = videoCodec->id;
  
  videoCodecContext->codec_type = videoCodec->type;
  
  videoCodecContext->time_base = new AVRational
  
  {
  
      num = 1,
  
      den = 30
  
  };

  For Audio :

  AVCodec* audioCodec = ffmpeg.avcodec_find_encoder(AVCodecID.AV_CODEC_ID_AAC)
  
  AVCodecContext* audioCodecContext = ffmpeg.avcodec_alloc_context3(audioCodec);
  
  audioCodecContext->bit_rate = 1280000;
  
  audioCodecContext->sample_rate = 48000;
  
  audioCodecContext->channels = 2;
  
  audioCodecContext->channel_layout = ffmpeg.AV_CH_LAYOUT_STEREO;
  
  audioCodecContext->frame_size = 1024;
  
  audioCodecContext->sample_fmt = audioCodec->sample_fmts[0];
  
  audioCodecContext->profile = ffmpeg.FF_PROFILE_AAC_LOW;
  
  audioCodecContext->codec_id = audioCodec->id;
  
  audioCodecContext->codec_type = audioCodec->type;

  When writing the video frames, I setup the PTS position as follows :

  outputFrame->pts = frameIndex;  // The current index of the image frame being written

  I then encode the frame using avcodec_encode_video2(). After this, I call the following to setup the time stamps :

  ffmpeg.av_packet_rescale_ts(&packet, videoCodecContext->time_base, videoStream->time_base);

  This plays perfectly.

  However, when I do the same for audio, the video plays in slow motion, plays the audio first and then carry’s on with the video afterwards with no sound.

  I cannot find an example anywhere of how to set pts/dts positions for video/audio in an MP4 file. Any examples of help would be great !

  Also, I’m writing the video frames first, after which (once they are all written) I write the audio. I’ve updated this question with the adjusted values suggested in the comments.

  I’ve uploaded a test video to show my results here : http://www.filedropper.com/test_124

• FFmpeg "movflags" > "faststart" causes invalid MP4 file to be written

  22 août 2016, par williamtroup

  I’m setting up the format layout for the video as follows :

  AVOutputFormat* outputFormat = ffmpeg.av_guess_format(null, "output.mp4", null);
  
  
  
  AVCodec* videoCodec = ffmpeg.avcodec_find_encoder(outputFormat->video_codec);
  
  
  
  AVFormatContext* formatContext = ffmpeg.avformat_alloc_context();
  
  formatContext->oformat = outputFormat;
  
  formatContext->video_codec_id = videoCodec->id;
  
  
  
  ffmpeg.avformat_new_stream(formatContext, videoCodec);

  This is how I am setting up the Codec Context :

  AVCodecContext* codecContext = ffmpeg.avcodec_alloc_context3(videoCodec);
  
  codecContext->bit_rate = 400000;
  
  codecContext->width = 1280;
  
  codecContext->height = 720;
  
  codecContext->gop_size = 12;
  
  codecContext->max_b_frames = 1;
  
  codecContext->pix_fmt = videoCodec->pix_fmts[0];
  
  codecContext->codec_id = videoCodec->id;
  
  codecContext->codec_type = videoCodec->type;
  
  codecContext->time_base = new AVRational
  
  {
  
      num = 1,
  
      den = 30
  
  };

  I’m using the following code to setup the "movflags" > "faststart" option for the header of the video :

  AVDictionary* options = null;
  
  
  
  int result = ffmpeg.av_dict_set(&options, "movflags", "faststart", 0);
  
  
  
  int writeHeaderResult = ffmpeg.avformat_write_header(formatContext, &options);

  The file is opened and the header is written as follows :

  if ((formatContext->oformat->flags & ffmpeg.AVFMT_NOFILE) == 0)
  
  {
  
      int ioOptionResult = ffmpeg.avio_open(&formatContext->pb, "output.mp4", ffmpeg.AVIO_FLAG_WRITE);
  
  }
  
  
  
  int writeHeaderResult = ffmpeg.avformat_write_header(formatContext, &options);

  After this, I write each video frame as follows :

  outputFrame->pts = frameIndex;
  
  
  
  packet.flags |= ffmpeg.AV_PKT_FLAG_KEY;
  
  packet.pts = frameIndex;
  
  packet.dts = frameIndex;
  
  
  
  int encodedFrame = 0;
  
  int encodeVideoResult = ffmpeg.avcodec_encode_video2(codecContext, &packet, outputFrame, &encodedFrame);
  
  
  
  if (encodedFrame != 0)
  
  {
  
      packet.pts = ffmpeg.av_rescale_q(packet.pts, codecContext->time_base, m_videoStream->time_base);
  
      packet.dts = ffmpeg.av_rescale_q(packet.dts, codecContext->time_base, m_videoStream->time_base);
  
      packet.stream_index = m_videoStream->index;
  
  
  
      if (codecContext->coded_frame->key_frame > 0)
  
      {
  
          packet.flags |= ffmpeg.AV_PKT_FLAG_KEY;
  
      }
  
  
  
      int writeFrameResult = ffmpeg.av_interleaved_write_frame(formatContext, &packet);
  
  }

  After that, I write the trailer :

  int writeTrailerResult = ffmpeg.av_write_trailer(formatContext);

  The file finishes writing and everything closes and frees up correctly. However, the MP4 file is unplayable (even VLC cant play it). AtomicParsley.exe won’t show any information about the file either.

  The DLLs used for the AutoGen library are :

  avcodec-56.dll
  
  avdevice-56.dll
  
  avfilter-5.dll
  
  avformat-56.dll
  
  avutil-54.dll
  
  postproc-53.dll
  
  swresample-1.dll
  
  swscale-3.dll