Recherche avancée

Sur d’autres sites (6253)

• RGB to x264 : Strange color render

  16 janvier 2014, par Maypeur

  i’m trying to make a video from an OpenGl context.

  I’m Using glReadPixel, to be sure RGB buffer data is Ok i save it into a bmp file, wich i can read correctly.

  My .h264 video is encoded but there are some artefact and i don’t understand why.
  I tried a lot of different parameters for the x264_param_t but anything better !

  Bitmap saved (OpenGL real data) : Bitmap from OpenGl (1mo)

  Raw h264 with error : Raw h264 video (1mo)

  OpenGl ReadPixel :

  int nSize = ClientHeight * ClientWidth * 3;
  
  GLubyte *inBuff = new GLubyte[nSize];
  
  glReadBuffer(GL_FRONT);
  
  glReadPixels(0, 0, ldwidth, ldheight, GL_BGR, GL_UNSIGNED_BYTE, inBuff);

  The params define :

  x264_param_default(&mX264_param_t);
  
  x264_param_default_preset(&mX264_param_t, "placebo", "film");
  
  
  
  mX264_param_t.i_csp = X264_CSP_BGR;
  
  mX264_param_t.i_threads = 6;
  
  mX264_param_t.i_width = mWidth;
  
  mX264_param_t.i_height = mHeight;
  
  
  
  mX264_param_t.i_fps_num = mFps;
  
  mX264_param_t.i_fps_den = 1;
  
  
  
  // Intra refres:
  
  mX264_param_t.i_keyint_max = mFps;
  
  mX264_param_t.b_intra_refresh = 1;
  
  
  
  //Rate control:
  
  mX264_param_t.rc.i_rc_method = X264_RC_CRF;
  
  mX264_param_t.rc.f_rf_constant = 25;
  
  mX264_param_t.rc.f_rf_constant_max = 35;
  
  
  
  int bps = 5000;
  
  mX264_param_t.rc.i_bitrate = bps;
  
  mX264_param_t.rc.i_vbv_max_bitrate = bps;
  
  mX264_param_t.i_bframe = 2;
  
  mX264_param_t.i_keyint_min = mFps / 4;
  
  //For streaming:
  
  mX264_param_t.b_repeat_headers = 1;
  
  mX264_param_t.b_annexb = 1;
  
  mX264_param_t.i_log_level = X264_LOG_DEBUG;
  
  x264_param_apply_profile(&mX264_param_t, "baseline");
  
  
  
  mpEncoder = x264_encoder_open(&mX264_param_t);
  
  x264_encoder_parameters(mpEncoder, &mX264_param_t);
  
  
  
  
  
  
  
  mpPictureOut = new x264_picture_t();
  
  mpPictureIn = new x264_picture_t();
  
  
  
  x264_picture_alloc(mpPictureIn, X264_CSP_BGR | X264_CSP_VFLIP, mWidth, mHeight);

  Then the encoding loop :

  mpPictureIn->img.i_csp = X264_CSP_BGR;
  
  
  
  mpPictureIn->img.i_plane = 1;
  
  mpPictureIn->img.i_stride[0] = 3 * mWidth;
  
  mpPictureIn->img.plane[0] = rgbframe;
  
  
  
  mpPictureIn->i_pts = mFrameCount;
  
  mpPictureIn->i_type = X264_TYPE_AUTO;
  
  
  
  mpPictureOut->i_pts = mFrameCount;
  
  
  
  int i_nals;
  
  x264_nal_t* nals;
  
  int frame_size = x264_encoder_encode(mpEncoder, &nals, &i_nals, mpPictureIn, mpPictureOut);
  
  
  
  if(frame_size > 0)
  
  {
  
  mpFileOut->write_frame(nals[0].p_payload, frame_size, mpPictureOut);
  
  mFrameCount++;
  
  }

  The write frame :

  int TVideoFileWriter::write_frame(uint8_t *p_nalu, int i_size, x264_picture_t *p_picture)
  
  {
  
  if(fwrite(p_nalu, i_size, 1, mFileHandle))
  
      return i_size;
  
  return -1;
  
  }

• In FFmpeg, using -filter_complex, how can I overlay and blend at the same time ?

  5 mars 2014, par Kristian Boruff

  My code works to combine three videos, resize the videos to 1920X1080, resize the watermark to the correct size, and then overlays the watermark to the lower left hand side. Then converts to the intended codecs for Youtube.
  My question is how do I Blend at the same time using the -filter_complex workflow ?
  Currently, I have the following workflow that does everything but set the opacity

  ffmpeg -y -i fancy movie.mov -i logo.png -i in.mov -i out.mov -c:v libx264 -crf 18 -b:v 50000k -preset veryfast -tune film -profile:v high -x264opts cabac=1:keyint=16:bframes=2:keyint_min=15 -c:a libvo_aacenc -ab 128K -ar 48000 -filter_complex "[0:0] scale=1920X1080 [main]; [2:0] scale=1920X1080 [start]; [3:0] scale=1920X1080 [end]; [start] [2:1] [main] [0:1] [end] [3:1] concat=n=3:v=1:a=1 [prog]; [1:0] scale=480:90 [wm]; [prog] [wm] overlay=36:main_h-overlay_h-45" fart.mp4

  I'm trying to add "blend=all_opacity=0.7" in the last step so the watermark will screen against the background. If I just add

  [prog] [wm] overlay=36:main_h-overlay_h-45, blend=all_mode='overlay':all_opacity=0.7" fart.mp4

  I get the error, Cannot find a matching stream for unlabeled input pad 1 on filter Parsed_blend_6

  If I try a semicolon instead,

  [prog] [wm] overlay=36:main_h-overlay_h-45; blend=all_mode='overlay':all_opacity=0.7

  I get the error, Cannot find a matching stream for unlabeled input pad 0 on filter Parsed_blend_6 which makes me think that it's expecting something like [input 1] [input 2] blend command [output]. The problem is that I need it to overlay and blend.

  I tried simplifying the code to just test if the blend operation was working properly.

  ffmpeg -i test.mp4 -i logo.png -filter_complex "[0:0] scale=1920x1080 [wm]; [1:0] scale=1920x1080 [prog], [wm][prog] blend=all_mode='overlay':all_opacity=0.7" fart.mp4

  I got the error First input link top parameters (size 1920x1080, SAR 1:1) do not match the corresponding second input link bottom parameters (1920x1080, SAR 243:80)
  Failed to configure output pad on Parsed_blend_2

  So, in addition to the trouble with combining of filters, I'm also having an issue with resizing the watermark as FFMpeg sees it as a different aspect ratio than the other videos.

  This is my second day with FFmpeg, so any help would be appreciated.

  I'm currently working with FFMpeg version N-61061-gf34cceb

• feed raw yuv frame to ffmpeg with timestamp

  30 août 2014, par hawk_with_wind

  I’ve trying pipe audio and video raw data to ffmpeg and push realtime stream through RTSP protocol on android.
  the command-line is look like this

  "ffmpeg -re -f image2pipe -vcodec mjpeg -i "+vpipepath
  
  + " -f s16le -acodec pcm_s16le -ar 8000 -ac 1 -i - "
  
  + " -vcodec libx264 "
  
  + " -preset slow -pix_fmt yuv420p -crf 30 -s 160x120 -r 6 -tune film "
  
  + " -g 6 -keyint_min 6 -bf 16 -b_strategy 1 "
  
  + " -acodec libopus -ac 1 -ar 48000 -b:a 80k -vbr on -frame_duration 20 "
  
  + " -compression_level 10 -application voip -packet_loss 20 "
  
  + " -f rtsp rtsp://remote-rtsp-server/live.sdp";

  I’m using libx264 for video codec and libopus for audio codec.
  the yuv frames are feed through a named pipe created by mkfifo, the pcm frames are feed through stdin.

  It works, and I can fetch and play the stream by ffplay. But there is serverely audio/video sync issue. Audio is 5 10 seconds later than video.
  I guess the problem is both yuv frame and pcm frame doesn’t have any timestamp on them. FFmpeg add timestamp when it feed with the data. but audio/video capture thread is impossible to run at the same rate.
  Is there a way to add timestamp to each raw data frame ? (something like PST/DST ?)

  the way I used was from this thread :
  Android Camera Capture using FFmpeg