Recherche avancée

Sur d’autres sites (3170)

• Direct Show Video capture performance

  23 mai 2019, par Barry Andrews

  I originally started out looking for an example of how I can use FFMPEG in c++ builder to create an application to record from usb capture device and playback video because of apparrent poor performance

  I tried Mitov components, Datastead, FFMPEGVCL and winsoft camera which use directshow but their capture performance seemed poor.

  I need to capture 1920x1080 at up to 60fps into a compressed format and play this back later at both normal speed and slow speed.

  What I found was that DirectShow itself has a number of limitations which can be improved by adding things like FFMPEG, but ultimately PC hardware, in particular the HDD and processor limit capture capability.

  1920x1080 60fps is basically the upper end for DirectShow so you need to have best performing hardware in order to achieve this sort of performance @Spektre kindly gave me examples of DirectShow using the API direct which were good for comparison with the purchased components.

  Using this and comparing to the components I found that MITOV has a major issue with regards the larger video sizes and frame rates. Using this 1920x108 30fps and 60fps can be previewed but they have a massive delay between video feed and preview (5 or 6 seconds). The other components performed similar to the API direct method with only minor variations in performance. None were able to capture and record 1920x108 60fps with any sort of compression filter without large frame drops and very jerky preview.

• ffmpeg not returning duration, cant play video until complete. Stream images 2 video via PHP

  17 février 2014, par John J

  I am real struggling with ffmpeg. I am trying to convert images to video, I have an ip camera which I am recording from. The recordings are mjpegs 1 frame per image.

  I am trying to create a script in php so I can recreate a video from date to date, this requires inputting the images via image2pipe and then creating the video.

  The trouble is, ffmpeg does return the duration and start stats, so I have no way of working out when the video is done or what percentage is done. The video won't play until its finished, and its not a very good UE.

  Any ideas of how I can resolve this, the video format can be anything I am open to suggestions.

  PHP :

  //Shell command
  
  exec('cat /image/dir/*.jpg | ffmpeg -y -c:v mjpeg -f image2pipe -r 10 -i - -c:v libx264 -pix_fmt yuv420p -movflags +faststart myvids/vidname.mp4 1>vidname.txt 2>&1')
  
  
  
  //This is loaded via javascript when the video is loaded (which is failing due to stats being wrong
  
  $video_play = "<video width="\&quot;320\&quot;" height="\&quot;240\&quot;" src="\&quot;myvids/vidname.mp4\&quot;" type="\&quot;video/mp4\&quot;\" controls="\&quot;controls\&quot;" preload="\&quot;none\&quot;"></video>";

  Javascript :

  //Javascript to create the loop until video is loaded
  
  <code class="echappe-js">&lt;script&gt;<br />
  
             $(document).ready(function() {<br />
  
                  var loader = $(&quot;#clip_load&quot;).percentageLoader();<br />
  
                  $.ajaxSetup({ cache: false }); // This part addresses an IE bug. without it, IE will only load the first number and will never refresh<br />
  
                  var interval = setInterval(updateProgress,1000);<br />
  
                  function updateProgress(){ $.get( &quot;&amp;#39;.base_url().&amp;#39;video/getVideoCompile_Process?l=&amp;#39;.$vid_name.&amp;#39;-output.txt&amp;amp;t=per&quot;, function( data ) { if(data=&gt;\&amp;#39;100\&amp;#39;){ $(&quot;#clip_load&quot;).html(\&amp;#39;&amp;#39;.$video_play.&amp;#39;\&amp;#39;); clearInterval(interval); }else{loader.setProgress(data); } });                    }<br />
  
              });<br />
  
              &lt;/script&gt;
  
  

  PHP (page is called via javascript :

  //This is the script which returns the current percentage
  
  $logloc = $this->input->get('l');
  
  $content = @file_get_contents($logloc);
  
  
  
  if($content){
  
      //get duration of source
  
      preg_match("/Duration: (.*?), start:/", $content, $matches);
  
  
  
      $rawDuration = $matches[1];
  
  
  
      //rawDuration is in 00:00:00.00 format. This converts it to seconds.
  
      $ar = array_reverse(explode(":", $rawDuration));
  
      $duration = floatval($ar[0]);
  
      if (!empty($ar[1])) $duration += intval($ar[1]) * 60;
  
      if (!empty($ar[2])) $duration += intval($ar[2]) * 60 * 60;
  
  
  
      //get the time in the file that is already encoded
  
      preg_match_all("/time=(.*?) bitrate/", $content, $matches);
  
  
  
      $rawTime = array_pop($matches);
  
  
  
      //this is needed if there is more than one match
  
      if (is_array($rawTime)){$rawTime = array_pop($rawTime);}
  
  
  
      //rawTime is in 00:00:00.00 format. This converts it to seconds.
  
      $ar = array_reverse(explode(":", $rawTime));
  
      $time = floatval($ar[0]);
  
      if (!empty($ar[1])) $time += intval($ar[1]) * 60;
  
      if (!empty($ar[2])) $time += intval($ar[2]) * 60 * 60;
  
  
  
      //calculate the progress
  
      $progress = round(($time/$duration) * 100);
  
      if ($this->input->get('t')=='per'){
  
          echo $progress;
  
      }else{
  
              echo "Duration: " . $duration . "<br />";
  
              echo "Current Time: " . $time . "<br />";
  
      echo "Progress: " . $progress . "%";}
  
  }else{ echo "cannot locate";}

  Thanks

• using X264 and librtmp to send live camera frame, but the flash can't show

  9 mai 2016, par brian_wang

  I am using X264 and librtmp to send my live camera frame, all the things seems right. but my web test flash can’t show the correct video. Sometimes it seems correct, but when I re-click play button, it doesn’t show any picture on the flash.

  Here is my X264 config code

  x264_param_default_preset(&x264param, "ultrafast", "zerolatency");
  
  x264param.i_threads = 2;
  
  x264param.i_width = width;
  
  x264param.i_height = height;
  
  x264param.i_log_level = X264_LOG_DEBUG;
  
  x264param.i_fps_num = x264param.i_timebase_num= fps;
  
  x264param.i_fps_den = x264param.i_timebase_den=1;
  
  x264param.i_frame_total = 0;
  
  
  
  x264param.i_frame_reference =1;
  
  //x264param.i_frame_reference = 2;
  
  x264param.i_keyint_min = 25;
  
  x264param.i_keyint_max = fps*3;
  
  x264param.i_scenecut_threshold = 40;
  
  
  
  x264param.b_deblocking_filter = 1;
  
  x264param.b_cabac = 0;
  
  x264param.analyse.i_trellis = 0;
  
  x264param.analyse.b_chroma_me = 1;
  
  
  
  x264param.vui.i_sar_width = 0;
  
  x264param.vui.i_sar_height = 0;
  
  x264param.i_bframe_bias = 0;
  
  x264param.b_interlaced= 0;
  
  x264param.analyse.i_subpel_refine = 6; /* 0..5 -> 1..6 */
  
  x264param.analyse.i_me_method = X264_ME_DIA;//X264_ME_HEX?X264_ME_DIA
  
  x264param.analyse.i_me_range = 16;
  
  x264param.analyse.i_direct_mv_pred = X264_DIRECT_PRED_AUTO;
  
  x264param.i_deblocking_filter_alphac0 = 0;
  
  x264param.i_deblocking_filter_beta = 0;
  
  //x264param.analyse.intra = X264_ANALYSE_I4x4;
  
  x264param.analyse.intra = X264_ANALYSE_I4x4;//  | X264_ANALYSE_PSUB16x16 | X264_ANALYSE_BSUB16x16;
  
  x264param.analyse.inter = X264_ANALYSE_I4x4 | X264_ANALYSE_PSUB16x16 | X264_ANALYSE_BSUB16x16; 
  
  //edit 2014-7-28
  
  x264param.analyse.b_transform_8x8 = 1;
  
  //x264param.analyse.b_transform_8x8 = 0;
  
  x264param.analyse.b_fast_pskip = 1;
  
  x264param.i_bframe = 0;
  
  //x264param.b_intra_refresh
  
  x264param.analyse.b_weighted_bipred = 0;
  
  
  
  //// Intra refres:
  
  x264param.i_keyint_max = 250;
  
  x264param.b_intra_refresh = 0;
  
  ////Rate control:
  
  //x264param.rc.i_rc_method = X264_RC_CRF;
  
  
  
  //Rate Control
  
  x264param.rc.f_ip_factor = 1.4f;
  
  x264param.rc.f_pb_factor = 1.3f;
  
  x264param.rc.f_qcompress = 1.0;
  
  x264param.rc.i_qp_min = 20;//20;
  
  x264param.rc.i_qp_max = 32;
  
  x264param.rc.i_qp_step = 1;
  
  
  
  switch (0)
  
  {
  
  case 0: /* 1 PASS ABR */
  
      x264param.rc.i_rc_method = X264_RC_ABR;
  
      x264param.rc.i_bitrate = 300; // max = 5000
  
      x264param.rc.b_mb_tree = 0;
  
      break;
  
  case 1: /* 1 PASS CQ */
  
      x264param.rc.i_rc_method = X264_RC_CQP;
  
      x264param.rc.i_qp_constant = 26;//10 - 51
  
      break;
  
  }
  
  
  
  //For streaming:
  
  x264param.b_repeat_headers = 1;
  
  x264param.b_annexb = 1;
  
  x264_param_apply_profile(&x264param, "baseline");
  
  encoder = x264_encoder_open(&x264param);
  
  x264_picture_init( &pic_in );
  
  x264_picture_alloc(&pic_in, X264_CSP_I420, width, height);
  
  
  
  pic_in.img.i_csp = X264_CSP_I420|X264_CSP_VFLIP;
  
  pic_in.img.i_plane = 3;
  
  pic_in.i_type = X264_TYPE_AUTO;

  Sending To RTMP :

  sws_scale(convertCtx,&a,&scribe,0,height, pic_in.img.plane, pic_in.img.i_stride);
  
  int i_nal;
  
  int i_frame_size = x264_encoder_encode( encoder, &nal, &i_nal, &pic_in, &pic_out );
  
  if(i_frame_size <= 0){
  
      printf("\t!!!FAILED encode frame \n");
  
  }else{
  
      for (int i = 0,last=0; i < i_nal;i++)  
  
      {
  
          fwrite(nal[i].p_payload, 1, i_frame_size-last, fpw1);
  
          if (nal[i].i_type == NAL_SPS) {
  
              sps_len = nal[i].i_payload-4;
  
              sps  = new unsigned char[sps_len];
  
              memcpy(sps,nal[i].p_payload+4,sps_len);
  
          } else if (nal[i].i_type == NAL_PPS) {
  
              pps_len = nal[i].i_payload-4;
  
              pps  = new unsigned char[sps_len];
  
              memcpy(pps,nal[i].p_payload+4,pps_len);
  
              send_video_sps_pps(); 
  
              free(sps);
  
              free(pps);
  
          } else {
  
              send_rtmp_video(nal[i].p_payload,i_frame_size-last);
  
              break;
  
          }
  
          last += nal[i].i_payload;
  
      }
  
  }

  Send PPS and SPS

  void send_video_sps_pps(){
  
  if(rtmp!= NULL){
  
      RTMPPacket * packet;
  
      unsigned char * body;
  
      int i;
  
  
  
      packet = (RTMPPacket *)malloc(RTMP_HEAD_SIZE+1024);
  
      memset(packet,0,RTMP_HEAD_SIZE);
  
  
  
      packet->m_body = (char *)packet + RTMP_HEAD_SIZE;
  
      body = (unsigned char *)packet->m_body;
  
      i = 0;
  
      body[i++] = 0x17;
  
      body[i++] = 0x00;
  
  
  
      body[i++] = 0x00;
  
      body[i++] = 0x00;
  
      body[i++] = 0x00;
  
  
  
      /*AVCDecoderConfigurationRecord*/
  
      body[i++] = 0x01;
  
      body[i++] = sps[1];
  
      body[i++] = sps[2];
  
      body[i++] = sps[3];
  
      body[i++] = 0xff;
  
  
  
      /*sps*/
  
      body[i++]   = 0xe1;
  
      body[i++] = (sps_len >> 8) & 0xff;
  
      body[i++] = sps_len & 0xff;
  
      memcpy(&body[i],sps,sps_len);
  
      i +=  sps_len;
  
  
  
      /*pps*/
  
      body[i++]   = 0x01;
  
      body[i++] = (pps_len >> 8) & 0xff;
  
      body[i++] = (pps_len) & 0xff;
  
      memcpy(&body[i],pps,pps_len);
  
      i +=  pps_len;
  
  
  
      packet->m_packetType = RTMP_PACKET_TYPE_VIDEO;
  
      packet->m_nBodySize = i;
  
      packet->m_nChannel = 0x04;
  
      packet->m_nTimeStamp = 0;
  
      packet->m_hasAbsTimestamp = 0;
  
      packet->m_headerType = RTMP_PACKET_SIZE_MEDIUM;
  
      packet->m_nInfoField2 = rtmp->m_stream_id;
  
  
  
      RTMP_SendPacket(rtmp,packet,TRUE);
  
      free(packet);   
  
      rtmp_start_time = GetTickCount();
  
  }else{
  
      std::cout<<"RTMP is not ready"<code>

  Send video Frame

  void send_rtmp_video(unsigned char * buf,int len){
  
  RTMPPacket * packet;
  
  long timeoffset = GetTickCount() - rtmp_start_time; 
  
  
  
  int type = buf[0]&0x1f;
  
  
  
  packet = (RTMPPacket *)malloc(RTMP_HEAD_SIZE+len+9);
  
  memset(packet,0,RTMP_HEAD_SIZE);
  
  
  
  packet->m_body = (char *)packet + RTMP_HEAD_SIZE;
  
  packet->m_nBodySize = len + 9;
  
  
  
  /*send video packet*/
  
  unsigned char *body = (unsigned char *)packet->m_body;
  
  memset(body,0,len+9);
  
  
  
  /*key frame*/
  
  body[0] = 0x27;
  
  if (type == NAL_SLICE_IDR) {
  
      body[0] = 0x17;
  
  }
  
  
  
  body[1] = 0x01;   /*nal unit*/
  
  body[2] = 0x00;
  
  body[3] = 0x00;
  
  body[4] = 0x00;
  
  
  
  body[5] = (len >> 24) & 0xff;
  
  body[6] = (len >> 16) & 0xff;
  
  body[7] = (len >>  8) & 0xff;
  
  body[8] = (len ) & 0xff;
  
  
  
  /*copy data*/
  
  memcpy(&body[9],buf,len);
  
  
  
  packet->m_hasAbsTimestamp = 0;
  
  packet->m_packetType = RTMP_PACKET_TYPE_VIDEO;
  
  if(rtmp != NULL){
  
      packet->m_nInfoField2 = rtmp->m_stream_id;
  
  }
  
  packet->m_nChannel = 0x04;
  
  packet->m_headerType = RTMP_PACKET_SIZE_LARGE;
  
  packet->m_nTimeStamp = timeoffset;
  
  
  
  if(rtmp != NULL){
  
      RTMP_SendPacket(rtmp,packet,TRUE);
  
  }
  
  free(packet);

  }