Recherche avancée

Sur d’autres sites (9847)

• Xuggler decode H264 packets

  18 novembre 2015, par Roy Bean

  I’m making a test with xuggler, and I’m observing a behavior that I don’t understand.

  So I have a H264 frame, stored in a file and I want to decode it.
  Bassically I need of the IVideoPicture to then get a buffred image.

  for the same same packet I need of 10 tries until it retrieved that the IVideoPicture is complete.

  this is what ffmpeg does when reads the frame :

  Input #0, h264, from 'sample1.jpg':
  
  Duration: N/A, bitrate: N/A
  
  Stream #0:0: Video: h264 (Baseline), yuv420p, 352x288, 25 tbr, 1200k tbn, 50 tbc

  Can someone of xuggler or ffmpeg knowledge explain what is happen ?

  My code bellow :

  IContainer container = IContainer.make();
  
  
  
  RandomAccessFile aFile = new RandomAccessFile("c://sample1Frame/sample1.jpg","r");
  
  IContainerFormat format = IContainerFormat.make();
  
  format.setInputFormat("h264");
  
  container.open(aFile, IContainer.Type.READ, null);
  
  int numStreams = container.getNumStreams();
  
  
  
  
  
  IStreamCoder videoCoder = null;
  
  for(int i = 0; i < numStreams; i++)
  
  {
  
      IStream stream = container.getStream(i);
  
      // Get the pre-configured decoder that can decode this stream;
  
      IStreamCoder coder = stream.getStreamCoder();
  
      if(coder.getCodecType() == ICodec.Type.CODEC_TYPE_VIDEO)
  
      {
  
          System.out.println("coder"); 
  
      }
  
      videoCoder = coder;
  
  }
  
  
  
  // The timebase here is used as the camera frame rate    
  
  videoCoder.setTimeBase(IRational.make(25,1));
  
  
  
  // we need to tell the driver what video with and height to use
  
  videoCoder.setWidth(352);
  
  videoCoder.setHeight(288);
  
  
  
  if(videoCoder.open(null , null) < 0){
  
      System.err.println("Could not open video decoder for input container");
  
      return;
  
  }
  
  //      videoCoder.setFlag(IStreamCoder.Flags.FLAG_QSCALE,true);
  
  //      videoCoder.setFlag(IStreamCoder.Flags.FLAG2_FAST,true);
  
  
  
  IPacket packet = IPacket.make();
  
  //      long firstTimestampInStream = Global.NO_PTS;
  
  //      long systemClockStartTime = 0;
  
  int complete = 1;
  
  
  
  
  
  while(container.readNextPacket(packet) >= 0){
  
      int trys= 1;
  
      System.out.println("PCK = ");
  
      while(true)
  
      {
  
          trys++;
  
          System.out.println("trys = " + trys);
  
          System.out.println("packet " + packet.getSize());
  
          IVideoPicture picture = IVideoPicture.make(videoCoder.getPixelType(), videoCoder.getWidth(), videoCoder.getHeight());
  
  
  
  
  
          //TODO
  
          int offset = 0;
  
          while(offset < packet.getSize())
  
          {
  
              /*
  
               * Now, we decode the video, checking for any errors.
  
               * 
  
               */
  
              System.out.println("packet getTimeBase " + packet.getTimeBase());
  
              System.out.println("vc getTimeBase " + videoCoder.getTimeBase());
  
              System.out.println("vc getCodecID " + videoCoder.getCodecID().toString());
  
              int bytOffset = videoCoder.decodeVideo(picture, packet, offset);
  
              Logger.getLogger(VideoSamsung.class.getName()).log(Level.SEVERE,"bytOffset =  " + bytOffset);
  
  
  
              if(bytOffset < 0){
  
                  //                  videoCoder.close();
  
                  //                  //                  picture.setComplete(true, com.xuggle.xuggler.IPixelFormat.Type.YUV420P, 352, 288, packet.getPts());
  
                  //                  System.err.println("picture.isComplete()"+picture.isComplete());
  
                  //                                      BufferedImage sdf = Utils.videoPictureToImage(picture);
  
                  //                                      File outputfile = new File("c://sdf/image.jpg");
  
                  //                                      ImageIO.write(sdf, "jpg", outputfile);
  
                  Logger.getLogger(VideoSamsung.class.getName()).log(Level.SEVERE,"BUMMMMMM!!!!!!!!!!!!!!!!!!!");
  
                  break;
  
              }else{
  
                  //System.out.println(DatatypeConverter.printBase64Binary(videoCoder.getExtraData().getByteArray(0, videoCoder.getExtraData().getSize())));
  
              }
  
              offset += bytOffset;
  
              System.err.println("picture.isComplete()"+picture.isComplete());
  
  
  
              /*
  
               * Some decoders will consume data in a packet, but will not be able to construct
  
               * a full video picture yet.  Therefore you should always check if you
  
               * got a complete picture from the decoder
  
               */
  
  
  
          }//end while(offset < packet.getSize())
  
  
  
          if (picture.isComplete())
  
          {
  
              System.out.println("isComplete");
  
              IVideoPicture newPic = picture;
  
              BufferedImage sdf = Utils.videoPictureToImage(picture);
  
              File outputfile = new File("c://sdf/image_"+complete+".jpg");
  
              ImageIO.write(sdf, "jpg", outputfile);
  
              complete++;
  
              System.out.println("trys = " + trys);
  
              break;
  
              //              System.exit(0);
  
          }else{
  
              System.out.println("Picture is not Complete");
  
          }
  
  
  
          if(trys > 20){
  
              System.out.println("FAIL!!!!!!!!!!  trys = " + trys);
  
              break;
  
          }
  
      }
  
  }
  
  /*
  
   * Technically since we're exiting anyway, these will be cleaned up by 
  
   * the garbage collector... but because we're nice people and want
  
   * to be invited places for Christmas, we're going to show how to clean up.
  
   */
  
  if (videoCoder != null)
  
  {
  
      videoCoder.close();
  
      videoCoder = null;
  
  }
  
  if (container !=null)
  
  {
  
      container.close();
  
      container = null;
  
  }

  the console output :

      PCK = 
  
  trys = 2
  
  packet 1748
  
  packet getTimeBase 1/1200000
  
  vc getTimeBase 25/1
  
  vc getCodecID CODEC_ID_H264
  
  Nov 18, 2015 5:39:11 PM filepath main
  
  SEVERE: bytOffset =  1748
  
  Picture is not Complete
  
  trys = 3
  
  packet 1748
  
  packet getTimeBase 1/1200000
  
  vc getTimeBase 25/1
  
  vc getCodecID CODEC_ID_H264
  
  picture.isComplete()false
  
  Nov 18, 2015 5:39:11 PM filepath main
  
  SEVERE: bytOffset =  1748
  
  Picture is not Complete
  
  picture.isComplete()false
  
  trys = 4
  
  packet 1748
  
  packet getTimeBase 1/1200000
  
  vc getTimeBase 25/1
  
  vc getCodecID CODEC_ID_H264
  
  Nov 18, 2015 5:39:11 PM filepath main
  
  SEVERE: bytOffset =  1748
  
  picture.isComplete()false
  
  Picture is not Complete
  
  trys = 5
  
  packet 1748
  
  packet getTimeBase 1/1200000
  
  vc getTimeBase 25/1
  
  vc getCodecID CODEC_ID_H264
  
  Nov 18, 2015 5:39:11 PM filepath main
  
  SEVERE: bytOffset =  1748
  
  picture.isComplete()false
  
  Picture is not Complete
  
  trys = 6
  
  packet 1748
  
  packet getTimeBase 1/1200000
  
  vc getTimeBase 25/1
  
  vc getCodecID CODEC_ID_H264
  
  Nov 18, 2015 5:39:11 PM filepath main
  
  SEVERE: bytOffset =  1748
  
  picture.isComplete()false
  
  Picture is not Complete
  
  trys = 7
  
  packet 1748
  
  packet getTimeBase 1/1200000
  
  vc getTimeBase 25/1
  
  vc getCodecID CODEC_ID_H264
  
  Nov 18, 2015 5:39:11 PM filepath main
  
  SEVERE: bytOffset =  1748
  
  picture.isComplete()false
  
  Picture is not Complete
  
  trys = 8
  
  packet 1748
  
  packet getTimeBase 1/1200000
  
  vc getTimeBase 25/1
  
  vc getCodecID CODEC_ID_H264
  
  Nov 18, 2015 5:39:11 PM filepath main
  
  SEVERE: bytOffset =  1748
  
  picture.isComplete()false
  
  Picture is not Complete
  
  trys = 9
  
  packet 1748
  
  packet getTimeBase 1/1200000
  
  vc getTimeBase 25/1
  
  vc getCodecID CODEC_ID_H264
  
  Nov 18, 2015 5:39:11 PM filepath main
  
  SEVERE: bytOffset =  1748
  
  picture.isComplete()false
  
  Picture is not Complete
  
  trys = 10
  
  packet 1748
  
  packet getTimeBase 1/1200000
  
  vc getTimeBase 25/1
  
  vc getCodecID CODEC_ID_H264
  
  Nov 18, 2015 5:39:11 PM filepath main
  
  SEVERE: bytOffset =  1748
  
  picture.isComplete()true
  
  isComplete
  
  trys = 10

• Error while trying to create dashcast stream using libx265

  16 décembre 2015, par Rahul

  I’m trying to create a h265 encoded stream from webcam using the follwoing command.

  DashCast -vf video4linux2  -v4l2f mjpeg -v /dev/video0 -conf dashcast.conf -live-media

  The content if dashcast.conf is

  [v1]
  
  type=video
  
  codec=libx265
  
  bitrate=1000000
  
  framerate=25
  
  width=640
  
  height=480

  But I’m getting this error.

  Options:
  
      video source: /dev/video0
  
      video format: video4linux2
  
      v4l2 format: mjpeg
  
      video crop: 0x0
  
      audio source: 
  
  Configurations:
  
      id:v1   res:640x480 vbr:1000000
  
  [mjpeg @ 0xb194e0] Changeing bps to 8
  
  Input #0, video4linux2,v4l2, from '/dev/video0':
  
    Duration: N/A, start: 50349.327770, bitrate: N/A
  
      Stream #0:0: Video: mjpeg, yuvj422p(pc, bt470bg/unknown/unknown), 1280x720, -5 kb/s, 30 fps, 30 tbr, 1000k tbn, 1000k tbc
  
  AVCTX give frame duration of 1/1000000 - keeping requested rate -1, but this may result in unexpected behaviour.
  
  [swscaler @ 0xb91ea0] deprecated pixel format used, make sure you did set range correctly
  
  Press q or Q to exit...
  
  [dashcast] Live system dropped a video frame
  
  [dashcast] Live system dropped a video frame
  
  x265 [info]: HEVC encoder version 1.85dcc9d3a928c400b
  
  x265 [info]: build info [Linux][GCC 4.8.4][64 bit] 8bit
  
  x265 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX AVX2 FMA3 LZCNT BMI2
  
  x265 [info]: Main profile, Level-3 (Main tier)
  
  x265 [info]: Thread pool created using 4 threads
  
  x265 [info]: frame threads / pool features       : 1 / wpp(8 rows)
  
  [dashcast] Live system dropped a video frame
  
  x265 [info]: Coding QT: max CU size, min CU size : 64 / 8
  
  x265 [info]: Residual QT: max TU size, max depth : 32 / 1 inter / 1 intra
  
  x265 [info]: ME / range / subpel / merge         : hex / 57 / 2 / 2
  
  x265 [info]: Keyframe min / max / scenecut       : 25 / 250 / 40
  
  x265 [info]: Lookahead / bframes / badapt        : 20 / 4 / 2
  
  x265 [info]: b-pyramid / weightp / weightb       : 1 / 1 / 0
  
  x265 [info]: References / ref-limit  cu / depth  : 3 / 0 / 0
  
  x265 [info]: AQ: mode / str / qg-size / cu-tree  : 1 / 1.0 / 32 / 1
  
  x265 [info]: Rate Control / qCompress            : ABR-1000 kbps / 0.60
  
  x265 [info]: tools: rd=3 psy-rd=0.30 signhide tmvp strong-intra-smoothing
  
  x265 [info]: tools: deblock sao
  
  Cannot parse HEVC/H265 SPS/PPS
  
  Bad Parameter: dc_gpac_video_write_config
  
  Bad Parameter: gf_isom_start_segment
  
  Cannot open output video file.
  
  Generating MPD at 2015-11-24T19:17:46.040Z
  
  StartTime: 2015-11-24T19:17:46.040Z - startNumber 1 - last number 1
  
  Keyboard thread exit
  
  [dashcast] Live system dropped a video frame
  
  [dashcast] Live system dropped a video frame

  What could be the problem ? Changing codec to libx264 in the conf file works fine.

• ffmpeg conversion fails for 640x360 video size

  12 novembre 2015, par user3132858

  Can somebody advice how I can fix the ffmpeg error below :

  Array ( [0] => ffmpeg version 2.0.1 Copyright (c) 2000-2013 the FFmpeg developers 
  
  [1] => built on Nov 11 2015 12:17:12 with gcc 4.4.7 (GCC) 20120313 (Red Hat 4.4.7-16) [2] 
  
  => configuration: --enable-gpl --enable-version3 --enable-shared --enable-nonfree 
  
  --enable-postproc --enable-libfaac --enable-libmp3lame --enable-libopencore-amrnb 
  
  --enable-libopencore-amrwb --enable-libtheora --enable-libvorbis --enable-libvpx 
  
  --enable-libx264 --enable-libxvid [3] => libavutil 52. 38.100 / 52. 38.100 [4]
  
  => libavcodec 55. 18.102 / 55. 18.102 [5] => libavformat 55. 12.100 / 55. 12.100 [6] 
  
  => libavdevice 55. 3.100 / 55. 3.100 [7] => libavfilter 3. 79.101 / 3. 79.101 [8] 
  
  => libswscale 2. 3.100 / 2. 3.100 [9] => libswresample 0. 17.102 / 0. 17.102 [10] 
  
  => libpostproc 52. 3.100 / 52. 3.100 [11] => Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '3.mov': [12] 
  
  => Metadata: [13] => major_brand : qt [14] => minor_version : 537199360 [15] => compatible_brands: qt [16] 
  
  => creation_time : 2005-10-17 22:54:32 [17] => Duration: 00:01:25.50, start: 0.000000, 
  
  bitrate: 307 kb/s [18] => Stream #0:0(eng): Video: mpeg4 (Simple Profile) (mp4v / 0x7634706D), 
  
  yuv420p, 640x480 [SAR 1:1 DAR 4:3], 261 kb/s, 10 fps, 10 tbr, 3k tbn, 25 tbc [19] 
  
  => Metadata: [20] => creation_time : 2005-10-17 22:54:33 [21] => handler_name : 
  
  Apple Video Media Handler [22] => Stream #0:1(eng): Audio: aac (mp4a / 0x6134706D), 
  
  32000 Hz, mono, fltp, 43 kb/s [23] => Metadata: [24] => creation_time : 2005-10-17 22:54:34 [25] 
  
  => handler_name : Apple Sound Media Handler [26] => [libx264 @ 0x19fbb00] using SAR=944/945 [27] 
  
  => [libx264 @ 0x19fbb00] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX [28] 
  
  => Output #0, mp4, to '4.mp4': [29] => Metadata: [30] => major_brand : qt [31] 
  
  => minor_version : 537199360 [32] => compatible_brands: qt [33] => Stream #0:0
  
  (eng): Video: h264, yuv420p, 630x472 [SAR 944:945 DAR 4:3], q=-1--1, 900 kb/s, 90k tbn, 
  
  10 tbc [34] => Metadata: [35] => creation_time : 2005-10-17 22:54:33 [36] 
  
  => handler_name : Apple Video Media Handler [37] => Stream #0:1(eng): Audio: aac, 32000 Hz, 
  
  mono, fltp, 128 kb/s [38] => Metadata: [39] => creation_time : 2005-10-17 22:54:34 [40] 
  
  => handler_name : Apple Sound Media Handler [41] => Stream mapping: [42] 
  
  => Stream #0:0 -> #0:0 (mpeg4 -> libx264) [43] => Stream #0:1 -> #0:1 (aac -> aac) [44] 
  
  => Error while opening encoder for output stream #0:0 - maybe incorrect parameters 
  
  such as bit_rate, rate, width or height )

  This is my code :

  $width=640;
  
  $height=360;
  
  $aspect=round($width/$height, 1);
  
  
  
  $command = "/usr/bin/ffmpeg -threads 1 -y -i 3.mov -vf \"scale=min(1\,gt(iw\,".$width.")+gt(ih\,".$height.")) * (gte(a\,".$aspect.")*".$width." + \
  
  lt(a\,".$aspect.")*((".$height."*iw)/ih)) + not(min(1\,gt(iw\,".$width.")+gt(ih\,".$height.")))*iw : \
  
  min(1\,gt(iw\,".$width.")+gt(ih\,".$height.")) * (lte(a\,".$aspect.")*".$height." + \
  
  gt(a\,".$aspect.")*((".$width."*ih)/iw)) + not(min(1\,gt(iw\,".$width.")+gt(ih\,".$height.")))*ih\"  -b:v 900k -acodec aac -strict -2 -ab 96k 4.mp4 ";

  It is rather strange but when I change the width and height parameters to 300 and 200 respectively, the command executes, the error appears when the width x height is 640x360.

  Any ideas of what might be wrong ?

  UPDATE : I am pretty sure the error has got something to do with the audio encoding. If I change the -ab 96k part to -c:a copy, command executes.
  I cannot however use -c:a copy because for some audio formats the video does not play on mobile devices. Therefore i need the audio settings to be fixed and the same for all videos.