Recherche avancée

Sur d’autres sites (8090)

• Right choice to play audio and video content

  22 juin 2012, par deimus

  What I'm doing :

  I need to play audio and video files that are not supported by Apple on iPhone/iPad for example mkv/mka files which my contain several audio channels.

  I'm using libffmpeg to find audio and video streams in media file.
  Video is being decoded with avcodec_decode_video2 and audio with avcodec_decode_audio3
  the return values are following for each function are following

  • avcodec_decode_video2 - returns AVFrame structure which encapsulates information about the video video frame from the pakcage, specifically is has data field which is a pointer to the picture/channel planes.
  • avcodec_decode_audio3 - returns samples of type int16_t * which I guess is the raw audio data

  So basically I've done all this and successfully decoding the media content.

  What I have to do :
  I've to play the audio and video accordingly using Apples services. The playback I need to perform should support mixing of audio channels while playing video, i.e. let say mkv file contains two audio channel and a video channel. So I would like to know which service will be the appropriate choice for me ? My research showed that AudioQueue service might be useful audio playback, and probably AVFoundation for video.

  Please help to find the right technology for my case i.e. video playeback + audio playback with possible audio channel mixing.

• FFmpeg mp4 videos load very slow outside of network

  6 juin 2014, par user3550401

  I used ffmpeg to convert my videos to mp4 using libx264 and qt fast start. Im playing my videos through the HTML tag, and when im inside my network where my website is, everything plays fast. But when i try to play the video from an outside network, I have to wait about 10 seconds before a 5 second video is played. And even when its playing, its super choppy. Any reason on why this is ? I am playing the videos in Safari on my iPhone.

  Here is how im encoding my videos :

  ffmpeg -i video.ts -i css/watermark.png -filter_complex overlay=10:main_h-overlay_h-10 -shortest -b:v 800k -vcodec libx264 -acodec libfaac -ar 44100 -ac 2 -b:a 128k -movflags faststart -map_metadata -1 video.mp4

• Render YUV video in OpenGL of ffmpeg using CVPixelBufferRef and Shaders

  4 septembre 2012, par resident_

  I'm using to render YUV frames of ffmpeg with the iOS 5.0 method "CVOpenGLESTextureCacheCreateTextureFromImage".

  I'm using like the apple example GLCameraRipple

  My result in iPhone screen is this : iPhone Screen

  I need to know I'm doing wrong.

  I put part of my code to find errors.

  ffmpeg configure frames :

  ctx->p_sws_ctx = sws_getContext(ctx->p_video_ctx->width, 
  
                                  ctx->p_video_ctx->height, 
  
                                  ctx->p_video_ctx->pix_fmt, 
  
                                  ctx->p_video_ctx->width, 
  
                                  ctx->p_video_ctx->height,
  
                                  PIX_FMT_YUV420P, SWS_FAST_BILINEAR, NULL, NULL, NULL);
  
  
  
  
  
  // Framebuffer for RGB data
  
  ctx->p_frame_buffer = malloc(avpicture_get_size(PIX_FMT_YUV420P,
  
                                                  ctx->p_video_ctx->width, 
  
                                                  ctx->p_video_ctx->height));
  
  
  
  avpicture_fill((AVPicture*)ctx->p_picture_rgb, ctx->p_frame_buffer,PIX_FMT_YUV420P, 
  
                 ctx->p_video_ctx->width, 
  
                 ctx->p_video_ctx->height);

  My render method :

  if (NULL == videoTextureCache) {
  
      NSLog(@"displayPixelBuffer error");
  
      return;
  
  }    
  
  
  
  
  
  CVPixelBufferRef pixelBuffer;    
  
     CVPixelBufferCreateWithBytes(kCFAllocatorDefault, mTexW, mTexH, kCVPixelFormatType_420YpCbCr8BiPlanarVideoRange, buffer, mFrameW * 3, NULL, 0, NULL, &pixelBuffer);
  
  
  
  
  
  
  
  CVReturn err;    
  
  // Y-plane
  
  glActiveTexture(GL_TEXTURE0);
  
  err = CVOpenGLESTextureCacheCreateTextureFromImage(kCFAllocatorDefault, 
  
                                                     videoTextureCache,
  
                                                     pixelBuffer,
  
                                                     NULL,
  
                                                     GL_TEXTURE_2D,
  
                                                     GL_RED_EXT,
  
                                                     mTexW,
  
                                                     mTexH,
  
                                                     GL_RED_EXT,
  
                                                     GL_UNSIGNED_BYTE,
  
                                                     0,
  
                                                     &_lumaTexture);
  
  if (err) 
  
  {
  
      NSLog(@"Error at CVOpenGLESTextureCacheCreateTextureFromImage %d", err);
  
  }   
  
  
  
  glBindTexture(CVOpenGLESTextureGetTarget(_lumaTexture), CVOpenGLESTextureGetName(_lumaTexture));
  
  glTexParameterf(GL_TEXTURE_2D, GL_TEXTURE_WRAP_S, GL_CLAMP_TO_EDGE);
  
  glTexParameterf(GL_TEXTURE_2D, GL_TEXTURE_WRAP_T, GL_CLAMP_TO_EDGE);     
  
  
  
  // UV-plane
  
  glActiveTexture(GL_TEXTURE1);
  
  err = CVOpenGLESTextureCacheCreateTextureFromImage(kCFAllocatorDefault, 
  
                                                     videoTextureCache,
  
                                                     pixelBuffer,
  
                                                     NULL,
  
                                                     GL_TEXTURE_2D,
  
                                                     GL_RG_EXT,
  
                                                     mTexW/2,
  
                                                     mTexH/2,
  
                                                     GL_RG_EXT,
  
                                                     GL_UNSIGNED_BYTE,
  
                                                     1,
  
                                                     &_chromaTexture);
  
  if (err) 
  
  {
  
      NSLog(@"Error at CVOpenGLESTextureCacheCreateTextureFromImage %d", err);
  
  }
  
  
  
  glBindTexture(CVOpenGLESTextureGetTarget(_chromaTexture), CVOpenGLESTextureGetName(_chromaTexture));
  
  glTexParameterf(GL_TEXTURE_2D, GL_TEXTURE_WRAP_S, GL_CLAMP_TO_EDGE);
  
  glTexParameterf(GL_TEXTURE_2D, GL_TEXTURE_WRAP_T, GL_CLAMP_TO_EDGE);     
  
  
  
  glBindFramebuffer(GL_FRAMEBUFFER, defaultFramebuffer);
  
  
  
  // Set the view port to the entire view
  
  glViewport(0, 0, backingWidth, backingHeight);
  
  
  
  static const GLfloat squareVertices[] = {
  
      1.0f, 1.0f,
  
      -1.0f, 1.0f,
  
      1.0f,  -1.0f,
  
      -1.0f,  -1.0f,
  
  };
  
  
  
  GLfloat textureVertices[] = {
  
      1, 1,
  
      1, 0,
  
      0, 1,
  
      0, 0,
  
  };
  
  
  
  // Draw the texture on the screen with OpenGL ES 2
  
  [self renderWithSquareVertices:squareVertices textureVertices:textureVertices];
  
  
  
  
  
  // Flush the CVOpenGLESTexture cache and release the texture
  
  CVOpenGLESTextureCacheFlush(videoTextureCache, 0);    
  
  CVPixelBufferRelease(pixelBuffer);     
  
  
  
   [moviePlayerDelegate bufferDone];

  RenderWithSquareVertices method

      - (void)renderWithSquareVertices:(const GLfloat*)squareVertices textureVertices:(const GLfloat*)textureVertices
  
  {
  
  
  
  
  
    // Use shader program.
  
      glUseProgram(shader.program);
  
  
  
  // Update attribute values.
  
  glVertexAttribPointer(ATTRIB_VERTEX, 2, GL_FLOAT, 0, 0, squareVertices);
  
  glEnableVertexAttribArray(ATTRIB_VERTEX);
  
  glVertexAttribPointer(ATTRIB_TEXTUREPOSITON, 2, GL_FLOAT, 0, 0, textureVertices);
  
  glEnableVertexAttribArray(ATTRIB_TEXTUREPOSITON);
  
  
  
  glDrawArrays(GL_TRIANGLE_STRIP, 0, 4);
  
  
  
  // Present
  
  glBindRenderbuffer(GL_RENDERBUFFER, colorRenderbuffer);
  
  [context presentRenderbuffer:GL_RENDERBUFFER];

  }

  My fragment shader :

  uniform sampler2D SamplerY;
  
  uniform sampler2D SamplerUV;
  
  
  
  
  
  varying highp vec2 _texcoord;
  
  
  
  void main()
  
  {
  
  
  
  mediump vec3 yuv;
  
  lowp vec3 rgb;
  
  
  
  yuv.x = texture2D(SamplerY, _texcoord).r;
  
  yuv.yz = texture2D(SamplerUV, _texcoord).rg - vec2(0.5, 0.5);
  
  
  
  // BT.601, which is the standard for SDTV is provided as a reference
  
  
  
  /* rgb = mat3(    1,       1,     1,
  
   0, -.34413, 1.772,
  
   1.402, -.71414,     0) * yuv;*/
  
  
  
  
  
  // Using BT.709 which is the standard for HDTV
  
  rgb = mat3(      1,       1,      1,
  
             0, -.18732, 1.8556,
  
             1.57481, -.46813,      0) * yuv;
  
  
  
     gl_FragColor = vec4(rgb, 1);
  
  
  
  }

  Very thanks,