Recherche avancée

Sur d’autres sites (4803)

• Broken output from libavcodec/swscale, depending on resolution

  3 juin 2014, par dtumaykin

  I am writing a video conference software, I have a H.264 stream decoded with libavcoded into IYUV and than rendered into a window with VMR9 in windowless mode. I use a DirectShow graph to do so.

  To avoid unnecessary conversion into RGB and back (see link), I convert IYUV video into YUY2 before passing it to VMR9, with libswscale.

  I noticed that with video resolution of 848x480, output video is broken, so I investigated further and came up that for some resolutions video is always broken. To exclude the libswscale from elaboration, I added support for IYUV+padding to IYUV conversion, and it worked, with all resolutions.

  Still, I was willing to avoid slow IYUV, so I implemented support for NV12 (with libswscale) and YV12 (manually, essentially the same as IYUV). After doing some tests on two different computers, I came up with strange results.

  resolution  YUY2    NV12    IYUV    YV12
  
  PC 1 (my laptop)                
  
  640x360     ok      broken  ok      broken
  
  848x480     broken  broken  ok      broken
  
  960x540     broken  broken  ok      broken
  
  1024x576    ok      ok      ok      ok
  
  1280x720    ok      ok      ok      broken
  
  1920x1080   ok      broken  ok      broken
  
  
  
  PC 2                
  
  640x360     ok      ok      ok      ok
  
  848x480     ok      broken  ok      broken
  
  960x540     ok      ok      ok      ok
  
  1024x576    ok      ok      ok      ok
  
  1280x720    ok      broken  ok      ok
  
  1920x1080   ok      ok      ok      ok

  To exclude VMR9 fault, I substituted it with EVR, but with same results.

  I know that padding is needed for memory alignment, and that the size of padding depends on CPU used (libavcodec doc), that may explain difference between two computers(first has Intel i7-3820QM, the second Intel Core 2 Quad Q6600). I suppose it has something to do with padding, because images are corrupted in certain way.
  
  You can see my blue t-shirt in lower part of image, and my face in the upper one.

  To follow is the code for the conversion. NV12 and YUY2 conversions are performed with libswscale, while IYUV and YV12 manually.

  int pixels = _outputFrame->width * _outputFrame->height;
  
  if (_outputFormat == "YUY2") {
  
      int stride = _outputFrame->width * 2;
  
      sws_scale(_convertCtx, _outputFrame->data, _outputFrame->linesize, 0, _outputFrame->height, &out, &stride);
  
  }
  
  else if (_outputFormat == "NV12") {
  
      int stride[] = { _outputFrame->width, _outputFrame->width };
  
      uint8_t * dst[] = { out, out + pixels };
  
      sws_scale(_convertCtx, _outputFrame->data, _outputFrame->linesize, 0, _outputFrame->height, dst, stride);
  
  }
  
  else if (_outputFormat == "IYUV") { // clean ffmpeg padding
  
      for (int i = 0; i < _outputFrame->height; i++) // copy Y
  
          memcpy(out + i * _outputFrame->width, _outputFrame->data[0] + i * _outputFrame->linesize[0] , _outputFrame->width);
  
      for (int i = 0; i < _outputFrame->height / 2; i++) // copy U
  
          memcpy(out + pixels + i * _outputFrame->width / 2, _outputFrame->data[1] + i * _outputFrame->linesize[1] , _outputFrame->width / 2);            
  
      for (int i = 0; i < _outputFrame->height / 2; i++) // copy V
  
          memcpy(out + pixels + pixels/4 + i * _outputFrame->width / 2, _outputFrame->data[2] + i * _outputFrame->linesize[2] , _outputFrame->width / 2);
  
  } 
  
  else if (_outputFormat == "YV12") { // like IYUV, but U is inverted with V plane
  
      for (int i = 0; i < _outputFrame->height; i++) // copy Y
  
          memcpy(out + i * _outputFrame->width, _outputFrame->data[0] + i * _outputFrame->linesize[0], _outputFrame->width);
  
      for (int i = 0; i < _outputFrame->height / 2; i++) // copy V
  
          memcpy(out + pixels + i * _outputFrame->width / 2, _outputFrame->data[2] + i * _outputFrame->linesize[2], _outputFrame->width / 2);
  
      for (int i = 0; i < _outputFrame->height / 2; i++) // copy U
  
          memcpy(out + pixels + pixels / 4 + i * _outputFrame->width / 2, _outputFrame->data[1] + i * _outputFrame->linesize[1], _outputFrame->width / 2);
  
  }

  out is an output buffer. _outputFrame is libavcodec output AVFrame. _convertCtx is initialized as follows.

  if (_outputFormat == "YUY2")
  
      _convertCtx = sws_getContext(_width, _height, AV_PIX_FMT_YUV420P,
  
                                   _width, _height, AV_PIX_FMT_YUYV422, SWS_FAST_BILINEAR, nullptr, nullptr, nullptr);
  
  else if (_outputFormat == "NV12")
  
      _convertCtx = sws_getContext(_width, _height, AV_PIX_FMT_YUV420P,
  
                                   _width, _height, AV_PIX_FMT_NV12, SWS_FAST_BILINEAR, nullptr, nullptr, nullptr);

  Questions :

  1. Are manual conversions correct ?
  2. Are my assumptions correct ?
  3. Is previous two answers are positive, where is the problem ? And especially...
  4. Why it presents only with some resolutions and not others ?
  5. What additional info can I provide ?

• How to record a specific window using ffmpeg ?

  16 novembre 2016, par Matin Lotfaliee

  I use ffmpeg to record a window using this code :

  ffmpeg.exe
  
  -f dshow 
  
  -y 
  
  -i video="screen-capture-recorder":audio="virtual-audio-capturer":audio="Microphone (USB Audio Device)" 
  
  -framerate 15 
  
  -vcodec libx264 
  
  -crf 0 
  
  -preset ultrafast 
  
  -acodec pcm_s16le 
  
  -vf crop=Width:Height:Left:Top 
  
  output.flv

  But the problem is i might move the window, this leads to recording an area without the window i want.

  How can i capture a specific window that I am able to move it ?

  ---

  Edit : I also used gdigrab to capture my window (Skype for instance) instead of dshow :

  ffmpeg.exe
  
  -y
  
  -f dshow
  
  -i audio="virtual-audio-capturer":audio="Microphone (USB Audio Device)"
  
  -f gdigrab
  
  -draw_mouse 0
  
  -i title="Skype"
  
  -framerate 30
  
  -vcodec libx264
  
  -crf 0
  
  -preset ultrafast
  
  -acodec pcm_s16le
  
  output.flv

  But the conference is black...

• Code library for image processing [on hold]

  1er septembre 2014, par user3928079

  Dear Stack Overflow Users,

  I am looking to create my programming portfolio as a graduate of Kennesaw State University by July 2015, when I graduate. I want to create at least 3 cross platform programs related to video or animation. In the package there will be a program for playing video and music files, a program for converting video and music files, and either a program upscaling video and image files or a program that helps animators create animation like Flipbook Pro. Since Java is cross platform, and Java is the language I’m more comfortable with, I’ll develop the software in Java, unless of course Python is cross platform as well. May you please recommend me some image processing libraries that will help me accomplish the development of these types of software programs. For the upscaling program, an upscaling algorithm from BenVista called S-Spline Max is needed, especially since I want to preserve the detail of the image, because in upscaling, you are unable to gain new information from the original information. What are some good image processing libraries I can use. I know of OpenCV, but what do a lot of programs use, high profile or low profile, like Adobe Premiere Pro or Davinci Resolve. FFMPEG is a good video library, but can it easily accomplish what I need ? What are some others that can help me in my 11 month long quest ?

  Regards,

  Jordan White