Recherche avancée

Sur d’autres sites (3172)

• ffmpeg : corrupt audio in usage of avfoundation

  3 janvier 2016, par Andy

  I am trying to record my desktop screen (MacBook Pro (Retina, 15-inch, Mid 2014), OSX 10.10.5) with audio. First, I have to find the devices for recording, video:1 and audio:0 in my case.

  User@User-MacBook-Pro:~/test$ ffmpeg -hide_banner -f avfoundation -list_devices true -i ""
  
  [AVFoundation input device @ 0x7ff19a422320] AVFoundation video devices:
  
  [AVFoundation input device @ 0x7ff19a422320] [0] FaceTime HD Camera
  
  [AVFoundation input device @ 0x7ff19a422320] [1] Capture screen 0
  
  [AVFoundation input device @ 0x7ff4b9c22320] [2] Capture screen 1
  
  [AVFoundation input device @ 0x7ff19a422320] AVFoundation audio devices:
  
  [AVFoundation input device @ 0x7ff19a422320] [0] Soundflower (2ch)
  
  [AVFoundation input device @ 0x7ff19a422320] [1] Built-in Microphone
  
  [AVFoundation input device @ 0x7ff19a422320] [2] Soundflower (64ch)
  
  : Input/output error

  Then I run to capture the screen :

  ffmpeg -f avfoundation -i "1:0" out_desktop.mkv

  and the audio of the output stutters terribly.
  But if I use the second external screen (which is connect via HDMI) :

  ffmpeg -f avfoundation -i "2:0" out_ext.mkv

  Then I have no audio problems.

  So, what could be the cause of this behaviour ? Somehow the video device "Capture screen 0" causes the audio stutter.

  Here are the full outputs of the two commands above, Screen 0 :

  User@User-MacBook-Pro:~/test$ ffmpeg -f avfoundation -i "1:0" out.mkv
  
  ffmpeg version 2.8.4 Copyright (c) 2000-2015 the FFmpeg developers
  
    built with Apple LLVM version 7.0.2 (clang-700.1.81)
  
    configuration: --prefix=/usr/local/Cellar/ffmpeg/2.8.4 --enable-shared --enable-pthreads --enable-gpl --enable-version3 --enable-hardcoded-tables --enable-avresample --cc=clang --host-cflags= --host-ldflags= --enable-opencl --enable-libx264 --enable-libmp3lame --enable-libvo-aacenc --enable-libxvid --enable-libfreetype --enable-libtheora --enable-libvorbis --enable-libvpx --enable-librtmp --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libass --enable-ffplay --enable-libspeex --enable-libschroedinger --enable-libfdk-aac --enable-libopus --enable-frei0r --enable-libopenjpeg --disable-decoder=jpeg2000 --extra-cflags=-I/usr/local/Cellar/openjpeg/1.5.2_1/include/openjpeg-1.5 --enable-nonfree --enable-vda
  
    libavutil      54. 31.100 / 54. 31.100
  
    libavcodec     56. 60.100 / 56. 60.100
  
    libavformat    56. 40.101 / 56. 40.101
  
    libavdevice    56.  4.100 / 56.  4.100
  
    libavfilter     5. 40.101 /  5. 40.101
  
    libavresample   2.  1.  0 /  2.  1.  0
  
    libswscale      3.  1.101 /  3.  1.101
  
    libswresample   1.  2.101 /  1.  2.101
  
    libpostproc    53.  3.100 / 53.  3.100
  
  [avfoundation @ 0x7fca1200da00] Selected pixel format (yuv420p) is not supported by the input device.
  
  [avfoundation @ 0x7fca1200da00] Supported pixel formats:
  
  [avfoundation @ 0x7fca1200da00]   uyvy422
  
  [avfoundation @ 0x7fca1200da00]   yuyv422
  
  [avfoundation @ 0x7fca1200da00]   nv12
  
  [avfoundation @ 0x7fca1200da00]   0rgb
  
  [avfoundation @ 0x7fca1200da00]   bgr0
  
  [avfoundation @ 0x7fca1200da00] Overriding selected pixel format to use uyvy422 instead.
  
  [avfoundation @ 0x7fca1200da00] Stream #0: not enough frames to estimate rate; consider increasing probesize
  
  Input #0, avfoundation, from '1:0':
  
    Duration: N/A, start: 11734.092500, bitrate: 2822 kb/s
  
      Stream #0:0: Video: rawvideo (UYVY / 0x59565955), uyvy422, 2880x1800, 1000k tbr, 1000k tbn, 1000k tbc
  
      Stream #0:1: Audio: pcm_f32le, 44100 Hz, stereo, flt, 2822 kb/s
  
  File 'out.mkv' already exists. Overwrite ? [y/N] y
  
  No pixel format specified, yuv422p for H.264 encoding chosen.
  
  Use -pix_fmt yuv420p for compatibility with outdated media players.
  
  [libx264 @ 0x7fca1390e000] MB rate (20340000000) > level limit (2073600)
  
  [libx264 @ 0x7fca1390e000] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 AVX2 LZCNT BMI2
  
  [libx264 @ 0x7fca1390e000] profile High 4:2:2, level 5.2, 4:2:2 8-bit
  
  [libx264 @ 0x7fca1390e000] 264 - core 148 r2601 a0cd7d3 - H.264/MPEG-4 AVC codec - Copyleft 2003-2015 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
  
  Output #0, matroska, to 'out.mkv':
  
    Metadata:
  
      encoder         : Lavf56.40.101
  
      Stream #0:0: Video: h264 (libx264) (H264 / 0x34363248), yuv422p, 2880x1800, q=-1--1, 1000k fps, 1k tbn, 1000k tbc
  
      Metadata:
  
        encoder         : Lavc56.60.100 libx264
  
      Stream #0:1: Audio: vorbis (libvorbis) (oV[0][0] / 0x566F), 44100 Hz, stereo, fltp
  
      Metadata:
  
        encoder         : Lavc56.60.100 libvorbis
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (rawvideo (native) -> h264 (libx264))
  
    Stream #0:1 -> #0:1 (pcm_f32le (native) -> vorbis (libvorbis))
  
  Press [q] to stop, [?] for help
  
  frame=  969 fps= 29 q=-1.0 Lsize=    6911kB time=00:00:34.80 bitrate=1626.8kbits/s    
  
  video:6475kB audio:396kB subtitle:0kB other streams:0kB global headers:4kB muxing overhead: 0.591309%
  
  [libx264 @ 0x7fca1390e000] frame I:4     Avg QP:15.77  size:1461092
  
  [libx264 @ 0x7fca1390e000] frame P:246   Avg QP:16.00  size:  2608
  
  [libx264 @ 0x7fca1390e000] frame B:719   Avg QP:13.91  size:   200
  
  [libx264 @ 0x7fca1390e000] consecutive B-frames:  0.9%  0.4%  0.0% 98.7%
  
  [libx264 @ 0x7fca1390e000] mb I  I16..4: 11.6% 43.3% 45.2%
  
  [libx264 @ 0x7fca1390e000] mb P  I16..4:  0.0%  0.0%  0.1%  P16..4:  0.4%  0.0%  0.0%  0.0%  0.0%    skip:99.5%
  
  [libx264 @ 0x7fca1390e000] mb B  I16..4:  0.0%  0.0%  0.0%  B16..8:  0.2%  0.0%  0.0%  direct: 0.0%  skip:99.8%  L0:39.9% L1:60.0% BI: 0.1%
  
  [libx264 @ 0x7fca1390e000] 8x8 transform intra:41.6% inter:38.8%
  
  [libx264 @ 0x7fca1390e000] coded y,uvDC,uvAC intra: 76.9% 77.9% 75.5% inter: 0.0% 0.1% 0.0%
  
  [libx264 @ 0x7fca1390e000] i16 v,h,dc,p: 51% 34% 11%  4%
  
  [libx264 @ 0x7fca1390e000] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 22% 17% 19%  7%  4%  3%  8%  5% 16%
  
  [libx264 @ 0x7fca1390e000] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 21% 24% 10%  7%  6%  5%  8%  7% 12%
  
  [libx264 @ 0x7fca1390e000] i8c dc,h,v,p: 59% 14% 18%  9%
  
  [libx264 @ 0x7fca1390e000] Weighted P-Frames: Y:0.0% UV:0.0%
  
  [libx264 @ 0x7fca1390e000] ref P L0: 71.5%  3.4% 13.0% 12.1%
  
  [libx264 @ 0x7fca1390e000] ref B L0: 46.6% 52.3%  1.1%
  
  [libx264 @ 0x7fca1390e000] ref B L1: 95.1%  4.9%
  
  [libx264 @ 0x7fca1390e000] kb/s:1525.48

  and Screen 1 :

  User@User-MacBook-Pro:~/test$ ffmpeg -f avfoundation -i "2:0" out.mkv
  
  ffmpeg version 2.8.4 Copyright (c) 2000-2015 the FFmpeg developers
  
    built with Apple LLVM version 7.0.2 (clang-700.1.81)
  
    configuration: --prefix=/usr/local/Cellar/ffmpeg/2.8.4 --enable-shared --enable-pthreads --enable-gpl --enable-version3 --enable-hardcoded-tables --enable-avresample --cc=clang --host-cflags= --host-ldflags= --enable-opencl --enable-libx264 --enable-libmp3lame --enable-libvo-aacenc --enable-libxvid --enable-libfreetype --enable-libtheora --enable-libvorbis --enable-libvpx --enable-librtmp --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libass --enable-ffplay --enable-libspeex --enable-libschroedinger --enable-libfdk-aac --enable-libopus --enable-frei0r --enable-libopenjpeg --disable-decoder=jpeg2000 --extra-cflags=-I/usr/local/Cellar/openjpeg/1.5.2_1/include/openjpeg-1.5 --enable-nonfree --enable-vda
  
    libavutil      54. 31.100 / 54. 31.100
  
    libavcodec     56. 60.100 / 56. 60.100
  
    libavformat    56. 40.101 / 56. 40.101
  
    libavdevice    56.  4.100 / 56.  4.100
  
    libavfilter     5. 40.101 /  5. 40.101
  
    libavresample   2.  1.  0 /  2.  1.  0
  
    libswscale      3.  1.101 /  3.  1.101
  
    libswresample   1.  2.101 /  1.  2.101
  
    libpostproc    53.  3.100 / 53.  3.100
  
  [avfoundation @ 0x7fc2e900da00] Selected pixel format (yuv420p) is not supported by the input device.
  
  [avfoundation @ 0x7fc2e900da00] Supported pixel formats:
  
  [avfoundation @ 0x7fc2e900da00]   uyvy422
  
  [avfoundation @ 0x7fc2e900da00]   yuyv422
  
  [avfoundation @ 0x7fc2e900da00]   nv12
  
  [avfoundation @ 0x7fc2e900da00]   0rgb
  
  [avfoundation @ 0x7fc2e900da00]   bgr0
  
  [avfoundation @ 0x7fc2e900da00] Overriding selected pixel format to use uyvy422 instead.
  
  [avfoundation @ 0x7fc2e900da00] Stream #0: not enough frames to estimate rate; consider increasing probesize
  
  Input #0, avfoundation, from '2:0':
  
    Duration: N/A, start: 11809.126333, bitrate: 2822 kb/s
  
      Stream #0:0: Video: rawvideo (UYVY / 0x59565955), uyvy422, 2560x1080, 1000k tbr, 1000k tbn, 1000k tbc
  
      Stream #0:1: Audio: pcm_f32le, 44100 Hz, stereo, flt, 2822 kb/s
  
  File 'out.mkv' already exists. Overwrite ? [y/N] y
  
  No pixel format specified, yuv422p for H.264 encoding chosen.
  
  Use -pix_fmt yuv420p for compatibility with outdated media players.
  
  [libx264 @ 0x7fc2ea82ac00] MB rate (10880000000) > level limit (2073600)
  
  [libx264 @ 0x7fc2ea82ac00] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 AVX2 LZCNT BMI2
  
  [libx264 @ 0x7fc2ea82ac00] profile High 4:2:2, level 5.2, 4:2:2 8-bit
  
  [libx264 @ 0x7fc2ea82ac00] 264 - core 148 r2601 a0cd7d3 - H.264/MPEG-4 AVC codec - Copyleft 2003-2015 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
  
  Output #0, matroska, to 'out.mkv':
  
    Metadata:
  
      encoder         : Lavf56.40.101
  
      Stream #0:0: Video: h264 (libx264) (H264 / 0x34363248), yuv422p, 2560x1080, q=-1--1, 1000k fps, 1k tbn, 1000k tbc
  
      Metadata:
  
        encoder         : Lavc56.60.100 libx264
  
      Stream #0:1: Audio: vorbis (libvorbis) (oV[0][0] / 0x566F), 44100 Hz, stereo, fltp
  
      Metadata:
  
        encoder         : Lavc56.60.100 libvorbis
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (rawvideo (native) -> h264 (libx264))
  
    Stream #0:1 -> #0:1 (pcm_f32le (native) -> vorbis (libvorbis))
  
  Press [q] to stop, [?] for help
  
  frame=  755 fps= 30 q=-1.0 Lsize=    1025kB time=00:00:26.65 bitrate= 315.1kbits/s    
  
  video:680kB audio:326kB subtitle:0kB other streams:0kB global headers:4kB muxing overhead: 2.003084%
  
  [libx264 @ 0x7fc2ea82ac00] frame I:4     Avg QP:13.22  size:145661
  
  [libx264 @ 0x7fc2ea82ac00] frame P:191   Avg QP:19.87  size:   250
  
  [libx264 @ 0x7fc2ea82ac00] frame B:560   Avg QP:28.31  size:   116
  
  [libx264 @ 0x7fc2ea82ac00] consecutive B-frames:  1.1%  0.0%  0.4% 98.5%
  
  [libx264 @ 0x7fc2ea82ac00] mb I  I16..4: 54.5% 29.2% 16.2%
  
  [libx264 @ 0x7fc2ea82ac00] mb P  I16..4:  0.2%  0.1%  0.0%  P16..4:  0.1%  0.0%  0.0%  0.0%  0.0%    skip:99.6%
  
  [libx264 @ 0x7fc2ea82ac00] mb B  I16..4:  0.0%  0.0%  0.0%  B16..8:  0.3%  0.0%  0.0%  direct: 0.0%  skip:99.7%  L0:69.2% L1:30.8% BI: 0.0%
  
  [libx264 @ 0x7fc2ea82ac00] 8x8 transform intra:31.7% inter:13.1%
  
  [libx264 @ 0x7fc2ea82ac00] coded y,uvDC,uvAC intra: 10.9% 8.8% 8.5% inter: 0.0% 0.0% 0.0%
  
  [libx264 @ 0x7fc2ea82ac00] i16 v,h,dc,p: 69% 31%  0%  0%
  
  [libx264 @ 0x7fc2ea82ac00] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 27%  5% 67%  0%  0%  0%  0%  0%  0%
  
  [libx264 @ 0x7fc2ea82ac00] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 38% 25% 14%  3%  3%  4%  5%  4%  5%
  
  [libx264 @ 0x7fc2ea82ac00] i8c dc,h,v,p: 92%  3%  4%  0%
  
  [libx264 @ 0x7fc2ea82ac00] Weighted P-Frames: Y:0.0% UV:0.0%
  
  [libx264 @ 0x7fc2ea82ac00] ref P L0: 76.3%  1.7% 16.8%  5.2%
  
  [libx264 @ 0x7fc2ea82ac00] ref B L0: 38.9% 56.9%  4.2%
  
  [libx264 @ 0x7fc2ea82ac00] ref B L1: 97.3%  2.7%
  
  [libx264 @ 0x7fc2ea82ac00] kb/s:208.84

  EDIT

  The main differences between the two (lengthy) outputs above via

  wdiff -n output1 output2 |colordiff

  is the resolution ([-2880x1800,-] {+2560x1080,+}) and the resulting MB rate ([-(20340000000)-] {+(10880000000)+}). So, what could increase the performance of ffmpeg ?

• FFMPEG crop video output is black screen, sound is good [on hold]

  11 janvier 2016, par Oum Alaa

  I cropped a video using ffmpeg command line, the output is black screen, the sound is clear and good :

  ffmpeg -i Original.mp4 -t 00:00:29 -vf "crop=634:300:0:60" Done.mp4

  ffmpeg version :

  ffmpeg version 0.8.17-4:0.8.17-0ubuntu0.12.04.1, Copyright (c) 2000-2014 the Libav developers

  built on Mar 16 2015 13:26:50 with gcc 4.6.3

  video information :

  mediainfo '--Inform=Video;%Width%x%Height%' Original.mp4
  
  634x360

  Thanks in advance

• FFmpeg library : modified muxing sample for FLTP input and FLTP audio, loses audio

  21 janvier 2014, par taansari

  Based on muxing sample that comes with FFmpeg docs, I have modified it, from input format as S16 to FLTP (planar stereo), and outputting to webm format (stereo).

  Since input is now FLTP, I am filling two arrays, then encoding again to FLTP. There are no obvious errors given on screen, but the resulting webm video does not play any audio (just the video content). This is just proof of concept in understanding things ; here is an added (crude) function to fill up input FLTP stereo buffer :

  static void get_audio_frame_for_planar_stereo(int16_t **samples, int frame_size, int nb_channels)
  
  {
  
      int j, i, v[2];
  
      int16_t *q1 = (int16_t *) samples[0];
  
      int16_t *q2 = (int16_t *) samples[1];
  
  
  
      for (j = 0; j < frame_size; j++)
  
      {
  
          v[0] = (int)(sin(t) * 10000);
  
          v[1] = (int)(tan(t) * 10000);
  
          *q1++ = v[0];
  
          *q2++ = v[1];
  
          t     += tincr;
  
          tincr += tincr2;
  
      }
  
  }

  Which I am calling from inside write_audio_frame() function.

  Note also, wherever code reffered AV_SAMPLE_FMT_S16 as input, I have changed to AV_SAMPLE_FMT_FLTP.

  Whole workable source is here :

  https://gist.github.com/anonymous/05d1d7662e9feafc45a6

  When run with ffprobe.exe, with these instructions :

  ffprobe -show_packets output.webm >output.txt

  I see nothing out of ordinary, all pts/dts values appear to be in place :

  https://gist.github.com/anonymous/3ed0d6308700ab991704

  Could someone highlight cause of this mis-interpretation ?

  Thanks for your time...

  p.s. I am using Zeranoe FFmpeg Windows builds (32 bit), built on Jan 9 2014 22:04:35 with gcc 4.8.2.(GCC)

  Edit : Based on your guidance elsewhere, I tried the following :

      /* set options */
  
      //av_opt_set_int       (swr_ctx, "in_channel_count",   c->channels,       0);
  
      //av_opt_set_int       (swr_ctx, "in_sample_rate",     c->sample_rate,    0);
  
      //av_opt_set_sample_fmt(swr_ctx, "in_sample_fmt",      AV_SAMPLE_FMT_FLTP, 0);
  
      //av_opt_set_int       (swr_ctx, "out_channel_count",  c->channels,       0);
  
      //av_opt_set_int       (swr_ctx, "out_sample_rate",    c->sample_rate,    0);
  
      //av_opt_set_sample_fmt(swr_ctx, "out_sample_fmt",     c->sample_fmt,     0);
  
  
  
      av_opt_set_int(swr_ctx, "in_channel_layout",    AV_CH_LAYOUT_STEREO, 0);
  
      av_opt_set_int(swr_ctx, "in_sample_rate",       c->sample_rate, 0);
  
      av_opt_set_sample_fmt(swr_ctx, "in_sample_fmt", AV_SAMPLE_FMT_FLTP, 0);
  
  
  
      av_opt_set_int(swr_ctx, "out_channel_layout",    AV_CH_LAYOUT_STEREO, 0);
  
      av_opt_set_int(swr_ctx, "out_sample_rate",       c->sample_rate, 0);
  
      av_opt_set_sample_fmt(swr_ctx, "out_sample_fmt", AV_SAMPLE_FMT_FLTP, 0);

  And the revised function :

  static void get_audio_frame_for_planar_stereo(uint8_t **samples, int frame_size, int nb_channels)
  
  {
  
      int j, i;
  
      float v[2];
  
      float *q1 = (float *) samples[0];
  
      float *q2 = (float *) samples[1];
  
  
  
      for (j = 0; j < frame_size; j++) 
  
      {
  
          v[0] = (tan(t) * 1);
  
          v[1] = (sin(t) * 1);
  
          *q1++ = v[0];
  
          *q2++ = v[1];
  
          t     += tincr;
  
          tincr += tincr2;
  
      }
  
  }

  Now it appears to be working properly. I tried changing function parameters from uint8_t** to float**, as well as src_samples_data from uint8_t** to float**, but did not make any difference, in a view.

  Updated code : https://gist.github.com/anonymous/35371b2c106961029c3d

  Thanks for highlighting the place(s) that result in this behavior !