Recherche avancée

Sur d’autres sites (9144)

• ffmpeg : corrupt audio in usage of avfoundation

  3 janvier 2016, par Andy

  I am trying to record my desktop screen (MacBook Pro (Retina, 15-inch, Mid 2014), OSX 10.10.5) with audio. First, I have to find the devices for recording, video:1 and audio:0 in my case.

  User@User-MacBook-Pro:~/test$ ffmpeg -hide_banner -f avfoundation -list_devices true -i ""
  
  [AVFoundation input device @ 0x7ff19a422320] AVFoundation video devices:
  
  [AVFoundation input device @ 0x7ff19a422320] [0] FaceTime HD Camera
  
  [AVFoundation input device @ 0x7ff19a422320] [1] Capture screen 0
  
  [AVFoundation input device @ 0x7ff4b9c22320] [2] Capture screen 1
  
  [AVFoundation input device @ 0x7ff19a422320] AVFoundation audio devices:
  
  [AVFoundation input device @ 0x7ff19a422320] [0] Soundflower (2ch)
  
  [AVFoundation input device @ 0x7ff19a422320] [1] Built-in Microphone
  
  [AVFoundation input device @ 0x7ff19a422320] [2] Soundflower (64ch)
  
  : Input/output error

  Then I run to capture the screen :

  ffmpeg -f avfoundation -i "1:0" out_desktop.mkv

  and the audio of the output stutters terribly.
  But if I use the second external screen (which is connect via HDMI) :

  ffmpeg -f avfoundation -i "2:0" out_ext.mkv

  Then I have no audio problems.

  So, what could be the cause of this behaviour ? Somehow the video device "Capture screen 0" causes the audio stutter.

  Here are the full outputs of the two commands above, Screen 0 :

  User@User-MacBook-Pro:~/test$ ffmpeg -f avfoundation -i "1:0" out.mkv
  
  ffmpeg version 2.8.4 Copyright (c) 2000-2015 the FFmpeg developers
  
    built with Apple LLVM version 7.0.2 (clang-700.1.81)
  
    configuration: --prefix=/usr/local/Cellar/ffmpeg/2.8.4 --enable-shared --enable-pthreads --enable-gpl --enable-version3 --enable-hardcoded-tables --enable-avresample --cc=clang --host-cflags= --host-ldflags= --enable-opencl --enable-libx264 --enable-libmp3lame --enable-libvo-aacenc --enable-libxvid --enable-libfreetype --enable-libtheora --enable-libvorbis --enable-libvpx --enable-librtmp --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libass --enable-ffplay --enable-libspeex --enable-libschroedinger --enable-libfdk-aac --enable-libopus --enable-frei0r --enable-libopenjpeg --disable-decoder=jpeg2000 --extra-cflags=-I/usr/local/Cellar/openjpeg/1.5.2_1/include/openjpeg-1.5 --enable-nonfree --enable-vda
  
    libavutil      54. 31.100 / 54. 31.100
  
    libavcodec     56. 60.100 / 56. 60.100
  
    libavformat    56. 40.101 / 56. 40.101
  
    libavdevice    56.  4.100 / 56.  4.100
  
    libavfilter     5. 40.101 /  5. 40.101
  
    libavresample   2.  1.  0 /  2.  1.  0
  
    libswscale      3.  1.101 /  3.  1.101
  
    libswresample   1.  2.101 /  1.  2.101
  
    libpostproc    53.  3.100 / 53.  3.100
  
  [avfoundation @ 0x7fca1200da00] Selected pixel format (yuv420p) is not supported by the input device.
  
  [avfoundation @ 0x7fca1200da00] Supported pixel formats:
  
  [avfoundation @ 0x7fca1200da00]   uyvy422
  
  [avfoundation @ 0x7fca1200da00]   yuyv422
  
  [avfoundation @ 0x7fca1200da00]   nv12
  
  [avfoundation @ 0x7fca1200da00]   0rgb
  
  [avfoundation @ 0x7fca1200da00]   bgr0
  
  [avfoundation @ 0x7fca1200da00] Overriding selected pixel format to use uyvy422 instead.
  
  [avfoundation @ 0x7fca1200da00] Stream #0: not enough frames to estimate rate; consider increasing probesize
  
  Input #0, avfoundation, from '1:0':
  
    Duration: N/A, start: 11734.092500, bitrate: 2822 kb/s
  
      Stream #0:0: Video: rawvideo (UYVY / 0x59565955), uyvy422, 2880x1800, 1000k tbr, 1000k tbn, 1000k tbc
  
      Stream #0:1: Audio: pcm_f32le, 44100 Hz, stereo, flt, 2822 kb/s
  
  File 'out.mkv' already exists. Overwrite ? [y/N] y
  
  No pixel format specified, yuv422p for H.264 encoding chosen.
  
  Use -pix_fmt yuv420p for compatibility with outdated media players.
  
  [libx264 @ 0x7fca1390e000] MB rate (20340000000) > level limit (2073600)
  
  [libx264 @ 0x7fca1390e000] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 AVX2 LZCNT BMI2
  
  [libx264 @ 0x7fca1390e000] profile High 4:2:2, level 5.2, 4:2:2 8-bit
  
  [libx264 @ 0x7fca1390e000] 264 - core 148 r2601 a0cd7d3 - H.264/MPEG-4 AVC codec - Copyleft 2003-2015 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
  
  Output #0, matroska, to 'out.mkv':
  
    Metadata:
  
      encoder         : Lavf56.40.101
  
      Stream #0:0: Video: h264 (libx264) (H264 / 0x34363248), yuv422p, 2880x1800, q=-1--1, 1000k fps, 1k tbn, 1000k tbc
  
      Metadata:
  
        encoder         : Lavc56.60.100 libx264
  
      Stream #0:1: Audio: vorbis (libvorbis) (oV[0][0] / 0x566F), 44100 Hz, stereo, fltp
  
      Metadata:
  
        encoder         : Lavc56.60.100 libvorbis
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (rawvideo (native) -> h264 (libx264))
  
    Stream #0:1 -> #0:1 (pcm_f32le (native) -> vorbis (libvorbis))
  
  Press [q] to stop, [?] for help
  
  frame=  969 fps= 29 q=-1.0 Lsize=    6911kB time=00:00:34.80 bitrate=1626.8kbits/s    
  
  video:6475kB audio:396kB subtitle:0kB other streams:0kB global headers:4kB muxing overhead: 0.591309%
  
  [libx264 @ 0x7fca1390e000] frame I:4     Avg QP:15.77  size:1461092
  
  [libx264 @ 0x7fca1390e000] frame P:246   Avg QP:16.00  size:  2608
  
  [libx264 @ 0x7fca1390e000] frame B:719   Avg QP:13.91  size:   200
  
  [libx264 @ 0x7fca1390e000] consecutive B-frames:  0.9%  0.4%  0.0% 98.7%
  
  [libx264 @ 0x7fca1390e000] mb I  I16..4: 11.6% 43.3% 45.2%
  
  [libx264 @ 0x7fca1390e000] mb P  I16..4:  0.0%  0.0%  0.1%  P16..4:  0.4%  0.0%  0.0%  0.0%  0.0%    skip:99.5%
  
  [libx264 @ 0x7fca1390e000] mb B  I16..4:  0.0%  0.0%  0.0%  B16..8:  0.2%  0.0%  0.0%  direct: 0.0%  skip:99.8%  L0:39.9% L1:60.0% BI: 0.1%
  
  [libx264 @ 0x7fca1390e000] 8x8 transform intra:41.6% inter:38.8%
  
  [libx264 @ 0x7fca1390e000] coded y,uvDC,uvAC intra: 76.9% 77.9% 75.5% inter: 0.0% 0.1% 0.0%
  
  [libx264 @ 0x7fca1390e000] i16 v,h,dc,p: 51% 34% 11%  4%
  
  [libx264 @ 0x7fca1390e000] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 22% 17% 19%  7%  4%  3%  8%  5% 16%
  
  [libx264 @ 0x7fca1390e000] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 21% 24% 10%  7%  6%  5%  8%  7% 12%
  
  [libx264 @ 0x7fca1390e000] i8c dc,h,v,p: 59% 14% 18%  9%
  
  [libx264 @ 0x7fca1390e000] Weighted P-Frames: Y:0.0% UV:0.0%
  
  [libx264 @ 0x7fca1390e000] ref P L0: 71.5%  3.4% 13.0% 12.1%
  
  [libx264 @ 0x7fca1390e000] ref B L0: 46.6% 52.3%  1.1%
  
  [libx264 @ 0x7fca1390e000] ref B L1: 95.1%  4.9%
  
  [libx264 @ 0x7fca1390e000] kb/s:1525.48

  and Screen 1 :

  User@User-MacBook-Pro:~/test$ ffmpeg -f avfoundation -i "2:0" out.mkv
  
  ffmpeg version 2.8.4 Copyright (c) 2000-2015 the FFmpeg developers
  
    built with Apple LLVM version 7.0.2 (clang-700.1.81)
  
    configuration: --prefix=/usr/local/Cellar/ffmpeg/2.8.4 --enable-shared --enable-pthreads --enable-gpl --enable-version3 --enable-hardcoded-tables --enable-avresample --cc=clang --host-cflags= --host-ldflags= --enable-opencl --enable-libx264 --enable-libmp3lame --enable-libvo-aacenc --enable-libxvid --enable-libfreetype --enable-libtheora --enable-libvorbis --enable-libvpx --enable-librtmp --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libass --enable-ffplay --enable-libspeex --enable-libschroedinger --enable-libfdk-aac --enable-libopus --enable-frei0r --enable-libopenjpeg --disable-decoder=jpeg2000 --extra-cflags=-I/usr/local/Cellar/openjpeg/1.5.2_1/include/openjpeg-1.5 --enable-nonfree --enable-vda
  
    libavutil      54. 31.100 / 54. 31.100
  
    libavcodec     56. 60.100 / 56. 60.100
  
    libavformat    56. 40.101 / 56. 40.101
  
    libavdevice    56.  4.100 / 56.  4.100
  
    libavfilter     5. 40.101 /  5. 40.101
  
    libavresample   2.  1.  0 /  2.  1.  0
  
    libswscale      3.  1.101 /  3.  1.101
  
    libswresample   1.  2.101 /  1.  2.101
  
    libpostproc    53.  3.100 / 53.  3.100
  
  [avfoundation @ 0x7fc2e900da00] Selected pixel format (yuv420p) is not supported by the input device.
  
  [avfoundation @ 0x7fc2e900da00] Supported pixel formats:
  
  [avfoundation @ 0x7fc2e900da00]   uyvy422
  
  [avfoundation @ 0x7fc2e900da00]   yuyv422
  
  [avfoundation @ 0x7fc2e900da00]   nv12
  
  [avfoundation @ 0x7fc2e900da00]   0rgb
  
  [avfoundation @ 0x7fc2e900da00]   bgr0
  
  [avfoundation @ 0x7fc2e900da00] Overriding selected pixel format to use uyvy422 instead.
  
  [avfoundation @ 0x7fc2e900da00] Stream #0: not enough frames to estimate rate; consider increasing probesize
  
  Input #0, avfoundation, from '2:0':
  
    Duration: N/A, start: 11809.126333, bitrate: 2822 kb/s
  
      Stream #0:0: Video: rawvideo (UYVY / 0x59565955), uyvy422, 2560x1080, 1000k tbr, 1000k tbn, 1000k tbc
  
      Stream #0:1: Audio: pcm_f32le, 44100 Hz, stereo, flt, 2822 kb/s
  
  File 'out.mkv' already exists. Overwrite ? [y/N] y
  
  No pixel format specified, yuv422p for H.264 encoding chosen.
  
  Use -pix_fmt yuv420p for compatibility with outdated media players.
  
  [libx264 @ 0x7fc2ea82ac00] MB rate (10880000000) > level limit (2073600)
  
  [libx264 @ 0x7fc2ea82ac00] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 AVX2 LZCNT BMI2
  
  [libx264 @ 0x7fc2ea82ac00] profile High 4:2:2, level 5.2, 4:2:2 8-bit
  
  [libx264 @ 0x7fc2ea82ac00] 264 - core 148 r2601 a0cd7d3 - H.264/MPEG-4 AVC codec - Copyleft 2003-2015 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
  
  Output #0, matroska, to 'out.mkv':
  
    Metadata:
  
      encoder         : Lavf56.40.101
  
      Stream #0:0: Video: h264 (libx264) (H264 / 0x34363248), yuv422p, 2560x1080, q=-1--1, 1000k fps, 1k tbn, 1000k tbc
  
      Metadata:
  
        encoder         : Lavc56.60.100 libx264
  
      Stream #0:1: Audio: vorbis (libvorbis) (oV[0][0] / 0x566F), 44100 Hz, stereo, fltp
  
      Metadata:
  
        encoder         : Lavc56.60.100 libvorbis
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (rawvideo (native) -> h264 (libx264))
  
    Stream #0:1 -> #0:1 (pcm_f32le (native) -> vorbis (libvorbis))
  
  Press [q] to stop, [?] for help
  
  frame=  755 fps= 30 q=-1.0 Lsize=    1025kB time=00:00:26.65 bitrate= 315.1kbits/s    
  
  video:680kB audio:326kB subtitle:0kB other streams:0kB global headers:4kB muxing overhead: 2.003084%
  
  [libx264 @ 0x7fc2ea82ac00] frame I:4     Avg QP:13.22  size:145661
  
  [libx264 @ 0x7fc2ea82ac00] frame P:191   Avg QP:19.87  size:   250
  
  [libx264 @ 0x7fc2ea82ac00] frame B:560   Avg QP:28.31  size:   116
  
  [libx264 @ 0x7fc2ea82ac00] consecutive B-frames:  1.1%  0.0%  0.4% 98.5%
  
  [libx264 @ 0x7fc2ea82ac00] mb I  I16..4: 54.5% 29.2% 16.2%
  
  [libx264 @ 0x7fc2ea82ac00] mb P  I16..4:  0.2%  0.1%  0.0%  P16..4:  0.1%  0.0%  0.0%  0.0%  0.0%    skip:99.6%
  
  [libx264 @ 0x7fc2ea82ac00] mb B  I16..4:  0.0%  0.0%  0.0%  B16..8:  0.3%  0.0%  0.0%  direct: 0.0%  skip:99.7%  L0:69.2% L1:30.8% BI: 0.0%
  
  [libx264 @ 0x7fc2ea82ac00] 8x8 transform intra:31.7% inter:13.1%
  
  [libx264 @ 0x7fc2ea82ac00] coded y,uvDC,uvAC intra: 10.9% 8.8% 8.5% inter: 0.0% 0.0% 0.0%
  
  [libx264 @ 0x7fc2ea82ac00] i16 v,h,dc,p: 69% 31%  0%  0%
  
  [libx264 @ 0x7fc2ea82ac00] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 27%  5% 67%  0%  0%  0%  0%  0%  0%
  
  [libx264 @ 0x7fc2ea82ac00] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 38% 25% 14%  3%  3%  4%  5%  4%  5%
  
  [libx264 @ 0x7fc2ea82ac00] i8c dc,h,v,p: 92%  3%  4%  0%
  
  [libx264 @ 0x7fc2ea82ac00] Weighted P-Frames: Y:0.0% UV:0.0%
  
  [libx264 @ 0x7fc2ea82ac00] ref P L0: 76.3%  1.7% 16.8%  5.2%
  
  [libx264 @ 0x7fc2ea82ac00] ref B L0: 38.9% 56.9%  4.2%
  
  [libx264 @ 0x7fc2ea82ac00] ref B L1: 97.3%  2.7%
  
  [libx264 @ 0x7fc2ea82ac00] kb/s:208.84

  EDIT

  The main differences between the two (lengthy) outputs above via

  wdiff -n output1 output2 |colordiff

  is the resolution ([-2880x1800,-] {+2560x1080,+}) and the resulting MB rate ([-(20340000000)-] {+(10880000000)+}). So, what could increase the performance of ffmpeg ?

• How to 'convert' MP3 file to numpy array or list

  30 mai 2021, par Ajayi Olamide

  I'm working on an audio-related project that connects with Django backend via rest api. Part of the front-end requires to display waveforms of associated mp3 files and for this, it in turn requires optimized data of each mp3 file in form of an array, which the front-end (javascript) then processes and converts to a waveform. I can pick the associated mp3 file from backend storage, the problem is converting it into an array which I can serve to the front-end api. I have tried several methods but none seem to be working. I tried this How to read a MP3 audio file into a numpy array / save a numpy array to MP3 ? which leaves my computer hanging until I forced it to restart by holding the power button down. I have a working ffmpeg and so, I have also tried this Trying to convert an mp3 file to a Numpy Array, and ffmpeg just hangs which continues to raise TypeError on np.fromstring(data[data.find("data")+4:], np.int16). I can't actually say what the problem is and I really hope someone can help. Thank you in advance !

  


  EDIT
This is the django view for retrieving the waveform data :

  


  NB : I've only included useful codes as I'm typing with my mobile phone.

  


  def waveform(self, request, ptype, id):
    project = Project.objects.get(pk=id)
    audio = project.audio

    mp3_path = os.path.join(cdn_dir, audio) 
    cmd = ['ffmpeg', '-i', mp3_path, '-f', 'wav', '-']
    p = Popen(cmd, stdin=PIPE, stdout=PIPE, stderr=PIPE, creationflags=0x8000000)
    data = p.communicate()[0]
    array = np.fromstring(data[data.find("data")+4:], np.int16)

    return Response(array)


  


  The TypeError I get is this :
TypeError: argument should be integer or bytes-like object, not "str"

  


• imdct15 : remove the AArch64 assembly

  4 janvier 2017, par Rostislav Pehlivanov

  imdct15 : remove the AArch64 assembly
  Prep work for the next commit, which will add a new FFT algorithm
  
  which makes the iMDCT over 3x faster than it is currently (standalone,
  
  the FFT is with some framesizes over 10x faster).
  The new FFT algorithm uses the already thouroughly SIMD’d power of two
  
  FFT which already has SIMD for AArch64, so users of that platform will
  
  still see an improvement.
  The previous FFT+SIMD was barely 2.5x faster than the C versions on these
  
  platforms.
  Signed-off-by : Rostislav Pehlivanov <atomnuker@gmail.com>
  

  • [DH] libavcodec/aarch64/Makefile
  • [DH] libavcodec/aarch64/imdct15_init.c
  • [DH] libavcodec/aarch64/imdct15_neon.S
  • [DH] libavcodec/imdct15.c
  • [DH] libavcodec/imdct15.h