Recherche avancée

Sur d’autres sites (10231)

• lavc : Add support for RockChip Media Process Platform

  24 septembre 2017, par Lionel CHAZALLON

  lavc : Add support for RockChip Media Process Platform
  This adds hardware decoding for H.264 / HEVC / VP8 / VP9 using the MPP
  
  Rockchip API.  It returns frames holding an AVDRMFrameDescriptor struct
  
  in buf[0] that allows drm / dmabuf usage.  Tested on RK3288 (TinkerBoard)
  
  and RK3328.
  Signed-off-by : Mark Thompson <sw@jkqxz.net>
  

  • [DH] Changelog
  • [DH] configure
  • [DH] libavcodec/Makefile
  • [DH] libavcodec/allcodecs.c
  • [DH] libavcodec/rkmppdec.c
  • [DH] libavcodec/version.h

• How to 'convert' MP3 file to numpy array or list

  30 mai 2021, par Ajayi Olamide

  I'm working on an audio-related project that connects with Django backend via rest api. Part of the front-end requires to display waveforms of associated mp3 files and for this, it in turn requires optimized data of each mp3 file in form of an array, which the front-end (javascript) then processes and converts to a waveform. I can pick the associated mp3 file from backend storage, the problem is converting it into an array which I can serve to the front-end api. I have tried several methods but none seem to be working. I tried this How to read a MP3 audio file into a numpy array / save a numpy array to MP3 ? which leaves my computer hanging until I forced it to restart by holding the power button down. I have a working ffmpeg and so, I have also tried this Trying to convert an mp3 file to a Numpy Array, and ffmpeg just hangs which continues to raise TypeError on np.fromstring(data[data.find("data")+4:], np.int16). I can't actually say what the problem is and I really hope someone can help. Thank you in advance !

  


  EDIT
This is the django view for retrieving the waveform data :

  


  NB : I've only included useful codes as I'm typing with my mobile phone.

  


  def waveform(self, request, ptype, id):
    project = Project.objects.get(pk=id)
    audio = project.audio

    mp3_path = os.path.join(cdn_dir, audio) 
    cmd = ['ffmpeg', '-i', mp3_path, '-f', 'wav', '-']
    p = Popen(cmd, stdin=PIPE, stdout=PIPE, stderr=PIPE, creationflags=0x8000000)
    data = p.communicate()[0]
    array = np.fromstring(data[data.find("data")+4:], np.int16)

    return Response(array)


  


  The TypeError I get is this :
TypeError: argument should be integer or bytes-like object, not "str"

  


• ffmpeg : playing media files does not release processor after media ends ?

  2 septembre 2017, par Blake Senftner

  I have a commercial C++ application which uses FFMPEG’s libav series of dlls to play media in a Windows application. I basically started with the dranger tutorial about two years ago, and created a library that can playback USB cameras, IP camera / online streams, and media files on disk. (http://dranger.com/ffmpeg/)

  My question is directed at anyone who has created their own similar library :

  I recently noticed after playing a video file from disk (as opposed to a live stream from USB or IP source), my 8 core i7 workstation will show 28-29% CPU usage after a media file has ended. My application can play an unlimited number of videos, and each "virtual video panel" (not a window, just a "virtual tab" created using wxWidgets that holds an OpenGL context that I use to glDrawPixels() to the visible app panel) will play any of the three media types fine (USB, IP stream or media file) and when I stop a USB or IP stream my application’s CPU usage drops to zero. But when I "stop" a media file playing or the media file ends on its own the CPU usage does not drop - until the application quits.

  Three media files playing will take my application to 80-83% CPU, and it never drops. UNLESS I reuse that same "virtual video panel" to play a USB or IP stream. If I stop those streams, CPU usage is released.

  MP4 (h264) video files exhibit this "holding a processor" problem.

  MP4 (mpeg2) files do not.

  MP4 (h265) files do not.

  MPG (mpeg1) files do not.

  ASF (MS MPEG-4 Video v3) files do not.

  MKV (vp8) files do not.

  MOV files using h265 do not, as well as MOV (h264) files do not.

  FLV (sorensen) files do not, as well as FLV (h264) files do not.

  So it is not just the h264 codec.

  Anyone know what is going on, and how I tell libav to release CPU usage when a media file is no longer playing ?