Recherche avancée

Sur d’autres sites (12365)

• doc/platform : drop reference to ffmpeg.zeranoe.com

  28 mars 2023, par Stefano Sabatini

  doc/platform : drop reference to ffmpeg.zeranoe.com
  It was closed in September 2020.
  Fix issue :
  
  http://trac.ffmpeg.org/ticket/9734
  

  • [DH] doc/platform.texi

• Unable to open audio file on Heroku using Librosa

  15 mars 2020, par Rohan Bojja

  I have a feature extraction REST API written in Python using the Librosa library (Extracting audio features), it receives an audio file through HTTP POST and responds with a list of features(such as MFCC,etc).

  Since librosa depends on SoundFile (libsndfile1 / libsndfile-dev), it doesn’t support all the formats, I’m converting the audio file using ffmpeg-python wrapper (https://kkroening.github.io/ffmpeg-python/) .

  It works just fine on my Windows 10 machine with Conda, but when I deploy it on Heroku, the librosa.load() functions returns an unknown format error, no matter what format I convert it to. I have tried FLAC, AIFF and WAV.

  My first guess is that the converted format isn’t supported by libsndfile1, but it works on my local server (plus, their documentation says AIFF and WAV are supported), so I’m a little lost.

  I have attached all the relevant snippets of code below, I can provide anything extra if necessary. Any help is highly appreciated. Thanks.

  UPDATE1 :

  I am using pipes instead of writing and reading from disk, worth a mention as the question could be misleading otherwise.

  The log :

  File "/app/app.py", line 31, in upload
  
  x , sr = librosa.load(audioFile,mono=True,duration=5)
  
  File "/app/.heroku/python/lib/python3.6/site-packages/librosa/core/audio.py", line 164, in load
  
  six.reraise(*sys.exc_info())
  
  File "/app/.heroku/python/lib/python3.6/site-packages/six.py", line 703, in reraise
  
  raise value
  
  File "/app/.heroku/python/lib/python3.6/site-packages/librosa/core/audio.py", line 129, in load
  
  with sf.SoundFile(path) as sf_desc:
  
  File "/app/.heroku/python/lib/python3.6/site-packages/soundfile.py", line 629, in __init__
  
  self._file = self._open(file, mode_int, closefd)
  
  File "/app/.heroku/python/lib/python3.6/site-packages/soundfile.py", line 1184, in _open
  
  "Error opening {0!r}: ".format(self.name))
  
  File "/app/.heroku/python/lib/python3.6/site-packages/soundfile.py", line 1357, in _error_check
  
  raise RuntimeError(prefix + _ffi.string(err_str).decode('utf-8', 'replace'))
  
  RuntimeError: Error opening <_io.BytesIO object at 0x7f46ad28beb8>: File contains data in an unknown format.
  
  10.69.244.94 - - [15/Mar/2020:12:37:28 +0000] "POST /receiveWav HTTP/1.1" 500 290 "-" "curl/7.55.1"

  Flask/Librosa code deployed on Heroku (app.py) :

  from flask import Flask, jsonify, request
  
  import scipy.optimize
  
  import os,pickle
  
  import numpy as np
  
  from sklearn.preprocessing import StandardScaler
  
  import librosa
  
  import logging
  
  import soundfile as sf
  
  from pydub import AudioSegment
  
  import subprocess as sp
  
  import ffmpeg
  
  from io import BytesIO
  
  
  
  logging.basicConfig(level=logging.DEBUG)
  
  
  
  app = Flask(__name__) 
  
  
  
  @app.route('/receiveWav',methods = ['POST'])
  
  def upload():
  
      if(request.method == 'POST'):
  
          f = request.files['file']
  
          app.logger.info(f'AUDIO FORMAT\n\n\n\n\n\n\n\n\n\n: {f}')
  
          proc = (
  
              ffmpeg.input('pipe:')
  
              .output('pipe:', format='aiff')
  
              .run_async(pipe_stdin=True,pipe_stdout=True, pipe_stderr=True)
  
          )
  
          audioFile,err = proc.communicate(input=f.read())
  
          audioFile =  BytesIO(audioFile)
  
          scaler = pickle.load(open("scaler.ok","rb"))
  
          x , sr = librosa.load(audioFile,mono=True,duration=5)
  
          y=x
  
          #Extract the features
  
          chroma_stft = librosa.feature.chroma_stft(y=y, sr=sr)
  
          spec_cent = librosa.feature.spectral_centroid(y=y, sr=sr)
  
          spec_bw = librosa.feature.spectral_bandwidth(y=y, sr=sr)
  
          rolloff = librosa.feature.spectral_rolloff(y=y, sr=sr)
  
          zcr = librosa.feature.zero_crossing_rate(y)
  
          rmse = librosa.feature.rms(y=y)
  
          mfcc = librosa.feature.mfcc(y=y, sr=sr)
  
          features = f'{np.mean(chroma_stft)} {np.mean(rmse)} {np.mean(spec_cent)} {np.mean(spec_bw)} {np.mean(rolloff)} {np.mean(zcr)}'    
  
          for e in mfcc:
  
              features += f' {np.mean(e)}'
  
          input_data2 = np.array([float(i) for i in features.split(" ")]).reshape(1,-1)
  
          input_data2 = scaler.transform(input_data2)
  
          return jsonify(input_data2.tolist())
  
  
  
  # driver function 
  
  if __name__ == '__main__':   
  
      app.run(debug = True) 

  Aptfile :

  libsndfile1
  
  libsndfile-dev
  
  libav-tools
  
  libavcodec-extra-53 
  
  libavcodec-extra-53
  
  ffmpeg 

  requirements.txt :

  aniso8601==8.0.0
  
  audioread==2.1.8
  
  certifi==2019.11.28
  
  cffi==1.14.0
  
  Click==7.0
  
  decorator==4.4.2
  
  ffmpeg-python==0.2.0
  
  Flask==1.1.1
  
  Flask-RESTful==0.3.8
  
  future==0.18.2
  
  gunicorn==20.0.4
  
  itsdangerous==1.1.0
  
  Jinja2==2.11.1
  
  joblib==0.14.1
  
  librosa==0.7.2
  
  llvmlite==0.31.0
  
  MarkupSafe==1.1.1
  
  marshmallow==3.2.2
  
  numba==0.48.0
  
  numpy==1.18.1
  
  pycparser==2.20
  
  pydub==0.23.1
  
  pytz==2019.3
  
  resampy==0.2.2
  
  scikit-learn==0.22.2.post1
  
  scipy==1.4.1
  
  six==1.14.0
  
  SoundFile==0.10.3.post1
  
  Werkzeug==1.0.0
  
  wincertstore==0.2

• VLC Player shows broken HLS stream with 4k HDR10 mkv

  8 avril 2023, par goodkid38

  I am trying to convert a 4k mkv to an HLS stream but I am not having any luck. I have tried a few ffmpeg commands to try and fix the issue but none have worked. Here are the commands I have tried.

  


  

  1. Basic copy command :

  


  


  ffmpeg -i "video.mkv" -c copy -f hls "plexTemp/out.m3u8"

  


  

  2. Command used to see if it was an HDR color issue :

  


  


  ffmpeg -i "video.mkv" -c copy -pix_fmt yuv420p10le -f hls "plexTemp/out.m3u8"
3. Command used to revert to 8 bit color :

  


  ffmpeg -i "video.mkv" -c copy -pix_fmt yuv420p -f hls "plexTemp/out.m3u8"

  


  

  4. I tried removing extra streams and just focusing on audio and video :

  


  


  ffmpeg -i "out.mkv" -map 0:v:0 -map 0:a:1 -c copy -pix_fmt yuv420p10le -f hls "plexTemp/out.m3u8"

  


  I also saw these warnings when running each command.Stream HEVC is not hvc1, you should use tag:v hvc1 to set it.
And this

  


  [matroska,webm @ 000001d7921803c0] Stream #12: not enough frames to estimate rate; consider increasing probesize
[matroska,webm @ 000001d7921803c0] Could not find codec parameters for stream 6 (Subtitle: hdmv_pgs_subtitle (pgssub)): unspecified size
Consider increasing the value for the 'analyzeduration' (0) and 'probesize' (5000000) options
[matroska,webm @ 000001d7921803c0] Could not find codec parameters for stream 7 (Subtitle: hdmv_pgs_subtitle (pgssub)): unspecified size
Consider increasing the value for the 'analyzeduration' (0) and 'probesize' (5000000) options
[matroska,webm @ 000001d7921803c0] Could not find codec parameters for stream 8 (Subtitle: hdmv_pgs_subtitle (pgssub)): unspecified size
Consider increasing the value for the 'analyzeduration' (0) and 'probesize' (5000000) options
[matroska,webm @ 000001d7921803c0] Could not find codec parameters for stream 9 (Subtitle: hdmv_pgs_subtitle (pgssub)): unspecified size
Consider increasing the value for the 'analyzeduration' (0) and 'probesize' (5000000) options
[matroska,webm @ 000001d7921803c0] Could not find codec parameters for stream 10 (Subtitle: hdmv_pgs_subtitle (pgssub)): unspecified size
Consider increasing the value for the 'analyzeduration' (0) and 'probesize' (5000000) options
[matroska,webm @ 000001d7921803c0] Could not find codec parameters for stream 11 (Subtitle: hdmv_pgs_subtitle (pgssub)): unspecified size
Consider increasing the value for the 'analyzeduration' (0) and 'probesize' (5000000) options


  


  So I tried increasing the analyzeduration and probesize and adding the tag like so :
ffmpeg -analyzeduration 10000000 -probesize 10000000 -i "out.mkv" -c copy -tag:v hvc1 -f hls "plexTemp/out.m3u8"

  


  To no avail. Here is what the output looks like on VLC. It's mostly black with a few lines of color that randomly change.

  


  On my TV I see this :

  


  

  


  One thing I see that stands out in ffmpegs output is this :

  


  [hls @ 00000207239a9ec0] Opening 'plexTemp/out0.ts' for writing7 bitrate=  -0.0kbits/s speed=N/A
[hls @ 00000207239a9ec0] Opening 'plexTemp/out.m3u8.tmp' for writing


  


  Here is the audio and video info on the mkv :

  


  General
Unique ID                                : 92280908398971492516286250889389584022 (0x456CA80EF29B1357B572719D6EC4AE96)
Complete name                            : I:\video.mkv
Format                                   : Matroska
Format version                           : Version 2
File size                                : 49.4 GiB
Duration                                 : 1 h 39 min
Overall bit rate mode                    : Variable
Overall bit rate                         : 71.2 Mb/s
Frame rate                               : 23.976 FPS
Movie name                               : video
Encoded date                             : 2023-04-06 22:39:53 UTC
Writing application                      : MakeMKV v1.16.7 win(x64-release)
Writing library                          : libmakemkv v1.16.7 (1.3.10/1.5.2) win(x64-release)
Cover                                    : Yes
Attachments                              : cover.jpg

Video
ID                                       : 1
ID in the original source medium         : 4113 (0x1011)
Format                                   : HEVC
Format/Info                              : High Efficiency Video Coding
Format profile                           : Main 10@L5.1@High
HDR format                               : SMPTE ST 2086, HDR10 compatible
Codec ID                                 : V_MPEGH/ISO/HEVC
Duration                                 : 1 h 39 min
Bit rate                                 : 63.6 Mb/s
Width                                    : 3 840 pixels
Height                                   : 2 160 pixels
Display aspect ratio                     : 16:9
Frame rate mode                          : Constant
Frame rate                               : 23.976 (24000/1001) FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0 (Type 2)
Bit depth                                : 10 bits
Bits/(Pixel*Frame)                       : 0.320
Stream size                              : 44.1 GiB (89%)
Writing library                          : ATEME Titan File 3.9.6 (4.9.6.2)        
Language                                 : English
Default                                  : No
Forced                                   : No
Color range                              : Limited
Color primaries                          : BT.2020
Transfer characteristics                 : PQ
Matrix coefficients                      : BT.2020 non-constant
Mastering display color primaries        : Display P3
Mastering display luminance              : min: 0.0050 cd/m2, max: 1000 cd/m2
Maximum Content Light Level              : 1000 cd/m2
Maximum Frame-Average Light Level        : 140 cd/m2
Original source medium                   : Blu-ray

Audio #1
ID                                       : 2
ID in the original source medium         : 4352 (0x1100)
Format                                   : DTS XLL X
Format/Info                              : Digital Theater Systems
Commercial name                          : DTS:X
Codec ID                                 : A_DTS
Duration                                 : 1 h 39 min
Bit rate mode                            : Variable
Bit rate                                 : 4 174 kb/s
Channel(s)                               : 8 channels
Channel layout                           : C L R LFE Lb Rb Lss Rss
Sampling rate                            : 48.0 kHz
Frame rate                               : 93.750 FPS (512 SPF)
Bit depth                                : 24 bits
Stream size                              : 2.89 GiB (6%)
Title                                    : Surround 7.1
Language                                 : English
Default                                  : Yes
Forced                                   : No
Original source medium                   : Blu-ray
Here is information on the HLS output:
General
Complete name                            : I:\out.m3u8
Format                                   : HLS
Format profile                           : Media
File size                                : 67.4 MiB
Duration                                 : 8 s 138 ms
Overall bit rate mode                    : Variable
Overall bit rate                         : 69.4 Mb/s
Frame rate                               : 23.976 FPS


  


  And my
Here is the output of my HLS stream :

  


  Video
ID                                       : 256 (0x100)
Menu ID                                  : 1 (0x1)
Format                                   : HEVC
Format/Info                              : High Efficiency Video Coding
Format profile                           : Main 10@L5.1@High
HDR format                               : SMPTE ST 2086, HDR10 compatible
Muxing mode                              : MPEG-TS
Codec ID                                 : 36
Duration                                 : 8 s 49 ms
Width                                    : 3 840 pixels
Height                                   : 2 160 pixels
Display aspect ratio                     : 16:9
Frame rate                               : 23.976 (24000/1001) FPS
Color space                              : YUV
Chroma subsampling                       : 4:2:0 (Type 2)
Bit depth                                : 10 bits
Writing library                          : ATEME Titan File 3.9.6 (4.9.6.2)        
Color range                              : Limited
Color primaries                          : BT.2020
Transfer characteristics                 : PQ
Matrix coefficients                      : BT.2020 non-constant
Mastering display color primaries        : Display P3
Mastering display luminance              : min: 0.0050 cd/m2, max: 1000 cd/m2
Maximum Content Light Level              : 1000 cd/m2
Maximum Frame-Average Light Level        : 140 cd/m2
Source                                   : out92.ts

Audio
ID                                       : 257 (0x101)
Menu ID                                  : 1 (0x1)
Format                                   : DTS XLL X
Format/Info                              : Digital Theater Systems
Commercial name                          : DTS:X
Muxing mode                              : MPEG-TS
Codec ID                                 : 130
Duration                                 : 8 s 138 ms
Bit rate mode                            : Variable
Channel(s)                               : 8 channels
Channel layout                           : C L R LFE Lb Rb Lss Rss
Sampling rate                            : 48.0 kHz
Frame rate                               : 93.750 FPS (512 SPF)
Bit depth                                : 24 bits
Delay relative to video                  : -125 ms
Language                                 : English
Source                                   : out92.ts