Recherche avancée

Sur d’autres sites (9886)

• ffmpeg azure function consumption plan low CPU availability for high volume requests

  27 novembre 2017, par The Lemon

  I am running an azure queue function on a consumption plan ; my function starts an FFMpeg process and accordingly is very CPU intensive. When I run the function with less than 100 items in the queue at once it works perfectly, azure scales up and gives me plenty of servers and all of the tasks complete very quickly. My problem is once I start doing more than 300 or 400 items at once, it starts fine but after a while the CPU slowly goes from 80% utilisation to only around 10% utilisation - my functions cant finish in time with only 10% CPU. This can be seen in the image shown below.
  Does anyone know why the CPU useage is going lower the more instances my function creates ? Thanks in advance Cuan

  edit : the function is set to only run one at a time per instance, but the problem exists when set to 2 or 3 concurrent processes per instance in the host.json

  edit : the CPU drops get noticeable at 15-20 servers, and start causing failures at around 60. After that the CPU bottoms out at an average of 8-10% with individuals reaching 0-3%, and the server count seems to increase without limit (which would be more helpful if I got some CPU with the servers)

  Thanks again, Cuan.

  I’ve also added the function code to the bottom of this post in case it helps.

  

  

  using System.Net;
  
  using System;
  
  using System.Diagnostics;
  
  using System.ComponentModel;
  
  
  
  public static void Run(string myQueueItem, TraceWriter log)
  
  {
  
      log.Info($"C# Queue trigger function processed a request: {myQueueItem}");
  
      //Basic Parameters
  
          string ffmpegFile = @"D:\home\site\wwwroot\CommonResources\ffmpeg.exe";
  
          string outputpath = @"D:\home\site\wwwroot\queue-ffmpeg-test\output\";
  
          string reloutputpath = "output/";
  
          string relinputpath = "input/";
  
          string outputfile = "video2.mp4";
  
          string dir =  @"D:\home\site\wwwroot\queue-ffmpeg-test\";
  
  
  
      //Special Parameters
  
  
  
          string videoFile = "1 minute basic.mp4";
  
          string sub = "1 minute sub.ass";
  
      //guid tmp files
  
  
  
          // Guid g1=Guid.NewGuid();
  
          // Guid g2=Guid.NewGuid();
  
          // string f1 = g1 + ".mp4";
  
          // string f2 = g2 + ".ass";
  
          string f1 = videoFile;
  
          string f2 = sub;
  
      //guid output - we will now do this at the caller level
  
          string g3 = myQueueItem;
  
          string outputGuid = g3+".mp4";
  
      //get input files
  
      //argument
  
          string tmp = subArg(f1, f2, outputGuid );
  
      //String.Format("-i \"" + @"input/tmp.mp4" + "\" -vf \"ass = '" + sub + "'\" \"" + reloutputpath +outputfile + "\" -y");
  
      log.Info("ffmpeg argument is: "+tmp);
  
  
  
  
  
      //startprocess parameters
  
      Process process = new Process();
  
      process.StartInfo.FileName = ffmpegFile;
  
      process.StartInfo.Arguments =  tmp;
  
      process.StartInfo.UseShellExecute = false;
  
      process.StartInfo.RedirectStandardOutput = true;
  
      process.StartInfo.RedirectStandardError = true;
  
      process.StartInfo.WorkingDirectory = dir;
  
      //output handler
  
  
  
      process.OutputDataReceived += new DataReceivedEventHandler(
  
          (s, e) => 
  
          { 
  
              log.Info("O: "+e.Data);
  
          }
  
      );
  
      process.ErrorDataReceived += new DataReceivedEventHandler(
  
          (s, e) => 
  
          { 
  
              log.Info("E: "+e.Data);
  
          }
  
      );
  
      //start process
  
      process.Start();
  
      log.Info("process started");
  
      process.BeginOutputReadLine();
  
      process.BeginErrorReadLine();
  
      process.WaitForExit();
  
  }
  
  public static void getFile(string link, string fileName, string dir, string relInputPath){
  
      using (var client = new WebClient()){
  
          client.DownloadFile(link, dir + relInputPath+ fileName);
  
          }
  
  
  
  }
  
  public static string subArg(string input1, string input2, string output1){
  
      return String.Format("-i \"" + @"input/" +input1+ "\" -vf \"ass = '" + @"input/"+input2 + "'\" \"" + @"output/" +output1 + "\" -y");
  
  
  
  }

• x86 : Remove some legacy CPU detection hacks

  11 octobre 2017, par Henrik Gramner

  x86 : Remove some legacy CPU detection hacks
  Some ancient Pentium-M and Core 1 CPU:s had slow SSE units, and using MMX
  
  was preferable. Nowadays many assembly functions in x264 completely lack MMX
  
  implementations and falling back to C code will likely make things worse.
  Some misconfigured virtualized systems could sometimes also trigger this code
  
  path and cause assertions.
  

  • [DH] common/cpu.c

• Cannot play local RTP stream

  24 janvier 2020, par gdogg371

  I have been struggling along with this issue now for a while, but am making good progress. I now have a 4k transport stream running using the below command line arguments for VLC :

  vlc --ffmpeg-hw --avcodec-hw=any dshow:// :dshow-vdev="Video (00 Pro Capture HDMI 4K+)" :dshow-adev="Audio (2- 00 Pro Capture HDMI 4K+)" :dshow-threads=8 :dshow-aspect-ratio=16\:9 :dshow-size="3840x2160" :dshow-pixel_format=yuv444p16le :dshow-tune=film :dshow-preset=lossless :dshow-profile=main10 show-vcodec=hevc_nvenc :dshow-fps=50 :dshow-crf=0 :dshow-acodec=mp4a :dshow-stereo-mode=5 :dshow-force-surround-sound=0 :dshow-ab=128 :dshow-samplerate=44100 :no-dshow-config :live-caching=3000 --sout "#transcode{venc=ffmpeg,vcodec=mpgv,threads=8,aspect=16:9,width=3840,height=2160,fps=50,acodec=a52,ab=1500,channels=6,samplerate=48000,soverlay}:rtp{dst=239.255.0.1,port=5004,mux=ts}"

  I can access the rtp stream on the same PC as I am running the stream from with the below :

  vlc -vvv rtp://@239.255.0.1:5004

  However, if I try the same commands on a different computer, connected via Ethernet to the same network, the client VLC session just hangs. I have included the log below with the verbosity set to debug. Can anyone spot anything in here suggesting why the stream won’t play ?

  -- logger module started --
  
  main debug: VLC media player - 3.0.8 Vetinari
  
  main debug: Copyright © 1996-2019 the VideoLAN team
  
  main debug: revision 3.0.8-0-gf350b6b5a7
  
  main debug: configured with ../extras/package/win32/../../../configure  '--enable-update-check' '--enable-lua' '--enable-faad' '--enable-flac' '--enable-theora' '--enable-avcodec' '--enable-merge-ffmpeg' '--enable-dca' '--enable-mpc' '--enable-libass' '--enable-schroedinger' '--enable-realrtsp' '--enable-live555' '--enable-dvdread' '--enable-shout' '--enable-goom' '--enable-caca' '--enable-qt' '--enable-skins2' '--enable-sse' '--enable-mmx' '--enable-libcddb' '--enable-zvbi' '--disable-telx' '--enable-nls' '--host=x86_64-w64-mingw32' '--with-breakpad=https://win.crashes.videolan.org' 'host_alias=x86_64-w64-mingw32' 'PKG_CONFIG_LIBDIR=/home/jenkins/workspace/vlc-release/windows/vlc-release-win32-x64/contrib/x86_64-w64-mingw32/lib/pkgconfig'
  
  main debug: using multimedia timers as clock source
  
  main debug:  min period: 1 ms, max period: 1000000 ms
  
  main debug: searching plug-in modules
  
  main debug: loading plugins cache file D:\VLC\plugins\plugins.dat
  
  main debug: recursively browsing `D:\VLC\plugins'
  
  main error: stale plugins cache: modified D:\VLC\plugins\access\libaccess_concat_plugin.dll
  
  main error: stale plugins cache: modified D:\VLC\plugins\access\libaccess_imem_plugin.dll
  
  ....
  
  ....
  
  ....
  
  main error: stale plugins cache: modified D:\VLC\plugins\visualization\libgoom_plugin.dll
  
  main error: stale plugins cache: modified D:\VLC\plugins\visualization\libprojectm_plugin.dll
  
  main error: stale plugins cache: modified D:\VLC\plugins\visualization\libvisual_plugin.dll
  
  main debug: plug-ins loaded: 494 modules
  
  main debug: opening config file (C:\Users\cg371\AppData\Roaming\vlc\vlcrc)
  
  main debug: looking for logger module matching "any": 2 candidates
  
  file debug: opening logfile `D:\VLC\Log.txt'
  
  main debug: using logger module "file"
  
  main debug: translation test: code is "en_GB"
  
  main debug: looking for keystore module matching "memory": 3 candidates
  
  main debug: using keystore module "memory"
  
  main debug: CPU has capabilities MMX MMXEXT SSE SSE2 SSE3 SSSE3 SSE4.1 SSE4.2 FPU 
  
  main debug: Creating an input for 'Media Library'
  
  main debug: Input is a meta file: disabling unneeded options
  
  main debug: using timeshift granularity of 50 MiB
  
  main debug: using timeshift path: C:\Users\cg371\AppData\Local\Temp
  
  main debug: `file/directory:///C:/Users/cg371/AppData/Roaming/vlc/ml.xspf' gives access `file' demux `directory' path `/C:/Users/cg371/AppData/Roaming/vlc/ml.xspf'
  
  main debug: creating demux: access='file' demux='directory' location='/C:/Users/cg371/AppData/Roaming/vlc/ml.xspf' file='C:\Users\cg371\AppData\Roaming\vlc\ml.xspf'
  
  main debug: looking for access_demux module matching "file": 15 candidates
  
  main debug: no access_demux modules matched
  
  main debug: creating access: file:///C:/Users/cg371/AppData/Roaming/vlc/ml.xspf
  
  main debug:  (path: C:\Users\cg371\AppData\Roaming\vlc\ml.xspf)
  
  main debug: looking for access module matching "file": 26 candidates
  
  main debug: using access module "filesystem"
  
  main debug: looking for stream_filter module matching "prefetch,cache_read": 24 candidates
  
  cache_read debug: Using stream method for AStream*
  
  cache_read debug: starting pre-buffering
  
  cache_read debug: received first data after 1 ms
  
  cache_read debug: pre-buffering done 304 bytes in 0s - 296 KiB/s
  
  main debug: using stream_filter module "cache_read"
  
  main debug: looking for stream_filter module matching "any": 24 candidates
  
  playlist debug: using XSPF playlist reader
  
  main debug: using stream_filter module "playlist"
  
  main debug: stream filter added to 00000266f6927700
  
  main debug: looking for stream_filter module matching "any": 24 candidates
  
  main debug: no stream_filter modules matched
  
  main debug: looking for stream_directory module matching "any": 1 candidates
  
  main debug: no stream_directory modules matched
  
  main debug: attachment of directory-extractor failed for file:///C:/Users/cg371/AppData/Roaming/vlc/ml.xspf
  
  main debug: looking for stream_filter module matching "record": 24 candidates
  
  main debug: using stream_filter module "record"
  
  main debug: creating demux: access='file' demux='directory' location='/C:/Users/cg371/AppData/Roaming/vlc/ml.xspf' file='C:\Users\cg371\AppData\Roaming\vlc\ml.xspf'
  
  main debug: looking for demux module matching "directory": 55 candidates
  
  main debug: using demux module "directory"
  
  main debug: looking for meta reader module matching "any": 2 candidates
  
  lua debug: Trying Lua scripts in C:\Users\cg371\AppData\Roaming\vlc\lua\meta\reader
  
  lua debug: Trying Lua scripts in D:\VLC\lua\meta\reader
  
  lua debug: Trying Lua playlist script D:\VLC\lua\meta\reader\filename.luac
  
  main debug: no meta reader modules matched
  
  main debug: `file/directory:///C:/Users/cg371/AppData/Roaming/vlc/ml.xspf' successfully opened
  
  main debug: looking for xml reader module matching "any": 1 candidates
  
  main debug: using xml reader module "xml"
  
  main debug: EOF reached
  
  main debug: removing module "directory"
  
  main debug: removing module "record"
  
  main debug: removing module "playlist"
  
  main debug: removing module "cache_read"
  
  main debug: removing module "filesystem"
  
  main debug: creating audio output
  
  main debug: looking for audio output module matching "any": 6 candidates
  
  mmdevice debug: using default device
  
  mmdevice debug: display name changed: VLC media player (LibVLC 3.0.8)
  
  mmdevice debug: version 2 session control unavailable
  
  mmdevice debug: volume from -65.250000 dB to +0.000000 dB with 0.031250 dB increments
  
  main debug: using audio output module "mmdevice"
  
  main debug: keeping audio output
  
  main debug: looking for interface module matching "hotkeys,none": 16 candidates
  
  main debug: using interface module "hotkeys"
  
  main debug: looking for interface module matching "globalhotkeys,none": 16 candidates
  
  main debug: using interface module "win32"
  
  main: Running vlc with the default interface. Use 'cvlc' to use vlc without interface.
  
  main debug: looking for interface module matching "any": 16 candidates
  
  main debug: looking for extension module matching "any": 1 candidates
  
  lua debug: Opening Lua Extension module
  
  lua debug: Trying Lua scripts in C:\Users\cg371\AppData\Roaming\vlc\lua\extensions
  
  lua debug: Trying Lua scripts in D:\VLC\lua\extensions
  
  lua debug: Trying Lua playlist script D:\VLC\lua\extensions\VLSub.luac
  
  lua debug: Scanning Lua script D:\VLC\lua\extensions\VLSub.luac
  
  lua debug: Script D:\VLC\lua\extensions\VLSub.luac has the following capability flags: 0x5
  
  main debug: using extension module "lua"
  
  main debug: using interface module "qt"
  
  main debug: processing request item: null, node: Playlist, skip: 0
  
  main debug: rebuilding array of current - root Playlist
  
  main debug: rebuild done - 1 items, index -1
  
  main debug: starting playback of new item
  
  main debug: resyncing on rtp://239.255.0.1:5004
  
  main debug: rtp://239.255.0.1:5004 is at 0
  
  main debug: creating new input thread
  
  main debug: Creating an input for 'rtp://239.255.0.1:5004'
  
  main debug: requesting art for new input thread
  
  main debug: using timeshift granularity of 50 MiB
  
  main debug: using timeshift path: C:\Users\cg371\AppData\Local\Temp
  
  main debug: `rtp://@239.255.0.1:5004' gives access `rtp' demux `any' path `@239.255.0.1:5004'
  
  main debug: creating demux: access='rtp' demux='any' location='@239.255.0.1:5004' file='\\@239.255.0.1:5004'
  
  main debug: looking for access_demux module matching "rtp": 15 candidates
  
  main debug: net: opening 239.255.0.1 datagram port 5004
  
  qt debug: IM: Setting an input
  
  main debug: looking for meta fetcher module matching "any": 1 candidates
  
  lua debug: Trying Lua scripts in C:\Users\cg371\AppData\Roaming\vlc\lua\meta\fetcher
  
  lua debug: Trying Lua scripts in D:\VLC\lua\meta\fetcher
  
  main debug: no meta fetcher modules matched
  
  main debug: looking for art finder module matching "any": 2 candidates
  
  lua debug: Trying Lua scripts in C:\Users\cg371\AppData\Roaming\vlc\lua\meta\art
  
  lua debug: Trying Lua scripts in D:\VLC\lua\meta\art
  
  lua debug: Trying Lua playlist script D:\VLC\lua\meta\art\00_musicbrainz.luac
  
  lua debug: skipping script (unmatched scope) D:\VLC\lua\meta\art\00_musicbrainz.luac
  
  lua debug: Trying Lua playlist script D:\VLC\lua\meta\art\01_googleimage.luac
  
  lua debug: skipping script (unmatched scope) D:\VLC\lua\meta\art\01_googleimage.luac
  
  lua debug: Trying Lua playlist script D:\VLC\lua\meta\art\02_frenchtv.luac
  
  lua debug: skipping script (unmatched scope) D:\VLC\lua\meta\art\02_frenchtv.luac
  
  lua debug: Trying Lua playlist script D:\VLC\lua\meta\art\03_lastfm.luac
  
  main debug: using access_demux module "rtp"
  
  main debug: looking for meta reader module matching "any": 2 candidates
  
  lua debug: Trying Lua scripts in C:\Users\cg371\AppData\Roaming\vlc\lua\meta\reader
  
  lua debug: Trying Lua scripts in D:\VLC\lua\meta\reader
  
  lua debug: Trying Lua playlist script D:\VLC\lua\meta\reader\filename.luac
  
  lua debug: skipping script (unmatched scope) D:\VLC\lua\meta\art\03_lastfm.luac
  
  main debug: no art finder modules matched
  
  main debug: no meta reader modules matched
  
  main debug: `rtp://@239.255.0.1:5004' successfully opened
  
  main debug: looking for meta fetcher module matching "any": 1 candidates
  
  lua debug: Trying Lua scripts in C:\Users\cg371\AppData\Roaming\vlc\lua\meta\fetcher
  
  lua debug: Trying Lua scripts in D:\VLC\lua\meta\fetcher
  
  main debug: no meta fetcher modules matched
  
  main debug: looking for art finder module matching "any": 2 candidates
  
  lua debug: Trying Lua scripts in C:\Users\cg371\AppData\Roaming\vlc\lua\meta\art
  
  lua debug: Trying Lua scripts in D:\VLC\lua\meta\art
  
  lua debug: Trying Lua playlist script D:\VLC\lua\meta\art\00_musicbrainz.luac
  
  lua debug: Trying Lua playlist script D:\VLC\lua\meta\art\01_googleimage.luac
  
  lua debug: Trying Lua playlist script D:\VLC\lua\meta\art\02_frenchtv.luac
  
  lua debug: Trying Lua playlist script D:\VLC\lua\meta\art\03_lastfm.luac
  
  main debug: no art finder modules matched
  
  main debug: exiting
  
  main debug: exiting
  
  main debug: no exit handler
  
  main debug: removing all interfaces
  
  main debug: removing module "qt"
  
  main debug: deactivating the playlist
  
  main debug: incoming request - stopping current input
  
  main debug: removing module "rtp"
  
  main debug: dead input
  
  main debug: nothing to play
  
  main debug: removing module "mmdevice"
  
  qt debug: requesting exit...
  
  qt debug: waiting for UI thread...
  
  qt debug: IM: Deleting the input
  
  qt debug: QApp exec() finished
  
  qt debug: Video is not needed anymore
  
  qt debug: Killing extension dialog provider
  
  qt debug: ExtensionsDialogProvider is quitting...
  
  main debug: removing module "lua"
  
  main debug: removing module "win32"
  
  main debug: removing module "hotkeys"
  
  main debug: destroying
  
  main debug: saving media library to file C:\Users\cg371\AppData\Roaming\vlc\ml.xspf.tmp14968
  
  main debug: looking for playlist export module matching "export-xspf": 4 candidates
  
  main debug: using playlist export module "export"
  
  main debug: removing module "export"
  
  main debug: deleting item `Media Library'
  
  main debug: deleting item `rtp://239.255.0.1:5004'
  
  main debug: deleting item `Playlist'
  
  main debug: removing module "memory"
  
  -- logger module stopped --