Advanced search

On other websites (5777)

• Python ImageIO: Too many open files

  23 April 2016, by orbv12

  I am using imageio in python in order to open all video files in a directory and convert them to numpy arrays.

  Here is the script I am using:

    1 from __future__ import print_function
  
    2 from avi_to_numpy import *
  
    3 from os import listdir
  
    4 import numpy as np
  
    5 import imageio 
  
    6       
  
    7 class_path = '../Diving/'
  
    8 max_frames = 16
  
    9 stride = 8
  
   10 videos = [vid for vid in listdir(class_path)]
  
   11 train = []
  
   12 
  
   13 for vid in videos:
  
   14     print(str.format('Loading {}...', vid), end="")
  
   15     filename = class_path + vid
  
   16     reader = imageio.get_reader(filename, 'ffmpeg')
  
   17     frames = []
  
   18     
  
   19     for i, im in enumerate(reader):
  
   20         if len(frames) == max_frames:
  
   21             break
  
   22         
  
   23         if i % stride == 0:
  
   24             frames.append(im)
  
   25     
  
   26     reader.close()
  
   27     train.append(np.array(frames))
  
   28     print('done')        
  
   29 
  
   30 
  
   31 print(len(train))

  Eventually this script crashes with the following error output:

  Traceback (most recent call last):
  
    File "load_class_test.py", line 16, in <module>
  
      reader = imageio.get_reader(filename, 'ffmpeg')
  
    File "/usr/local/lib/python2.7/site-packages/imageio/core/functions.py", line 111, in get_reader
  
      return format.get_reader(request)
  
    File "/usr/local/lib/python2.7/site-packages/imageio/core/format.py", line 158, in get_reader
  
      return self.Reader(self, request)
  
    File "/usr/local/lib/python2.7/site-packages/imageio/core/format.py", line 207, in __init__
  
      self._open(**self.request.kwargs.copy())
  
    File "/usr/local/lib/python2.7/site-packages/imageio/plugins/ffmpeg.py", line 260, in _open
  
      self._initialize()
  
    File "/usr/local/lib/python2.7/site-packages/imageio/plugins/ffmpeg.py", line 326, in _initialize
  
      stdout=sp.PIPE, stderr=sp.PIPE)
  
    File "/usr/local/Cellar/python/2.7.11/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 710, in __init__
  
      errread, errwrite)
  
    File "/usr/local/Cellar/python/2.7.11/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 1223, in _execute_child
  
      errpipe_read, errpipe_write = self.pipe_cloexec()
  
    File "/usr/local/Cellar/python/2.7.11/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 1175, in pipe_cloexec
  
      r, w = os.pipe()
  
  OSError: [Errno 24] Too many open files
  
  </module>

  I am closing the Reader object from imageio. It seems as if the files opened by ffmpeg are not being closed properly.

  Is there an obvious step I am missing here? Am I closing the files properly?

  EDIT: Found temporary solution. Opened a new issue on github.

  I was able to resolve the issue by uncommenting the following lines of code from ’imageio/plugins/ffmpeg.py’:

  381         def _close_streams(self):
  
  382             for std in (self._proc.stdin,
  
  383                         self._proc.stdout,
  
  384                         self._proc.stderr):
  
  385                 try:
  
  386                     std.close()
  
  387                 except Exception:  # pragma: no cover
  
  388                     pass

  I then added a call to the above function in _close(self):

  271         def _close(self):
  
  272             self._terminate(0.05)  # Short timeout
  
  273             self._close_streams()
  
  274             self._proc = None

  I am not sure what the side effects of doing this are, but it provides a solution for me.

  Here is the link to the issue: https://github.com/imageio/imageio/issues/145

• Trying to open file with PHP-FFMpeg after it was encoded once

  19 May 2016, by Shillo Ben David

  in the same PHP process I’m trying to open a file that was manipulated and saved, and then I’m trying to open it with as a new FFMpeg\Video. For example, in the same process:

  Open -> original.MOV
  
    Manipulate & save to -> new.mp4
  
      Open -> new.mp4

  However when I’m trying to open the manipulated file I get this InvalidArgumentException exception:

  InvalidArgumentException: Unable to detect file format, only audio and video supported

  It’s thrown by the FFMpeg::open() after it could not detect that it’s a either Video or Audio stream.

  FFMpeg::open()

  public function open($pathfile)
  
  {
  
      if (null === $streams = $this->ffprobe->streams($pathfile)) {
  
          throw new RuntimeException(sprintf('Unable to probe "%s".', $pathfile));
  
      }
  
  
  
      if (0 < count($streams->videos())) {
  
          return new Video($pathfile, $this->driver, $this->ffprobe);
  
      } elseif (0 < count($streams->audios())) {
  
          return new Audio($pathfile, $this->driver, $this->ffprobe);
  
      }
  
  
  
      throw new InvalidArgumentException('Unable to detect file format, only audio and video supported');
  
  }

  The filters I applied to the video are audio mute and speedup (setpts).

  So I wonder, why FFMpeg doesn’t recognise it as video?

• open source CMS and server for video streaming platform

  30 May 2016, by Infinite

  I have to propose a platform that allows streaming video services employing the MPEEG-DASH standard. This platform blocks must be implemented with open source tools. I proposed FFmpeg to encode and MP4Box/GPAC tool for encryption and packaging. For the DRM case my propose is to use Widewine (I didn’t find any other open source tool) which is compatible with dash.js (the player proposed by me), it can be integrated to Chrome and according to CastLabs it’s also compatible with MP4Box. So, I have to select an open source CMS, and at the same time I need it to be compatible with dash.js. I read that it’s possible to add any JavaScript to these CMS, that it’s only necessary to create some modules to do so. I’d like to know which one of the following CMS you suggest me: MediaDrop, Drupal or Wordpress.
  I also have some doubts about the server. I know that in order to offer this service it only takes a traditional HTTP server. In a first moment I chose Nginx over Apache because the latter presents some problems associated to performance (the server will receive a large amount of simultaneous requests), nevertheless, I discarded Nginx (Nginx-rtmp module) due to its constraints: it’s only for live streaming (I need the service to be offered also on demand) and the inputs must be RTMP. I found something about Nginx-based VOD packager, do you know if this one can be used as a server to offer live and on demand streaming service?