Recherche avancée

Sur d’autres sites (9435)

• Rails using stremio-ffmpeg gem to watermark a movie while uploading

  16 juin 2016, par Felix

  I am using carrierwave to upload a movie to amazon s3 that works perfect.

  Now I want to add a watermark to the movie while uploading or after uploading, I don’t know, what’s the best way ?

  I tried this :

  movie_controller.rb action uploadVideo

  movie = FFMPEG::Movie.new(@vid.video.url)
  
  
  
  puts "........................................"
  
  puts movie.inspect
  
  
  
  if @vid.save

  Just to find out if the video is catched from stremio.

  But then I got the error that the movie is not found, the problem is that it doesn’t look in the amazon s3 bucket, it looks on my local server

  No such file or directory - the file '/uploads/tmp/1462954331-3471-8766/VID-20160424-WA0013.mp4' does not exist

  What could be the solution ? or should I do this in carrierwave uploader ?

  UPDATE :

  When I do this after the .save action it looks at amazon s3 bucket .. but also says that the movie isn’t there. But if I call it directly in browser it’s displayed.

  UPDATE Code :

  #Laedt ein Video hoch
  
  def uploadMovie
  
    @user = User.find_by_id session[:user_id]
  
    #Holt alle Channels für die er eine Berechtigung hat (Eingeloggter user)
  
    @user = User.find_by_id session[:user_id]
  
    @knowledgeproviderList = @user.knowledgeprovider
  
    @channels = Channel.where(knowledgeprovider_id:     @knowledgeproviderList.pluck(:id))
  
    @vid = Movie.new(movies_params)
  
    @channel = Channel.find(params[:vid][:channel_id])
  
    @vid.channel = @channel
  
  
  
    #Fügt dem Movie einen Tag hinzu
  
    createTag params
  
    createCategory params
  
  
  
  
  
  
  
    if @vid.save
  
      flash[:notice] = t("flash.saved")
  
  
  
      #movie = FFMPEG::Movie.new(@vid.video.url)
  
  
  
      #puts "........................................"
  
      #puts movie.inspect
  
  
  
      redirect_to :action => :add
  
     else
  
       redirect_to :action => :add
  
    end
  
   end

  Update error :

  movie = FFMPEG::Movie.new(@vid.video.current_path)
  
  
  
  options = {watermark: "mages/header.png", resolution: "640x360", watermark_filter: { position: "RT", padding_x: 10, padding_y: 10 } }
  
  movie.transcode("movie.flv", options)

  

  Update :
  Added the code in the uploader :

    process :watermark_movie
  
  
  
       def watermark_movie
  
         if self.file.path
  
               options = {watermark: "images/header.png", resolution: "640x360", watermark_filter: { position: "RT", padding_x: 10, padding_y: 10 } }
  
               self.model.file = FFMPEG::Movie.new(self.file.path).transcode("#{root}/#{cache_dir}/#{self.cache_id}/file.mp4", options)
  
          end
  
        end

  Error :

  multi_json (1.12.0) lib/multi_json/adapter.rb:19:in `load'
  
  multi_json (1.12.0) lib/multi_json.rb:122:in `load'
  
  streamio-ffmpeg (2.0.0) lib/ffmpeg/movie.rb:28:in `initialize'
  
  app/uploaders/movie_uploader.rb:40:in `new'
  
  app/uploaders/movie_uploader.rb:40:in `watermark_movie'
  
  carrierwave (0.11.2) lib/carrierwave/uploader/processing.rb:84:in `block in process!'
  
  carrierwave (0.11.2) lib/carrierwave/uploader/processing.rb:76:in `each'
  
  carrierwave (0.11.2) lib/carrierwave/uploader/processing.rb:76:in `process!'
  
  carrierwave_backgrounder (0.4.2) lib/backgrounder/delay.rb:14:in `process!'
  
  carrierwave (0.11.2) lib/carrierwave/uploader/callbacks.rb:18:in `block in with_callbacks'
  
  carrierwave (0.11.2) lib/carrierwave/uploader/callbacks.rb:18:in `each'
  
  carrierwave (0.11.2) lib/carrierwave/uploader/callbacks.rb:18:in `with_callbacks'
  
  carrierwave (0.11.2) lib/carrierwave/uploader/cache.rb:134:in `cache!'
  
  carrierwave (0.11.2) lib/carrierwave/mount.rb:329:in `cache'
  
  carrierwave (0.11.2) lib/carrierwave/mount.rb:163:in `video='
  
  carrierwave (0.11.2) lib/carrierwave/orm/activerecord.rb:39:in `video='
  
  activerecord (4.2.1) lib/active_record/attribute_assignment.rb:54:in `public_send'
  
  activerecord (4.2.1) lib/active_record/attribute_assignment.rb:54:in `_assign_attribute'
  
  activerecord (4.2.1) lib/active_record/attribute_assignment.rb:41:in `block in assign_attributes'
  
  actionpack (4.2.1) lib/action_controller/metal/strong_parameters.rb:183:in `each_pair'
  
  actionpack (4.2.1) lib/action_controller/metal/strong_parameters.rb:183:in `each_pair'
  
  activerecord (4.2.1) lib/active_record/attribute_assignment.rb:35:in `assign_attributes'
  
  activerecord (4.2.1) lib/active_record/core.rb:559:in `init_attributes'
  
  activerecord (4.2.1) lib/active_record/core.rb:281:in `initialize'
  
  activerecord (4.2.1) lib/active_record/inheritance.rb:61:in `new'
  
  activerecord (4.2.1) lib/active_record/inheritance.rb:61:in `new'
  
  app/controllers/movies_controller.rb:71:in `uploadMovie'
  
  actionpack (4.2.1) lib/action_controller/metal/implicit_render.rb:4:in `send_action'
  
  actionpack (4.2.1) lib/abstract_controller/base.rb:198:in `process_action'
  
  actionpack (4.2.1) lib/action_controller/metal/rendering.rb:10:in `process_action'
  
  actionpack (4.2.1) lib/abstract_controller/callbacks.rb:20:in `block in process_action'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:117:in `call'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:117:in `call'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:555:in `block (2 levels) in compile'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:505:in `call'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:505:in `call'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:92:in `_run_callbacks'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:776:in `_run_process_action_callbacks'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:81:in `run_callbacks'
  
  actionpack (4.2.1) lib/abstract_controller/callbacks.rb:19:in `process_action'
  
  actionpack (4.2.1) lib/action_controller/metal/rescue.rb:29:in `process_action'
  
  actionpack (4.2.1) lib/action_controller/metal/instrumentation.rb:32:in `block in process_action'
  
  activesupport (4.2.1) lib/active_support/notifications.rb:164:in `block in instrument'
  
  activesupport (4.2.1) lib/active_support/notifications/instrumenter.rb:20:in `instrument'
  
  activesupport (4.2.1) lib/active_support/notifications.rb:164:in `instrument'
  
  actionpack (4.2.1) lib/action_controller/metal/instrumentation.rb:30:in `process_action'
  
  actionpack (4.2.1) lib/action_controller/metal/params_wrapper.rb:250:in `process_action'
  
  activerecord (4.2.1) lib/active_record/railties/controller_runtime.rb:18:in `process_action'
  
  actionpack (4.2.1) lib/abstract_controller/base.rb:137:in `process'
  
  actionview (4.2.1) lib/action_view/rendering.rb:30:in `process'
  
  actionpack (4.2.1) lib/action_controller/metal.rb:196:in `dispatch'
  
  actionpack (4.2.1) lib/action_controller/metal/rack_delegation.rb:13:in `dispatch'
  
  actionpack (4.2.1) lib/action_controller/metal.rb:237:in `block in action'
  
  actionpack (4.2.1) lib/action_dispatch/routing/route_set.rb:74:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/routing/route_set.rb:74:in `dispatch'
  
  actionpack (4.2.1) lib/action_dispatch/routing/route_set.rb:43:in `serve'
  
  actionpack (4.2.1) lib/action_dispatch/journey/router.rb:43:in `block in serve'
  
  actionpack (4.2.1) lib/action_dispatch/journey/router.rb:30:in `each'
  
  actionpack (4.2.1) lib/action_dispatch/journey/router.rb:30:in `serve'
  
  actionpack (4.2.1) lib/action_dispatch/routing/route_set.rb:819:in `call'
  
  rack (1.6.4) lib/rack/etag.rb:24:in `call'
  
  rack (1.6.4) lib/rack/conditionalget.rb:38:in `call'
  
  rack (1.6.4) lib/rack/head.rb:13:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/params_parser.rb:27:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/flash.rb:260:in `call'
  
  rack (1.6.4) lib/rack/session/abstract/id.rb:225:in `context'
  
  rack (1.6.4) lib/rack/session/abstract/id.rb:220:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/cookies.rb:560:in `call'
  
  activerecord (4.2.1) lib/active_record/query_cache.rb:36:in `call'
  
  activerecord (4.2.1) lib/active_record/connection_adapters/abstract/connection_pool.rb:649:in `call'
  
  activerecord (4.2.1) lib/active_record/migration.rb:378:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/callbacks.rb:29:in `block in call'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:88:in `call'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:88:in `_run_callbacks'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:776:in `_run_call_callbacks'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:81:in `run_callbacks'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/callbacks.rb:27:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/reloader.rb:73:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/remote_ip.rb:78:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/debug_exceptions.rb:17:in `call'
  
  web-console (2.3.0) lib/web_console/middleware.rb:20:in `block in call'
  
  web-console (2.3.0) lib/web_console/middleware.rb:18:in `catch'
  
  web-console (2.3.0) lib/web_console/middleware.rb:18:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/show_exceptions.rb:30:in `call'
  
  railties (4.2.1) lib/rails/rack/logger.rb:38:in `call_app'
  
  railties (4.2.1) lib/rails/rack/logger.rb:20:in `block in call'
  
  activesupport (4.2.1) lib/active_support/tagged_logging.rb:68:in `block in tagged'
  
  activesupport (4.2.1) lib/active_support/tagged_logging.rb:26:in `tagged'
  
  activesupport (4.2.1) lib/active_support/tagged_logging.rb:68:in `tagged'
  
  railties (4.2.1) lib/rails/rack/logger.rb:20:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/request_id.rb:21:in `call'
  
  rack (1.6.4) lib/rack/methodoverride.rb:22:in `call'
  
  rack (1.6.4) lib/rack/runtime.rb:18:in `call'
  
  activesupport (4.2.1) lib/active_support/cache/strategy/local_cache_middleware.rb:28:in `call'
  
  rack (1.6.4) lib/rack/lock.rb:17:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/static.rb:113:in `call'
  
  rack (1.6.4) lib/rack/sendfile.rb:113:in `call'
  
  railties (4.2.1) lib/rails/engine.rb:518:in `call'
  
  railties (4.2.1) lib/rails/application.rb:164:in `call'
  
  rack (1.6.4) lib/rack/lock.rb:17:in `call'
  
  rack (1.6.4) lib/rack/content_length.rb:15:in `call'
  
  rack (1.6.4) lib/rack/handler/webrick.rb:88:in `service'
  
  /home/felix/.rvm/rubies/ruby-2.0.0-p643/lib/ruby/2.0.0/webrick/httpserver.rb:138:in `service'
  
  /home/felix/.rvm/rubies/ruby-2.0.0-p643/lib/ruby/2.0.0/webrick/httpserver.rb:94:in `run'
  
  /home/felix/.rvm/rubies/ruby-2.0.0-p643/lib/ruby/2.0.0/webrick/server.rb:295:in `block in start_thread'

  UPDATE — Movie Uploader

  # encoding: utf-8
  
  class MovieUploader < CarrierWave::Uploader::Base
  
  
  
    # Include RMagick or MiniMagick support:
  
    # include CarrierWave::RMagick
  
    include CarrierWave::MiniMagick
  
    include CarrierWave::Video
  
    include CarrierWave::Video::Thumbnailer
  
    include CarrierWave::Backgrounder::Delay
  
  
  
    require 'rubygems'
  
    require 'streamio-ffmpeg'
  
  
  
    # Choose what kind of storage to use for this uploader:
  
    storage :fog
  
  
  
    # Override the directory where uploaded files will be stored.
  
    # This is a sensible default for uploaders that are meant to be mounted:
  
    def store_dir
  
      "uploads/#{model.class.to_s.underscore}/#{mounted_as}/#{model.id}"
  
    end
  
  
  
    process :watermark_movie
  
  
  
    def watermark_movie
  
      puts "ssssssssssssssssssssssssssssssssss"
  
      puts self.file.inspect
  
  
  
      if self.file.path
  
        options = {watermark: "http://felix-hohlwegler.de/holz-soft/include/designs/design13/images/header.png", resolution: "640x360", watermark_filter: { position: "RT", padding_x: 10, padding_y: 10 } }
  
        self.model.file = FFMPEG::Movie.new(self.file.path).transcode("#{root}/#{cache_dir}/#{self.cache_id}/file.mp4", options)
  
      end
  
    end
  
  
  
    version :thumb do
  
      process thumbnail: [{format: 'png', quality: 10, size: 1200, strip: false, seek: 10, logger: Rails.logger}]
  
      def full_filename for_file
  
        png_name for_file, version_name
  
      end
  
    end
  
  
  
    def png_name for_file, version_name
  
      %Q{#{version_name}_#{for_file.chomp(File.extname(for_file))}.png}
  
    end
  
  
  
  
  
    # Add a white list of extensions which are allowed to be uploaded.
  
    # For images you might use something like this:
  
     def extension_white_list
  
       %w(mov avi mkv mpeg mpeg2 mp4 3gp)
  
     end
  
  end

• ffmpeg overlay issue with rotation

  16 mai 2016, par Nitin

  I want to execute a command using ffmpeg so it performs three tasks for me at once :

  1. croping the video (OK)
  2. rotate the video for 90° (OK) and
  3. add an overlay

  Unfortunately, the tasks 1 and 2 are performed, but the overlay isn’t. Please help me.. Here’s the command I’m using :

  ffmpeg -i " + path + " -i /storage/emulated/0/image.png -filter_complex [0]crop=" + cut + ":" + cut + ":0:0 -metadata:s:v:0 rotate=90 -c:a [a];[a][1]overlay=10:10 -preset ultrafast -codec:a copy /storage/emulated/0/Nitin/" + videoFile;

• FFmpeg + OpenAL - playback streaming sound from video won't work

  28 janvier 2014, par TheSHEEEP

  I am decoding an OGG video (theora & vorbis as codecs) and want to show it on the screen (using Ogre 3D) while playing its sound. I can decode the image stream just fine and the video plays perfectly with the correct frame rate, etc.

  However, I cannot get the sound to play at all with OpenAL.

  Edit : I managed to make the playing sound resemble the actual audio in the video at least somewhat. Updated sample code.

  Edit 2 : I was able to get "almost" correct sound now. I had to set OpenAL to use AL_FORMAT_STEREO_FLOAT32 (after initializing the extension) instead of just STEREO16. Now the sound is "only" extremely high pitched and stuttering, but at the correct speed.

  Here is how I decode audio packets (in a background thread, the equivalent works just fine for the image stream of the video file) :

  //------------------------------------------------------------------------------
  
  int decodeAudioPacket(  AVPacket& p_packet, AVCodecContext* p_audioCodecContext, AVFrame* p_frame,
  
                          FFmpegVideoPlayer* p_player, VideoInfo& p_videoInfo)
  
  {
  
      // Decode audio frame
  
      int got_frame = 0;
  
      int decoded = avcodec_decode_audio4(p_audioCodecContext, p_frame, &got_frame, &p_packet);
  
      if (decoded < 0) 
  
      {
  
          p_videoInfo.error = "Error decoding audio frame.";
  
          return decoded;
  
      }
  
  
  
      // Frame is complete, store it in audio frame queue
  
      if (got_frame)
  
      {
  
          int bufferSize = av_samples_get_buffer_size(NULL, p_audioCodecContext->channels, p_frame->nb_samples, 
  
                                                      p_audioCodecContext->sample_fmt, 0);
  
  
  
          int64_t duration = p_frame->pkt_duration;
  
          int64_t dts = p_frame->pkt_dts;
  
  
  
          if (staticOgreLog)
  
          {
  
              staticOgreLog->logMessage("Audio frame bufferSize / duration / dts: " 
  
                      + boost::lexical_cast(bufferSize) + " / "
  
                      + boost::lexical_cast(duration) + " / "
  
                      + boost::lexical_cast(dts), Ogre::LML_NORMAL);
  
          }
  
  
  
          // Create the audio frame
  
          AudioFrame* frame = new AudioFrame();
  
          frame->dataSize = bufferSize;
  
          frame->data = new uint8_t[bufferSize];
  
          if (p_frame->channels == 2)
  
          {
  
              memcpy(frame->data, p_frame->data[0], bufferSize >> 1);
  
              memcpy(frame->data + (bufferSize >> 1), p_frame->data[1], bufferSize >> 1);
  
          }
  
          else
  
          {
  
              memcpy(frame->data, p_frame->data, bufferSize);
  
          }
  
          double timeBase = ((double)p_audioCodecContext->time_base.num) / (double)p_audioCodecContext->time_base.den;
  
          frame->lifeTime = duration * timeBase;
  
  
  
          p_player->addAudioFrame(frame);
  
      }
  
  
  
      return decoded;
  
  }

  So, as you can see, I decode the frame, memcpy it to my own struct, AudioFrame. Now, when the sound is played, I use these audio frame like this :

      int numBuffers = 4;
  
      ALuint buffers[4];
  
      alGenBuffers(numBuffers, buffers);
  
      ALenum success = alGetError();
  
      if(success != AL_NO_ERROR)
  
      {
  
          CONSOLE_LOG("Error on alGenBuffers : " + Ogre::StringConverter::toString(success) + alGetString(success));
  
          return;
  
      }
  
  
  
      // Fill a number of data buffers with audio from the stream
  
      std::vector audioBuffers;
  
      std::vector<unsigned int="int"> audioBufferSizes;
  
      unsigned int numReturned = FFMPEG_PLAYER->getDecodedAudioFrames(numBuffers, audioBuffers, audioBufferSizes);
  
  
  
      // Assign the data buffers to the OpenAL buffers
  
      for (unsigned int i = 0; i &lt; numReturned; ++i)
  
      {
  
          alBufferData(buffers[i], _streamingFormat, audioBuffers[i]->data, audioBufferSizes[i], _streamingFrequency);
  
  
  
          success = alGetError();
  
          if(success != AL_NO_ERROR)
  
          {
  
              CONSOLE_LOG("Error on alBufferData : " + Ogre::StringConverter::toString(success) + alGetString(success)
  
                              + " size: " + Ogre::StringConverter::toString(audioBufferSizes[i]));
  
              return;
  
          }
  
      }
  
  
  
      // Queue the buffers into OpenAL
  
      alSourceQueueBuffers(_source, numReturned, buffers);
  
      success = alGetError();
  
      if(success != AL_NO_ERROR)
  
      {
  
          CONSOLE_LOG("Error queuing streaming buffers: " + Ogre::StringConverter::toString(success) + alGetString(success));
  
          return;
  
      }
  
  }
  
  
  
  alSourcePlay(_source);
  
  </unsigned>

  The format and frequency I give to OpenAL are AL_FORMAT_STEREO_FLOAT32 (it is a stereo sound stream, and I did initialize the FLOAT32 extension) and 48000 (which is the sample rate of the AVCodecContext of the audio stream).

  And during playback, I do the following to refill OpenAL's buffers :

  ALint numBuffersProcessed;
  
  
  
  // Check if OpenAL is done with any of the queued buffers
  
  alGetSourcei(_source, AL_BUFFERS_PROCESSED, &numBuffersProcessed);
  
  if(numBuffersProcessed <= 0)
  
      return;
  
  
  
  // Fill a number of data buffers with audio from the stream
  
  std::vector audioBuffers;
  
  std::vector<unsigned int="int"> audioBufferSizes;
  
  unsigned int numFilled = FFMPEG_PLAYER->getDecodedAudioFrames(numBuffersProcessed, audioBuffers, audioBufferSizes);
  
  
  
  // Assign the data buffers to the OpenAL buffers
  
  ALuint buffer;
  
  for (unsigned int i = 0; i &lt; numFilled; ++i)
  
  {
  
      // Pop the oldest queued buffer from the source, 
  
      // fill it with the new data, then re-queue it
  
      alSourceUnqueueBuffers(_source, 1, &amp;buffer);
  
  
  
      ALenum success = alGetError();
  
      if(success != AL_NO_ERROR)
  
      {
  
          CONSOLE_LOG("Error Unqueuing streaming buffers: " + Ogre::StringConverter::toString(success));
  
          return;
  
      }
  
  
  
      alBufferData(buffer, _streamingFormat, audioBuffers[i]->data, audioBufferSizes[i], _streamingFrequency);
  
  
  
      success = alGetError();
  
      if(success != AL_NO_ERROR)
  
      {
  
          CONSOLE_LOG("Error on re- alBufferData: " + Ogre::StringConverter::toString(success));
  
          return;
  
      }
  
  
  
      alSourceQueueBuffers(_source, 1, &amp;buffer);
  
  
  
      success = alGetError();
  
      if(success != AL_NO_ERROR)
  
      {
  
          CONSOLE_LOG("Error re-queuing streaming buffers: " + Ogre::StringConverter::toString(success) + " "
  
                      + alGetString(success));
  
          return;
  
      }
  
  }
  
  
  
  // Make sure the source is still playing, 
  
  // and restart it if needed.
  
  ALint playStatus;
  
  alGetSourcei(_source, AL_SOURCE_STATE, &amp;playStatus);
  
  if(playStatus != AL_PLAYING)
  
      alSourcePlay(_source);
  
  </unsigned>

  As you can see, I do quite heavy error checking. But I do not get any errors, neither from OpenAL nor from FFmpeg.
  Edit : What I hear somewhat resembles the actual audio from the video, but VERY high pitched and stuttering VERY much. Also, it seems to be playing on top of TV noise. Very strange. Plus, it is playing much slower than the correct audio would.
  Edit : 2 After using AL_FORMAT_STEREO_FLOAT32, the sound plays at the correct speed, but is still very high pitched and stuttering (though less than before).

  The video itself is not broken, it can be played fine on any player. OpenAL can also play *.way files just fine in the same application, so it is also working.

  Any ideas what could be wrong here or how to do this correctly ?

  My only guess is that somehow, FFmpeg's decode function does not produce data OpenGL can read. But this is as far as the FFmpeg decode example goes, so I don't know what's missing. As I understand it, the decode_audio4 function decodes the frame to raw data. And OpenAL should be able to work with RAW data (or rather, doesn't work with anything else).