Sur d’autres sites (3964)

• create stream from http url .ts nginx ffmpeg

  1er juillet 2016, par mikel atef

  create streaming form http url .ts by using nginx and ffmpeg

     application xxxxx {
  
                      live on;
  
                      meta copy;
  
                      record off;
  
                      push http://xx:8000/xx/xx/xxx/1140.ts ;
  
              }

  not working

  i try to make streaming as old style , by

    application xxxxx {
  
                      live on;
  
                      meta copy;
  
                      record off;
  
              }

  how to use ffmpeg to make url input for xxxxx

• How do I get videos to upload using ruby on rails carrierwave-video ?

  9 juillet 2016, par Eric

  Updated as of July 9, 2016

  I tried to follow the instructions on the github website for the video uploader process using carrierwave-video gem but get an error that says the file or directory mmpeg -i doesn’t exist.

  The upload path for images functions correctly, just not the video one.

  I have added all of the following code necessary to help solve the error and minified as much as i possibly could.

  Video uploader code using carrierwave

  class VideoUploader < CarrierWave::Uploader::Base

    include CarrierWave::Video
  
    storage :file
  
  
  
    version :mp4 do
  
      process :encode_video => [:mp4, resolution: "100x100"]
  
    end
  
  
  
    def store_dir
  
      "uploads/#{model.class.to_s.underscore}/#{mounted_as}/#{model.id}"
  
    end
  
  end

  Here is the movie controller code that handles uploading of videos

  class MoviesController < ApplicationController
  
     include MoviesHelper
  
  
  
     def index
  
        mode "index"
  
     end
  
  
  
     def show
  
        mode "show"
  
     end
  
  
  
     def new
  
        mode "new"
  
     end
  
  
  
     def edit
  
        mode "edit"
  
     end
  
  
  
     def create
  
        mode "create"
  
     end
  
  
  
     def update
  
        mode "update"
  
     end
  
  
  
     def destroy
  
        mode "destroy"
  
     end
  
  
  
     def review
  
        mode "review"
  
     end
  
  
  
     def approve
  
        mode "approve"
  
     end
  
  
  
     def deny
  
        mode "deny"
  
     end
  
  end

  Here is the model data for the movie that goes with it

  class Movie < ActiveRecord::Base
  
    attr_accessible :created_on, :description, :maintenance, :reviewed, :subplaylist_id, :title, :user_id, :video, :remote_video_url
  
    belongs_to :user
  
    belongs_to :subplaylist
  
    mount_uploader :video, VideoUploader
  
  end

  Here is where the movie is supposed to be displayed but it is not working

  <% provide(:title, "Movie: Where movies are made!") %>
  
  <% provide(:keywords, "movies, video") %>
  
  <% provide(:description, "This is the place where users showcase their wonderful video talent.") %>
  
  <p>&lt;%= notice %></p>
  
  <h1 class="pageheader">&lt;%= @movie.title %></h1>
  
  <br />
  
  <p class="pagetext">&lt;%= video_tag(@movie.video_url.to_s, controls: true, class: "imagebox") %></p>
  
  <p class="pagetext">&lt;%= @movie.description %></p>
  
  <p class="pagetext">Created on: &lt;%= @movie.created_on.strftime("%B-%d-%Y") %></p>
  
  <p class="pagetext">Owner: &lt;%= getType(@movie.user) %>&lt;%= link_to @movie.user.vname, user_path(@movie.user) %></p>
  
  <br />
  
  <p class="pagetext">&lt;%= link_to 'Back', mainplaylist_subplaylist_path(@subplaylist.mainplaylist, @movie.subplaylist) %></p>

  Here is where the movie new action is

  <% provide(:title, "Movie: Create new movies here!") %>
  
  <% provide(:description, "New movies are uploaded only to the site when the movie gets approved.") %>
  
  <h1 class="pagetextheader">New movie</h1>
  
  &lt;%= render 'form' %>
  
  <p class="pagetext">&lt;%= link_to 'Back', mainplaylist_subplaylist_path(@subplaylist.mainplaylist, @subplaylist) %></p>

  Here is where the movies forum parameters are

  <%= form_for([@subplaylist, @movie], :html=>{:multipart => true}) do |f| %>
  
    <% if @movie.errors.any? %>
  
      <div>
  
        <h2>&lt;%= pluralize(@movie.errors.count, "error") %> prohibited this movie from being saved:</h2>
  
  
  
        <ul>
  
        &lt;% @movie.errors.full_messages.each do |msg| %>
  
          <li>&lt;%= msg %></li>
  
        &lt;% end %>
  
        </ul>
  
      </div>
  
    &lt;% end %>
  
    <br />
  
    <div class="pagetext">
  
      &lt;%= f.label :title %><br />
  
      &lt;%= f.text_field :title %>
  
    </div>
  
    <div class="pagetext">
  
      &lt;%= f.file_field :video %>
  
    </div>
  
    <div class="pagetext">
  
      &lt;%= f.label :remote_video_url, "or video URL" %><br />
  
      &lt;%= f.text_field :remote_video_url %>
  
    </div>
  
    <div class="pagetext">
  
      &lt;%= f.label :description %><br />
  
      &lt;%= f.text_area :description %>
  
    </div>
  
    <div class="pagetext">
  
      &lt;%= f.submit %>
  
    </div>
  
    <br />
  
  &lt;% end %>

  Here is the movies helper code

  module MoviesHelper
  
  
  
     def mode(type)
  
        code = auto_logout
  
        if(code == true)
  
           sign_out
  
           redirect_to root_path
  
        else
  
           #Check if Maintenance is turned_on
  
           allmode = Maintenancemode.find_by_id(1)
  
           moviemode = Maintenancemode.find_by_id(19)
  
           mode_turned_on = (allmode.maintenance_on || moviemode.maintenance_on)
  
           #Determine if any maintenance is on
  
           if(mode_turned_on)
  
              #Determine if we are a regular user
  
              regularUser = (!current_user || !current_user.admin?)
  
              if(regularUser)
  
                 #Determine which maintenance mode is on
  
                 if(allmode.maintenance_on)
  
                    redirect_to maintenance_path
  
                 else
  
                    redirect_to movies_maintenance_path
  
                 end
  
              else
  
                 switch type
  
              end
  
           else
  
              switch type
  
           end
  
        end
  
     end
  
  
  
     private
  
        def getType(user)
  
           if(user.admin)
  
              value = "$"
  
           else
  
              typeFound = Usertype.find_by_user_id(user.id)
  
              if(typeFound)
  
                 type = typeFound.privilege
  
                 if(type == "Reviewer")
  
                    value = "^"
  
                 elsif(type == "Banned")
  
                    value = "!"
  
                 else
  
                    value = "~"
  
                 end
  
              else
  
                 value = "~"
  
              end
  
           end
  
           return value
  
        end
  
  
  
        def movieApproved
  
           movieFound = Movie.find_by_id(params[:movie_id])
  
           if(movieFound)
  
              movieFound.reviewed = true
  
              pouch = Pouch.find_by_user_id(movieFound.user_id)
  
              pointsForMovie = 10
  
              pouch.amount += pointsForMovie
  
              @pouch = pouch
  
              @pouch.save
  
              @movie = movieFound
  
              @movie.save
  
  #            MovieMailer.movie_approved(@movie, pointsForMovie).deliver
  
              redirect_to movies_review_path
  
           else
  
              render "public/404"
  
           end
  
        end
  
  
  
        def movieDenied
  
           movieFound = Movie.find_by_id(params[:movie_id])
  
           if(movieFound)
  
              #Retrieve the user who owns this pet first
  
              #userEmail = petFound.user.email
  
              #Send mail to user with link to edit the pet they sent
  
              @movie = movieFound
  
              MovieMailer.movie_denied(@movie).deliver
  
              redirect_to movies_review_path
  
           else
  
              render "public/404"
  
           end
  
        end
  
  
  
        def createMovie(subplaylistFound)
  
           newMovie = subplaylistFound.movies.new
  
           @subplaylist = subplaylistFound
  
           @movie = newMovie
  
        end
  
  
  
        def saveMovie(subplaylistFound, logged_in)
  
           newMovie = subplaylistFound.movies.new(params[:movie])
  
           newMovie.user_id = logged_in.id
  
           currentTime = Time.now
  
           newMovie.created_on = currentTime
  
           @movie = newMovie
  
           if(@movie.save)
  
              @subplaylist = subplaylistFound
  
  #            MovieMailer.review_movie(@movie).deliver
  
              flash[:success] = "#{@movie.title} is currently being reviewed please check back later."
  
              redirect_to subplaylist_movie_path(@subplaylist, @movie)
  
           else
  
              render "new"
  
           end
  
        end
  
  
  
        def switch(type)
  
           if(type == "index") #Admin only
  
              logged_in = current_user
  
              if(logged_in)
  
                 if(logged_in.admin)
  
                    allMovies = Movies.order("created_on desc").page(params[:page]).per(10)
  
                    @movies = allMovies
  
                 else
  
                    redirect_to root_path
  
                 end
  
              else
  
                 redirect_to root_path
  
              end
  
           elsif(type == "show")
  
              movieFound = Movie.find_by_id(params[:id])
  
              if(movieFound)
  
                 subplaylistFound = Subplaylist.find_by_id(params[:subplaylist_id])
  
                 if(subplaylistFound)
  
                    if(movieFound.reviewed)
  
                       @subplaylist = subplaylistFound
  
                       @movie = movieFound
  
                    else
  
                       logged_in = current_user
  
                       if(logged_in)
  
                          userMatch = ((logged_in.id == movieFound.user_id) || logged_in.admin)
  
                          if(userMatch)
  
                             @subplaylist = subplaylistFound
  
                             @movie = movieFound
  
                          else
  
                             redirect_to root_path
  
                          end
  
                       else
  
                          redirect_to root_path
  
                       end
  
                    end
  
                 else
  
                    redirect_to root_path
  
                 end
  
              else
  
                 render "public/404"
  
              end
  
           elsif(type == "new")
  
              logged_in = current_user
  
              if(logged_in)
  
                 subplaylistFound = Subplaylist.find_by_id(params[:subplaylist_id])
  
                 if(subplaylistFound)
  
                    if(subplaylistFound.collab_mode)
  
                       createMovie(subplaylistFound)
  
                    else
  
                       userMatch = (logged_in.id == subplaylistFound.user_id)
  
                       if(userMatch)
  
                          createMovie(subplaylistFound)
  
                       else
  
                          redirect_to root_path
  
                       end
  
                    end
  
                 else
  
                    render "public/404"
  
                 end
  
              else
  
                 redirect_to root_path
  
              end
  
           elsif(type == "create")
  
              logged_in = current_user
  
              if(logged_in)
  
                 subplaylistFound = Subplaylist.find_by_id(params[:subplaylist_id])
  
                 if(subplaylistFound)
  
                    if(subplaylistFound.collab_mode)
  
                       saveMovie(subplaylistFound, logged_in)
  
                    else
  
                       userMatch = (logged_in.id == subplaylistFound.user_id)
  
                       if(userMatch)
  
                          saveMovie(subplaylistFound, logged_in)
  
                       else
  
                          redirect_to root_path
  
                       end
  
                    end
  
                 else
  
                    render "public/404"
  
                 end
  
              else
  
                 redirect_to root_path
  
              end
  
           elsif(type == "edit")
  
              logged_in = current_user
  
              if(logged_in)
  
                 movieFound = Movie.find_by_id(params[:id])
  
                 if(movieFound)
  
                    userMatch = (logged_in.id == movieFound.user_id)
  
                    if(userMatch)
  
                       subplaylistFound = Subplaylist.find_by_id(movieFound.subplaylist_id)
  
                       if(subplaylistFound)
  
                          @subplaylist = subplaylistFound
  
                          @movie = movieFound
  
                       else
  
                          render "public/404"
  
                       end
  
                    else
  
                       redirect_to root_path
  
                    end
  
                 else
  
                    render "public/404"
  
                 end
  
              else
  
                 redirect_to root_path
  
              end
  
           elsif(type == "update")
  
              logged_in = current_user
  
              if(logged_in)
  
                 movieFound = Movie.find_by_id(params[:id])
  
                 if(movieFound)
  
                    userMatch = (logged_in.id == movieFound.user_id)
  
                    if(userMatch)
  
                       subplaylistFound = Subplaylist.find_by_id(movieFound.subplaylist_id)
  
                       if(subplaylistFound)
  
                          @movie = movieFound
  
                          if(@movie.update_attributes(params[:movie]))
  
                             @subplaylist = subplaylistFound
  
                             flash[:success] = 'Movie was successfully updated.'
  
                             redirect_to subplaylist_movie_path(@subplaylist, @movie)
  
                          else
  
                             render "edit"
  
                          end
  
                       else
  
                          render "public/404"
  
                       end
  
                    else
  
                       redirect_to root_path
  
                    end
  
                 else
  
                    render "public/404"
  
                 end
  
              else
  
                 redirect_to root_path
  
              end
  
           elsif(type == "destroy")
  
              logged_in = current_user
  
              if(logged_in)
  
                 movieFound = Movie.find_by_id(params[:id]) #Need to move this below the admin section to protect it
  
                 if(movieFound)
  
                    if(logged_in.admin)
  
                       subplaylistFound = Subplaylist.find_by_id(movieFound.subplaylist_id)
  
                       if(subplaylistFound)
  
                          @movie = movieFound
  
                          @subplaylist = subplaylistFound
  
                          @movie.destroy
  
                          redirect_to mainplaylist_subplaylist_path(@subplaylist.mainplaylist, @subplaylist)
  
                       else
  
                          render "public/404"
  
                       end
  
                    else
  
                       redirect_to root_path
  
                    end
  
                 else
  
                    render "public/404"
  
                 end
  
              else
  
                 redirect_to root_path
  
              end
  
           elsif(type == "review") #Admin
  
              logged_in = current_user
  
              if(logged_in)
  
                 if(logged_in.admin)
  
                    allMovies = Movie.all
  
                    moviesToReview = allMovies.select{|movie| !movie.reviewed}
  
                    @movies = Kaminari.paginate_array(moviesToReview).page(params[:page]).per(10)
  
                 else
  
                    typeFound = Usertype.find_by_user_id(logged_in.id)
  
                    if(typeFound.privilege == "Reviewer")
  
                       allMovies = Movie.all
  
                       moviesToReview = allMovies.select{|movie| !movie.reviewed}
  
                       @movies = Kaminari.paginate_array(moviesToReview).page(params[:page]).per(10)
  
                    else
  
                       redirect_to root_path
  
                    end
  
                 end
  
              else
  
                 redirect_to root_path
  
              end
  
           elsif(type == "approve") #Admin
  
              logged_in = current_user
  
              if(logged_in)
  
                 if(logged_in.admin)
  
                    movieApproved
  
                 else
  
                    typeFound = Usertype.find_by_user_id(logged_in.id)
  
                    if(typeFound.privilege == "Reviewer")
  
                       movieApproved
  
                    else
  
                       redirect_to root_path
  
                    end
  
                 end
  
              else
  
                 redirect_to root_path
  
              end
  
           elsif(type == "deny") #Admin
  
              logged_in = current_user
  
              if(logged_in)
  
                 if(logged_in.admin)
  
                    movieDenied
  
                 else
  
                    typeFound = Usertype.find_by_user_id(logged_in.id)
  
                    if(typeFound.privilege == "Reviewer")
  
                       movieDenied
  
                    else
  
                       redirect_to root_path
  
                    end
  
                 end
  
              else
  
                 redirect_to root_path
  
              end
  
           end
  
        end
  
  end

  Here is the subplaylists show code

  <% provide(:title, "Subplaylist: The place where users videos gets uploaded to!") %>
  
  <% provide(:keywords, "user, video, uploaded") %>
  
  <% provide(:description, "Allows the categorization of various videos that the user submitted successfully.") %>
  
  <p>&lt;%= notice %></p>
  
  <h1 class="pageheader">&lt;%= @subplaylist.title %></h1>
  
  <br />
  
  <p class="pagetext">&lt;%= @subplaylist.description %></p>
  
  <br />
  
  <div class="pagebox">&lt;%= paginate @movies %></div>
  
  
  
  
  
  
  
  
  
  
  
  <br />
  
  <div class="pagetext">
  
     &lt;% @movies.each_with_index do |movie, index| %>
  
        <div class="container">
  
           <div class="inner">
  
              <div class="inner">&lt;%= link_to movie.title, subplaylist_movie_path(@subplaylist, movie) %></div>
  
              &lt;% if current_user &amp;&amp; (current_user.id == movie.user_id || current_user.admin? )%>
  
                 <div class="inner">&lt;%= button_to 'Edit', edit_subplaylist_movie_path(@subplaylist, movie), method: :get %></div>
  
                 <div class="inner">&lt;%= button_to 'Destroy', [@subplaylist, movie], method: :delete, data: { confirm: 'Are you sure?' } %></div>
  
              &lt;% end %>
  
              <p>&lt;%= video_tag movie.video_url(:thumb).to_s, controls: true %></p>
  
           </div>
  
           <br />
  
           <p>Created on: &lt;%= movie.created_on.strftime("%B-%d-%Y") %></p>
  
           <p>Owner: &lt;%= getType(movie.user) %>&lt;%= link_to movie.user.vname, user_path(movie.user) %></p>
  
        </div>
  
        &lt;% if ((index + 1) % 3) == 0 %>
  
           <br />
  
           <br />
  
        &lt;% end %>
  
     &lt;% end %>
  
  </div>
  
  <br />
  
  &lt;% if current_user %>
  
     <p class="pagetext">&lt;%= link_to "New Movie", new_subplaylist_movie_path(@subplaylist) %></p>
  
     <br />
  
  &lt;% end %>
  
  <p class="pagetext">&lt;%= link_to 'Back', user_mainplaylist_path(@mainplaylist.user.vname, @subplaylist.mainplaylist.title) %></p>

  Here is the subplaylists model

  class Subplaylist < ActiveRecord::Base
  
     attr_accessible :title, :description, :collab_mode
  
     belongs_to :user
  
     belongs_to :mainplaylist
  
     has_many :movies, :foreign_key => "subplaylist_id", :dependent => :destroy
  
     VALID_NAME = /\A[A-Za-z][A-Za-z1-9][A-Za-z1-9 ]+\z/
  
     validates :title, presence: true, format: {with: VALID_NAME}
  
     validates :description, presence: true
  
  end

  Here is the subplaylists controller code

  class SubplaylistsController < ApplicationController
  
     include SubplaylistsHelper
  
  
  
     def index
  
        mode "index"
  
     end
  
  
  
     def show
  
        mode "show"
  
     end
  
  
  
     def new
  
        mode "new"
  
     end
  
  
  
     def edit
  
        mode "edit"
  
     end
  
  
  
     def create
  
        mode "create"
  
     end
  
  
  
     def update
  
        mode "update"
  
     end
  
  
  
     def destroy
  
        mode "destroy"
  
     end
  
  end

  Here is the subplaylist helper code

  module SubplaylistsHelper
  
  
  
     def mode(type)
  
        code = auto_logout
  
        if(code == true)
  
           sign_out
  
           redirect_to root_path
  
        else
  
           #Check if Maintenance is turned_on
  
           allmode = Maintenancemode.find_by_id(1)
  
           subplaylistmode = Maintenancemode.find_by_id(18)
  
           mode_turned_on = (allmode.maintenance_on || subplaylistmode.maintenance_on)
  
           #Determine if any maintenance is on
  
           if(mode_turned_on)
  
              #Determine if we are a regular user
  
              regularUser = (!current_user || !current_user.admin?)
  
              if(regularUser)
  
                 #Determine which maintenance mode is on
  
                 if(allmode.maintenance_on)
  
                    redirect_to maintenance_path
  
                 else
  
                    redirect_to subplaylists_maintenance_path
  
                 end
  
              else
  
                 switch type
  
              end
  
           else
  
              switch type
  
           end
  
        end
  
     end
  
  
  
     private
  
        def getType(user)
  
           if(user.admin)
  
              value = "$"
  
           else
  
              typeFound = Usertype.find_by_user_id(user.id)
  
              if(typeFound)
  
                 type = typeFound.privilege
  
                 if(type == "Reviewer")
  
                    value = "^"
  
                 elsif(type == "Banned")
  
                    value = "!"
  
                 else
  
                    value = "~"
  
                 end
  
              else
  
                 value = "~"
  
              end
  
           end
  
           return value
  
        end
  
  
  
        def switch(type)
  
           if(type == "show")
  
              subplaylistFound = Subplaylist.find_by_id(params[:id])
  
              if(subplaylistFound)
  
                 mainplaylistFound = Mainplaylist.find_by_title(params[:mainplaylist_id])
  
                 if(mainplaylistFound)
  
                    playlistMatch = (subplaylistFound.mainplaylist_id == mainplaylistFound.id)
  
                    if(playlistMatch)
  
                       @mainplaylist = mainplaylistFound
  
                       @subplaylist = subplaylistFound
  
                       subplaylistMovies = @subplaylist.movies.all
  
                       reviewedMovies = subplaylistMovies
  
                       if(subplaylistMovies.count > 0)
  
                          reviewedMovies = subplaylistMovies.select{|movie| movie.reviewed}
  
                       end
  
                       @movies = Kaminari.paginate_array(reviewedMovies).page(params[:page]).per(10)
  
                    else
  
                       redirect_to root_path
  
                    end
  
                 else
  
                    render "public/404"
  
                 end
  
              else
  
                 redirect_to root_path
  
              end
  
           elsif(type == "destroy")
  
              logged_in = current_user
  
              if(logged_in)
  
                 subplaylistFound = Subplaylist.find_by_id(params[:id]) #Need to move this below the admin section to protect it
  
                 if(subplaylistFound)
  
                    if(logged_in.admin)
  
                       mainplaylistFound = Mainplaylist.find_by_id(subplaylistFound.mainplaylist_id)
  
                       if(mainplaylistFound)
  
                          @subplaylist = subplaylistFound
  
                          @mainplaylist = mainplaylistFound
  
                          @subplaylist.destroy
  
                          redirect_to mainplaylist_subplaylists_path(@mainplaylist)
  
                       else
  
                          render "public/404"
  
                       end
  
                    else
  
                       redirect_to root_path
  
                    end
  
                 else
  
                    render "public/404"
  
                 end
  
              else
  
                 redirect_to root_path
  
              end
  
           end
  
        end
  
  end

  Here is the User model

  class User < ActiveRecord::Base
  
     attr_accessible :email, :first_name, :last_name, :login_id, :vname, :password, :password_confirmation, :avatar
  
     has_secure_password
  
     mount_uploader :avatar, AvatarUploader
  
     before_save { |user| user.email = user.email.downcase }
  
     before_save { |user| user.first_name = user.first_name.humanize }
  
  
  
     #key
  
     has_one :sessionkey, :foreign_key => "user_id", :dependent => :destroy
  
     has_one :usertype, :foreign_key => "user_id", :dependent => :destroy
  
  
  
     #Video section
  
     has_many :mainplaylists, :foreign_key => "user_id", :dependent => :destroy
  
     has_many :subplaylists, :foreign_key => "user_id", :dependent => :destroy
  
     has_many :movies, :foreign_key => "user_id", :dependent => :destroy
  
  
  
     #validates :first_name, presence: true
  
     VALID_EMAIL_REGEX = /\A[\w+\-.]+@[a-z\d\-.]+\.[a-z]+\z/i
  
     VALID_NAME_REGEX = /\A[a-z][a-z][a-z]+\z/i
  
     VALID_VNAME_REGEX = /\A[A-Za-z][A-Za-z][A-Za-z][A-Za-z0-9 ]+([-][A-Za-z0-9 ]+)?\z/
  
     VALID_PASSWORD_REGEX = /\A[A-Za-z0-9!][A-Za-z0-9!][A-Za-z0-9!][A-Za-z0-9!][A-Za-z0-9!][A-Za-z0-9!]+\z/
  
     validates :first_name, presence: true, format: { with: VALID_NAME_REGEX}
  
     validates :last_name, presence: true, format: { with: VALID_NAME_REGEX}
  
     validates :email, presence: true, format: { with: VALID_EMAIL_REGEX}
  
     validates :login_id, presence: true, format: { with: VALID_VNAME_REGEX}, uniqueness: { case_sensitive: false}
  
     validates :vname, presence: true, format: { with: VALID_VNAME_REGEX}, uniqueness: { case_sensitive: false}
  
     validates :password, length: {minimum: 6}#, format: { with: VALID_PASSWORD_REGEX}
  
     validates :password_confirmation, presence: true #, format: { with: VALID_PASSWORD_REGEX}
  
  
  
     def to_param
  
        vname
  
     end
  
  end

  Here is the sessionkey model

  class Sessionkey < ActiveRecord::Base
  
    belongs_to :user
  
  end

  Here is the usertype model

  class Usertype < ActiveRecord::Base
  
    attr_accessible :privilege, :user_id #Only priviledge will be changeable
  
    belongs_to :user
  
  end

  Error message

  No such file or directory - ffmpeg -i /home/eric/Projects/Local/Lduelingpets/Trial/public/uploads/tmp/1466811951-3149-2702/mp4_TrialMovies.mp4

• Subtitling Sierra RBT Files

  2 juin 2016, par Multimedia Mike — Game Hacking

  This is part 2 of the adventure started in my Subtitling Sierra VMD Files post. After I completed the VMD subtitling, The Translator discovered a wealth of animation files in a format called RBT (this apparently stands for “Robot” but I think “Ribbit” format could be more fun). What are we going to do ? We had come so far by solving the VMD subtitling problem for Phantasmagoria. It would be a shame if the effort ground to a halt due to this.

  Fortunately, the folks behind the ScummVM project already figured out enough of the format to be able to decode the RBT files in Phantasmagoria.

  In the end, I was successful in creating a completely standalone tool that can take a Robot file and a subtitle file and create a new Robot file with subtitles. The source code is here (subtitle-rbt.c). Here’s what the final result looks like :

  
  
  “What’s in the refrigerator ?” I should note at this juncture that I am not sure if this particular Robot file even has sound or dialogue since I was conducting these experiments on a computer with non-working audio.
  

  The RBT Format
  I have created a new MultimediaWiki page describing the Robot Animation format based on the ScummVM source code. I have not worked with a format quite like this before. These are paletted animations which consist of a sequence of independent frames that are designed to be overlaid on top of static background. Because of these characteristics, each frame encodes its own unique dimensions and origin coordinate within the frame. While the Phantasmagoria VMD files are usually 288×144 (which are usually double-sized for the benefit of a 640×400 Super VGA canvas), these frames are meant to be plotted on a game field that was roughly 576×288 (288×144 doublesized).
  

  For example, 2 minimalist animation frames from a desk investigation Robot file :

  
  
  100×147

  
  101×149
  

  As for compression, my first impression was that the algorithm was the same as VMD. This is wrong. It evidently uses an unmodified version of a standard algorithm called Lempel-Ziv-Stac (LZS). It shows up in several RFCs and was apparently used in MS-DOS’s transparent disk compression scheme.

  Approach
  Thankfully, many of the lessons I learned from the previous project are applicable to this project, including : subtitle library interfacing, subtitling in the paletted colorspace, and replacing encoded frames from the original file instead of trying to create a new file.

  Here is the pitch for this project :

  • Create a C program that can traverse through an input file, piece by piece, and generate an output file. The result of this should be a bitwise identical file.
  • Adapt the LZS compression decoding algorithm from ScummVM into the new tool. Make the tool dump raw Portable NetMap (PNM) files of varying dimensions and ensure that they look correct.
  • Compress using LZS.
  • Stretch the frames and draw subtitles.
  • More compression. Find the minimum window for each frame.

  Compression
  Normally, my first goal is to decompress the video and store the data in a raw form. However, this turned out to be mathematically intractable. While the format does support both compressed and uncompressed frames (even though ScummVM indicates that the uncompressed path is yet unexercised), the goal of this project requires making the frames so large that they overflow certain parameters of the file.

  A Robot file has a sequence of frames and 2 tables describing the size of each frame. One table describes the entire frame size (audio + video) while the second table describes just the video frame size. Since these tables only use 16 bits to specify a size, the maximum frame size is 65536 bytes. Leaving space for the audio portion of the frame, this only leaves a per-frame byte budget of about 63000 bytes for the video. Expanding the frame to 576×288 (165,888 pixels) would overflow this limit.

  Anyway, the upshot is that I needed to compress the data up front.

  Fortunately, the LZS compressor is pretty straightforward, at least if you have experience writing VLC-oriented codecs. While the algorithm revolves around back references, my approach was to essentially write an RLE encoder. My compressor would search for runs of data (plentiful when I started to stretch the frame for subtitling purposes). When a run length of n=3 or more of the same pixel is found, encode the pixel by itself, and then store a back reference of offset -1 and length (n-1). It took a little while to iron out a few problems, but I eventually got it to work perfectly.

  I have to say, however, that the format is a little bit weird in how it codes very large numbers. The length encoding is somewhat Golomb-like, i.e., smaller values are encoded with fewer bits. However, when it gets to large numbers, it starts encoding counts of 15 as blocks of 1111. For example, 24 is bigger than 7. Thus, emit 1111 into the bitstream and subtract 8 from 23 -> 16. Still bigger than 15, so stuff another 1111 into the bitstream and subtract 15. Now we’re at 1, so stuff 0001. So 24 is 11111111 0001. 12 bits is not too horrible. But the total number of bytes (value / 30). So a value of 300 takes around 10 bytes (80 bits) to encode.

  Palette Slices
  As in the VMD subtitling project, I took the subtitle color offered in the subtitle spec file as a suggestion and used Euclidean distance to match to the closest available color in the palette. One problem, however, is that the palette is a lot smaller in these animations. According to my notes, for the set of animations I scanned, only about 80 colors were specified, starting at palette index 55. I hypothesize that different slices of the palette are reserved for different uses. E.g., animation, background, and user interface. Thus, there is a smaller number of colors to draw upon for subtitling purposes.

  Scaling
  One bit of residual weirdness in this format is the presence of a per-frame scale factor. While most frames set this to 100 (100% scale), I have observed 70%, 80%, and 90%. ScummVM is a bit unsure about how to handle these, so I am as well. However, I eventually realized I didn’t really need to care, at least not when decoding and re-encoding the frame. Just preserve the scale factor. I intend to modify the tool further to take scale factor into account when creating the subtitle.

  The Final Resolution
  Right around the time that I was composing this post, The Translator emailed me and notified me that he had found a better way to subtitle the Robot files by modifying the scripts, rendering my entire approach moot. The result is much cleaner :

  
  
  Turns out that the engine supported subtitles all along
  

  It’s a good thing that I enjoyed the challenge or I might be annoyed at this point.

  See Also

  • Subtitling Sierra VMD Files : My effort to subtitle the main FMV files found in Sierra games.