Recherche avancée

Sur d’autres sites (7578)

• How to make video from images using Java + x264 ; cross platform solution required

  19 octobre 2014, par Shashank Tulsyan

  I have made a software which records my entire day into a video.
  Example video : https://www.youtube.com/watch?v=ITZYMMcubdw (Note : >16hrs compressed in 2mins, video speed too high, might cause epilepsy :P )

  The approach that I use right now is, Avisynth + x264 + Java.
  This is very very efficient. The video for entire day is created in 3-4mins, and reduced to a size of 40-50MB. This is perfect, the only issue is that this solution is not cross platform.
  Does anyone have a better idea ?

  I tried using java based x246 libraries but

  1. They are slow as hell
  2. The video output size is too big
  3. The video quality is not satisfactory.

  Some website suggest a command such as :

  x264.exe --crf 18 --fps 24 --input-res 1920x1080 --input-csp rgb -o "T:\crf18.mkv" "T:\___BBB\big_buck_bunny_%05d.png"

  There are 2 problems with this approach.

  1. As far as I know, x264 does accept image sequence as input, ffmpeg does
  2. The input images are not named in sequence such as image01.png , image02.png etc. They are named as timestamp_as_longinteger.png . So inorder to allow x264 to accept these images as input, I have to rename all of them ( i make a symbolic link for all images in a new folder ). This approach is again unsatisfactory, because I need more flexibility in selecting/unselecting files which would be converted to a video. Right now my approach is a hack.

  The best solution is x264. But not sure how I can send it an image sequence from Java. That too, images which are not named in sequential fashion.

  ---

  BTW The purpose of making video is going back in time, and finding out how time was spend/wasted.
  The software is aware of what the user is doing. So using this I can find out (visually) how a class evolved with time. How much time I spend on a particular class/package/module/project/customer. The granuality right now is upto the class level, I wish to take it to the function level. The software is called jitendriya.

  

  ---

  Here is 1 solution
  How does one encode a series of images into H264 using the x264 C API ?

  But this is for C. If I have to do the same in java, and in a cross plaform fashion, I will have to resort to JNA/JNI. JNA might have a significant performance hit. JNI would be more work.
  FFMpeg also looks like a nice alternative, but I am still not satisfied by any of these solutions looking at the pros and cons.

  ---

  Solution Adapted.

  package weeklyvideomaker;
  
  
  
  import java.awt.AWTException;
  
  import java.awt.Rectangle;
  
  import java.awt.Robot;
  
  import java.awt.Toolkit;
  
  import java.awt.image.BufferedImage;
  
  import java.io.File;
  
  import java.io.IOException;
  
  import java.io.OutputStream;
  
  import java.util.Calendar;
  
  import java.util.LinkedList;
  
  import java.util.logging.Level;
  
  import java.util.logging.Logger;
  
  import neembuu.release1.util.StreamGobbler;
  
  import org.shashaank.activitymonitor.ScreenCaptureHandler;
  
  import org.shashaank.jitendriya.JitendriyaParams;
  
  
  
  /**
  
   *
  
   * @author Shashank
  
   */
  
  public class DirectVideoScreenHandler implements ScreenCaptureHandler {
  
      private final JitendriyaParams  jp;
  
  
  
      private String extension="264";
  
      private boolean lossless=false;
  
      private String fps="24/1";
  
  
  
      private Process p = null;
  
      private Rectangle r1;
  
      private Robot r;
  
  
  
      private int currentDay;
  
  
  
      private static final String[]weeks={"sun","mon","tue","wed","thu","fri","sat"};
  
  
  
      public DirectVideoScreenHandler(JitendriyaParams jp) {
  
          this.jp = jp;
  
      }
  
  
  
      public String getExtension() {
  
          return extension;
  
      }
  
  
  
      public void setExtension(String extension) {
  
          this.extension = extension;
  
      }
  
  
  
      public boolean isLossless() {
  
          return lossless;
  
      }
  
  
  
      public void setLossless(boolean lossless) {
  
          this.lossless = lossless;
  
      }
  
  
  
      public String getFps() {
  
          return fps;
  
      }
  
  
  
      public void setFps(String fps) {
  
          this.fps = fps;
  
      }
  
  
  
      private static int getday(){
  
          return Calendar.getInstance().get(Calendar.DAY_OF_WEEK) - 1;
  
      }
  
  
  
      public void make()throws IOException,AWTException{
  
          currentDay = getday();
  
          File week = jp.getWeekFolder();
  
  
  
          String destinationFile = week+"\\videos\\"+weeks[currentDay]+"_"+System.currentTimeMillis()+"_direct."+extension;
  
  
  
          r = new Robot();
  
          r1 = getScreenSize();
  
  
  
          ProcessBuilder pb = makeProcess(destinationFile, 0, r1.width, r1.height);
  
  
  
          p = pb.start();
  
          StreamGobbler out = new StreamGobbler(p.getInputStream(), "out");
  
          StreamGobbler err = new StreamGobbler(p.getErrorStream(), "err");
  
          out.start();err.start();
  
      }
  
  
  
      private static Rectangle getScreenSize(){
  
          return new Rectangle(Toolkit.getDefaultToolkit().getScreenSize());
  
      }
  
  
  
      private void screenShot(OutputStream os)throws IOException{        
  
          BufferedImage bi = r.createScreenCapture(r1);
  
          int[]intRawData = ((java.awt.image.DataBufferInt)
  
                  bi.getRaster().getDataBuffer()).getData();
  
          byte[]rawData = new byte[intRawData.length*3];
  
          for (int i = 0; i < intRawData.length; i++) {
  
              int rgb = intRawData[i];
  
              rawData[ i*3 + 0 ] = (byte) (rgb >> 16);
  
              rawData[ i*3 + 1 ] = (byte) (rgb >> 8);
  
              rawData[ i*3 + 2 ] = (byte) (rgb);
  
          }
  
          os.write(rawData);
  
      }
  
  
  
      private ProcessBuilder makeProcess(String destinationFile, int numberOfFrames,
  
              int width, int height){
  
          LinkedList<string> commands = new LinkedList&lt;>();
  
          commands.add("\""+encoderPath()+"\"");
  
          if(true){
  
              commands.add("-");
  
              if(lossless){
  
                  commands.add("--qp");
  
                  commands.add("0");
  
              }
  
              commands.add("--keyint");
  
              commands.add("240");
  
              commands.add("--sar");
  
              commands.add("1:1");
  
              commands.add("--output");
  
              commands.add("\""+destinationFile+"\"");
  
              if(numberOfFrames>0){
  
                  commands.add("--frames");
  
                  commands.add(String.valueOf(numberOfFrames));
  
              }else{
  
                  commands.add("--stitchable");
  
              }
  
              commands.add("--fps");
  
              commands.add(fps);
  
              commands.add("--input-res");
  
              commands.add(width+"x"+height);
  
              commands.add("--input-csp");
  
              commands.add("rgb");//i420
  
          }
  
          return new ProcessBuilder(commands);
  
      }
  
  
  
      private String encoderPath(){
  
          return jp.getToolsPath()+File.separatorChar+"x264_64.exe";
  
      }
  
  
  
      @Override public void run() {
  
          try {
  
              if(p==null){
  
                  make();
  
              }
  
              if(currentDay!=getday()){// day changed
  
                  destroy(); 
  
                  return;
  
              }
  
              if(!r1.equals(getScreenSize())){// screensize changed
  
                  destroy();
  
                  return;
  
              }
  
              screenShot(p.getOutputStream());
  
          } catch (Exception ex) {
  
              Logger.getLogger(DirectVideoScreenHandler.class.getName()).log(Level.SEVERE, null, ex);
  
          }
  
      }
  
  
  
      private void destroy()throws Exception{
  
          p.getOutputStream().flush();
  
          p.getOutputStream().close();
  
          p.destroy();
  
          p = null;
  
      }
  
  
  
  }
  
  </string>

  ---

  package weeklyvideomaker;
  
  
  
  import org.shashaank.jitendriya.JitendriyaParams;
  
  
  
  /**
  
   *
  
   * @author Shashank
  
   */
  
  public class DirectVideoScreenHandlerTest {
  
      public static void main(String[] args)throws Exception {
  
          JitendriyaParams  jp = new JitendriyaParams.Builder()
  
                  .setToolsPath("F:\\GeneralProjects\\JReminder\\development_environment\\tools")
  
                  .setOsDependentDataFolderPath("J:\\jt_data")
  
                  .build();
  
          DirectVideoScreenHandler w = new DirectVideoScreenHandler(jp);
  
          w.setExtension("264");
  
          w.setFps("24/1");
  
          w.setLossless(false);
  
          w.make();
  
  
  
          for (int i = 0; ; i++) {
  
              w.run();
  
              Thread.sleep(1000);
  
          }
  
      }
  
  }

• Add image or photo in the background of .3gp file

  17 août 2014, par psouza

  I have an android app that records audio in 3gp format. Audio is recorded successfully and the file created.

  I would add at least an image file to 3gp created but without using external libraries like ffmpeg, javacv as they leave the app created over 10MB in size.

  Basically what I would like is information and sources about what search to add images to the background of my files 3gp audio libraries created without weighing the size of my apps.

  Thank you

• Zlib vs. XZ on 2SF

  21 juillet 2012, par Multimedia Mike — General, psf, saltygme, xz, zlib

  I recently released my Game Music Appreciation website. It allows users to play an enormous range of video game music directly in their browsers. To do this, the site has to host the music. And since I’m a compression bore, I have to know how small I can practically make these music files. I already published the results of my effort to see if XZ could beat RAR (RAR won, but only slightly, and I still went with XZ for the project) on the corpus of Super Nintendo chiptune sets. Next is the corpus of Nintendo DS chiptunes.

  Repacking Nintendo DS 2SF
  The prevailing chiptune format for storing Nintendo DS songs is the .2sf format. This is a subtype of the Portable Sound Format (PSF). The designers had the foresight to build compression directly into the format. Much of payload data in a PSF file is compressed with zlib. Since I already incorporated Embedded XZ into the player project, I decided to try repacking the PSF payload data from zlib -> xz.

  In an effort to not corrupt standards too much, I changed the ’PSF’ file signature (seen in the first 3 bytes of a file) to ’psf’.

  Results
  There are about 900 Nintendo DS games currently represented in my website’s archive. Total size of the original PSF archive, payloads packed with zlib : 2.992 GB. Total size of the same archive with payloads packed as xz : 2.059 GB.

  Using xz vs. zlib saved me nearly a gigabyte of storage. That extra storage doesn’t really impact my hosting plan very much (I have 1/2 TB, which is why I’m so nonchalant about hosting the massive MPlayer Samples Archive). However, smaller individual files translates to a better user experience since the files are faster to download.

  Here is a pretty picture to illustrate the space savings :

  
  
  

  The blue occasionally appears to dip below the orange but the data indicates that xz is always more efficient than zlib. Here’s the raw data (comes in vanilla CSV flavor too).

  Interface Impact
  So the good news for the end user is that the songs are faster to load up front. The downside is that there can be a noticeable delay when changing tracks. Even though all songs are packaged into one file for download, and the entire file is downloaded before playback begins, each song is individually compressed. Thus, changing tracks triggers another decompression operation. I’m toying the possibility of some sort of background process that decompresses song (n+1) while playing song (n) in order to help compensate for this.

  I don’t like the idea of decompressing everything up front because A) it would take even longer to start playing ; and B) it would take a huge amount of memory.

  Corner Case
  There was at least one case in which I found zlib to be better than xz. It looks like zlib’s minimum block size is smaller than xz’s. I think I discovered xz to be unable to compress a few bytes to a block any smaller than about 60-64 bytes while zlib got it down into the teens. However, in those cases, it was more efficient to just leave the data uncompressed anyway.