Recherche avancée

Sur d’autres sites (5648)

• squeeze image while capturing video with FFmpegFrameRecorder

  12 avril 2016, par Saty

  I am trying to stream video with FFmpegFrameRecorder using javacv. All are working great except I find videos which are actually images are bit squeeze from the height.

  I am using the below code which half of the internet community is using to live stream

  public class MainActivity extends Activity implements OnClickListener {
  
  
  
  private final static String LOG_TAG = "MainActivity";
  
  
  
  private PowerManager.WakeLock mWakeLock;
  
  
  
  private String ffmpeg_link = "rtmp://username:password@xxx.xxx.xxx.xxx:1935/live/test.flv";
  
  //private String ffmpeg_link = "/mnt/sdcard/new_stream.flv";
  
  
  
  private volatile FFmpegFrameRecorder recorder;
  
  boolean recording = false;
  
  long startTime = 0;
  
  
  
  private int sampleAudioRateInHz = 44100;
  
  private int imageWidth = 320;
  
  private int imageHeight = 240;
  
  private int frameRate = 30;
  
  
  
  private Thread audioThread;
  
  volatile boolean runAudioThread = true;
  
  private AudioRecord audioRecord;
  
  private AudioRecordRunnable audioRecordRunnable;
  
  
  
  private CameraView cameraView;
  
  private IplImage yuvIplimage = null;
  
  
  
  private Button recordButton;
  
  private LinearLayout mainLayout;
  
  
  
  @Override
  
  public void onCreate(Bundle savedInstanceState) {
  
      super.onCreate(savedInstanceState);
  
  
  
      setRequestedOrientation(ActivityInfo.SCREEN_ORIENTATION_LANDSCAPE);
  
      setContentView(R.layout.activity_main);
  
  
  
      initLayout();
  
      initRecorder();
  
  }
  
  
  
  @Override
  
  protected void onResume() {
  
      super.onResume();
  
  
  
      if (mWakeLock == null) {
  
          PowerManager pm = (PowerManager) getSystemService(Context.POWER_SERVICE); 
  
          mWakeLock = pm.newWakeLock(PowerManager.SCREEN_BRIGHT_WAKE_LOCK, LOG_TAG); 
  
          mWakeLock.acquire(); 
  
      }
  
  }
  
  
  
  @Override
  
  protected void onPause() {
  
      super.onPause();
  
  
  
      if (mWakeLock != null) {
  
          mWakeLock.release();
  
          mWakeLock = null;
  
      }
  
  }
  
  
  
  @Override
  
  protected void onDestroy() {
  
      super.onDestroy();
  
  
  
      recording = false;
  
  }
  
  
  
  
  
  private void initLayout() {
  
  
  
      mainLayout = (LinearLayout) this.findViewById(R.id.record_layout);
  
  
  
      recordButton = (Button) findViewById(R.id.recorder_control);
  
      recordButton.setText("Start");
  
      recordButton.setOnClickListener(this);
  
  
  
      cameraView = new CameraView(this);
  
  
  
      LinearLayout.LayoutParams layoutParam = new LinearLayout.LayoutParams(imageWidth, imageHeight);        
  
      mainLayout.addView(cameraView, layoutParam);
  
      Log.v(LOG_TAG, "added cameraView to mainLayout");
  
  }
  
  
  
  private void initRecorder() {
  
      Log.w(LOG_TAG,"initRecorder");
  
  
  
      if (yuvIplimage == null) {
  
          // Recreated after frame size is set in surface change method
  
          yuvIplimage = IplImage.create(imageWidth, imageHeight, IPL_DEPTH_8U, 2);
  
          //yuvIplimage = IplImage.create(imageWidth, imageHeight, IPL_DEPTH_32S, 2);
  
  
  
          Log.v(LOG_TAG, "IplImage.create");
  
      }
  
  
  
      recorder = new FFmpegFrameRecorder(ffmpeg_link, imageWidth, imageHeight, 1);
  
      Log.v(LOG_TAG, "FFmpegFrameRecorder: " + ffmpeg_link + " imageWidth: " + imageWidth + " imageHeight " + imageHeight);
  
  
  
      recorder.setFormat("flv");
  
      Log.v(LOG_TAG, "recorder.setFormat(\"flv\")");
  
  
  
      recorder.setSampleRate(sampleAudioRateInHz);
  
      Log.v(LOG_TAG, "recorder.setSampleRate(sampleAudioRateInHz)");
  
  
  
      // re-set in the surface changed method as well
  
      recorder.setFrameRate(frameRate);
  
      Log.v(LOG_TAG, "recorder.setFrameRate(frameRate)");
  
  
  
      // Create audio recording thread
  
      audioRecordRunnable = new AudioRecordRunnable();
  
      audioThread = new Thread(audioRecordRunnable);
  
  }
  
  
  
  // Start the capture
  
  public void startRecording() {
  
      try {
  
          recorder.start();
  
          startTime = System.currentTimeMillis();
  
          recording = true;
  
          audioThread.start();
  
      } catch (FFmpegFrameRecorder.Exception e) {
  
          e.printStackTrace();
  
      }
  
  }
  
  
  
  public void stopRecording() {
  
      // This should stop the audio thread from running
  
      runAudioThread = false;
  
  
  
      if (recorder != null && recording) {
  
          recording = false;
  
          Log.v(LOG_TAG,"Finishing recording, calling stop and release on recorder");
  
          try {
  
              recorder.stop();
  
              recorder.release();
  
          } catch (FFmpegFrameRecorder.Exception e) {
  
              e.printStackTrace();
  
          }
  
          recorder = null;
  
      }
  
  }
  
  
  
  @Override
  
  public boolean onKeyDown(int keyCode, KeyEvent event) {
  
      // Quit when back button is pushed
  
      if (keyCode == KeyEvent.KEYCODE_BACK) {
  
          if (recording) {
  
              stopRecording();
  
          }
  
          finish();
  
          return true;
  
      }
  
      return super.onKeyDown(keyCode, event);
  
  }
  
  
  
  @Override
  
  public void onClick(View v) {
  
      if (!recording) {
  
          startRecording();
  
          Log.w(LOG_TAG, "Start Button Pushed");
  
          recordButton.setText("Stop");
  
      } else {
  
          stopRecording();
  
          Log.w(LOG_TAG, "Stop Button Pushed");
  
          recordButton.setText("Start");
  
      }
  
  }
  
  
  
  //---------------------------------------------
  
  // audio thread, gets and encodes audio data
  
  //---------------------------------------------
  
  class AudioRecordRunnable implements Runnable {
  
  
  
      @Override
  
      public void run() {
  
          // Set the thread priority
  
          android.os.Process.setThreadPriority(android.os.Process.THREAD_PRIORITY_URGENT_AUDIO);
  
  
  
          // Audio
  
          int bufferSize;
  
          short[] audioData;
  
          int bufferReadResult;
  
  
  
          bufferSize = AudioRecord.getMinBufferSize(sampleAudioRateInHz, 
  
                  AudioFormat.CHANNEL_CONFIGURATION_MONO, AudioFormat.ENCODING_PCM_16BIT);
  
          audioRecord = new AudioRecord(MediaRecorder.AudioSource.MIC, sampleAudioRateInHz, 
  
                  AudioFormat.CHANNEL_CONFIGURATION_MONO, AudioFormat.ENCODING_PCM_16BIT, bufferSize);
  
  
  
          audioData = new short[bufferSize];
  
  
  
          Log.d(LOG_TAG, "audioRecord.startRecording()");
  
          audioRecord.startRecording();
  
  
  
          // Audio Capture/Encoding Loop
  
          while (runAudioThread) {
  
              // Read from audioRecord
  
              bufferReadResult = audioRecord.read(audioData, 0, audioData.length);
  
              if (bufferReadResult > 0) {
  
                  //Log.v(LOG_TAG,"audioRecord bufferReadResult: " + bufferReadResult);
  
  
  
                  // Changes in this variable may not be picked up despite it being "volatile"
  
                  if (recording) {
  
                      try {
  
                          // Write to FFmpegFrameRecorder
  
                          Buffer[] buffer = {ShortBuffer.wrap(audioData, 0, bufferReadResult)};                        
  
                          recorder.record(buffer);
  
                      } catch (FFmpegFrameRecorder.Exception e) {
  
                          Log.v(LOG_TAG,e.getMessage());
  
                          e.printStackTrace();
  
                      }
  
                  }
  
              }
  
          }
  
          Log.v(LOG_TAG,"AudioThread Finished");
  
  
  
          /* Capture/Encoding finished, release recorder */
  
          if (audioRecord != null) {
  
              audioRecord.stop();
  
              audioRecord.release();
  
              audioRecord = null;
  
              Log.v(LOG_TAG,"audioRecord released");
  
          }
  
      }
  
  }
  
  
  
  class CameraView extends SurfaceView implements SurfaceHolder.Callback, PreviewCallback {
  
  
  
      private boolean previewRunning = false;
  
  
  
      private SurfaceHolder holder;
  
      private Camera camera;
  
  
  
      private byte[] previewBuffer;
  
  
  
      long videoTimestamp = 0;
  
  
  
      Bitmap bitmap;
  
      Canvas canvas;
  
  
  
      public CameraView(Context _context) {
  
          super(_context);
  
  
  
          holder = this.getHolder();
  
          holder.addCallback(this);
  
          holder.setType(SurfaceHolder.SURFACE_TYPE_PUSH_BUFFERS);
  
      }
  
  
  
      @Override
  
      public void surfaceCreated(SurfaceHolder holder) {
  
          camera = Camera.open();
  
  
  
          try {
  
              camera.setPreviewDisplay(holder);
  
              camera.setPreviewCallback(this);
  
  
  
              Camera.Parameters currentParams = camera.getParameters();
  
              Log.v(LOG_TAG,"Preview Framerate: " + currentParams.getPreviewFrameRate());
  
              Log.v(LOG_TAG,"Preview imageWidth: " + currentParams.getPreviewSize().width + " imageHeight: " + currentParams.getPreviewSize().height);
  
  
  
              // Use these values
  
              imageWidth = currentParams.getPreviewSize().width;
  
              imageHeight = currentParams.getPreviewSize().height;
  
              frameRate = currentParams.getPreviewFrameRate();                
  
  
  
              bitmap = Bitmap.createBitmap(imageWidth, imageHeight, Bitmap.Config.ALPHA_8);
  
  
  
  
  
              /*
  
              Log.v(LOG_TAG,"Creating previewBuffer size: " + imageWidth * imageHeight * ImageFormat.getBitsPerPixel(currentParams.getPreviewFormat())/8);
  
              previewBuffer = new byte[imageWidth * imageHeight * ImageFormat.getBitsPerPixel(currentParams.getPreviewFormat())/8];
  
              camera.addCallbackBuffer(previewBuffer);
  
              camera.setPreviewCallbackWithBuffer(this);
  
              */              
  
  
  
              camera.startPreview();
  
              previewRunning = true;
  
          }
  
          catch (IOException e) {
  
              Log.v(LOG_TAG,e.getMessage());
  
              e.printStackTrace();
  
          }   
  
      }
  
  
  
      public void surfaceChanged(SurfaceHolder holder, int format, int width, int height) {
  
          Log.v(LOG_TAG,"Surface Changed: width " + width + " height: " + height);
  
  
  
          // We would do this if we want to reset the camera parameters
  
          /*
  
          if (!recording) {
  
              if (previewRunning){
  
                  camera.stopPreview();
  
              }
  
              try {
  
                  //Camera.Parameters cameraParameters = camera.getParameters();
  
                  //p.setPreviewSize(imageWidth, imageHeight);
  
                  //p.setPreviewFrameRate(frameRate);
  
                  //camera.setParameters(cameraParameters);
  
  
  
                  camera.setPreviewDisplay(holder);
  
                  camera.startPreview();
  
                  previewRunning = true;
  
              }
  
              catch (IOException e) {
  
                  Log.e(LOG_TAG,e.getMessage());
  
                  e.printStackTrace();
  
              }   
  
          }            
  
          */
  
  
  
          // Get the current parameters
  
          Camera.Parameters currentParams = camera.getParameters();
  
          Log.v(LOG_TAG,"Preview Framerate: " + currentParams.getPreviewFrameRate());
  
          Log.v(LOG_TAG,"Preview imageWidth: " + currentParams.getPreviewSize().width + " imageHeight: " + currentParams.getPreviewSize().height);
  
  
  
          // Use these values
  
          imageWidth = currentParams.getPreviewSize().width;
  
          imageHeight = currentParams.getPreviewSize().height;
  
          frameRate = currentParams.getPreviewFrameRate();
  
  
  
          // Create the yuvIplimage if needed
  
          yuvIplimage = IplImage.create(imageWidth, imageHeight, IPL_DEPTH_8U, 2);
  
          //yuvIplimage = IplImage.create(imageWidth, imageHeight, IPL_DEPTH_32S, 2);
  
      }
  
  
  
      @Override
  
      public void surfaceDestroyed(SurfaceHolder holder) {
  
          try {
  
              camera.setPreviewCallback(null);
  
  
  
              previewRunning = false;
  
              camera.release();
  
  
  
          } catch (RuntimeException e) {
  
              Log.v(LOG_TAG,e.getMessage());
  
              e.printStackTrace();
  
          }
  
      }
  
  
  
      @Override
  
      public void onPreviewFrame(byte[] data, Camera camera) {
  
  
  
          if (yuvIplimage != null && recording) {
  
              videoTimestamp = 1000 * (System.currentTimeMillis() - startTime);
  
  
  
              // Put the camera preview frame right into the yuvIplimage object
  
              yuvIplimage.getByteBuffer().put(data);
  
  
  
              // FAQ about IplImage:
  
              // - For custom raw processing of data, getByteBuffer() returns an NIO direct
  
              //   buffer wrapped around the memory pointed by imageData, and under Android we can
  
              //   also use that Buffer with Bitmap.copyPixelsFromBuffer() and copyPixelsToBuffer().
  
              // - To get a BufferedImage from an IplImage, we may call getBufferedImage().
  
              // - The createFrom() factory method can construct an IplImage from a BufferedImage.
  
              // - There are also a few copy*() methods for BufferedImage<->IplImage data transfers.
  
  
  
              // Let's try it..
  
              // This works but only on transparency
  
              // Need to find the right Bitmap and IplImage matching types
  
  
  
              /*
  
              bitmap.copyPixelsFromBuffer(yuvIplimage.getByteBuffer());
  
              //bitmap.setPixel(10,10,Color.MAGENTA);
  
  
  
              canvas = new Canvas(bitmap);
  
              Paint paint = new Paint(); 
  
              paint.setColor(Color.GREEN);
  
              float leftx = 20; 
  
              float topy = 20; 
  
              float rightx = 50; 
  
              float bottomy = 100; 
  
              RectF rectangle = new RectF(leftx,topy,rightx,bottomy); 
  
              canvas.drawRect(rectangle, paint);
  
  
  
              bitmap.copyPixelsToBuffer(yuvIplimage.getByteBuffer());
  
              */
  
              //Log.v(LOG_TAG,"Writing Frame");
  
  
  
              try {
  
  
  
                  // Get the correct time
  
                  recorder.setTimestamp(videoTimestamp);
  
  
  
                  // Record the image into FFmpegFrameRecorder
  
                  recorder.record(yuvIplimage);
  
  
  
              } catch (FFmpegFrameRecorder.Exception e) {
  
                  Log.v(LOG_TAG,e.getMessage());
  
                  e.printStackTrace();
  
              }
  
          }
  
      }
  
  }

  }

• Cant we use mp4 as format of FFmpegFrameRecorder while RTMP streaming

  13 avril 2016, par Saty

  I am trying to stream video with FFmpegFrameRecorder using javacv. All are working good however I want to use "mp4" as the recording format instead of FLV. is that possible because when i set that, it crashed ?

  I am using the below code which half of the internet community is using to live stream

  public class MainActivity extends Activity implements OnClickListener {
  
  
  
  private final static String LOG_TAG = "MainActivity";
  
  
  
  private PowerManager.WakeLock mWakeLock;
  
  
  
  private String ffmpeg_link = "rtmp://username:password@xxx.xxx.xxx.xxx:1935/live/test.flv";
  
  //private String ffmpeg_link = "/mnt/sdcard/new_stream.flv";
  
  
  
  private volatile FFmpegFrameRecorder recorder;
  
  boolean recording = false;
  
  long startTime = 0;
  
  
  
  private int sampleAudioRateInHz = 44100;
  
  private int imageWidth = 320;
  
  private int imageHeight = 240;
  
  private int frameRate = 30;
  
  
  
  private Thread audioThread;
  
  volatile boolean runAudioThread = true;
  
  private AudioRecord audioRecord;
  
  private AudioRecordRunnable audioRecordRunnable;
  
  
  
  private CameraView cameraView;
  
  private IplImage yuvIplimage = null;
  
  
  
  private Button recordButton;
  
  private LinearLayout mainLayout;
  
  
  
  @Override
  
  public void onCreate(Bundle savedInstanceState) {
  
      super.onCreate(savedInstanceState);
  
  
  
      setRequestedOrientation(ActivityInfo.SCREEN_ORIENTATION_LANDSCAPE);
  
      setContentView(R.layout.activity_main);
  
  
  
      initLayout();
  
      initRecorder();
  
  }
  
  
  
  @Override
  
  protected void onResume() {
  
      super.onResume();
  
  
  
      if (mWakeLock == null) {
  
          PowerManager pm = (PowerManager) getSystemService(Context.POWER_SERVICE); 
  
          mWakeLock = pm.newWakeLock(PowerManager.SCREEN_BRIGHT_WAKE_LOCK, LOG_TAG); 
  
          mWakeLock.acquire(); 
  
      }
  
  }
  
  
  
  @Override
  
  protected void onPause() {
  
      super.onPause();
  
  
  
      if (mWakeLock != null) {
  
          mWakeLock.release();
  
          mWakeLock = null;
  
      }
  
  }
  
  
  
  @Override
  
  protected void onDestroy() {
  
      super.onDestroy();
  
  
  
      recording = false;
  
  }
  
  
  
  
  
  private void initLayout() {
  
  
  
      mainLayout = (LinearLayout) this.findViewById(R.id.record_layout);
  
  
  
      recordButton = (Button) findViewById(R.id.recorder_control);
  
      recordButton.setText("Start");
  
      recordButton.setOnClickListener(this);
  
  
  
      cameraView = new CameraView(this);
  
  
  
      LinearLayout.LayoutParams layoutParam = new LinearLayout.LayoutParams(imageWidth, imageHeight);        
  
      mainLayout.addView(cameraView, layoutParam);
  
      Log.v(LOG_TAG, "added cameraView to mainLayout");
  
  }
  
  
  
  private void initRecorder() {
  
      Log.w(LOG_TAG,"initRecorder");
  
  
  
      if (yuvIplimage == null) {
  
          // Recreated after frame size is set in surface change method
  
          yuvIplimage = IplImage.create(imageWidth, imageHeight, IPL_DEPTH_8U, 2);
  
          //yuvIplimage = IplImage.create(imageWidth, imageHeight, IPL_DEPTH_32S, 2);
  
  
  
          Log.v(LOG_TAG, "IplImage.create");
  
      }
  
  
  
      recorder = new FFmpegFrameRecorder(ffmpeg_link, imageWidth, imageHeight, 1);
  
      Log.v(LOG_TAG, "FFmpegFrameRecorder: " + ffmpeg_link + " imageWidth: " + imageWidth + " imageHeight " + imageHeight);
  
  
  
      recorder.setFormat("flv");
  
      Log.v(LOG_TAG, "recorder.setFormat(\"flv\")");
  
  
  
      recorder.setSampleRate(sampleAudioRateInHz);
  
      Log.v(LOG_TAG, "recorder.setSampleRate(sampleAudioRateInHz)");
  
  
  
      // re-set in the surface changed method as well
  
      recorder.setFrameRate(frameRate);
  
      Log.v(LOG_TAG, "recorder.setFrameRate(frameRate)");
  
  
  
      // Create audio recording thread
  
      audioRecordRunnable = new AudioRecordRunnable();
  
      audioThread = new Thread(audioRecordRunnable);
  
  }
  
  
  
  // Start the capture
  
  public void startRecording() {
  
      try {
  
          recorder.start();
  
          startTime = System.currentTimeMillis();
  
          recording = true;
  
          audioThread.start();
  
      } catch (FFmpegFrameRecorder.Exception e) {
  
          e.printStackTrace();
  
      }
  
  }
  
  
  
  public void stopRecording() {
  
      // This should stop the audio thread from running
  
      runAudioThread = false;
  
  
  
      if (recorder != null && recording) {
  
          recording = false;
  
          Log.v(LOG_TAG,"Finishing recording, calling stop and release on recorder");
  
          try {
  
              recorder.stop();
  
              recorder.release();
  
          } catch (FFmpegFrameRecorder.Exception e) {
  
              e.printStackTrace();
  
          }
  
          recorder = null;
  
      }
  
  }
  
  
  
  @Override
  
  public boolean onKeyDown(int keyCode, KeyEvent event) {
  
      // Quit when back button is pushed
  
      if (keyCode == KeyEvent.KEYCODE_BACK) {
  
          if (recording) {
  
              stopRecording();
  
          }
  
          finish();
  
          return true;
  
      }
  
      return super.onKeyDown(keyCode, event);
  
  }
  
  
  
  @Override
  
  public void onClick(View v) {
  
      if (!recording) {
  
          startRecording();
  
          Log.w(LOG_TAG, "Start Button Pushed");
  
          recordButton.setText("Stop");
  
      } else {
  
          stopRecording();
  
          Log.w(LOG_TAG, "Stop Button Pushed");
  
          recordButton.setText("Start");
  
      }
  
  }
  
  
  
  //---------------------------------------------
  
  // audio thread, gets and encodes audio data
  
  //---------------------------------------------
  
  class AudioRecordRunnable implements Runnable {
  
  
  
      @Override
  
      public void run() {
  
          // Set the thread priority
  
          android.os.Process.setThreadPriority(android.os.Process.THREAD_PRIORITY_URGENT_AUDIO);
  
  
  
          // Audio
  
          int bufferSize;
  
          short[] audioData;
  
          int bufferReadResult;
  
  
  
          bufferSize = AudioRecord.getMinBufferSize(sampleAudioRateInHz, 
  
                  AudioFormat.CHANNEL_CONFIGURATION_MONO, AudioFormat.ENCODING_PCM_16BIT);
  
          audioRecord = new AudioRecord(MediaRecorder.AudioSource.MIC, sampleAudioRateInHz, 
  
                  AudioFormat.CHANNEL_CONFIGURATION_MONO, AudioFormat.ENCODING_PCM_16BIT, bufferSize);
  
  
  
          audioData = new short[bufferSize];
  
  
  
          Log.d(LOG_TAG, "audioRecord.startRecording()");
  
          audioRecord.startRecording();
  
  
  
          // Audio Capture/Encoding Loop
  
          while (runAudioThread) {
  
              // Read from audioRecord
  
              bufferReadResult = audioRecord.read(audioData, 0, audioData.length);
  
              if (bufferReadResult > 0) {
  
                  //Log.v(LOG_TAG,"audioRecord bufferReadResult: " + bufferReadResult);
  
  
  
                  // Changes in this variable may not be picked up despite it being "volatile"
  
                  if (recording) {
  
                      try {
  
                          // Write to FFmpegFrameRecorder
  
                          Buffer[] buffer = {ShortBuffer.wrap(audioData, 0, bufferReadResult)};                        
  
                          recorder.record(buffer);
  
                      } catch (FFmpegFrameRecorder.Exception e) {
  
                          Log.v(LOG_TAG,e.getMessage());
  
                          e.printStackTrace();
  
                      }
  
                  }
  
              }
  
          }
  
          Log.v(LOG_TAG,"AudioThread Finished");
  
  
  
          /* Capture/Encoding finished, release recorder */
  
          if (audioRecord != null) {
  
              audioRecord.stop();
  
              audioRecord.release();
  
              audioRecord = null;
  
              Log.v(LOG_TAG,"audioRecord released");
  
          }
  
      }
  
  }
  
  
  
  class CameraView extends SurfaceView implements SurfaceHolder.Callback, PreviewCallback {
  
  
  
      private boolean previewRunning = false;
  
  
  
      private SurfaceHolder holder;
  
      private Camera camera;
  
  
  
      private byte[] previewBuffer;
  
  
  
      long videoTimestamp = 0;
  
  
  
      Bitmap bitmap;
  
      Canvas canvas;
  
  
  
      public CameraView(Context _context) {
  
          super(_context);
  
  
  
          holder = this.getHolder();
  
          holder.addCallback(this);
  
          holder.setType(SurfaceHolder.SURFACE_TYPE_PUSH_BUFFERS);
  
      }
  
  
  
      @Override
  
      public void surfaceCreated(SurfaceHolder holder) {
  
          camera = Camera.open();
  
  
  
          try {
  
              camera.setPreviewDisplay(holder);
  
              camera.setPreviewCallback(this);
  
  
  
              Camera.Parameters currentParams = camera.getParameters();
  
              Log.v(LOG_TAG,"Preview Framerate: " + currentParams.getPreviewFrameRate());
  
              Log.v(LOG_TAG,"Preview imageWidth: " + currentParams.getPreviewSize().width + " imageHeight: " + currentParams.getPreviewSize().height);
  
  
  
              // Use these values
  
              imageWidth = currentParams.getPreviewSize().width;
  
              imageHeight = currentParams.getPreviewSize().height;
  
              frameRate = currentParams.getPreviewFrameRate();                
  
  
  
              bitmap = Bitmap.createBitmap(imageWidth, imageHeight, Bitmap.Config.ALPHA_8);
  
  
  
  
  
              /*
  
              Log.v(LOG_TAG,"Creating previewBuffer size: " + imageWidth * imageHeight * ImageFormat.getBitsPerPixel(currentParams.getPreviewFormat())/8);
  
              previewBuffer = new byte[imageWidth * imageHeight * ImageFormat.getBitsPerPixel(currentParams.getPreviewFormat())/8];
  
              camera.addCallbackBuffer(previewBuffer);
  
              camera.setPreviewCallbackWithBuffer(this);
  
              */              
  
  
  
              camera.startPreview();
  
              previewRunning = true;
  
          }
  
          catch (IOException e) {
  
              Log.v(LOG_TAG,e.getMessage());
  
              e.printStackTrace();
  
          }   
  
      }
  
  
  
      public void surfaceChanged(SurfaceHolder holder, int format, int width, int height) {
  
          Log.v(LOG_TAG,"Surface Changed: width " + width + " height: " + height);
  
  
  
          // We would do this if we want to reset the camera parameters
  
          /*
  
          if (!recording) {
  
              if (previewRunning){
  
                  camera.stopPreview();
  
              }
  
              try {
  
                  //Camera.Parameters cameraParameters = camera.getParameters();
  
                  //p.setPreviewSize(imageWidth, imageHeight);
  
                  //p.setPreviewFrameRate(frameRate);
  
                  //camera.setParameters(cameraParameters);
  
  
  
                  camera.setPreviewDisplay(holder);
  
                  camera.startPreview();
  
                  previewRunning = true;
  
              }
  
              catch (IOException e) {
  
                  Log.e(LOG_TAG,e.getMessage());
  
                  e.printStackTrace();
  
              }   
  
          }            
  
          */
  
  
  
          // Get the current parameters
  
          Camera.Parameters currentParams = camera.getParameters();
  
          Log.v(LOG_TAG,"Preview Framerate: " + currentParams.getPreviewFrameRate());
  
          Log.v(LOG_TAG,"Preview imageWidth: " + currentParams.getPreviewSize().width + " imageHeight: " + currentParams.getPreviewSize().height);
  
  
  
          // Use these values
  
          imageWidth = currentParams.getPreviewSize().width;
  
          imageHeight = currentParams.getPreviewSize().height;
  
          frameRate = currentParams.getPreviewFrameRate();
  
  
  
          // Create the yuvIplimage if needed
  
          yuvIplimage = IplImage.create(imageWidth, imageHeight, IPL_DEPTH_8U, 2);
  
          //yuvIplimage = IplImage.create(imageWidth, imageHeight, IPL_DEPTH_32S, 2);
  
      }
  
  
  
      @Override
  
      public void surfaceDestroyed(SurfaceHolder holder) {
  
          try {
  
              camera.setPreviewCallback(null);
  
  
  
              previewRunning = false;
  
              camera.release();
  
  
  
          } catch (RuntimeException e) {
  
              Log.v(LOG_TAG,e.getMessage());
  
              e.printStackTrace();
  
          }
  
      }
  
  
  
      @Override
  
      public void onPreviewFrame(byte[] data, Camera camera) {
  
  
  
          if (yuvIplimage != null && recording) {
  
              videoTimestamp = 1000 * (System.currentTimeMillis() - startTime);
  
  
  
              // Put the camera preview frame right into the yuvIplimage object
  
              yuvIplimage.getByteBuffer().put(data);
  
  
  
              // FAQ about IplImage:
  
              // - For custom raw processing of data, getByteBuffer() returns an NIO direct
  
              //   buffer wrapped around the memory pointed by imageData, and under Android we can
  
              //   also use that Buffer with Bitmap.copyPixelsFromBuffer() and copyPixelsToBuffer().
  
              // - To get a BufferedImage from an IplImage, we may call getBufferedImage().
  
              // - The createFrom() factory method can construct an IplImage from a BufferedImage.
  
              // - There are also a few copy*() methods for BufferedImage<->IplImage data transfers.
  
  
  
              // Let's try it..
  
              // This works but only on transparency
  
              // Need to find the right Bitmap and IplImage matching types
  
  
  
              /*
  
              bitmap.copyPixelsFromBuffer(yuvIplimage.getByteBuffer());
  
              //bitmap.setPixel(10,10,Color.MAGENTA);
  
  
  
              canvas = new Canvas(bitmap);
  
              Paint paint = new Paint(); 
  
              paint.setColor(Color.GREEN);
  
              float leftx = 20; 
  
              float topy = 20; 
  
              float rightx = 50; 
  
              float bottomy = 100; 
  
              RectF rectangle = new RectF(leftx,topy,rightx,bottomy); 
  
              canvas.drawRect(rectangle, paint);
  
  
  
              bitmap.copyPixelsToBuffer(yuvIplimage.getByteBuffer());
  
              */
  
              //Log.v(LOG_TAG,"Writing Frame");
  
  
  
              try {
  
  
  
                  // Get the correct time
  
                  recorder.setTimestamp(videoTimestamp);
  
  
  
                  // Record the image into FFmpegFrameRecorder
  
                  recorder.record(yuvIplimage);
  
  
  
              } catch (FFmpegFrameRecorder.Exception e) {
  
                  Log.v(LOG_TAG,e.getMessage());
  
                  e.printStackTrace();
  
              }
  
          }
  
      }
  
  }

  }

• ISO-9660 Compromise, Part 2 : Finding Root

  25 octobre 2021, par Multimedia Mike — General

  A long time ago, I dashed off a quick blog post with a curious finding after studying the ISO-9660 spec : The format stores multi-byte numbers in a format I termed “omni-endian”– the committee developing the format apparently couldn’t come to an agreement on this basic point regarding big- vs. little-endian encoding (I’m envisioning something along the lines of “tastes great ! … less filling !” in the committee meetings).

  I recently discovered another bit of compromise in the ISO-9660 spec : It seems that there are 2 different methods for processing the directory structure. That means it’s incumbent upon ISO-9660 creation software to fill in the data structures to support both methods, because some ISO-reading programs out there rely on one set of data structures while the rest prefer to read the other set.

  Background

  As a refresher, the “ISO” extension of an ISO file refers to the ISO-9660 specification. This is a type of read-only filesystem (i.e, the filesystem is created once and never updated after initial creation) for the purpose of storing on a read-only medium, often an optical disc (CD-ROM, DVD-ROM). The level of nostalgic interest I display for the ISO-9660 filesystem reminds me of my computer science curriculum professors from the mid-90s reminiscing about ye olden days of punchcard programming, but such is my lot. I’m probably also alone in my frustration of seeing rips of, e.g., GameCube or Xbox or 3DO games being tagged with the extension .ISO since those systems use different read-only filesystems.

  I recently fell in with an odd bunch called the eXoDOS project and was trying to help fill in a few gaps. One request was a 1994 game called Power Drive for DOS.

  
  
  

  
  

  My usual CD-ROM ripping method (for the data track) is a simple ‘dd’ command from a Linux command line to copy the string of raw sectors. However, it turned out to be unusually difficult to open the resulting ISO. A few of the the options I know of worked but most didn’t. What’s the difference ?

  Methods that work :

  • Mounting the file with the Linux iso9660 kernel module, i.e.,

    mount -t iso9660 /dev/optical-drive /mnt

    or

    mount -t iso9660 -o loop /path/to/Power-Drive.iso /mnt

  • Directory Opus
  • Windows 10 can read the filesystem when reading the physical disc
  • Windows 10 can burn the ISO image to a new CD (“right click” -> “Burn disc image”) ; this method does not modify any of the existing sectors but did append 149 additional empty sectors

  Methods that don’t work :

  • fuseiso
  • Dosbox
  • Winrar
  • 7zip
  • Daemon Tools
  • Imgburn
  • Internet Archive’s ISO lister (“View contents” on the ISO file)

  Understanding The Difference

  I think I might have a handle on why some tools are able to process this disc while most can’t. There appears to be 2 sets of data structures to describe the base of the filesystem : A root directory, and a path table. These both occur in the first substantive sector of the ISO-9660 filesystem, usually sector 16.

  A compact disc can be abstractly visualized as a long string of sectors, each one 2,352 bytes long. (See my Grand Unified Theory of Compact Disc post for deeper discussion.) A CD-ROM data track will contain 2048 bytes of data. Thus, sector 16 appears at 0x8000 of an ISO filesystem. I like the clarity of this description of the ISO-9660 spec. It shows that the path table is defined at byte 140 (little-endian ; big comes later) and location of the root directory is at byte 158. Thus, these locations generally occur at 0x808c and 0x809e.

  
  
  Primary Volume Descriptor
  

  The path table is highlighted in green and the root directory record is highlighted in red. These absolute locations are specified in sectors. So the path table is located at sector 0x12 = offset 0x9000 in the image, while the root directory record is supposed to be at sector 0x62 = 0x31000. Checking into those sectors, it turns out that the path table is valid while the root directory record is invalid. Thus, any tool that relies on the path table will be successful in interpreting the disc, while tools that attempt to recursively traverse starting from root directory record are gonna have a bad time.

  Since I was able to view the filesystem with a few different tools, I know what the root directory contains. Searching for those filenames reveals that the root directory was supposed to point to the next sector, number 0x63. So this was a bizarre off-by-1 error on the part of the ISO creation tool. Maybe. I manually corrected 0x62 -> 0x63 and that fixed the interaction with fuseiso, but not with other tools. So there may have been some other errors. Note that a quick spot-check of another, functional ISO revealed that this root directory sector is supposed to be exact, not 1-indexed.

  Upon further inspection, I noticed that, while fuseiso appeared to work with that one patch, none of the files returned correct data, and none of the directories contained anything. That’s when I noticed that ALL of the sector locations described in the various directory and file records are off by 1 !

  Further Investigation

  I have occasionally run across ISO images on the Internet Archive that return the error about not being able to read the contents when trying to “View contents” (error text : “failed to obtain file list from xyz.iso”, as seen with this ISO). Too bad I didn’t make a record of them because I would be interested to see if they have the same corruption.

  Eventually, I’ll probably be able to compile an archive of deviant ISO-9660 images. A few months ago, I was processing a large collection from IA and found a corrupted ISO which had a cycle, i.e., the subdirectory pointed to a parent directory, which caused various ISO tools to loop forever. Just one of those things that is “never supposed to happen”, so why write code to deal with it gracefully ?

  See Also

  • The disc archived at The Internet Archive
  • MobyGames Entry
  • Wikipedia Entry

  The post ISO-9660 Compromise, Part 2 : Finding Root first appeared on Breaking Eggs And Making Omelettes.