Advanced search

Medias (1)

Tag: - Tags -/epub

Other articles (17)

  • Publier sur MédiaSpip

    13 June 2013

    Puis-je poster des contenus à partir d’une tablette Ipad ?
    Oui, si votre Médiaspip installé est à la version 0.2 ou supérieure. Contacter au besoin l’administrateur de votre MédiaSpip pour le savoir

  • Configuration spécifique pour PHP5

    4 February 2011, by

    PHP5 est obligatoire, vous pouvez l’installer en suivant ce tutoriel spécifique.
    Il est recommandé dans un premier temps de désactiver le safe_mode, cependant, s’il est correctement configuré et que les binaires nécessaires sont accessibles, MediaSPIP devrait fonctionner correctement avec le safe_mode activé.
    Modules spécifiques
    Il est nécessaire d’installer certains modules PHP spécifiques, via le gestionnaire de paquet de votre distribution ou manuellement : php5-mysql pour la connectivité avec la (...)

  • La sauvegarde automatique de canaux SPIP

    1 April 2010, by

    Dans le cadre de la mise en place d’une plateforme ouverte, il est important pour les hébergeurs de pouvoir disposer de sauvegardes assez régulières pour parer à tout problème éventuel.
    Pour réaliser cette tâche on se base sur deux plugins SPIP : Saveauto qui permet une sauvegarde régulière de la base de donnée sous la forme d’un dump mysql (utilisable dans phpmyadmin) mes_fichiers_2 qui permet de réaliser une archive au format zip des données importantes du site (les documents, les éléments (...)

On other websites (5525)

  • Is there a case where I can not create a file if I run a lot of threads? ( feat. Ffmpeg, thread)

    26 June 2018, by Junburg

    I am now creating an app that will duet with the singer. We use a thread (mAudioPlayer) that outputs background music, a vAudioPlayer that prints the voice of the singer, a mRecordThread that records the voice of the user, and a thread that weaves and attaches each file (mp3ConcatThread).

    It works by stopping the singer’s voice while recording background music and recording by the user. Of course, when the user does not record, the singer’s voice is output. In this way, each section must be made into an mp3 file and merged into a single file. However, it often happens that files that do not record and merge properly are created.

    Audio processing is done using Ffmpeg. I guess the following error might be the reason.

    06-26 21:37:11.084 13017-13017/com.softcode.kihnoplay I/Choreographer: Skipped 72 frames!  The application may be doing too much work on its main thread.

    Could not generate a file because of this kind of error?

    If you know the answer to this question, please answer. Thank you.

    Below are related codes. For more information, please leave a comment.
    Because the code is too long, I’ve included only the code that looks like it’s needed.

    Record Thread.class

    public class Record_Thread {
    
private static final String LOG_TAG = Record_Thread.class.getSimpleName();
    
private static final int SAMPLE_RATE = 44100;
    
private int bufferSize = 0;
    
private String currentOutFile = null;
    
private Context context;
    

    
byte RECORDER_BPP = 16;
    

    

    
public Record_Thread(Record_interface listener) {
    
    mListener = listener;
    
    Player.currentCreateFileName = SmcInfo.APPDIRPATH + "/ucc/" + Player.getCurrentTime(false);
    
    currentOutFile = Player.currentCreateFileName + ".pcm";
    
}
    

    
public Record_Thread(Record_interface listener, Context context) {
    
    mListener = listener;
    
    RecordActivity.currentCreateFileName = SmcInfo.APPDIRPATH + "/ucc/" + RecordActivity.getCurrentTime(false);
    
    currentOutFile = RecordActivity.currentCreateFileName + ".pcm";
    
    this.context = context;
    
}
    

    
private boolean isSampleTranspo;
    
private boolean isRecording;
    
public boolean isSharding = false;
    
private Record_interface mListener;
    
private Thread mThread;
    

    
public boolean recording() {
    
    return mThread != null;
    
}
    

    
public void setSampleTranspo(boolean booleanValue) {
    
    this.isSampleTranspo = booleanValue;
    
}
    

    
public boolean getSampleTranspo() {
    
    return this.isSampleTranspo;
    
}
    

    
long startpoint = 0;
    
boolean posWrite = false;
    

    
public void startRecording() {
    
    if (mThread != null)
    
        return;
    

    
    isRecording = true;
    
    mThread = new Thread(new Runnable() {
    
        @Override
    
        public void run() {
    
            record();
    
        }
    
    });
    
    mThread.start();
    
}
    

    
public void stopRecording() {
    
    if (mThread == null)
    
        return;
    

    
    isRecording = false;
    
    mThread = null;
    
    posWrite = false;
    
    startpoint = 0;
    
}
    

    
public void startFileWrite(long startpoint) {
    
    this.startpoint = startpoint;
    
    this.posWrite = true;
    
}
    

    
public void stopFileWrite() {
    
    this.posWrite = false;
    
}
    

    
private void record() {
    
    try {
    
        Log.v(LOG_TAG, "Start");
    
        android.os.Process.setThreadPriority(android.os.Process.THREAD_PRIORITY_AUDIO);
    

    
        bufferSize = AudioRecord.getMinBufferSize(SAMPLE_RATE, AudioFormat.CHANNEL_IN_STEREO, AudioFormat.ENCODING_PCM_16BIT);
    

    
        if (bufferSize == AudioRecord.ERROR || bufferSize == AudioRecord.ERROR_BAD_VALUE) {
    
            bufferSize = SAMPLE_RATE * 2;
    
        }
    

    
        short[] audioBuffer = new short[bufferSize];
    
        short[] audioZero = new short[bufferSize];
    

    
        AudioRecord record = new AudioRecord(MediaRecorder.AudioSource.MIC, SAMPLE_RATE, AudioFormat.CHANNEL_IN_STEREO, AudioFormat.ENCODING_PCM_16BIT, bufferSize);
    

    

    
        if (record.getState() != AudioRecord.STATE_INITIALIZED) {
    
            Log.e(LOG_TAG, "Audio Record can't initialize!");
    
            return;
    
        }
    
        record.startRecording();
    

    
        Log.v(LOG_TAG, "Start recording");
    

    
        long shortsRead = 0;
    

    

    
        int readsize = 0;
    
        File tempFile = new File(currentOutFile);
    
        if (tempFile.exists())
    
            tempFile.delete();
    
        FileOutputStream fos = new FileOutputStream(currentOutFile);
    

    
        byte[] audiodata = new byte[bufferSize];
    

    
        while (isRecording && record != null) {
    
            readsize = record.read(audiodata, 0, audiodata.length);
    
            if (AudioRecord.ERROR_INVALID_OPERATION != readsize && fos != null) {
    
                try {
    
                    if (readsize > 0 && readsize <= audiodata.length) {
    
                        fos.write(audiodata, 0, readsize);//TypeCast.shortToByte(audioBuffer)
    
                        fos.flush();
    
                    }
    
                } catch (Exception ex) {
    
                    Log.e("AudioRecorder", ex.getMessage());
    
                }
    
            }
    

    
            ShortBuffer sb = ByteBuffer.wrap(audiodata).order(ByteOrder.LITTLE_ENDIAN).asShortBuffer();
    
            short[] samples = new short[sb.limit()];
    
            sb.get(samples);
    

    
            if (isSampleTranspo) {
    
                mListener.onAudioDataReceived(samples);
    
            } else {
    
                mListener.onAudioDataReceived(audioZero);
    
            }
    

    
            if (posWrite) {
    

    
                FileOutputStream pos = null;
    
                try {
    
                    if (startpoint > 0) {
    
                        if (context instanceof RecordActivity) {
    
                            pos = new FileOutputStream(RecordActivity.currentCreateFileName.replaceAll("/ucc/", "/tmp/") + "_" + caltime(String.valueOf((int) (startpoint / 1000)), false) + "_uv.pcm", true);/////파일에 이어서 쓰기
    
                            Log.d(TAG, "record: " + pos.toString());
    
                        } else {
    
                            pos = new FileOutputStream(Player.currentCreateFileName.replaceAll("/ucc/", "/tmp/") + "_" + caltime(String.valueOf((int) (startpoint / 1000)), false) + "_uv.pcm", true);/////파일에 이어서 쓰기
    
                        }
    
                    }
    
                    pos.write(audiodata);
    
                    pos.flush();
    
                } catch (Exception e) {
    
                    e.printStackTrace();
    
                } finally {
    
                    pos.close();
    
                    pos = null;
    
                }
    
            }
    

    
        }
    
        if (fos != null)
    
            fos.close();
    
        mListener.onRecordEnd();
    
        record.stop();
    
        record.release();
    
    } catch (IOException e) {
    
        Log.e("AudioRecorder", e.getMessage());
    
    }
    
}
    

    
private String caltime(String sMillis, boolean timeFormat) {
    
    double dMillis = 0;
    

    
    int minutes = 0;
    
    int seconds = 0;
    
    int millis = 0;
    

    
    String sTime;
    

    
    try {
    
        dMillis = Double.parseDouble(sMillis);
    
    } catch (Exception e) {
    
        System.out.println(e.getMessage());
    
    }
    

    

    
    seconds = (int) (dMillis / 1000) % 60;
    
    millis = (int) (dMillis % 1000);
    

    
    if (seconds > 0) {
    
        minutes = (int) (dMillis / 1000 / 60) % 60;
    
        if (minutes > 0) {
    
            if (timeFormat)
    
                sTime = String.format("%02d:%02d.%d", minutes, seconds, millis);
    
            else
    
                sTime = String.format("%02d%02d%d", minutes, seconds, millis);
    

    
        } else {
    
            if (timeFormat)
    
                sTime = String.format("%02d:%02d.%d", 0, seconds, millis);
    
            else
    
                sTime = String.format("%02d%02d%d", 0, seconds, millis);
    

    
        }
    
    } else {
    
        if (timeFormat)
    
            sTime = String.format("%02d:%02d.%d", 0, 0, millis);
    
        else
    
            sTime = String.format("%02d%02d%d", 0, 0, millis);
    
    }
    

    
    return sTime;
    
}
    

    
}

    RecordActivity.class

    public class RecordActivity extends AppCompatActivity implements Player_interface, SeekBar.OnSeekBarChangeListener {
    

    
private static final String TAG = "RecordActivity";
    

    
public Context context = this;
    
private LinearLayout recordLayout;
    
private RelativeLayout recordBtn, saveBtn;
    
private CircleImageView userImg, artistImg;
    
private TextView songTitleTxt, playTimeTxt, progressTimeTxt;
    
private BlurBitmap blurBitmap;
    
private SeekBar seekBar;
    
private ImageView micBg1, micBg2;
    

    
private String assPath;
    
private String ampPath;
    

    
private int deviceWidth, deviceHeight;
    

    
public static AssRenderView assView;
    
public static LinearLayout lyricsLayout;
    
public static int lyricsWidth, lyricsHeight, layoutWidth;
    
public static LinearLayout.LayoutParams assViewParams;
    
public static String currentCreateFileName = null;
    
public static String mrPath;
    
public static String voicePath;
    

    
private String recMusicPath;
    

    
Player_Thread mAudioPlayer = null, vAudioPlayer = null, testPlayer = null;
    
private Record_Thread mRecordThread;
    
public static Mp3Concat_Thread mMp3ConcatThread;
    
long lastDuration = 0L;
    

    
private boolean isSeekbarTouch = false;
    

    
private ArrayList<long> combineList;
    

    
CNetProgressdialog createMp3Dialog;
    

    
int bufferSize = 7104;
    
int SAMPLE_RATE = 44100;
    
int RECORDER_SAMPLERATE = 44100;
    
byte RECORDER_BPP = 16;
    

    

    
@Override
    
protected void onCreate(@Nullable Bundle savedInstanceState) {
    
    super.onCreate(savedInstanceState);
    
    removeDir(SmcInfo.APPDIRPATH + "/tmp");
    
    setContentView(R.layout.activity_record_phone);
    

    
    if (Build.VERSION.SDK_INT >= Build.VERSION_CODES.KITKAT) {
    
        Window window = getWindow();
    
        window.addFlags(WindowManager.LayoutParams.FLAG_LAYOUT_NO_LIMITS);
    
        window.addFlags(WindowManager.LayoutParams.FLAG_TRANSLUCENT_NAVIGATION);
    
    }
    

    
    recordLayout = (LinearLayout) findViewById(R.id.record_layout);
    
    userImg = (CircleImageView) findViewById(R.id.user_img);
    
    artistImg = (CircleImageView) findViewById(R.id.artist_img);
    
    songTitleTxt = (TextView) findViewById(R.id.song_title_txt);
    
    progressTimeTxt = (TextView) findViewById(R.id.progress_time_txt);
    
    playTimeTxt = (TextView) findViewById(R.id.play_time_txt);
    
    recordBtn = (RelativeLayout) findViewById(R.id.record_btn);
    
    saveBtn = (RelativeLayout) findViewById(R.id.save_btn);
    
    seekBar = (SeekBar) findViewById(R.id.seek_bar);
    
    micBg1 = (ImageView) findViewById(R.id.mic_bg_small);
    
    micBg2 = (ImageView) findViewById(R.id.mic_bg_big);
    

    
    createMp3Dialog = new CNetProgressdialog(this);
    

    
    GradientDrawable drawable = new GradientDrawable();
    
    drawable.setColors(new int[]{
    
            Color.parseColor("#32c49b"),
    
            Color.parseColor("#19b2c3")
    
    });
    

    
    Intent intent = getIntent();
    
    final String artistImgPath = intent.getStringExtra("artistImgPath");
    
    final String songTitle = intent.getStringExtra("songTitle");
    
    assPath = intent.getStringExtra("assPath");
    
    ampPath = intent.getStringExtra("ampPath");
    
    String playTime = intent.getStringExtra("playTime");
    

    
    blurBitmap = new BlurBitmap();
    

    
    songTitleTxt.setText(songTitle);
    
    playTimeTxt.setText(playTime);
    

    
    final Bitmap artistImgBitmap = blurBitmap.toBitmap(artistImgPath);
    
    final Bitmap userImgBitmap = BitmapFactory.decodeResource(context.getResources(), R.drawable.dummy_artist_2);
    

    
    final Bitmap userBlurImg = blurBitmap.blurRenderScript(this, userImgBitmap, 25);
    
    final Bitmap artistBlurImg = blurBitmap.blurRenderScript(this, artistImgBitmap, 25);
    

    
    artistImg.setImageBitmap(artistImgBitmap);
    
    userImg.setImageBitmap(userBlurImg);
    

    
    drawable.setGradientType(GradientDrawable.LINEAR_GRADIENT);
    
    drawable.setOrientation(GradientDrawable.Orientation.TOP_BOTTOM);
    

    
    recordLayout.setBackground(drawable);
    

    
    play(ampToMp3(ampPath));
    

    
    mRecordThread = new Record_Thread(new Record_interface() {
    
        @Override
    
        public void onAudioDataReceived(short[] data) {
    

    
        }
    

    
        @Override
    
        public void onRecordEnd() {
    

    
        }
    
    }, context);
    

    
    mMp3ConcatThread = new Mp3Concat_Thread(new Mp3Concat_interface() {
    
        @Override
    
        public void onAudioDataReceived(short[] data) {
    

    
        }
    

    
        @Override
    
        public void onRecordEnd() {
    
            createMp3Dialog.dismiss();
    
            startPrelisteningActivity(recMusicPath, songTitle);
    
        }
    
    }, this);
    

    
    if (!mRecordThread.recording()) {
    
        mRecordThread.startRecording();
    
    }
    

    
    final Animation animZoomIn = AnimationUtils.loadAnimation(this, R.anim.zoom_in);
    
    final Animation animZoomOut = AnimationUtils.loadAnimation(this, R.anim.zoom_out);
    
    final Animation animMic1 = AnimationUtils.loadAnimation(this, R.anim.bg_mic_anim_1_phone);
    
    final Animation animMic2 = AnimationUtils.loadAnimation(this, R.anim.bg_mic_anim_2_phone);
    

    
    artistImg.startAnimation(animZoomIn);
    

    
    combineList = new ArrayList<long>();
    

    
    recordBtn.setOnTouchListener(new View.OnTouchListener() {
    
        @Override
    
        public boolean onTouch(View view, MotionEvent motionEvent) {
    
            switch (motionEvent.getAction()) {
    
                case MotionEvent.ACTION_DOWN: {
    
                    long currentDuration = vAudioPlayer.getCurrentDuration();
    
                    // 녹음 시작 ( combineList 사이즈가 짝수일 때 )
    
                    if (mRecordThread != null) {
    
                        if (combineList.size() % 2 == 0) {
    

    
                            mRecordThread.startFileWrite(currentDuration);
    
                            combineList.add(currentDuration);
    
                        }
    
                        vAudioPlayer.setSampleTranspo(true);
    
                        mRecordThread.setSampleTranspo(true);
    
                    }
    
                }
    

    
                micBg1.setVisibility(View.VISIBLE);
    
                micBg2.setVisibility(View.VISIBLE);
    

    
                micBg1.startAnimation(animMic1);
    
                micBg2.startAnimation(animMic2);
    

    
                userImg.setImageBitmap(userImgBitmap);
    
                userImg.startAnimation(animZoomIn);
    
                artistImg.setImageBitmap(artistBlurImg);
    
                artistImg.startAnimation(animZoomOut);
    

    

    
                break;
    
                case MotionEvent.ACTION_UP: {
    
                    long currentDuration = vAudioPlayer.getCurrentDuration();
    
                    if (mRecordThread != null) {
    

    
                        if (combineList.size() % 2 == 1) {
    
                            mRecordThread.startRecording();
    
                            mRecordThread.stopFileWrite();
    

    
                            File waveFile = new File(RecordActivity.currentCreateFileName.replaceAll("/ucc/", "/tmp/")
    
                                    + "_" + caltime(combineList.get(combineList.size() - 1) / 1000, false) + "_uv.pcm");
    

    
                            if (waveFile.exists()) {
    
                                copyWaveFile(RecordActivity.currentCreateFileName.replaceAll("/ucc/", "/tmp/") + "_" + caltime(combineList.get(combineList.size() - 1) / 1000, false) + "_uv.pcm",
    
                                        RecordActivity.currentCreateFileName.replaceAll("/ucc/", "/tmp/") + "_" + caltime(combineList.get(combineList.size() - 1) / 1000, false) + "_u0.wav");
    
                                Log.d(TAG, "onTouch: " + currentCreateFileName);
    
                                if (mMp3ConcatThread != null) {
    
                                    mMp3ConcatThread.startCombine(null, 3333333333333333333L, combineList.get(combineList.size() - 1), currentDuration);
    
                                }
    
                            }
    

    
                            combineList.add(currentDuration);
    
                            Log.d(TAG, "onTouch: " + combineList.size());
    
                            if (combineList.size() == 2) {
    
                                mMp3ConcatThread.startCombine(null, 0, combineList.get(combineList.size() - 2), currentDuration);
    
                            } else {
    
                                mMp3ConcatThread.startCombine(null, combineList.get(combineList.size() - 3), combineList.get(combineList.size() - 2), currentDuration);
    
                            }
    
                        }
    
                        vAudioPlayer.setSampleTranspo(false);
    
                        mRecordThread.setSampleTranspo(false);
    
                    }
    
                }
    

    
                micBg1.setVisibility(View.GONE);
    
                micBg2.setVisibility(View.GONE);
    

    
                micBg1.clearAnimation();
    
                micBg2.clearAnimation();
    

    
                userImg.setImageBitmap(userBlurImg);
    
                userImg.startAnimation(animZoomOut);
    
                artistImg.setImageBitmap(artistImgBitmap);
    
                artistImg.startAnimation(animZoomIn);
    

    
                break;
    
            }
    
            return false;
    
        }
    
    });
    

    
    saveBtn.setOnClickListener(new View.OnClickListener() {
    
        @Override
    
        public void onClick(View view) {
    

    
            createMp3Dialog.show();
    
            vAudioPlayer.setSampleTranspo(true);
    
            vAudioPlayer.setlistenerStop(true);
    

    
            if (assView != null)
    
                assView.Destroy();
    

    
            if (lyricsLayout != null) {
    
                lyricsLayout.removeAllViews();
    
            }
    

    
            seekBar.setProgress(0);
    
            seekBar.setMax(100);
    
            Log.d(TAG, "donep3: " + "done");
    

    
            if (mMp3ConcatThread != null) {
    
                try {
    
                    mMp3ConcatThread.startCombine(combineList, 7777777777777777777L, combineList.get(combineList.size() - 1), lastDuration);
    
                } catch (ArrayIndexOutOfBoundsException e) {
    
                    e.getMessage();
    
                    finish();
    
                }
    
            }
    

    
            releaseAudioPlayer();
    

    
            recMusicPath = SmcInfo.APPDIRPATH + "/ucc/" + currentCreateFileName.substring(currentCreateFileName.lastIndexOf('/') + 1, currentCreateFileName.length()) + ".mp3";
    
        }
    
    });
    

    

    
    DisplayMetrics displayMetrics = new DisplayMetrics();
    
    getWindowManager().getDefaultDisplay().getMetrics(displayMetrics);
    

    
    deviceWidth = displayMetrics.widthPixels;
    
    deviceHeight = displayMetrics.heightPixels;
    

    
    lyricsWidth = deviceWidth;
    
    lyricsHeight = deviceHeight;
    

    
    Log.d(TAG, "onCreate: " + lyricsWidth + "/" + lyricsHeight);
    

    
    layoutWidth = lyricsWidth * 2 / 3;
    
    int parentAssViewHeight = ((lyricsHeight * 50) / 91) - 2;
    
    if (layoutWidth > parentAssViewHeight)
    
        layoutWidth = (parentAssViewHeight * 8) / 10;
    

    
    assViewParams = new LinearLayout.LayoutParams(new ViewGroup.LayoutParams(layoutWidth * 2, layoutWidth));
    
    assViewParams.gravity = Gravity.CENTER;
    

    
    lyricsLayout = (LinearLayout)
    

    
            findViewById(R.id.lyrics_layout);
    

    
    if (assView != null) {
    
        assView.Destroy();
    
    }
    
    if (lyricsLayout != null) {
    
        lyricsLayout.removeAllViews();
    
    }
    

    
    assView = new AssRenderView(getApplicationContext(), layoutWidth * 13 / 10, layoutWidth);
    

    
    File assFile = new File(assPath);
    
    if (assFile.exists()) {
    
        assView.ReadASSFile(assFile.toString(), true, layoutWidth * 2, layoutWidth * 5 / 7);
    
    }
    

    
    lyricsLayout.addView(assView, assViewParams);
    
    lyricsLayout.setGravity(Gravity.CENTER);
    
    assView.ShowASS(true);
    

    
    seekBar.setOnSeekBarChangeListener(this);
    
    seekBar.setProgress(0);
    
    seekBar.setMax(100);
    

    
}
    

    
private void startPrelisteningActivity(String recMusicPath, String songTitle) {
    

    
    Intent intent = new Intent(RecordActivity.this, PrelisteningActivity.class);
    
    intent.putExtra("recMusicPath", recMusicPath);
    
    intent.putExtra("songTitle", songTitle);
    
    startActivityForResult(intent, 1);
    
}
    

    
private String[] ampToMp3(String ampPath) {
    

    
    String[] pathArray = new String[2];
    

    
    try {
    

    
        File ampFile = new File(ampPath);
    
        String ampName = ampFile.getName();
    
        int size;
    
        BufferedInputStream buf = null;
    
        FileInputStream fis = null;
    
        size = (int) ampFile.length();
    
        byte[] bytes = new byte[size];
    
        fis = new FileInputStream(ampFile);
    

    
        buf = new BufferedInputStream(fis, 8 * 1024);
    
        buf.read(bytes, 0, bytes.length);
    

    
        byte[] vocalbytes = AMPFileUtility.getByteData(bytes, "voice");
    
        byte[] mrbytes = AMPFileUtility.getByteData(bytes, "mr");
    

    
        voicePath = SmcInfo.APPDIRPATH + "/audio/" + ampName.replaceAll(".amp", "") + "_voice.mp3";
    
        mrPath = SmcInfo.APPDIRPATH + "/audio/" + ampName.replaceAll(".amp", "") + "_mr.mp3";
    

    
        BufferedOutputStream bosVocal = new BufferedOutputStream(new FileOutputStream(voicePath));
    
        bosVocal.write(vocalbytes);
    
        bosVocal.flush();
    
        bosVocal.close();
    

    
        BufferedOutputStream bosMr = new BufferedOutputStream(new FileOutputStream(mrPath));
    
        bosMr.write(mrbytes);
    
        bosMr.flush();
    
        bosMr.close();
    

    
    } catch (Exception e) {
    

    
        e.getMessage();
    
    }
    

    
    pathArray[0] = voicePath;
    
    pathArray[1] = mrPath;
    

    
    return pathArray;
    
}
    

    
private void play(String[] pathArray) {
    

    
    releaseAudioPlayer();
    

    
    String voicePath = pathArray[0];
    
    String mrPath = pathArray[1];
    

    
    mAudioPlayer = new Player_Thread();
    
    mAudioPlayer.setOnAudioStreamInterface(this);
    
    mAudioPlayer.setUrlString(mrPath);
    
    mAudioPlayer.setlistenerStop(true);
    

    
    vAudioPlayer = new Player_Thread();
    
    vAudioPlayer.setOnAudioStreamInterface(this);
    
    vAudioPlayer.setUrlString(voicePath);
    
    vAudioPlayer.setlistenerStop(false);
    

    
    try {
    
        mAudioPlayer.play();
    
        vAudioPlayer.play();
    
    } catch (IOException e) {
    
        e.printStackTrace();
    
    }
    
}
    

    
private void releaseAudioPlayer() {
    

    
    if (mAudioPlayer != null) {
    
        mAudioPlayer.stop();
    
        mAudioPlayer.release();
    
        mAudioPlayer = null;
    
    }
    

    
    if (vAudioPlayer != null) {
    
        vAudioPlayer.stop();
    
        vAudioPlayer.release();
    
        vAudioPlayer = null;
    
    }
    

    
    if (mRecordThread != null) {
    
        mRecordThread.stopRecording();
    
    }
    

    
}
    

    
public static String getCurrentTime(boolean dateForm) {
    
    SimpleDateFormat dateFormat;
    
    if (dateForm)
    
        dateFormat = new SimpleDateFormat("yyyy-MM-dd HH:mm:ss.SSS"); //SSS가 밀리세컨드 표시
    
    else
    
        dateFormat = new SimpleDateFormat("yyyyMMdd_HHmmssSSS");
    
    Calendar calendar = Calendar.getInstance();
    
    return dateFormat.format(calendar.getTime());
    
}
    

    

    
private String caltime(long sMillis, boolean timeFormat) {
    

    
    double dMillis = 0;
    

    
    int minutes = 0;
    
    int seconds = 0;
    
    int millis = 0;
    

    
    String sTime;
    

    
    try {
    
        dMillis = Double.parseDouble(String.valueOf(sMillis));
    
    } catch (Exception e) {
    
        System.out.println(e.getMessage());
    
    }
    

    

    
    seconds = (int) (dMillis / 1000) % 60;
    
    millis = (int) (dMillis % 1000);
    

    
    if (seconds > 0) {
    
        minutes = (int) (dMillis / 1000 / 60) % 60;
    
        if (minutes > 0) {
    
            if (timeFormat)
    
                sTime = String.format("%02d:%02d.%d", minutes, seconds, millis);
    
            else
    
                sTime = String.format("%02d%02d%d", minutes, seconds, millis);
    
        } else {
    
            if (timeFormat)
    
                sTime = String.format("%02d:%02d.%d", 0, seconds, millis);
    
            else
    
                sTime = String.format("%02d%02d%d", 0, seconds, millis);
    
        }
    
    } else {
    
        if (timeFormat)
    
            sTime = String.format("%02d:%02d.%d", 0, 0, millis);
    
        else
    
            sTime = String.format("%02d%02d%d", 0, 0, millis);
    
    }
    
    Log.d(TAG, "caltime:  " + sTime);
    
    return sTime;
    
}
    

    
public void copyWaveFile(String inFilename, String outFilename) {
    
    FileInputStream in = null;
    
    FileOutputStream out = null;
    
    long totalAudioLen = 0;
    
    long totalDataLen = totalAudioLen + 36;
    
    long longSampleRate = SAMPLE_RATE;
    
    int channels = 2;/////////////////byte 저장은 1에서 완벽함 AudioFormat.CHANNEL_IN_MONO: channels = 1;AudioFormat.CHANNEL_IN_STEREO: channels = 2;
    
    long byteRate = RECORDER_BPP * SAMPLE_RATE * channels / 8;
    

    

    
    try {
    
        in = new FileInputStream(inFilename);
    
        out = new FileOutputStream(outFilename);
    

    
        byte[] data = new byte[bufferSize];
    

    
        totalAudioLen = in.getChannel().size();
    
        totalDataLen = totalAudioLen + 36;
    

    
        AppLog.logString("File size: " + totalDataLen);
    

    
        WriteWaveFileHeader(out, totalAudioLen, totalDataLen, longSampleRate, channels, byteRate);
    

    
        while (in.read(data) != -1) {
    
            out.write(data);
    
        }
    

    
        in.close();
    
        out.close();
    
    } catch (FileNotFoundException e) {
    
        e.printStackTrace();
    
    } catch (IOException e) {
    
        e.printStackTrace();
    
    }
    
}
    

    
public void WriteWaveFileHeader(FileOutputStream out, long totalAudioLen, long totalDataLen, long longSampleRate, int channels, long byteRate) throws IOException {
    

    
    byte[] header = new byte[44];
    

    
    header[0] = 'R';
    
    header[1] = 'I';
    
    header[2] = 'F';
    
    header[3] = 'F';
    
    header[4] = (byte) (totalDataLen &amp; 0xff);
    
    header[5] = (byte) ((totalDataLen >> 8) &amp; 0xff);
    
    header[6] = (byte) ((totalDataLen >> 16) &amp; 0xff);
    
    header[7] = (byte) ((totalDataLen >> 24) &amp; 0xff);
    
    header[8] = 'W';
    
    header[9] = 'A';
    
    header[10] = 'V';
    
    header[11] = 'E';
    
    header[12] = 'f';
    
    header[13] = 'm';
    
    header[14] = 't';
    
    header[15] = ' ';
    
    header[16] = 16;
    
    header[17] = 0;
    
    header[18] = 0;
    
    header[19] = 0;
    
    header[20] = 1;
    
    header[21] = 0;
    
    header[22] = (byte) channels;
    
    header[23] = 0;
    
    header[24] = (byte) (longSampleRate &amp; 0xff);
    
    header[25] = (byte) ((longSampleRate >> 8) &amp; 0xff);
    
    header[26] = (byte) ((longSampleRate >> 16) &amp; 0xff);
    
    header[27] = (byte) ((longSampleRate >> 24) &amp; 0xff);
    
    header[28] = (byte) (byteRate &amp; 0xff);
    
    header[29] = (byte) ((byteRate >> 8) &amp; 0xff);
    
    header[30] = (byte) ((byteRate >> 16) &amp; 0xff);
    
    header[31] = (byte) ((byteRate >> 24) &amp; 0xff);
    
    header[32] = (byte) (2 * 16 / 8);
    
    header[33] = 0;
    
    header[34] = RECORDER_BPP;
    
    header[35] = 0;
    
    header[36] = 'd';
    
    header[37] = 'a';
    
    header[38] = 't';
    
    header[39] = 'a';
    
    header[40] = (byte) (totalAudioLen &amp; 0xff);
    
    header[41] = (byte) ((totalAudioLen >> 8) &amp; 0xff);
    
    header[42] = (byte) ((totalAudioLen >> 16) &amp; 0xff);
    
    header[43] = (byte) ((totalAudioLen >> 24) &amp; 0xff);
    

    
    out.write(header, 0, 44);
    
}
    
</long></long>

  • Extracting audio from video command fails for some videos

    16 June 2018, by Java Android

    I am using below FFmpeg command for extracting audio from video-

    String[] complexCommand = new String[]"-y","-ss", "" +
    startMs / 1000, "-t", "" + (endMs - startMs) / 1000, "-i",
    inputFileAbsolutePath, "-vn", "-ar", "44100", "-ac", "2", "-b:a",
    "256k", "-f", "mp3", outputFileAbsolutePath    ;

    It works fine in my device but through analytics I came to know that its failing for many users or for many videos.I failed to understand whats wrong with the command and why its failing many times?

  • FFmpeg encoding produces slightly incompatible MKV/MP4 container

    11 June 2018, by james2048

    I’ve been using the FFmpeg libraries to read and write media files using the C API.

    So far, reading seems to be pretty straightforward. I am able to read frames which I can then process, convert to RGB, process, and then convert back to YUV420 to be encoded.

    The encoded files play back with VLC media player fine, and Windows Media Player if I have a codec pack installed. However, they do behave strangely: the stock Windows 10 player won’t play them, same for Adobe Premiere. Also thumbnailers don’t work on it.
    Basically it seems like nothing other than VLC or FFmpeg itself can play/process the file. I have seen this with both MP4 and MKV, so it is not a format-specific issue.

    The problems go away once you remux the file with FFmpeg, for example "ffmpeg -i input.mkv -c copy output.mkv". Everything can play the file correctly.
    Also, the "remuxing.c" sample from the official samples works as well, with the same library version and compilers that I’m using (Visual Studio 2017, FFmpeg compiled with MinGW). It will fix the file and make it playable in all software.

    I’m not sure what could be causing this. I also don’t understand what the remuxing "fixed". It must be a container issue as the frames aren’t touched by remuxing.
    I have analysed the output MKVs with FFprobe -show_packets. It seems to have budged the packet timestamps a little constant factor, and the output stream now has
    is_avc=true and nal_length_size=4 instead of is_avc=false and nal_length_size=0, but apart from that the files are identical.

    Now here’s the output of FFprobe with the 3 last test packets, stream info and format info for both streams. As you can see, they are identical except for a couple of field. But something in here must have been "fixed" during remuxing to make it work.

    [PACKET]
    
codec_type=video
    
stream_index=0
    
pts=59050
    
pts_time=59.050000
    
dts=58890
    
dts_time=58.890000
    
duration=1
    
duration_time=0.001000
    
convergence_duration=N/A
    
convergence_duration_time=N/A
    
size=427
    
pos=277358
    
flags=__
    
[/PACKET]
    
[PACKET]
    
codec_type=video
    
stream_index=0
    
pts=58970
    
pts_time=58.970000
    
dts=58970
    
dts_time=58.970000
    
duration=1
    
duration_time=0.001000
    
convergence_duration=N/A
    
convergence_duration_time=N/A
    
size=205
    
pos=277792
    
flags=__
    
[/PACKET]
    
[PACKET]
    
codec_type=video
    
stream_index=0
    
pts=59130
    
pts_time=59.130000
    
dts=59050
    
dts_time=59.050000
    
duration=1
    
duration_time=0.001000
    
convergence_duration=N/A
    
convergence_duration_time=N/A
    
size=268
    
pos=278004
    
flags=__
    
[/PACKET]
    
[STREAM]
    
index=0
    
codec_name=h264
    
codec_long_name=H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10
    
profile=Main
    
codec_type=video
    
codec_time_base=1/2000
    
codec_tag_string=[0][0][0][0]
    
codec_tag=0x0000
    
width=720
    
height=576
    
coded_width=720
    
coded_height=576
    
has_b_frames=2
    
sample_aspect_ratio=N/A
    
display_aspect_ratio=N/A
    
pix_fmt=yuv420p
    
level=50
    
color_range=unknown
    
color_space=unknown
    
color_transfer=unknown
    
color_primaries=unknown
    
chroma_location=left
    
field_order=progressive
    
timecode=N/A
    
refs=1
    
is_avc=false
    
nal_length_size=0
    
id=N/A
    
r_frame_rate=299/12
    
avg_frame_rate=1000/1
    
time_base=1/1000
    
start_pts=0
    
start_time=0.000000
    
duration_ts=N/A
    
duration=N/A
    
bit_rate=N/A
    
max_bit_rate=N/A
    
bits_per_raw_sample=8
    
nb_frames=N/A
    
nb_read_frames=N/A
    
nb_read_packets=737
    
DISPOSITION:default=1
    
DISPOSITION:dub=0
    
DISPOSITION:original=0
    
DISPOSITION:comment=0
    
DISPOSITION:lyrics=0
    
DISPOSITION:karaoke=0
    
DISPOSITION:forced=0
    
DISPOSITION:hearing_impaired=0
    
DISPOSITION:visual_impaired=0
    
DISPOSITION:clean_effects=0
    
DISPOSITION:attached_pic=0
    
DISPOSITION:timed_thumbnails=0
    
TAG:DURATION=00:00:59.211000000
    
[/STREAM]
    
[FORMAT]
    
filename=testEncLeft.mkv
    
nb_streams=1
    
nb_programs=0
    
format_name=matroska,webm
    
format_long_name=Matroska / WebM
    
start_time=0.000000
    
duration=59.211000
    
size=278349
    
bit_rate=37607
    
probe_score=100
    
TAG:COMMENT=Slickline Player Export
    
TAG:ENCODER=Lavf57.83.100
    
[/FORMAT]

    And the info after remuxing, which works:

    [PACKET]
    
codec_type=video
    
stream_index=0
    
pts=59050
    
pts_time=59.050000
    
dts=58890
    
dts_time=58.890000
    
duration=1
    
duration_time=0.001000
    
convergence_duration=N/A
    
convergence_duration_time=N/A
    
size=427
    
pos=277418
    
flags=__
    
[/PACKET]
    
[PACKET]
    
codec_type=video
    
stream_index=0
    
pts=58970
    
pts_time=58.970000
    
dts=58970
    
dts_time=58.970000
    
duration=1
    
duration_time=0.001000
    
convergence_duration=N/A
    
convergence_duration_time=N/A
    
size=205
    
pos=277852
    
flags=__
    
[/PACKET]
    
[PACKET]
    
codec_type=video
    
stream_index=0
    
pts=59130
    
pts_time=59.130000
    
dts=59050
    
dts_time=59.050000
    
duration=1
    
duration_time=0.001000
    
convergence_duration=N/A
    
convergence_duration_time=N/A
    
size=268
    
pos=278064
    
flags=__
    
[/PACKET]
    
[STREAM]
    
index=0
    
codec_name=h264
    
codec_long_name=H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10
    
profile=Main
    
codec_type=video
    
codec_time_base=1/2000
    
codec_tag_string=[0][0][0][0]
    
codec_tag=0x0000
    
width=720
    
height=576
    
coded_width=720
    
coded_height=576
    
has_b_frames=2
    
sample_aspect_ratio=N/A
    
display_aspect_ratio=N/A
    
pix_fmt=yuv420p
    
level=50
    
color_range=unknown
    
color_space=unknown
    
color_transfer=unknown
    
color_primaries=unknown
    
chroma_location=left
    
field_order=progressive
    
timecode=N/A
    
refs=1
    
is_avc=true
    
nal_length_size=4
    
id=N/A
    
r_frame_rate=299/12
    
avg_frame_rate=1000/1
    
time_base=1/1000
    
start_pts=0
    
start_time=0.000000
    
duration_ts=N/A
    
duration=N/A
    
bit_rate=N/A
    
max_bit_rate=N/A
    
bits_per_raw_sample=8
    
nb_frames=N/A
    
nb_read_frames=N/A
    
nb_read_packets=737
    
DISPOSITION:default=1
    
DISPOSITION:dub=0
    
DISPOSITION:original=0
    
DISPOSITION:comment=0
    
DISPOSITION:lyrics=0
    
DISPOSITION:karaoke=0
    
DISPOSITION:forced=0
    
DISPOSITION:hearing_impaired=0
    
DISPOSITION:visual_impaired=0
    
DISPOSITION:clean_effects=0
    
DISPOSITION:attached_pic=0
    
DISPOSITION:timed_thumbnails=0
    
TAG:DURATION=00:00:59.212000000
    
[/STREAM]
    
[FORMAT]
    
filename=fixedLeft.mkv
    
nb_streams=1
    
nb_programs=0
    
format_name=matroska,webm
    
format_long_name=Matroska / WebM
    
start_time=0.000000
    
duration=59.212000
    
size=278409
    
bit_rate=37615
    
probe_score=100
    
TAG:COMMENT=Slickline Player Export
    
TAG:ENCODER=Lavf58.12.100
    
[/FORMAT]

    Here is how I’m setting up the output context, for reference: it’s pretty standard, following the sample code.

    int ret;
    

    
avformat_alloc_output_context2(&amp;outputFormatCtx, nullptr, nullptr, outFilePath.c_str());
    

    
av_dict_set(&amp;outputFormatCtx->metadata, "comment", "FFmpeg Export", 0);
    

    
if (!outputFormatCtx)
    
{
    
    LOG_AND_THROW("Could not allocate output context");
    
}
    

    
outputVideoStream = avformat_new_stream(outputFormatCtx, nullptr);
    
outputVideoStream->time_base = AVRational{ 1, AV_TIME_BASE }; // Stream timebase will be used by codec
    

    
if (!outputVideoStream)
    
{
    
    LOG_AND_THROW("Failed allocating output stream");
    
}
    

    
// defaults to "libx264"
    
AVCodec *outCodec = avcodec_find_encoder_by_name(selectedCodecName.c_str());
    

    
if (!outCodec)
    
{
    
    LOG_AND_THROW("Failed finding output codec");
    
}
    

    
AVDictionary *opts = nullptr;
    

    
if (selectedCodecName == "libx264")
    
{
    
    opts = getX264CodecOptions();
    
}
    

    
encoderCtx = avcodec_alloc_context3(outCodec);
    

    
if (!encoderCtx)
    
{
    
    LOG_AND_THROW("Failed to allocate the encoder context");
    
}
    

    
encoderCtx->width = width;
    
encoderCtx->height = height;
    
encoderCtx->pix_fmt = AV_PIX_FMT_YUV420P;
    
// time base for the frames we will provide to the encoder
    
encoderCtx->time_base = AVRational{ 1, AV_TIME_BASE };
    
// convert framerate from double to rational
    
encoderCtx->framerate = AVRational{ (int)(frameRate * AV_TIME_BASE), AV_TIME_BASE};
    

    
// Match encoderCtx time base for the stream
    
outputVideoStream->time_base = encoderCtx->time_base;
    

    
ret = avcodec_open2(encoderCtx, outCodec, &amp;opts);
    

    
if (ret &lt; 0)
    
{
    
    LOG_AND_THROW_PARAM("Cannot open video encoder for stream: %d", ret);
    
}
    

    
// Fill in some params for MP4 stream, details about encoder
    
ret = avcodec_parameters_from_context(outputVideoStream->codecpar, encoderCtx);
    

    
if (ret &lt; 0)
    
{
    
    LOG_AND_THROW_PARAM("Failed to copy encoder parameters to output stream: %d", ret);
    
}
    

    
if (outputFormatCtx->oformat->flags &amp; AVFMT_GLOBALHEADER)
    
{
    
    encoderCtx->flags |= AV_CODEC_FLAG_GLOBAL_HEADER;
    
}
    

    
av_dump_format(outputFormatCtx, 0, filePath.c_str(), 1);
    

    
// End of encoder settings, setting up MP4
    
if (!(outputFormatCtx->oformat->flags &amp; AVFMT_NOFILE))
    
{
    
    ret = avio_open(&amp;outputFormatCtx->pb, outFilePath.c_str(), AVIO_FLAG_WRITE);
    

    
    if (ret &lt; 0)
    
    {
    
        LOG_AND_THROW_PARAMSTR("Could not open output file '%s'", outFilePath.c_str());
    
    }
    
}
    

    
ret = avformat_write_header(outputFormatCtx, nullptr);
    

    
if (ret &lt; 0)
    
{
    
    LOG_AND_THROW_PARAM("Error occurred when opening output file for writing: %d", ret);
    
}

    Can anyone help me figure out why the container is not playing properly?

    Thanks in advance.

    -James

Browsing