Recherche avancée

Médias (91)

Autres articles (41)

  • Des sites réalisés avec MediaSPIP

    2 mai 2011, par

    Cette page présente quelques-uns des sites fonctionnant sous MediaSPIP.
    Vous pouvez bien entendu ajouter le votre grâce au formulaire en bas de page.

  • Use, discuss, criticize

    13 avril 2011, par

    Talk to people directly involved in MediaSPIP’s development, or to people around you who could use MediaSPIP to share, enhance or develop their creative projects.
    The bigger the community, the more MediaSPIP’s potential will be explored and the faster the software will evolve.
    A discussion list is available for all exchanges between users.

  • Supporting all media types

    13 avril 2011, par

    Unlike most software and media-sharing platforms, MediaSPIP aims to manage as many different media types as possible. The following are just a few examples from an ever-expanding list of supported formats : images : png, gif, jpg, bmp and more audio : MP3, Ogg, Wav and more video : AVI, MP4, OGV, mpg, mov, wmv and more text, code and other data : OpenOffice, Microsoft Office (Word, PowerPoint, Excel), web (html, CSS), LaTeX, Google Earth and (...)

Sur d’autres sites (7528)

  • Feeding MediaCodec with byte data from AVPacket : problems with output buffers

    2 mars 2016, par serg66

    Description of my task :
    I’m developing a video player on Android (API >= 17). It has to work both with HLS and multicast video. In addition, it has to support multiple audio tracks.

    Why I decided to use ffmpeg :

    • On some devices MediaPlayer doesn’t support multicast-video
    • MediaExtractor doesn’t work with HLS (getTrackCount() returns 0)
    • ffmpeg works both with HLS and multicast

    My idea :
    I demux a stream using ffmpeg in a loop. I get the CSD using videoStream->codec->extradata and then properly configure the MediaFormat. On each iteration when I have a new video AVPacket available, I filter it’s buffer using av_bitstream_filter_init to h264_mp4toannexb. Then I call the java method onNewVideoData, in which I get the AVPacket byte array. I clear the available input buffer, after that I fill it with the new data. I also get the pts. Since I have a stream with no beginning, additionally, I calculate new pts’ by subtracting the pts of the first AVPacket from all the following pts’. The first pts I assign to 0. Then I call queueInputBuffer to send the buffer to the decoder.

    I use two threads : one for getting and submitting data to the input buffers, and another one for posting it to the Surface.

    The full player c-code :

    #include 
    
#include <android></android>log.h>
    
#include 
    

    
#include <libavformat></libavformat>avformat.h>
    
#include <libavcodec></libavcodec>avcodec.h>
    
#include <libavutil></libavutil>buffer.h>
    

    
#define TAG "ffmpegPlayer"
    

    
struct
    
{
    
    const char* url;
    
    jint width;
    
    jint height;
    
    jfloat aspectRatio;
    
    jint streamsCount;
    
    AVFormatContext* formatContext;
    
    AVStream* videoStream;
    
} context;
    

    
AVPacket packet;
    
AVBitStreamFilterContext* avBitStreamFilterContext;
    

    
JNIEXPORT jbyteArray JNICALL Java_com_example_app_FfmpegPlayer_getCsdNative(JNIEnv* env, jobject x)
    
{
    
    jbyteArray arr = (*env)->NewByteArray(env, context.videoStream->codec->extradata_size);
    
    (*env)->SetByteArrayRegion(env, arr, 0, context.videoStream->codec->extradata_size, (jbyte*)context.videoStream->codec->extradata);
    

    
    return arr;
    
}
    

    
JNIEXPORT jint JNICALL Java_com_example_app_FfmpegPlayer_getWidthNative(JNIEnv* env, jobject x)
    
{
    
    return context.width;
    
}
    

    
JNIEXPORT jint JNICALL Java_com_example_app_FfmpegPlayer_getHeightNative(JNIEnv* env, jobject x)
    
{
    
    return context.height;
    
}
    

    
JNIEXPORT jfloat JNICALL Java_com_example_app_FfmpegPlayer_getAspectRatioNative(JNIEnv* env, jobject x)
    
{
    
    return context.aspectRatio;
    
}
    

    
JNIEXPORT jfloat JNICALL Java_com_example_app_FfmpegPlayer_getStreamsCountNative(JNIEnv* env, jobject x)
    
{
    
    return context.streamsCount;
    
}
    

    
JNIEXPORT jlong JNICALL Java_com_example_app_FfmpegPlayer_getPtsNative(JNIEnv* env, jobject obj)
    
{
    
    return packet.pts * av_q2d(context.videoStream->time_base) * 1000000;
    
}
    

    
JNIEXPORT jboolean JNICALL Java_com_example_app_FfmpegPlayer_initNative(JNIEnv* env, jobject obj, const jstring u)
    
{
    
    av_register_all();
    
    avBitStreamFilterContext = av_bitstream_filter_init("h264_mp4toannexb");
    

    
    const char* url = (*env)->GetStringUTFChars(env, u , NULL);
    
    __android_log_print(ANDROID_LOG_DEBUG, TAG, "Init: %s", url);
    

    
    AVFormatContext* formatContext = NULL;
    
    if (avformat_open_input(&amp;formatContext, url, NULL, NULL) &lt; 0) {
    
        __android_log_print(ANDROID_LOG_ERROR, TAG, "Unable to open input");
    
        return JNI_FALSE;
    
    }
    

    
    if (avformat_find_stream_info(formatContext, NULL) &lt; 0) {
    
        __android_log_print(ANDROID_LOG_ERROR, TAG, "Unable to find stream info");
    
        return JNI_FALSE;
    
    }
    

    
    AVInputFormat * iformat = formatContext->iformat;
    
    __android_log_print(ANDROID_LOG_DEBUG, TAG, "format: %s", iformat->name);
    

    
    context.streamsCount = formatContext->nb_streams;
    
    __android_log_print(ANDROID_LOG_DEBUG, TAG, "Streams count: %d", formatContext->nb_streams);
    

    
    int i = 0;
    
    AVStream* videoStream = NULL;
    
    AVDictionaryEntry* lang;
    
    for (i = 0; i &lt; formatContext->nb_streams; i++) {
    
        int codecType = formatContext->streams[i]->codec->codec_type;
    
        if (videoStream == NULL &amp;&amp; codecType == AVMEDIA_TYPE_VIDEO) {
    
            videoStream = formatContext->streams[i];
    
        }
    
        else if (codecType == AVMEDIA_TYPE_AUDIO) {
    
            lang = av_dict_get(formatContext->streams[i]->metadata, "language", NULL, 0);
    
            if (lang != NULL) {
    
                __android_log_print(ANDROID_LOG_DEBUG, TAG, "Audio stream %d: %s", i, lang->value);
    
            }
    
        }
    
    }
    
    if (videoStream == NULL) {
    
        __android_log_print(ANDROID_LOG_ERROR, TAG, "Unable to find video stream");
    
        return JNI_FALSE;
    
    }
    
    context.videoStream = videoStream;
    
    __android_log_print(ANDROID_LOG_DEBUG, TAG, "Video stream:  %d", videoStream->index);
    

    
    AVCodecContext *codecContext = formatContext->streams[videoStream->index]->codec;
    

    
    __android_log_print(ANDROID_LOG_DEBUG, TAG, "width: %d, height: %d", codecContext->width, codecContext->height);
    
    context.width = codecContext->width;
    
    context.height = codecContext->height;
    

    
    AVRational aspectRatio = codecContext->sample_aspect_ratio;
    
    __android_log_print(ANDROID_LOG_DEBUG, TAG, "aspect ratio: %d/%d", aspectRatio.num, aspectRatio.den);
    
    context.aspectRatio = aspectRatio.num / aspectRatio.den;
    

    
    context.formatContext = formatContext;
    

    
    return JNI_TRUE;
    
}
    

    
void filterPacket()
    
{
    
    av_bitstream_filter_filter(avBitStreamFilterContext, context.videoStream->codec, NULL, &amp;packet.data, &amp;packet.size, packet.data, packet.size, packet.flags);
    
}
    

    
JNIEXPORT void JNICALL Java_com_example_app_FfmpegPlayer_startNative(JNIEnv* env, jobject obj)
    
{
    
    jclass cl = (*env)->GetObjectClass(env, obj);
    
    jmethodID updateMethodId = (*env)->GetMethodID(env, cl, "onNewVideoData", "()V");
    

    
    while (av_read_frame(context.formatContext, &amp;packet) >= 0) {
    
        if (context.formatContext == NULL) {
    
            return;
    
        }
    
        if (packet.stream_index == context.videoStream->index) {
    
            filterPacket();
    
            (*env)->CallVoidMethod(env, obj, updateMethodId);
    
        }
    
    }
    
}
    

    
JNIEXPORT jbyteArray JNICALL Java_com_example_app_FfmpegPlayer_getVideoDataNative(JNIEnv* env, jobject obj)
    
{
    
    AVBufferRef *buf = packet.buf;
    

    
    jbyteArray arr = (*env)->NewByteArray(env, buf->size);
    
    (*env)->SetByteArrayRegion(env, arr, 0, buf->size, (jbyte*)buf->data);
    

    
    return arr;
    
}

    The full Java-code :

    package com.example.app;
    

    

    
import android.media.MediaCodec;
    
import android.media.MediaFormat;
    
import android.view.Surface;
    

    
import java.nio.ByteBuffer;
    

    
public class FfmpegPlayer {
    

    
    static {
    
        System.loadLibrary("avutil-54");
    
        System.loadLibrary("swscale-3");
    
        System.loadLibrary("swresample-1");
    
        System.loadLibrary("avcodec-56");
    
        System.loadLibrary("avformat-56");
    
        System.loadLibrary("avfilter-5");
    
        System.loadLibrary("ffmpeg-player");
    
    }
    

    
    private native boolean initNative(String url);
    
    private native boolean startNative();
    
    private native int getWidthNative();
    
    private native int getHeightNative();
    
    private native float getAspectRatioNative();
    
    private native byte[] getVideoDataNative();
    
    private native long getPtsNative();
    
    private native byte[] getCsdNative();
    

    
    private String source;
    
    private PlayerThread playerThread;
    
    private int width;
    
    private int height;
    
    private MediaCodec decoder;
    
    private ByteBuffer[] inputBuffers;
    
    private Surface surface;
    
    private long firstPtsTime;
    

    
    public PlanetaPlayer(Surface surface) {
    
        this.surface = surface;
    
    }
    

    
    public void setDataSource(String source) {
    
        if (!initNative(source)) {
    
            return;
    
        }
    
        width = getWidthNative();
    
        height = getHeightNative();
    
        MediaFormat format = MediaFormat.createVideoFormat("video/avc", width, height);
    
        format.setInteger(MediaFormat.KEY_MAX_INPUT_SIZE, width * height);
    
        format.setByteBuffer("csd-0", ByteBuffer.wrap(getCsdNative()));
    
        LogUtils.log("CSD: ");
    
        outputAsHex(getCsdNative());
    
        try {
    
            decoder = MediaCodec.createDecoderByType("video/avc");
    
            decoder.configure(format, surface, null, 0);
    
            decoder.start();
    

    
            playerThread = new PlayerThread();
    
            playerThread.start();
    

    
            new OutputThread().run();
    
        }
    
        catch (Exception e) {
    
            e.printStackTrace();
    
        }
    
    }
    

    
    public void onNewVideoData() {
    
        int index = decoder.dequeueInputBuffer(0);
    
        if (index >= 0) {
    
            byte[] data = getVideoDataNative();
    
            ByteBuffer byteBuffer = decoder.getInputBuffers()[index];
    
            byteBuffer.clear();
    
            byteBuffer.put(data);
    
            long pts = getPtsNative();
    

    
            LogUtils.log("Input AVPacket pts: " + pts);
    
            LogUtils.log("Input AVPacket data length: " + data.length);
    
            LogUtils.log("Input AVPacket data: ");
    
            outputAsHex(data);
    

    
            if (firstPtsTime == 0) {
    
                firstPtsTime = pts;
    
                pts = 0;
    
            }
    
            else {
    
                pts -= firstPtsTime;
    
            }
    
            decoder.queueInputBuffer(index, 0, data.length, pts, 0);
    
        }
    
    }
    

    
    private void outputAsHex(byte[] data) {
    
        String[] test = new String[data.length];
    
        for (int i = 0; i &lt; data.length; i++) {
    
            test[i] = String.format("%02x", data[i]);
    
        }
    
        LogUtils.log(test);
    
    }
    

    
    private class PlayerThread extends Thread {
    
        @Override
    
        public void run() {
    
            super.run();
    

    
            startNative();
    
        }
    
    }
    

    
    private class OutputThread extends Thread {
    

    
        @Override
    
        public void run() {
    
            super.run();
    
            MediaCodec.BufferInfo info = new MediaCodec.BufferInfo();
    
            while (true) {
    
                int index = decoder.dequeueOutputBuffer(info, 0);
    
                if (index >= 0) {
    
                    ByteBuffer buffer = decoder.getOutputBuffers()[index];
    
                    buffer.position(info.offset);
    
                    buffer.limit(info.offset + info.size);
    
                    byte[] test = new byte[info.size];
    
                    for (int i = 0; i &lt; info.size; i++) {
    
                        test[i] = buffer.get(i);
    
                    }
    
                    LogUtils.log("Output info: size=" + info.size + ", presentationTimeUs=" + info.presentationTimeUs + ",offset=" + info.offset + ",flags=" + info.flags);
    
                    LogUtils.log("Output data: ");
    
                    outputAsHex(test);
    
                    decoder.releaseOutputBuffer(index, true);
    
                }
    
            }
    
        }
    
    }
    
}

    The problem :
    For the tests I used a TS file with the following video stream :

    Codec: H264 - MPEG-4 AVC (part 10) (h264)
    
Resolution: 720x578
    
Frame rate: 25
    
Decoded format: Planar 4:2:0 YUV

    The CSD is the following :

    [00, 00, 00, 01, 09, 10, 00, 00, 00, 01, 27, 4d, 40, 1e, 9a, 62, 01, 68, 48, b0, 44, 20, a0, a0, a8, 00, 00, 03, 00, 08, 00, 00, 03, 01, 94, a0, 00, 00, 00, 01, 28, ee, 3c, 80]

    On different devices I have different results. But I couldn’t achieve showing the video on the Surface.

    Input :

    Input AVPacket pts: 351519222
    
Input AVPacket data length: 54941
    
Input AVPacket data: [00, 00, 00, 01, 09, 10, 00, 00, 00, 01, 27, 4d, 40, 1e, 9a, 62, 01, 68, 48, b0, 44, 20, a0, a0, a8, 00, 00, 03, 00, 08, 00, 00, 03, 01, 94, a0, 00, 00, 00, 01,...]
    
------------------------------------
    
Input AVPacket pts: 351539222
    
Input AVPacket data length: 9605
    
Input AVPacket data: [00, 00, 00, 01, 09, 30, 00, 00, 00, 01, 06, 01, 01, 24, 80, 00, 00, 00, 01, 21, e3, bd, da, e4, 46, c5, 8b, 6b, 7d, 07, 59, 23, 6f, 92, e9, fb, 3b, b9, 4d, f9,...]
    
------------------------------------
    
Input AVPacket pts: 351439222
    
Input AVPacket data length: 1985
    
Input AVPacket data: [00, 00, 00, 01, 09, 50, 00, 00, 00, 01, 06, 01, 01, 14, 80, 00, 00, 00, 01, 21, a8, f2, 74, 69, 14, 54, 4d, c5, 8b, e8, 42, 52, ac, 80, 53, b4, 4d, 24, 1f, 6c,...]
    
------------------------------------
    
Input AVPacket pts: 351459222
    
Input AVPacket data length: 2121
    
Input AVPacket data: [00, 00, 00, 01, 09, 50, 00, 00, 00, 01, 06, 01, 01, 24, 80, 00, 00, 00, 01, 21, a8, f3, 74, e9, 0b, 8b, 17, e8, 43, f8, 10, 88, ca, 2b, 11, 53, c8, 31, f0, 0b,...]
    
... on and on

    Asus Zenfone (Android 5.0.2) output thread (after decoding, strange results with 25 buffers of only 8 byte data) :

    Output info: size=8, presentationTimeUs=-80001,offset=0,flags=0
    
Output data: 
    
[01, 00, 00, 00, 90, c5, 99, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=0,offset=0,flags=1
    
Output data: 
    
[01, 00, 00, 00, 78, ea, 86, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=720000,offset=0,flags=1
    
Output data: 
    
[01, 00, 00, 00, e8, 86, b6, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=780000,offset=0,flags=1
    
Output data: 
    
[01, 00, 00, 00, c0, cb, 93, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=840000,offset=0,flags=0
    
Output data: 
    
[01, 00, 00, 00, 80, 87, 93, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=960000,offset=0,flags=1
    
Output data: 
    
[01, 00, 00, 00, e0, 3f, 8b, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=1040000,offset=0,flags=1
    
Output data: 
    
[01, 00, 00, 00, f8, 76, 85, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=1180000,offset=0,flags=1
    
Output data: 
    
[01, 00, 00, 00, e0, 87, 93, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=1260000,offset=0,flags=1
    
Output data: 
    
[01, 00, 00, 00, e8, b5, d2, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=1800000,offset=0,flags=0
    
Output data: 
    
[01, 00, 00, 00, 90, c5, 99, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=1860000,offset=0,flags=1
    
Output data: 
    
[01, 00, 00, 00, e0, c0, 84, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=2080000,offset=0,flags=1
    
Output data: 
    
[01, 00, 00, 00, c0, cb, 93, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=3440000,offset=0,flags=1
    
Output data: 
    
[01, 00, 00, 00, 80, 87, 93, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=3520000,offset=0,flags=0
    
Output data: 
    
[01, 00, 00, 00, 78, ea, 86, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=4160000,offset=0,flags=1
    
Output data: 
    
[01, 00, 00, 00, e8, 86, b6, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=4300000,offset=0,flags=1
    
Output data: 
    
[01, 00, 00, 00, e0, 3f, 8b, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=4400000,offset=0,flags=1
    
Output data: 
    
[01, 00, 00, 00, 90, c5, 99, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=4480000,offset=0,flags=1
    
Output data: 
    
[01, 00, 00, 00, f8, 76, 85, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=4680000,offset=0,flags=0
    
Output data: 
    
[01, 00, 00, 00, c0, cb, 93, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=4720000,offset=0,flags=1
    
Output data: 
    
[01, 00, 00, 00, e0, c0, 84, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=4760000,offset=0,flags=1
    
Output data: 
    
[01, 00, 00, 00, e0, 87, 93, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=4800000,offset=0,flags=0
    
Output data: 
    
[01, 00, 00, 00, 58, 54, 83, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=5040000,offset=0,flags=0
    
Output data: 
    
[01, 00, 00, 00, e8, b5, d2, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=5100000,offset=0,flags=1
    
Output data: 
    
[01, 00, 00, 00, 80, 87, 93, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=5320000,offset=0,flags=0
    
Output data: 
    
[01, 00, 00, 00, 78, ea, 86, ac]
    
---------------------------
    
Output info: size=8, presentationTimeUs=5380000,offset=0,flags=1
    
Output data: 
    
[01, 00, 00, 00, e8, 86, b6, ac]

    Other Asus Zenfone logs :

    01-25 17:11:36.859 4851-4934/com.example.app I/OMXClient: Using client-side OMX mux.
    
01-25 17:11:36.865 317-1075/? I/OMX-VDEC-1080P: component_init: OMX.qcom.video.decoder.avc : fd=43
    
01-25 17:11:36.867 317-1075/? I/OMX-VDEC-1080P: Capabilities: driver_name = msm_vidc_driver, card = msm_vdec_8974, bus_info = , version = 1, capabilities = 4003000
    
01-25 17:11:36.881 317-1075/? I/OMX-VDEC-1080P: omx_vdec::component_init() success : fd=43
    
01-25 17:11:36.885 4851-4934/com.example.app I/ACodec: [OMX.qcom.video.decoder.avc] DRC Mode: Dynamic Buffer Mode
    
01-25 17:11:36.893 317-20612/? E/C2DColorConvert: unknown format passed for luma alignment number
    
01-25 17:11:36.933 317-12269/? E/C2DColorConvert: unknown format passed for luma alignment number
    
01-25 17:11:36.933 317-12269/? E/C2DColorConvert: unknown format passed for luma alignment number
    
01-25 17:11:36.935 317-5559/? E/C2DColorConvert: unknown format passed for luma alignment number
    
01-25 17:11:36.957 317-5559/? E/C2DColorConvert: unknown format passed for luma alignment number
    
01-25 17:11:36.957 4851-4934/com.example.app I/ExtendedCodec: Decoder will be in frame by frame mode
    
01-25 17:11:36.963 317-1075/? E/C2DColorConvert: unknown format passed for luma alignment number
    
01-25 17:11:36.963 317-1075/? E/C2DColorConvert: unknown format passed for luma alignment number
    
01-25 17:11:36.964 317-20612/? E/OMX-VDEC-1080P: Extension: OMX.google.android.index.describeColorFormat not implemented
    
01-25 17:11:37.072 317-20612/? E/OMX-VDEC-1080P: Extension: OMX.google.android.index.describeColorFormat not implemented
    
01-25 17:11:37.072 4851-4934/com.example.app W/ACodec: do not know color format 0x7fa30c04 = 2141391876

    Asus Nexus 7 (Android 6.0.1) crashes :

    01-25 17:23:06.921 11602-11695/com.example.app I/OMXClient: Using client-side OMX mux.
    
01-25 17:23:06.952 11602-11694/com.example.app I/MediaCodec: [OMX.qcom.video.decoder.avc] setting surface generation to 11880449
    
01-25 17:23:06.954 194-194/? E/OMX-VDEC-1080P: Extension: OMX.google.android.index.storeANWBufferInMetadata not implemented
    
01-25 17:23:06.954 194-194/? E/OMX-VDEC-1080P: Extension: OMX.google.android.index.storeMetaDataInBuffers not implemented
    
01-25 17:23:06.954 194-194/? E/OMXNodeInstance: getExtensionIndex(45:qcom.decoder.avc, OMX.google.android.index.storeMetaDataInBuffers) ERROR: NotImplemented(0x80001006)
    
01-25 17:23:06.954 11602-11695/com.example.app E/ACodec: [OMX.qcom.video.decoder.avc] storeMetaDataInBuffers failed w/ err -2147483648
    
01-25 17:23:06.963 11602-11695/com.example.app D/SurfaceUtils: set up nativeWindow 0xa0b7a108 for 720x576, color 0x7fa30c03, rotation 0, usage 0x42002900
    
01-25 17:23:06.967 194-604/? E/OMX-VDEC-1080P: GET_MV_BUFFER_SIZE returned: Size: 122880 and alignment: 8192
    
01-25 17:23:07.203 11602-11695/com.example.app W/AHierarchicalStateMachine: Warning message AMessage(what = 'omxI') = {
    
                                                                         int32_t type = 0
    
                                                                         int32_t event = 2130706432
    
                                                                         int32_t data1 = 1
    
                                                                         int32_t data2 = 0
    
                                                                       } unhandled in root state.
    
01-25 17:23:07.232 11602-11695/com.example.app D/SurfaceUtils: set up nativeWindow 0xa0b7a108 for 720x576, color 0x7fa30c03, rotation 0, usage 0x42002900
    
01-25 17:23:07.241 194-194/? E/OMX-VDEC-1080P: GET_MV_BUFFER_SIZE returned: Size: 122880 and alignment: 8192
    
01-25 17:23:07.242 194-194/? E/OMX-VDEC-1080P: Insufficient sized buffer given for playback, expected 671744, got 663552
    
01-25 17:23:07.242 194-194/? E/OMXNodeInstance: useBuffer(45:qcom.decoder.avc, Output:1 671744@0xb60a0860) ERROR: BadParameter(0x80001005)
    
01-25 17:23:07.243 11602-11695/com.example.app E/ACodec: registering GraphicBuffer 0 with OMX IL component failed: -2147483648
    
01-25 17:23:07.243 11602-11695/com.example.app E/ACodec: Failed to allocate output port buffers after port reconfiguration: (-2147483648)
    
01-25 17:23:07.243 11602-11695/com.example.app E/ACodec: signalError(omxError 0x80001001, internalError -2147483648)
    
01-25 17:23:07.243 11602-11694/com.example.app E/MediaCodec: Codec reported err 0x80001001, actionCode 0, while in state 6
    
01-25 17:23:07.245 11602-11602/com.example.app W/System.err: java.lang.IllegalStateException
    
01-25 17:23:07.245 11602-11602/com.example.app W/System.err:     at android.media.MediaCodec.native_dequeueOutputBuffer(Native Method)
    
01-25 17:23:07.245 11602-11602/com.example.app W/System.err:     at android.media.MediaCodec.dequeueOutputBuffer(MediaCodec.java:2379)
    
01-25 17:23:07.245 11602-11602/com.example.app W/System.err:     at com.example.app.FfmpegPlayer$OutputThread.run(FfmpegPlayer.java:122)
    
01-25 17:23:07.245 11602-11602/com.example.app W/System.err:     at com.example.app.FfmpegPlayer.setDataSource(FfmpegPlayer.java:66)
    
01-25 17:23:07.245 11602-11602/com.example.app W/System.err:     at com.example.app.activities.TestActivity$2.surfaceCreated(TestActivity.java:151)
    
01-25 17:23:07.245 11602-11602/com.example.app W/System.err:     at android.view.SurfaceView.updateWindow(SurfaceView.java:583)
    
01-25 17:23:07.245 11602-11602/com.example.app W/System.err:     at android.view.SurfaceView$3.onPreDraw(SurfaceView.java:177)
    
01-25 17:23:07.246 11602-11602/com.example.app W/System.err:     at android.view.ViewTreeObserver.dispatchOnPreDraw(ViewTreeObserver.java:944)
    
01-25 17:23:07.246 11602-11602/com.example.app W/System.err:     at android.view.ViewRootImpl.performTraversals(ViewRootImpl.java:2055)
    
01-25 17:23:07.246 11602-11602/com.example.app W/System.err:     at android.view.ViewRootImpl.doTraversal(ViewRootImpl.java:1107)
    
01-25 17:23:07.246 11602-11602/com.example.app W/System.err:     at android.view.ViewRootImpl$TraversalRunnable.run(ViewRootImpl.java:6013)
    
01-25 17:23:07.246 11602-11602/com.example.app W/System.err:     at android.view.Choreographer$CallbackRecord.run(Choreographer.java:858)
    
01-25 17:23:07.246 11602-11602/com.example.app W/System.err:     at android.view.Choreographer.doCallbacks(Choreographer.java:670)
    
01-25 17:23:07.246 11602-11602/com.example.app W/System.err:     at android.view.Choreographer.doFrame(Choreographer.java:606)
    
01-25 17:23:07.246 11602-11602/com.example.app W/System.err:     at android.view.Choreographer$FrameDisplayEventReceiver.run(Choreographer.java:844)
    
01-25 17:23:07.246 11602-11602/com.example.app W/System.err:     at android.os.Handler.handleCallback(Handler.java:739)
    
01-25 17:23:07.246 11602-11602/com.example.app W/System.err:     at android.os.Handler.dispatchMessage(Handler.java:95)
    
01-25 17:23:07.246 11602-11602/com.example.app W/System.err:     at android.os.Looper.loop(Looper.java:148)
    
01-25 17:23:07.246 11602-11602/com.example.app W/System.err:     at android.app.ActivityThread.main(ActivityThread.java:5417)
    
01-25 17:23:07.246 11602-11602/com.example.app W/System.err:     at java.lang.reflect.Method.invoke(Native Method)
    
01-25 17:23:07.246 11602-11602/com.example.app W/System.err:     at com.android.internal.os.ZygoteInit$MethodAndArgsCaller.run(ZygoteInit.java:726)
    
01-25 17:23:07.246 11602-11602/com.example.app W/System.err:     at com.android.internal.os.ZygoteInit.main(ZygoteInit.java:616)

    Another device always has empty output buffers, thought the indexes aren >= 0 ;

    What am I doing wrong ?

  • Building my JAVA parameter array for FFMPEG

    29 janvier 2016, par user3541092

    FFmpeg Version : N-63893-gc69defd Copyright (c) 2000-2014 the FFmpeg developers
    built on Jul 16 2014 05:38:01 with gcc 4.6 (Debian 4.6.3-1)

    Machine : Amazon Linux t2.micro (free tier)

    Sample File : sample_iTunes.mov
    Sample File URL : https://support.apple.com/en-us/HT201549

    I’m trying to replicate the following FFmpeg command, using a string array and then pass this array into the Runtime.getRuntime().exec().

    ffmpeg -i file:/var/local/ffmpegtest/media_input/sample_iTunes.mov -pix_fmt yuv420p -c:v libx264 -vtag mp42 -metadata major_brand="mp42" -b:v 8000k -minrate 8000k -maxrate 10000k -ac 2 -strict experimental -c:a aac -b:a 256k -metadata:s:a:0 handler="Stereo" /var/local/ffmpegtest/media_output/sample_iTunes.mp4 -y

    NOTE : This works when I pass the full command, as a single string into Runtime.getRuntime().exec().

        String _cmd = "ffmpeg -i %s -pix_fmt yuv420p -c:v libx264 -vtag mp42 -metadata major_brand=\"mp42\" "
    
            + "-b:v 8000k -minrate 8000k -maxrate 10000k -ac 2 -strict experimental -c:a aac -b:a 256k -metadata:s:a:0 handler=\"Stereo\" %s -y";
    
    String _ffmpegCommand = String.format(_cmd, _inputFile, _outPutFile);
    
    p = Runtime.getRuntime().exec(_ffmpegCommand);
    
    BufferedReader _reader = new BufferedReader(new InputStreamReader(p.getErrorStream()));
    

    
    String _line = null;
    

    
    while((_line = _reader.readLine()) != null) {
    
        lw.writeLine(_logPath + _logName, _line);
    
        System.out.println(_line);
    
    }

    I started out with just a basic parameter list. As I add add each additional parameter, I re-build the JAR file and upload it to my EC2 instance to test for any errors.

    The following string array works :

    try
    
        {
    
            String[] _params = {"ffmpeg",
    
                       "-i",
    
                       String.format("%s", _inputFile),
    
                       "-pix_fmt",
    
                       "yuv420p",
    
                       "-c:v",
    
                       "libx264",
    
                       String.format("%s", _outPutFile),
    
                       "-y"};
    

    
            p = Runtime.getRuntime().exec(_params);
    

    
            BufferedReader _reader = new BufferedReader(new InputStreamReader(p.getErrorStream()));
    

    
            String _line = null;
    

    
            while((_line = _reader.readLine()) != null) {
    
                lw.writeLine(_logPath + _logName, _line);
    
                System.out.println(_line);
    
            }
    
        }
    
        catch (Exception e) {
    
            BufferedReader _reader = new BufferedReader(new InputStreamReader(p.getErrorStream()));
    

    
            String _line = null;
    

    
            while((_line = _reader.readLine()) != null) {
    
                lw.writeLine(_logPath + _logName, _line);
    
                System.out.println(_line);
    
            }
    

    
        }

    However, when I continue to build the array with additional parameters, I begin to experience problems (lets add -vtag mp42) :

    try
    
        {
    
            String[] _params = {"ffmpeg",
    
                       "-i",
    
                       String.format("%s", _inputFile),
    
                       "-pix_fmt",
    
                       "yuv420p",
    
                       "-c:v",
    
                       "libx264",
    
                       "-vtag", // &lt;---- New
    
                       "mp42", // &lt;---  New
    
                       String.format("%s", _outPutFile),
    
                       "-y"};
    

    
            p = Runtime.getRuntime().exec(_params);
    

    
            BufferedReader _reader = new BufferedReader(new InputStreamReader(p.getErrorStream()));
    

    
            String _line = null;
    

    
            while((_line = _reader.readLine()) != null) {
    
                lw.writeLine(_logPath + _logName, _line);
    
                System.out.println(_line);
    
            }
    
        }
    
        catch (Exception e) {
    
            BufferedReader _reader = new BufferedReader(new InputStreamReader(p.getErrorStream()));
    

    
            String _line = null;
    

    
            while((_line = _reader.readLine()) != null) {
    
                lw.writeLine(_logPath + _logName, _line);
    
                System.out.println(_line);
    
            }
    

    
        }

    Error Message : Could not write header for output file #0 (incorrect codec parameters ?) : Invalid data found when processing input

    Full Log output for errant trail run :

    29 Jan 2016 03:45:09 UTC - Running FFMpeg...
    
29 Jan 2016 03:45:09 UTC -  Input file: /var/local/ffmpegtest/media_input/sample_iTunes.mov
    
29 Jan 2016 03:45:09 UTC -  Output file: /var/local/ffmpegtest/media_output/sample_iTunes.mp4
    
29 Jan 2016 03:45:09 UTC - ffmpeg version N-63893-gc69defd Copyright (c) 2000-2014 the FFmpeg developers
    
29 Jan 2016 03:45:09 UTC -   built on Jul 16 2014 05:38:01 with gcc 4.6 (Debian 4.6.3-1)
    
29 Jan 2016 03:45:09 UTC -   configuration: --prefix=/root/ffmpeg-static/64bit --extra-cflags='-I/root/ffmpeg-static/64bit/include -static' --extra-ldflags='-L/root/ffmpeg-static/64bit/lib -static' --extra-libs='-lxml2 -lexpat -lfreetype' --enable-static --disable-shared --disable-ffserver --disable-doc --enable-bzlib --enable-zlib --enable-postproc --enable-runtime-cpudetect --enable-libx264 --enable-gpl --enable-libtheora --enable-libvorbis --enable-libmp3lame --enable-gray --enable-libass --enable-libfreetype --enable-libopenjpeg --enable-libspeex --enable-libvo-aacenc --enable-libvo-amrwbenc --enable-version3 --enable-libvpx
    
29 Jan 2016 03:45:09 UTC -   libavutil      52. 89.100 / 52. 89.100
    
29 Jan 2016 03:45:09 UTC -   libavcodec     55. 66.101 / 55. 66.101
    
29 Jan 2016 03:45:09 UTC -   libavformat    55. 43.100 / 55. 43.100
    
29 Jan 2016 03:45:09 UTC -   libavdevice    55. 13.101 / 55. 13.101
    
29 Jan 2016 03:45:09 UTC -   libavfilter     4.  8.100 /  4.  8.100
    
29 Jan 2016 03:45:09 UTC -   libswscale      2.  6.100 /  2.  6.100
    
29 Jan 2016 03:45:09 UTC -   libswresample   0. 19.100 /  0. 19.100
    
29 Jan 2016 03:45:09 UTC -   libpostproc    52.  3.100 / 52.  3.100
    
29 Jan 2016 03:45:09 UTC - Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/var/local/ffmpegtest/media_input/sample_iTunes.mov':
    
29 Jan 2016 03:45:09 UTC -   Metadata:
    
29 Jan 2016 03:45:09 UTC -     major_brand     : qt  
    
29 Jan 2016 03:45:09 UTC -     minor_version   : 537199360
    
29 Jan 2016 03:45:09 UTC -     compatible_brands: qt  
    
29 Jan 2016 03:45:09 UTC -     creation_time   : 2005-10-17 22:54:32
    
29 Jan 2016 03:45:09 UTC -   Duration: 00:01:25.50, start: 0.000000, bitrate: 307 kb/s
    
29 Jan 2016 03:45:09 UTC -     Stream #0:0(eng): Video: mpeg4 (Simple Profile) (mp4v / 0x7634706D), yuv420p, 640x480 [SAR 1:1 DAR 4:3], 261 kb/s, 10 fps, 10 tbr, 3k tbn, 25 tbc (default)
    
29 Jan 2016 03:45:09 UTC -     Metadata:
    
29 Jan 2016 03:45:09 UTC -       creation_time   : 2005-10-17 22:54:33
    
29 Jan 2016 03:45:09 UTC -       handler_name    : Apple Video Media Handler
    
29 Jan 2016 03:45:09 UTC -       encoder         : 3ivx D4 4.5.1
    
29 Jan 2016 03:45:09 UTC -     Stream #0:1(eng): Audio: aac (mp4a / 0x6134706D), 32000 Hz, mono, fltp, 43 kb/s (default)
    
29 Jan 2016 03:45:09 UTC -     Metadata:
    
29 Jan 2016 03:45:09 UTC -       creation_time   : 2005-10-17 22:54:34
    
29 Jan 2016 03:45:09 UTC -       handler_name    : Apple Sound Media Handler
    
29 Jan 2016 03:45:09 UTC - [libx264 @ 0x30c2c00] using SAR=1/1
    
29 Jan 2016 03:45:09 UTC - [libx264 @ 0x30c2c00] using cpu capabilities: MMX2 SSE2Fast SSSE3 FastShuffle SSE4.2 AVX AVX2 FMA3 BMI1 BMI2
    
29 Jan 2016 03:45:09 UTC - [libx264 @ 0x30c2c00] profile High, level 2.2
    
29 Jan 2016 03:45:09 UTC - [libx264 @ 0x30c2c00] 264 - core 129 r2230 1cffe9f - H.264/MPEG-4 AVC codec - Copyleft 2003-2012 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=1 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=10 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
    
29 Jan 2016 03:45:09 UTC - [mp4 @ 0x30c21a0] Tag mp42/0x3234706d incompatible with output codec id '28' ([33][0][0][0])
    
29 Jan 2016 03:45:09 UTC - Output #0, mp4, to '/var/local/ffmpegtest/media_output/sample_iTunes.mp4':
    
29 Jan 2016 03:45:09 UTC -   Metadata:
    
29 Jan 2016 03:45:09 UTC -     major_brand     : qt  
    
29 Jan 2016 03:45:09 UTC -     minor_version   : 537199360
    
29 Jan 2016 03:45:09 UTC -     compatible_brands: qt  
    
29 Jan 2016 03:45:09 UTC -     Stream #0:0(eng): Video: h264 (libx264) (mp42 / 0x3234706D), yuv420p, 640x480 [SAR 1:1 DAR 4:3], q=-1--1, 10 fps, 90k tbn, 10 tbc (default)
    
29 Jan 2016 03:45:09 UTC -     Metadata:
    
29 Jan 2016 03:45:09 UTC -       creation_time   : 2005-10-17 22:54:33
    
29 Jan 2016 03:45:09 UTC -       handler_name    : Apple Video Media Handler
    
29 Jan 2016 03:45:09 UTC -       encoder         : Lavc55.66.101 libx264
    
29 Jan 2016 03:45:09 UTC -     Stream #0:1(eng): Audio: aac (libvo_aacenc), 32000 Hz, mono, s16, 128 kb/s (default)
    
29 Jan 2016 03:45:09 UTC -     Metadata:
    
29 Jan 2016 03:45:09 UTC -       creation_time   : 2005-10-17 22:54:34
    
29 Jan 2016 03:45:09 UTC -       handler_name    : Apple Sound Media Handler
    
29 Jan 2016 03:45:09 UTC -       encoder         : Lavc55.66.101 libvo_aacenc
    
29 Jan 2016 03:45:09 UTC - Stream mapping:
    
29 Jan 2016 03:45:09 UTC -   Stream #0:0 -> #0:0 (mpeg4 (native) -> h264 (libx264))
    
29 Jan 2016 03:45:09 UTC -   Stream #0:1 -> #0:1 (aac (native) -> aac (libvo_aacenc))
    
29 Jan 2016 03:45:09 UTC - Could not write header for output file #0 (incorrect codec parameters ?): Invalid data found when processing input

  • Screen recorder in Ubuntu using python

    3 août 2013, par mridul

    I am a hobby programmer and trying to make screen-recorder in Ubuntu using python.
    Using this code able to take screenshot.

    import wx
    
app = wx.App(False)
    
s = wx.ScreenDC()
    
w, h = s.Size.Get()
    
b = wx.EmptyBitmap(w, h)
    
m = wx.MemoryDCFromDC(s)
    
m.SelectObject(b)
    
m.Blit(0, 0, w, h, s, 0, 0)
    
m.SelectObject(wx.NullBitmap)
    
b.SaveFile("screenshot.png", wx.BITMAP_TYPE_PNG)

    And using loop I take more pictures and create video using these screen shots.My code is given bellow,

    import wx,os
    
app=wx.App(False)
    
s = wx.ScreenDC()
    
w, h = s.Size.Get()
    
b = wx.EmptyBitmap(w, h)
    
m = wx.MemoryDCFromDC(s)
    
i=0
    
while i&lt;50:
    
   m.SelectObject(b)
    
   m.Blit(0, 0, w, h, s, 0, 0)
    
   m.SelectObject(wx.NullBitmap)
    
   b.SaveFile(&#39;{0:05d}.png&#39;.format(i), wx.BITMAP_TYPE_PNG)
    
   i+=1
    
os.system(&#39;ffmpeg -f image2 -r 8 -i %05d.png -vcodec mpeg4 -y movie1.mp4&#39;)
    
i=0  
    
while i&lt;50:
    
   os.remove(&#39;{0:05d}.png&#39;.format(i))
    
   i += 1   `

    In above code I take 50 pictures and store as 00000.png to 00049.png and make video using ffmpeg.
    After creating video I delete all pictures.

    Current Problems :

    • Very small delay between screen shoots. If try to record videos using this code out put is not perfect.
    • For recording long time it is not efficient. It take lot of hard drive memory to store screen shoots. And use more CPU .

    What I do for get code more efficient ? Using pure python how to create video from pictures ? Is there any alternative methods to record screen ?
    I like to improve my code.

Navigation