Recherche avancée

Médias (2)

Mot : - Tags -/doc2img

Autres articles (46)

  • Gestion générale des documents

    13 mai 2011, par

    MédiaSPIP ne modifie jamais le document original mis en ligne.
    Pour chaque document mis en ligne il effectue deux opérations successives : la création d’une version supplémentaire qui peut être facilement consultée en ligne tout en laissant l’original téléchargeable dans le cas où le document original ne peut être lu dans un navigateur Internet ; la récupération des métadonnées du document original pour illustrer textuellement le fichier ;
    Les tableaux ci-dessous expliquent ce que peut faire MédiaSPIP (...)

  • Les autorisations surchargées par les plugins

    27 avril 2010, par

    Mediaspip core
    autoriser_auteur_modifier() afin que les visiteurs soient capables de modifier leurs informations sur la page d’auteurs

  • Use, discuss, criticize

    13 avril 2011, par

    Talk to people directly involved in MediaSPIP’s development, or to people around you who could use MediaSPIP to share, enhance or develop their creative projects.
    The bigger the community, the more MediaSPIP’s potential will be explored and the faster the software will evolve.
    A discussion list is available for all exchanges between users.

Sur d’autres sites (9931)

  • What am I doing wrong with my audio writing in ffmpeg ? [on hold]

    12 septembre 2014, par Michael Nguyen

    I’m trying to splice multiple video sources into one. I’m having trouble understanding the audio portion of it. Rather I should say, the audio part of my code doesn’t seem to work. I don’t understand it. Could somebody help me understand what I am doing wrong ? The method doing all the work is called renderMovieRequest

    Thanks in advance.

    My entire code can be found here : http://pastebin.com/rAZkU3XZ

    Any help would be appreciated.
    below is a snippet of the code (it’s too long otherwise)

    int64_t timeBase;
    bool seek(AVFormatContext *pFormatCtx, int frameIndex){

       if(!pFormatCtx)
           return false;

       int64_t seekTarget = int64_t(frameIndex) * timeBase;

       if(av_seek_frame(pFormatCtx, -1, seekTarget, AVSEEK_FLAG_ANY) < 0) {
           ELOG("av_seek_frame failed.");
           return false;
       }

       return true;

    }

    typedef struct OutputStream {
       AVStream *st;
       /* pts of the next frame that will be generated */
       int64_t next_pts;
       int samples_count;
       AVFrame *frame;
       AVFrame *tmp_frame;
       float t, tincr, tincr2;
       struct SwsContext *sws_ctx;
       struct SwrContext *swr_ctx;
    } OutputStream;


    static int write_frame(AVFormatContext *fmt_ctx, const AVRational *time_base, AVStream *st, AVPacket *pkt)
    {
       /* rescale output packet timestamp values from codec to stream timebase */
       av_packet_rescale_ts(pkt, *time_base, st->time_base);
       pkt->stream_index = st->index;
       /* Write the compressed frame to the media file. */
       log_packet(fmt_ctx, pkt);
       return av_interleaved_write_frame(fmt_ctx, pkt);
    }
    /* Add an output stream. */
    static void add_stream(OutputStream *ost, AVFormatContext *oc,
                          AVCodec **codec,
                          enum AVCodecID codec_id) {
       AVCodecContext *c;
       int i;
       /* find the encoder */
       *codec = avcodec_find_encoder(codec_id);
       if (!(*codec)) {
           ELOG("Could not find encoder for '%s'\n", avcodec_get_name(codec_id));
           return;
       }
       ost->st = avformat_new_stream(oc, *codec);
       if (!ost->st) {
           ELOG("Could not allocate stream\n");
           return;
       }
       ost->st->id = oc->nb_streams-1;
       c = ost->st->codec;
       switch ((*codec)->type) {
       case AVMEDIA_TYPE_AUDIO:
           c->sample_fmt  = (*codec)->sample_fmts ?
               (*codec)->sample_fmts[0] : AV_SAMPLE_FMT_FLTP;
           c->bit_rate    = 64000;
           c->sample_rate = 44100;
           if ((*codec)->supported_samplerates) {
               c->sample_rate = (*codec)->supported_samplerates[0];
               for (i = 0; (*codec)->supported_samplerates[i]; i++) {
                   if ((*codec)->supported_samplerates[i] == 44100)
                       c->sample_rate = 44100;
               }
           }
           c->channels        = av_get_channel_layout_nb_channels(c->channel_layout);
           c->channel_layout = AV_CH_LAYOUT_STEREO;
           if ((*codec)->channel_layouts) {
               c->channel_layout = (*codec)->channel_layouts[0];
               for (i = 0; (*codec)->channel_layouts[i]; i++) {
                   if ((*codec)->channel_layouts[i] == AV_CH_LAYOUT_STEREO)
                       c->channel_layout = AV_CH_LAYOUT_STEREO;
               }
           }
           c->channels        = av_get_channel_layout_nb_channels(c->channel_layout);
           ost->st->time_base = (AVRational){ 1, c->sample_rate };
           break;
       case AVMEDIA_TYPE_VIDEO:
           c->codec_id = codec_id;
           c->bit_rate = 400000;
           /* Resolution must be a multiple of two. */
    //        c->width    = 352;
    //        c->height   = 288;
           c->width    = 1280;
           c->height   = 720;

           /* timebase: This is the fundamental unit of time (in seconds) in terms
            * of which frame timestamps are represented. For fixed-fps content,
            * timebase should be 1/framerate and timestamp increments should be
            * identical to 1. */
           ost->st->time_base = (AVRational){ 1, STREAM_FRAME_RATE };
           c->time_base       = ost->st->time_base;
           c->gop_size      = 12; /* emit one intra frame every twelve frames at most */
           c->pix_fmt       = STREAM_PIX_FMT;
           if (c->codec_id == AV_CODEC_ID_MPEG2VIDEO) {
               /* just for testing, we also add B frames */
               c->max_b_frames = 2;
           }
           if (c->codec_id == AV_CODEC_ID_MPEG1VIDEO) {
               /* Needed to avoid using macroblocks in which some coeffs overflow.
                * This does not happen with normal video, it just happens here as
                * the motion of the chroma plane does not match the luma plane. */
               c->mb_decision = 2;
           }
       break;
       default:
           break;
       }
       /* Some formats want stream headers to be separate. */
       if (oc->oformat->flags & AVFMT_GLOBALHEADER)
           c->flags |= CODEC_FLAG_GLOBAL_HEADER;
    }

    /**************************************************************/
    /* audio output */
    static AVFrame *alloc_audio_frame(enum AVSampleFormat sample_fmt,
                                     uint64_t channel_layout,
                                     int sample_rate, int nb_samples)
    {
       AVFrame *frame = av_frame_alloc();
       int ret;
       if (!frame) {
           fprintf(stderr, "Error allocating an audio frame\n");
           exit(1);
       }
       frame->format = sample_fmt;
       frame->channel_layout = channel_layout;
       frame->sample_rate = sample_rate;
       frame->nb_samples = nb_samples;
       if (nb_samples) {
           ret = av_frame_get_buffer(frame, 0);
           if (ret < 0) {
               fprintf(stderr, "Error allocating an audio buffer\n");
               exit(1);
           }
       }
       return frame;
    }
    static int open_audio(AVFormatContext *oc, AVCodec *codec, OutputStream *ost, AVDictionary *opt_arg)
    {
       AVCodecContext *c;
       int nb_samples;
       int ret;
       AVDictionary *opt = NULL;
       c = ost->st->codec;
       /* open it */
       av_dict_copy(&opt, opt_arg, 0);
       ret = avcodec_open2(c, codec, &opt);
       av_dict_free(&opt);
       if (ret < 0) {
           ELOG("Could not open audio codec: %s\n", av_err2str(ret));
           return ret;
       }
       /* init signal generator */
       ost->t     = 0;
       ost->tincr = 2 * M_PI * 110.0 / c->sample_rate;
       /* increment frequency by 110 Hz per second */
       ost->tincr2 = 2 * M_PI * 110.0 / c->sample_rate / c->sample_rate;
       if (c->codec->capabilities & CODEC_CAP_VARIABLE_FRAME_SIZE)
           nb_samples = 10000;
       else
           nb_samples = c->frame_size;
       ost->frame     = alloc_audio_frame(c->sample_fmt, c->channel_layout,
                                          c->sample_rate, nb_samples);
       ost->tmp_frame = alloc_audio_frame(AV_SAMPLE_FMT_S16, c->channel_layout,
                                          c->sample_rate, nb_samples);
       /* create resampler context */
           ost->swr_ctx = swr_alloc();
           if (!ost->swr_ctx) {
               ELOG("Could not allocate resampler context\n");
               return -300;
           }
           /* set options */
           av_opt_set_int       (ost->swr_ctx, "in_channel_count",   c->channels,       0);
           av_opt_set_int       (ost->swr_ctx, "in_sample_rate",     c->sample_rate,    0);
           av_opt_set_sample_fmt(ost->swr_ctx, "in_sample_fmt",      AV_SAMPLE_FMT_S16, 0);
           av_opt_set_int       (ost->swr_ctx, "out_channel_count",  c->channels,       0);
           av_opt_set_int       (ost->swr_ctx, "out_sample_rate",    c->sample_rate,    0);
           av_opt_set_sample_fmt(ost->swr_ctx, "out_sample_fmt",     c->sample_fmt,     0);
           /* initialize the resampling context */
           if ((ret = swr_init(ost->swr_ctx)) < 0) {
               ELOG("Failed to initialize the resampling context: %i\n", ret);
               return ret;
           }

           return 0;
    }

    /*
    * encode one audio frame and send it to the muxer
    * return 1 when encoding is finished, 0 otherwise
    */
    static int write_audio_frame(AVFormatContext *oc, OutputStream *ost, AVFrame *frame)
    {
       AVCodecContext *c;
       AVPacket pkt = { 0 }; // data and size must be 0;
    //    AVFrame *frame;
       int ret;
       int got_packet;
       int dst_nb_samples;
       av_init_packet(&pkt);
       c = ost->st->codec;
    //    frame = get_audio_frame(ost);
       if (frame) {
           /* convert samples from native format to destination codec format, using the resampler */
               /* compute destination number of samples */
               dst_nb_samples = av_rescale_rnd(swr_get_delay(ost->swr_ctx, c->sample_rate) + frame->nb_samples,
                                               c->sample_rate, c->sample_rate, AV_ROUND_UP);
               av_assert0(dst_nb_samples == frame->nb_samples);
           /* when we pass a frame to the encoder, it may keep a reference to it
            * internally;
            * make sure we do not overwrite it here
            */
           ret = av_frame_make_writable(ost->frame);
           if (ret < 0) {
               ELOG("Unable to prepare frame for writing: Error code: %s", av_err2str(ret));
               return ret;
           }
               /* convert to destination format */
               ret = swr_convert(ost->swr_ctx,
                                 ost->frame->data, dst_nb_samples,
                                 (const uint8_t **)frame->data, frame->nb_samples);
               if (ret < 0) {
                   ELOG("Error while converting: %s\n", av_err2str(ret));
                   return -1;
               }
               frame = ost->frame;
           frame->pts = av_rescale_q(ost->samples_count, (AVRational){1, c->sample_rate}, c->time_base);
           ost->samples_count += dst_nb_samples;
       }
       ret = avcodec_encode_audio2(c, &pkt, frame, &got_packet);
       if (ret < 0) {
           ELOG("Error encoding audio frame: %s\n", av_err2str(ret));
           return -1;
       }
       if (got_packet) {
           ret = write_frame(oc, &c->time_base, ost->st, &pkt);
           if (ret < 0) {
               ELOG( "Error while writing audio frame: %s\n", av_err2str(ret));
               return -1;
           }
       }
       return (frame || got_packet) ? 0 : 1;
    }


    /**************************************************************/
    /* video output */
    static AVFrame *alloc_picture(enum AVPixelFormat pix_fmt, int width, int height)
    {
       AVFrame *picture;
       int ret;
       picture = av_frame_alloc();
       if (!picture)
           return NULL;
       picture->format = pix_fmt;
       picture->width  = width;
       picture->height = height;
       /* allocate the buffers for the frame data */
       ret = av_frame_get_buffer(picture, 32);
       if (ret < 0) {
           fprintf(stderr, "Could not allocate frame data.\n");
           exit(1);
       }
       return picture;
    }


    static int open_video(AVFormatContext *oc, AVCodec *codec, OutputStream *ost, AVDictionary *opt_arg)
    {
       int ret;
       AVCodecContext *c = ost->st->codec;
       AVDictionary *opt = NULL;
       av_dict_copy(&opt, opt_arg, 0);
       /* open the codec */
       ret = avcodec_open2(c, codec, &opt);
       av_dict_free(&opt);

       if (ret < 0) {
           ELOG("Could not open video codec: %s\n", av_err2str(ret));
           return ret;
       }
       /* allocate and init a re-usable frame */
       DLOG("Allocate and init a are-usable frame: %i x %i Format: %i", c->width, c->height, c->pix_fmt);
       ost->frame = alloc_picture(c->pix_fmt, c->width, c->height);
       if (!ost->frame) {
           ELOG("Could not allocate video frame\n");
           return -100;
       }

       /* If the output format is not YUV420P, then a temporary YUV420P
        * picture is needed too. It is then converted to the required
        * output format. */
       ost->tmp_frame = NULL;
       if (c->pix_fmt != AV_PIX_FMT_YUV420P) {
           DLOG("input format is not YUV420P converting to size %i x %i", c->width, c->height);
           ost->tmp_frame = alloc_picture(AV_PIX_FMT_YUV420P, c->width, c->height);
           if (!ost->tmp_frame) {
               ELOG("Could not allocate temporary picture\n");
               return -200;
           }
       }

       return 0;
    }

    /*
    * encode one video frame and send it to the muxer
    * return 1 when encoding is finished, 0 otherwise
    */
    static int write_video_frame(AVFormatContext *oc, OutputStream *ost, AVFrame *frame)
    {
       int ret;
       AVCodecContext *c;
       int got_packet = 0;
       c = ost->st->codec;

       if (oc->oformat->flags & AVFMT_RAWPICTURE) {
           /* a hack to avoid data copy with some raw video muxers */
           AVPacket pkt;
           av_init_packet(&pkt);
           if (!frame)
               return 1;
           pkt.flags        |= AV_PKT_FLAG_KEY;
           pkt.stream_index  = ost->st->index;
           pkt.data          = (uint8_t *)frame;
           pkt.size          = sizeof(AVPicture);
           pkt.pts = pkt.dts = frame->pts;
           av_packet_rescale_ts(&pkt, c->time_base, ost->st->time_base);
           ret = av_interleaved_write_frame(oc, &pkt);
       } else {
           AVPacket pkt = { 0 };
           av_init_packet(&pkt);
           /* encode the image */
           ret = avcodec_encode_video2(c, &pkt, frame, &got_packet);
           if (ret < 0) {
               fprintf(stderr, "Error encoding video frame: %s\n", av_err2str(ret));
               exit(1);
           }
           if (got_packet) {
               ret = write_frame(oc, &c->time_base, ost->st, &pkt);
           } else {
               ret = 0;
           }
       }
       if (ret < 0) {
           fprintf(stderr, "Error while writing video frame: %s\n", av_err2str(ret));
           exit(1);
       }
       return (frame || got_packet) ? 0 : 1;
    }
    static void close_stream(AVFormatContext *oc, OutputStream *ost)
    {
       avcodec_close(ost->st->codec);
       av_frame_free(&ost->frame);
       av_frame_free(&ost->tmp_frame);
       sws_freeContext(ost->sws_ctx);
       swr_free(&ost->swr_ctx);
    }



    int renderMovieRequest(movieRequest *movieRequestObj, string outputPath) {
       AVOutputFormat *ofmt = NULL;
       AVFormatContext *ifmt_ctx = NULL, *ofmt_ctx = NULL;
       AVFormatContext *pFormatCtx = NULL;
       AVCodec *audio_codec, *video_codec;

       OutputStream video_st = { 0 }, audio_st = { 0 };
       size_t            i;
       int             videoStream, audioStream;
       AVCodecContext  *pCodecCtx = NULL;
       AVCodec         *pCodec = NULL;
       AVFrame         *pFrame = NULL;
       AVFrame         *pFrameRGB = NULL;
       AVPacket        packet = { 0 };
       int             frameFinished;
       int             audioFrameFinished;
       int             numBytes;
       uint8_t         *buffer = NULL;
       AVDictionary    *optionsDict = NULL;
       AVDictionary *opt = NULL;
       struct SwsContext      *sws_ctx = NULL;

       const char *in_filename, *out_filename;
       int ret;

       int have_audio = 0, have_video = 0;
       int encode_audio = 0, encode_video = 0;

       processProtobuf(movieRequestObj);

       out_filename = outputPath.c_str();

       av_register_all();

       DLOG("attempting to create context for output file %s", out_filename);

       avformat_alloc_output_context2(&ofmt_ctx, NULL, NULL, out_filename);
       if (!ofmt_ctx) {
           ELOG("Could not create output context\n");
           ret = AVERROR_UNKNOWN;
           return ret; //goto end;
       }
       ofmt = ofmt_ctx->oformat;

      /* Add the audio and video streams using the default format codecs
          * and initialize the codecs. */
         if (ofmt->video_codec != AV_CODEC_ID_NONE) {
             add_stream(&video_st, ofmt_ctx, &video_codec, ofmt->video_codec);
             have_video = 1;
             encode_video = 1;
         }
         if (ofmt->audio_codec != AV_CODEC_ID_NONE) {
             add_stream(&audio_st, ofmt_ctx, &audio_codec, ofmt->audio_codec);
             have_audio = 1;
             encode_audio = 1;
         }

       DLOG("allocate encode buffers");
    /* Now that all the parameters are set, we can open the audio and
        * video codecs and allocate the necessary encode buffers. */
       if (have_video)
           open_video(ofmt_ctx, video_codec, &video_st, opt);
       if (have_audio) {
           DLOG("Opening audio codec");
           open_audio(ofmt_ctx, audio_codec, &audio_st, opt);
       }

       DLOG("open output file for writing");
      /* open the output file, if needed */
       if (!(ofmt->flags & AVFMT_NOFILE)) {
           ret = avio_open(&ofmt_ctx->pb, out_filename, AVIO_FLAG_WRITE);
           if (ret < 0) {
               ELOG( "Could not open '%s': %s\n", out_filename, av_err2str(ret));
               return 1;
           }
       }

       /* Write the stream header, if any. */
       ret = avformat_write_header(ofmt_ctx, &opt);
       if (ret < 0) {
           ELOG("Error occurred when opening output file: %s\n", av_err2str(ret));
           return 1;
       }

       vector<clipshptr> * clips = &amp;(movieRequestObj->clips);

       DLOG("ready to process clips: %i", clips->size());
       for (size_t clipIdx = 0; clipIdx &lt; clips->size(); ++clipIdx) {

           shared_ptr<clip> currentClip = clips->at(clipIdx);

           switch (currentClip->getClipType()) {
               case VIDEO_CLIP: {
                   DLOG("clip is a video clip...");

                   shared_ptr<videoclip> vidClip = dynamic_pointer_cast<videoclip>(clips->at(clipIdx));

                   if (vidClip->shouldHaveSegments) {
                       // open the file for reading and create a temporary file for output
                       in_filename = vidClip->vidFileName.c_str();
                       DLOG("Opening %s for reading", in_filename);

                       if ((ret = avformat_open_input(&amp;ifmt_ctx, in_filename, 0, 0)) &lt; 0) {
                           ELOG("Could not open input file '%s'", in_filename);
                           return ret; //goto end;
                       }

                       if ((ret = avformat_find_stream_info(ifmt_ctx, 0)) &lt; 0) {
                           ELOG("Failed to retrieve input stream information");
                           return ret; //goto end;
                       }

                       av_dump_format(ifmt_ctx, 0, in_filename, 0);

                       videoStream = -1;
                       audioStream = -1;
                       // setup input format context and output format context;
    //                    AVStream *video_in_stream = NULL;
                       for (i = 0; i &lt; ifmt_ctx->nb_streams; i++) {
                           if(ifmt_ctx->streams[i]->codec->codec_type==AVMEDIA_TYPE_VIDEO) {
                               videoStream=i;
    //                            video_in_stream = ifmt_ctx->streams[i];
                           }
                           else if(ifmt_ctx->streams[i]->codec->codec_type==AVMEDIA_TYPE_AUDIO) {
                               audioStream=i;
    //                            video_in_stream = ifmt_ctx->streams[i];
                           }
                       }

                       if (videoStream == -1) {
                           DLOG("not a video stream.");
                           continue;
                       }

                       // Get a pointer to the codec context for the video stream
                       pCodecCtx = ifmt_ctx->streams[videoStream]->codec;
                       if (pCodecCtx == NULL) {
                           ELOG("Error in getting pointer to codec for vidstream");
                       }

                       DLOG("Input pixel format: %i ", pCodecCtx->pix_fmt);

                       // Find the decoder for the video stream
                       pCodec=avcodec_find_decoder(pCodecCtx->codec_id);

                       if(pCodec==NULL) {
                           ELOG("Unsupported codec!\n");
                           return -1; // Codec not found
                       }
                       // Open codec
                       if(avcodec_open2(pCodecCtx, pCodec, &amp;optionsDict)&lt;0) {
                           ELOG("Unable to open codec");
                           return -1; // Could not open codec
                       }

                       // get the timebase
                       timeBase = (int64_t(pCodecCtx->time_base.num) * AV_TIME_BASE) / int64_t(pCodecCtx->time_base.den);

                       // Allocate video frame
                       pFrame=av_frame_alloc();

                       // Allocate an AVFrame structure
                       pFrameRGB=av_frame_alloc();
                       if(pFrameRGB==NULL)
                           return -1;

                       // Determine required buffer size and allocate buffer
    //                    numBytes=avpicture_get_size(PIX_FMT_RGB24, pCodecCtx->width, pCodecCtx->height);
                       numBytes = avpicture_get_size(PIX_FMT_RGB24, movieRequestObj->width, movieRequestObj->height);
                       DLOG("Buffer size allocated: %i x %i: %i ", movieRequestObj->width, movieRequestObj->height, numBytes);
                       buffer=(uint8_t *)av_malloc(numBytes*sizeof(uint8_t));

                       sws_ctx = sws_getContext
                       (
                           pCodecCtx->width,
                           pCodecCtx->height,
                           pCodecCtx->pix_fmt,
                           movieRequestObj->width,
                           movieRequestObj->height,
                           PIX_FMT_RGB24,
                           SWS_BILINEAR,
                           NULL,
                           NULL,
                           NULL
                       );

                       // Assign appropriate parts of buffer to image planes in pFrameRGB
                       // Note that pFrameRGB is an AVFrame, but AVFrame is a superset
                       // of AVPicture
                       avpicture_fill((AVPicture *)pFrameRGB, buffer, PIX_FMT_RGB24, movieRequestObj->width, movieRequestObj->height);
                       size_t numSegments = vidClip->segments.size();

                       DLOG("Found %i segments to process", numSegments);
                       for (size_t segmentIdx = 0; segmentIdx &lt; numSegments; ++segmentIdx) {
                           // seek to the right position
                           int frameOffset = vidClip->segments.at(segmentIdx).first;
                           int clipDuration = vidClip->segments.at(segmentIdx).second;
                           DLOG("Starting Frame Number: %i Duration: %i", frameOffset, clipDuration);

                           seek(ifmt_ctx, frameOffset);
                           // loop for X frames where X is &lt; frameOffset + clipDuration; clipDuration is the length of the clip in terms of frames
                           for (int frameIdx = frameOffset; frameIdx &lt; (frameOffset + clipDuration); ++frameIdx) {
                               av_init_packet(&amp;packet);
                               int avReadResult = 0;
                               int continueRecording = 1;
                               while ((continueRecording == 1) &amp;&amp; (frameIdx &lt; (frameOffset + clipDuration) )) {
                                   avReadResult = av_read_frame(ifmt_ctx, &amp;packet);
                                   if(avReadResult != 0){
                                       if (avReadResult != AVERROR_EOF) {
                                           ELOG("av_read_frame error: %i", avReadResult );
                                       } else {
                                           ILOG("End of input file");
                                       }
                                       continueRecording = 0;
                                   }
                                   // Is this a packet from the video stream?
                                   if(packet.stream_index==videoStream) {
                                       // Decode video frame
                                       avcodec_decode_video2(pCodecCtx, pFrameRGB, &amp;frameFinished, &amp;packet);

                                       // Did we get a video frame?
                                       if(frameFinished) {
                                           // Convert the image from its native format to RGB
                                           sws_scale
                                           (
                                              sws_ctx,
                                              (uint8_t const * const *)pFrame->data,
                                              pFrame->linesize,
                                              0,
                                              pCodecCtx->height,
                                              pFrameRGB->data,
                                              pFrameRGB->linesize
                                           );
                                           write_video_frame(ofmt_ctx, &amp;video_st, pFrameRGB);
                                           frameIdx++;
                                       }

                                   }
                                   else if (packet.stream_index == audioStream) {
                                       // Decode audio frame
                                       DLOG("Audio frame found");
                                       avcodec_decode_audio4(pCodecCtx, pFrameRGB, &amp;audioFrameFinished, &amp;packet);

                                       if (audioFrameFinished) {
    //                                        write the audio frame to file
                                           write_audio_frame(ofmt_ctx, &amp;audio_st, pFrameRGB);

                                       }

                                   }
                                   // Free the packet that was allocated by av_read_frame
                                   av_free_packet(&amp;packet);
                               }
                                   // Free the RGB image

                           }
                       }

                       DLOG("Cleaning up frame allocations");
                       av_free(buffer);
                       av_free(pFrameRGB);
                       // Free the YUV frame
                       av_free(pFrame);

                   } // end video clip processing
               }
               break;

               case TITLE_CLIP: {
                 }
               break;

               default:
                   ELOG("Failed to identify clip");
                   break;
           } // end switch statement

           DLOG("Finished processing clip #%i", clipIdx);
           avformat_close_input(&amp;ifmt_ctx);
       } // end main for loop -> clip iteration


    /* Write the trailer, if any. The trailer must be written before you
        * close the CodecContexts open when you wrote the header; otherwise
        * av_write_trailer() may try to use memory that was freed on
        * av_codec_close(). */
       av_write_trailer(ofmt_ctx);

       /* Close each codec. */
       if (have_video)
           close_stream(ofmt_ctx, &amp;video_st);
       if (have_audio)
           close_stream(ofmt_ctx, &amp;audio_st);

       if (ofmt_ctx &amp;&amp; !(ofmt->flags &amp; AVFMT_NOFILE)) {
           /* Close the output file. */
           avio_close(ofmt_ctx->pb);
       }

       DLOG("Closing input format context");
       avformat_close_input(&amp;ifmt_ctx);

       DLOG("Free ouptut format context");
       avformat_free_context(ofmt_ctx);

       if (ret &lt; 0 &amp;&amp; ret != AVERROR_EOF) {
           ELOG( "Error occurred: %s\n", av_err2str(ret));
           return 1;
       }

       return 0;
    }


    #ifdef __cplusplus
    }

    #endif
    </videoclip></videoclip></clip></clipshptr>
  • How to add new pages and menu items to Piwik – Introducing the Piwik Platform

    11 septembre 2014, par Thomas Steur — Development

    This is the next post of our blog series where we introduce the capabilities of the Piwik platform (our previous post was How to create a widget). This time you’ll learn how to extend Piwik by adding new pages and menu items. For this tutorial you will need to have basic knowledge of PHP and optionally of Twig which is the template engine we use.

    What can be displayed in a page ?

    To make it short : You can display any corporate related content, key metrics, news, help pages, custom reports, contact details, information about your server, forms to manage any data and anything else.

    Getting started

    In this series of posts, we assume that you have already set up your development environment. If not, visit the Piwik Developer Zone where you’ll find the tutorial Setting up Piwik.

    To summarize the things you have to do to get setup :

    • Install Piwik (for instance via git).
    • Activate the developer mode : ./console development:enable --full.
    • Generate a plugin : ./console generate:plugin --name="MyControllerPlugin". There should now be a folder plugins/MyControllerPlugin.
    • And activate the created plugin under Settings => Plugins.

    Let’s start creating a page

    We start by using the Piwik Console to create a new page :

    ./console generate:controller

    The command will ask you to enter the name of the plugin the controller should belong to. I will simply use the above chosen plugin name “MyControllerPlugin”. There should now be two files plugins/MyControllerPlugin/Controller.php and plugins/MyControllerPlugin/templates/index.twig which both already contain an example to get you started easily :

    Controller.php

    1. class Controller extends \Piwik\Plugin\Controller
    2. {
    3.     public function index()
    4.     {
    5.         return $this-&gt;renderTemplate('index', array(
    6.              'answerToLife' =&gt; 42
    7.         ));
    8.     }
    9. }

    Télécharger

    and templates/index.twig

    1. {% extends 'dashboard.twig' %}
    2.  
    3. {% block content %}
    4.     &lt;strong&gt;Hello world!&lt;/strong&gt;
    5.     &lt;br/&gt;
    6.  
    7.     The answer to life is {{ answerToLife }}
    8. {% endblock %}

    Télécharger

    Note : If you are generating the Controller before Piwik 2.7.0 the example will look slightly different.

    The controller action index assigns the view variable answerToLife to the view and renders the Twig template templates/index.twig. Any variable assigned this way can then be used in the view using for example {{ answerToLife }}.

    Using a Twig template to generate the content of your page is actually optional : instead feel free to generate any content as desired and return a string in your controller action.

    As the above template index.twig is extending the dashboard template the Logo as well as the top menu will automatically appear on top of your content which is defined within the block content.

    Rendered page content

    How to display the page within the admin

    If you would like to add the admin menu on the left you have to modify the following parts :

    • Extend \Piwik\Plugin\ControllerAdmin instead of \Piwik\Plugin\Controller in the file Controller.php. In a future version of Piwik this step will be no longer neccessary, see #6151
    • Extend the template admin.twig instead of dashboard.twig
    • Define a headline using an H2-element
    1. {% extends 'admin.twig' %}
    2.  
    3. {% block content %}
    4.     &lt;h2&gt;Hello world!&lt;/h2&gt;
    5.     &lt;br/&gt;
    6.  
    7.     The answer to life is {{ answerToLife }}
    8. {% endblock %}

    Télécharger

    Note : Often one needs to add a page to the admin to make a plugin configurable. We have a unified solution for this using the Settings API.

    Admin page

    How to display a blank page

    If you would like to generate a blank page that shows only your content the template should contain only your markup as follows :

    1. &lt;strong&gt;Hello world!&lt;/strong&gt;
    2. &lt;br/&gt;
    3.  
    4. The answer to life is {{ answerToLife }}

    Télécharger

    Predefined variables, UI components, security and accessing query parameters

    In this blog post we only cover the basics to get you started. We highly recommend to read the MVC guide on our developer pages which covers some of those advanced topics. For instance you might be wondering how to securely access $_GET or $_POST parameters, you might want to restrict the content of your page depending on a user role, and much more.

    If you would like to know how to make use of JavaScript, CSS and Less have a look at our Working with Piwik’s UI guide.

    Note : How to include existing UI components such as a site selector or a date selector will be covered in a future blog post. Also, there are default variables assigned to the view depending on the context. A list of those variables that may or may not be defined is unfortunately not available yet but we will catch up on this.

    Let’s add a menu item to make the page accessible

    So far you have created a page but you can still not access it. Therefore we need to add a menu item to one of the Piwik menus. We start by using the Piwik Console to create a menu template :

    ./console generate:menu

    The command will ask you to enter the name of the plugin the menu should belong to. I will use again the above chosen plugin name “MyControllerPlugin”. There should now be a file plugins/MyControllerPlugin/Menu.php which contains an example to get you started easily :

    Menu.php

    1. class Menu extends \Piwik\Plugin\Menu
    2. {
    3.     public function configureUserMenu(MenuUser $menu)
    4.     {
    5.         // reuse an existing category.
    6.         $menu-&gt;addManageItem('My User Item', $this-&gt;urlForAction('showList'));
    7.  
    8.         // or create a custom category
    9.         $menu-&gt;addItem('My Custom Category', 'My User Item', $this-&gt;urlForDefaultAction());
    10.     }
    11. }

    Télécharger

    This is only a part of the generated template since all the examples of the different menus are similar. You can add items to four menus :

    • configureReportingMenu To add a new item to the reporting menu which includes all the reports like “Actions” and “Visitors”.
    • configureAdminMenu To add a new item to the admin menu which includes items like “User settings” and “Websites”.
    • configureTopMenu To add a new item to the top menu which includes items like “All Websites” and “Logout”.
    • configureUserMenu To add a new item to the user menu which is accessible when clicking on the username on the top right.

    In this blog post we will add a new item to the user menu and to do so we adjust the generated template like this :

    1. class Menu extends \Piwik\Plugin\Menu
    2. {
    3.     public function configureUserMenu(MenuUser $menu)
    4.     {
    5.         $menu-&gt;addManageItem('My User Item', $this-&gt;urlForAction($method = 'index'), $orderId = 30);
    6.     }
    7. }

    Télécharger

    That’s it. This will add a menu item named “My User Item” to the “Manage” section of the user menu. When a user chooses the menu item, the “index” method of your controller will be executed and your previously created page will be first rendered and then displayed. Optionally, you can define an order to influence the position of the menu item within the manage section. Following this example you can add an item to any menu for any action. I think you get the point !

    User menu

    Note : In Piwik 2.6.0 and before the above example would look like this :

    1. class Menu extends \Piwik\Plugin\Menu
    2. {
    3.     public function configureUserMenu(MenuUser $menu)
    4.     {
    5.         $menu-&gt;addManageItem('My User Item', array($module = 'MyControllerPlugin', $action = 'index'), $orderId = 30);
    6.     }
    7. }

    Télécharger

    How to test a page

    After you have created your page you are surely wondering how to test it. A controller should be usually very simple as it is only the connector between model and view. Therefore, we do usually not create unit or integration test for controllers and for the view less than ever. Instead we would create a UI test that takes a screenshot of your page and compares it with an expected screenshot. Luckily, there is already a section UI tests in our Automated tests guide.

    Publishing your Plugin on the Marketplace

    In case you want to share your page with other Piwik users you can do this by pushing your plugin to a public GitHub repository and creating a tag. Easy as that. Read more about how to distribute a plugin.

    Advanced features

    Isn’t it easy to create a page ? We never even created a file ! Of course, based on our API design principle “The complexity of our API should never exceed the complexity of your use case.” you can accomplish more if you want : You can make use of Vanilla JavaScript, jQuery, AngularJS, Less and CSS, you can reuse UI components, you can access query parameters and much more.

    Would you like to know more about this ? Go to our MVC (Model-View-Controller) and Working with Piwik’s UI guides in the Piwik Developer Zone.

    If you have any feedback regarding our APIs or our guides in the Developer Zone feel free to send it to us.

  • Building FFMPEG library for iOS6.0 ARMv7 Processor

    15 août 2013, par Jimmy

    WARNING :

    I was just informed by another user that there are some legal issues revolving around using FFMPEG for iOS, leaving the link here http://multinc.com/2009/08/24/compatibility-between-the-iphone-app-store-and-the-lgpl/

    I cleaned up my question a little bit, when I wrote it the first time I was flustered. Now I can be more clear after taking a small break.

    Edit : learned that you have to build for ARMv7, ARMv7s and iOS6.0

    I'm trying to use the FFMPEG library in an XCode 4.5.1 project. And I'm trying to build it for ARMv7. What I'm looking for is the exact process, and some explanation. I understand that this is not a well documented problem. But I know that other pople have had the same problem as me.

    What I have been able to do.

    I have been able to build the library for testing.

    1) I have been able to clone ffmpeg. For beginners this will get you started by creating a directory with the ffmpeg source. (Kudos to the guys who wrote it)

    git clone git ://source.ffmpeg.org/ffmpeg.git ffmpeg

    2) I have been able to write a config file that doesn't have any errors. We will go back to this part later. This is the command I attach to ./configure

    ./configure
    —disable-doc
    —disable-ffmpeg
    —disable-ffplay
    —disable-ffserver
    —enable-cross-compile
    —arch=arm
    —target-os=darwin
    —cc=/Applications/Xcode.app/Contents/Developer/Platforms/iPhoneOS.platform/Developer/usr/llvm-gcc-4.2/bin/arm-apple-darwin10-llvm-gcc-4.2

    —as='gas-preprocessor/gas-preprocessor.pl /Applications/Xcode.app/Contents/Developer/Platforms/iPhoneOS.platform/Developer/usr/llvm-gcc-4.2/bin/arm-apple-darwin10-llvm-gcc-4.2'

    —sysroot=/applications/xcode.app/contents/Developer/Platforms/iPhoneOS.platform/Developer/SDKs/iPhoneOS6.0.sdk

    —cpu=cortex-a8
    —extra-ldflags='-arch=armv7 -isysroot /applications/xcode.app/contents/Developer/Platforms/iPhoneOS.platform/Developer/SDKs/iPhoneOS6.0.sdk'
    —enable-pic —disable-bzlib —disable-gpl —disable-shared —enable-static —disable-mmx —disable-debug —disable-neon —extra-cflags='-pipe -Os -gdwarf-2 -isysroot /applications/xcode.app/contents/Developer/Platforms/iPhoneOS.platform/Developer/SDKs/iPhoneOS5.1.sdk
    -m$thumb_opt :-no-thumb -mthumb-interwork'

    These are some things to note.

    • I had to download ( https://github.com/yuvi/gas-preprocessor ) copy the file gas-preprocessor.pl at /usr/local/bin. Set permissions to read write (777)
    • Make sure I'm using the right GCC compiler : /Applications/Xcode.app/Contents/Developer/Platforms/iPhoneOS.platform/Developer/usr/llvm-gcc-4.2/bin/arm-apple-darwin10-llvm-gcc-4.2
    • Make sure I'm using the right SDK : /applications/xcode.app/contents/Developer/Platforms/iPhoneOS.platform/Developer/SDKs/iPhoneOS6.0.sdk
    • —extra-cflags="-arch armv7" causes : error : unrecognized command line option “-arch”

    Here in lies the problem.

    I can include the library like so

    libavcodec/avcodec.h

    But when I started to write the encoder. I received this warning, and countless errors.

    ignoring file /Users/Jimmy/Development/source.ffmpeg/Library/libavutil.a, file was built for archive which is not the architecture being linked (armv7s) : /Users/Jimmy/Development/source.ffmpeg/Library/libavutil.a

    That means that I didn't build the right binary.

    What I'm looking for is someone whose done it before, to walk all of us through the process of building FFMPEG for iOS6.0 and ARMv7 and the majority of things to look out for. Thanks a ton.