Recherche avancée

Médias (1)

Mot : - Tags -/géodiversité

Autres articles (27)

  • Librairies et binaires spécifiques au traitement vidéo et sonore

    31 janvier 2010, par

    Les logiciels et librairies suivantes sont utilisées par SPIPmotion d’une manière ou d’une autre.
    Binaires obligatoires FFMpeg : encodeur principal, permet de transcoder presque tous les types de fichiers vidéo et sonores dans les formats lisibles sur Internet. CF ce tutoriel pour son installation ; Oggz-tools : outils d’inspection de fichiers ogg ; Mediainfo : récupération d’informations depuis la plupart des formats vidéos et sonores ;
    Binaires complémentaires et facultatifs flvtool2 : (...)

  • Support audio et vidéo HTML5

    10 avril 2011

    MediaSPIP utilise les balises HTML5 video et audio pour la lecture de documents multimedia en profitant des dernières innovations du W3C supportées par les navigateurs modernes.
    Pour les navigateurs plus anciens, le lecteur flash Flowplayer est utilisé.
    Le lecteur HTML5 utilisé a été spécifiquement créé pour MediaSPIP : il est complètement modifiable graphiquement pour correspondre à un thème choisi.
    Ces technologies permettent de distribuer vidéo et son à la fois sur des ordinateurs conventionnels (...)

  • De l’upload à la vidéo finale [version standalone]

    31 janvier 2010, par

    Le chemin d’un document audio ou vidéo dans SPIPMotion est divisé en trois étapes distinctes.
    Upload et récupération d’informations de la vidéo source
    Dans un premier temps, il est nécessaire de créer un article SPIP et de lui joindre le document vidéo "source".
    Au moment où ce document est joint à l’article, deux actions supplémentaires au comportement normal sont exécutées : La récupération des informations techniques des flux audio et video du fichier ; La génération d’une vignette : extraction d’une (...)

Sur d’autres sites (4062)

  • How can i capture a screenshots from pictureBox1 every X milliseconds ?

    9 avril 2016, par Brubaker Haim

    The way it is now it’s capturing screenshots depending on on what screen I am in.
    For example if i’m in my desktop it will take screenshots of my desktop if I move to the form1 and see the pictureBox1 it will take screenshots of the pictureBox1.

    But how can I get directly screenshots from the pictureBox1 no matter on what screen I am ?

    Bitmap bmp1;
    
        public static int counter = 0;
    
        private void timer1_Tick(object sender, EventArgs e)
    
        {
    
            counter++;
    

    
            Rectangle rect = new Rectangle(0, 0, pictureBox1.ClientSize.Width, pictureBox1.ClientSize.Height);
    
            bmp1 = new Bitmap(rect.Width, rect.Height, PixelFormat.Format32bppArgb);
    
            Graphics g = Graphics.FromImage(bmp1);
    
            g.CopyFromScreen(rect.Left, rect.Top, 0, 0, bmp1.Size, CopyPixelOperation.SourceCopy);
    
            bmp1.Save(@"e:\screenshots\" + "screenshot" + counter.ToString("D6") + ".bmp", ImageFormat.Bmp);
    
            bmp1.Dispose();
    
            g.Dispose();
    
            if (counter == 500)//1200)
    
            {
    
                timer1.Stop();
    
                this.Close();
    
            }
    
        }

    The timer1 is set now to 100ms interval in the designer.
    But what is a reasonable speed to take screenshots from animation in the pictureBox1 ? In this case I have a game I show in the pictureBox1 and I want to take a screenshots of each frame from the pictureBox1 and in real time to create mp4 video file on the hard disk from each frame I took.

    So instead saving the bmp1 to the hard disk I need somehow to save each frame I capture in memory and build mp4 video file in real time.

    I created a ffmpeg class for that :

    using System;
    
using System.Windows.Forms;
    
using System.Collections.Generic;
    
using System.Linq;
    
using System.Text;
    
using System.Threading.Tasks;
    
using System.Drawing;
    
using System.IO.Pipes;
    
using System.Runtime.InteropServices;
    
using System.Diagnostics;
    
using System.IO;
    
using DannyGeneral;
    

    
namespace ffmpeg
    
{
    
    public class Ffmpeg
    
    {
    
        NamedPipeServerStream p;
    
        String pipename = "mytestpipe";
    
        System.Diagnostics.Process process;
    
        string ffmpegFileName = "ffmpeg.exe";
    
        string workingDirectory;
    

    
        public Ffmpeg()
    
        {
    
            workingDirectory = Path.GetDirectoryName(Application.ExecutablePath);
    
            Logger.Write("workingDirectory: " + workingDirectory);
    
            if (!Directory.Exists(workingDirectory))
    
            {
    
                Directory.CreateDirectory(workingDirectory);
    
            }
    
            ffmpegFileName = Path.Combine(workingDirectory, ffmpegFileName);
    
            Logger.Write("FfmpegFilename: " + ffmpegFileName);
    
        }
    

    
        public void Start(string pathFileName, int BitmapRate)
    
        {
    
            try
    
            {
    

    
                string outPath = pathFileName;
    
                p = new NamedPipeServerStream(pipename, PipeDirection.Out, 1, PipeTransmissionMode.Byte);
    
                ProcessStartInfo psi = new ProcessStartInfo();
    
                psi.WindowStyle = ProcessWindowStyle.Hidden;
    
                psi.UseShellExecute = false;
    
                psi.CreateNoWindow = false;
    
                psi.FileName = ffmpegFileName;
    
                psi.WorkingDirectory = workingDirectory;
    
                psi.Arguments = @"-f rawvideo -pix_fmt bgra -video_size 1920x1080 -i \\.\pipe\mytestpipe -c:v mpeg2video -crf 20 -r " + BitmapRate + " " + outPath;
    
                process = Process.Start(psi);
    
                process.EnableRaisingEvents = false;
    
                psi.RedirectStandardError = true;
    
                p.WaitForConnection();
    
            }
    
            catch (Exception err)
    
            {
    
                Logger.Write("Exception Error: " + err.ToString());
    
            }
    
        }
    

    
        public void PushFrame(Bitmap bmp)
    
        {
    
            try
    
            {
    
                int length;
    
                // Lock the bitmap's bits.
    
                //bmp = new Bitmap(1920, 1080);
    
                Rectangle rect = new Rectangle(0, 0, bmp.Width, bmp.Height);
    
                //Rectangle rect = new Rectangle(0, 0, 1280, 720);
    
                System.Drawing.Imaging.BitmapData bmpData =
    
                    bmp.LockBits(rect, System.Drawing.Imaging.ImageLockMode.ReadOnly,
    
                    bmp.PixelFormat);
    

    
                int absStride = Math.Abs(bmpData.Stride);
    
                // Get the address of the first line.
    
                IntPtr ptr = bmpData.Scan0;
    

    
                // Declare an array to hold the bytes of the bitmap.
    
                //length = 3 * bmp.Width * bmp.Height;
    
                length = absStride * bmpData.Height;
    
                byte[] rgbValues = new byte[length];
    

    
                //Marshal.Copy(ptr, rgbValues, 0, length);
    
                int j = bmp.Height - 1;
    
                for (int i = 0; i < bmp.Height; i++)
    
                {
    
                    IntPtr pointer = new IntPtr(bmpData.Scan0.ToInt32() + (bmpData.Stride * j));
    
                    System.Runtime.InteropServices.Marshal.Copy(pointer, rgbValues, absStride * (bmp.Height - i - 1), absStride);
    
                    j--;
    
                }
    
                p.Write(rgbValues, 0, length);
    
                bmp.UnlockBits(bmpData);
    
            }
    
            catch(Exception err)
    
            {
    
                Logger.Write("Error: " + err.ToString());
    
            }
    

    
        }
    

    
        public void Close()
    
        {
    
            p.Close();
    
        }
    
    }
    
}

    And using the ffmpeg class like this :

    public static Ffmpeg fmpeg;

    Then

    fmpeg = new Ffmpeg();
    
fmpeg.Start(@"e:\screenshots\test.mp4", 25);

    And

    fmpeg.PushFrame(_screenShot);

    My main question is first how to get the screenshots(frames) from the pictureBox1 directly no matter what screen i’m in now ?

    And how to use on each frame with the fmpeg to get a fine mp4 speed video file I mean that I will not miss a frame to capture all frames and also that the mp4 video file will when I play it later will not display a fast video or too slow ?

  • Creating GIF from QImages with ffmpeg

    17 août 2016, par Sierra

    I would like to generate GIF from QImage, using ffmpeg - all of that programmatically (C++). I’m working with Qt 5.6 and the last build of ffmpeg (build git-0a9e781 (2016-06-10).

    I’m already able to convert these QImage in .mp4 and it works. I tried to use the same principle for the GIF, changing format pixel and codec. GIF is generated with two pictures (1 second each), in 15 FPS.

    ## INITIALIZATION
    
#####################################################################
    

    
// Filepath : "C:/Users/.../qt_temp.Jv7868.gif"  
    
// Allocating an AVFormatContext for an output format...
    
avformat_alloc_output_context2(formatContext, NULL, NULL, filepath);
    

    
...
    

    
// Adding the video streams using the default format codecs and initializing the codecs.
    
stream = avformat_new_stream(formatContext, *codec);
    

    
AVCodecContext * codecContext = avcodec_alloc_context3(*codec);
    

    
context->codec_id       = codecId;
    
context->bit_rate       = 400000;
    
...
    
context->pix_fmt        = AV_PIX_FMT_BGR8;
    

    
...
    

    
// Opening the codec...
    
avcodec_open2(codecContext, codec, NULL);
    

    
...
    

    
frame = allocPicture(codecContext->width, codecContext->height, codecContext->pix_fmt);
    
tmpFrame = allocPicture(codecContext->width, codecContext->height, AV_PIX_FMT_RGBA);
    

    
...
    

    
avformat_write_header(formatContext, NULL);
    

    
## ADDING A NEW FRAME
    
#####################################################################
    

    
// Getting in parameter the QImage: newFrame(const QImage & image)
    
const qint32 width  = image.width();
    
const qint32 height = image.height();
    

    
// Converting QImage into AVFrame
    
for (qint32 y = 0; y < height; y++) {
    
    const uint8_t * scanline = image.scanLine(y);
    

    
    for (qint32 x = 0; x < width * 4; x++) {
    
        tmpFrame->data[0][y * tmpFrame->linesize[0] + x] = scanline[x];
    
    }
    
}
    

    
...
    

    
// Scaling...
    
if (codec->pix_fmt != AV_PIX_FMT_BGRA) {
    
    if (!swsCtx) {
    
        swsCtx = sws_getContext(codec->width, codec->height,
    
                                AV_PIX_FMT_BGRA,
    
                                codec->width, codec->height,
    
                                codec->pix_fmt,
    
                                SWS_BICUBIC, NULL, NULL, NULL);
    
    }
    

    
    sws_scale(swsCtx,
    
              (const uint8_t * const *)tmpFrame->data,
    
              tmpFrame->linesize,
    
              0,
    
              codec->height,
    
              frame->data,
    
              frame->linesize);
    
}
    
frame->pts = nextPts++;
    

    
...
    

    
int gotPacket = 0;
    
AVPacket packet = {0};
    

    
av_init_packet(&packet);
    
avcodec_encode_video2(codec, &packet, frame, &gotPacket);
    

    
if (gotPacket) {
    
    av_packet_rescale_ts(paket, *codec->time_base, stream->time_base);
    
    paket->stream_index = stream->index;
    

    
    av_interleaved_write_frame(formatContext, paket);
    
}

    But when I’m trying to modify the video codec and pixel format to match with GIF specifications, I’m facing some issues.
    I tried several codecs such as AV_CODEC_ID_GIF and AV_CODEC_ID_RAWVIDEO but none of them seem to work. During the initialization phase, avcodec_open2() always returns such kind of errors :

    Specified pixel format rgb24 is invalid or not supported
    
Could not open video codec:  gif

    EDIT 17/06/2016

    Digging a little bit more, avcodec_open2() returns -22 :

    #define EINVAL          22      /* Invalid argument */

    EDIT 22/06/2016

    Here are the flags used to compile ffmpeg :

    "FFmpeg/Libav configuration: --disable-static --enable-shared --enable-gpl --enable-version3 --disable-w32threads --enable-nvenc --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmfx --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libschroedinger --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-libzimg --enable-lzma --enable-decklink --enable-zlib"

    Did I miss a crucial one for GIF ?

    EDIT 27/06/2016

    Thanks to Gwen, I have a first output : I setted the context->pix_fmt to AV_PIX_FMT_BGR8. Btw I’m still facing some issues with the generated GIF. It’s not playing and encoding appears to fail.

    GIF generated in command lines with ffmpeg (left) . . . GIF generated programmatically (right)
    Generated in command line with ffmpeg
    enter image description here

    It looks like some options are not defined... also may be a wrong conversion between QImage and AVFrame ? I updated the code above. It represents a lot of code, so I tried to stay short. Don’t hesitate to ask more details.

    End of EDIT

    I’m not really familiar with ffmpeg, any kind of help would be highly appreciated. Thank you.

  • Creating GIF from QImages with ffmpeg

    21 mars 2020, par Sierra

    I would like to generate GIF from QImage, using ffmpeg - all of that programmatically (C++). I’m working with Qt 5.6 and the last build of ffmpeg (build git-0a9e781 (2016-06-10).

    I’m already able to convert these QImage in .mp4 and it works. I tried to use the same principle for the GIF, changing format pixel and codec. GIF is generated with two pictures (1 second each), in 15 FPS.

    ## INITIALIZATION
    
#####################################################################
    

    
// Filepath : "C:/Users/.../qt_temp.Jv7868.gif"  
    
// Allocating an AVFormatContext for an output format...
    
avformat_alloc_output_context2(formatContext, NULL, NULL, filepath);
    

    
...
    

    
// Adding the video streams using the default format codecs and initializing the codecs.
    
stream = avformat_new_stream(formatContext, *codec);
    

    
AVCodecContext * codecContext = avcodec_alloc_context3(*codec);
    

    
context->codec_id       = codecId;
    
context->bit_rate       = 400000;
    
...
    
context->pix_fmt        = AV_PIX_FMT_BGR8;
    

    
...
    

    
// Opening the codec...
    
avcodec_open2(codecContext, codec, NULL);
    

    
...
    

    
frame = allocPicture(codecContext->width, codecContext->height, codecContext->pix_fmt);
    
tmpFrame = allocPicture(codecContext->width, codecContext->height, AV_PIX_FMT_RGBA);
    

    
...
    

    
avformat_write_header(formatContext, NULL);
    

    
## ADDING A NEW FRAME
    
#####################################################################
    

    
// Getting in parameter the QImage: newFrame(const QImage & image)
    
const qint32 width  = image.width();
    
const qint32 height = image.height();
    

    
// Converting QImage into AVFrame
    
for (qint32 y = 0; y < height; y++) {
    
    const uint8_t * scanline = image.scanLine(y);
    

    
    for (qint32 x = 0; x < width * 4; x++) {
    
        tmpFrame->data[0][y * tmpFrame->linesize[0] + x] = scanline[x];
    
    }
    
}
    

    
...
    

    
// Scaling...
    
if (codec->pix_fmt != AV_PIX_FMT_BGRA) {
    
    if (!swsCtx) {
    
        swsCtx = sws_getContext(codec->width, codec->height,
    
                                AV_PIX_FMT_BGRA,
    
                                codec->width, codec->height,
    
                                codec->pix_fmt,
    
                                SWS_BICUBIC, NULL, NULL, NULL);
    
    }
    

    
    sws_scale(swsCtx,
    
              (const uint8_t * const *)tmpFrame->data,
    
              tmpFrame->linesize,
    
              0,
    
              codec->height,
    
              frame->data,
    
              frame->linesize);
    
}
    
frame->pts = nextPts++;
    

    
...
    

    
int gotPacket = 0;
    
AVPacket packet = {0};
    

    
av_init_packet(&packet);
    
avcodec_encode_video2(codec, &packet, frame, &gotPacket);
    

    
if (gotPacket) {
    
    av_packet_rescale_ts(paket, *codec->time_base, stream->time_base);
    
    paket->stream_index = stream->index;
    

    
    av_interleaved_write_frame(formatContext, paket);
    
}

    But when I’m trying to modify the video codec and pixel format to match with GIF specifications, I’m facing some issues.
    I tried several codecs such as AV_CODEC_ID_GIF and AV_CODEC_ID_RAWVIDEO but none of them seem to work. During the initialization phase, avcodec_open2() always returns such kind of errors :

    Specified pixel format rgb24 is invalid or not supported
    
Could not open video codec:  gif

    EDIT 17/06/2016

    Digging a little bit more, avcodec_open2() returns -22 :

    #define EINVAL          22      /* Invalid argument */

    EDIT 22/06/2016

    Here are the flags used to compile ffmpeg :

    "FFmpeg/Libav configuration: --disable-static --enable-shared --enable-gpl --enable-version3 --disable-w32threads --enable-nvenc --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmfx --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libschroedinger --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-libzimg --enable-lzma --enable-decklink --enable-zlib"

    Did I miss a crucial one for GIF ?

    EDIT 27/06/2016

    Thanks to Gwen, I have a first output : I setted the context->pix_fmt to AV_PIX_FMT_BGR8. Btw I’m still facing some issues with the generated GIF. It’s not playing and encoding appears to fail.

    GIF generated in command lines with ffmpeg (left) . . . GIF generated programmatically (right)
    Generated in command line with ffmpeg
    enter image description here

    It looks like some options are not defined... also may be a wrong conversion between QImage and AVFrame ? I updated the code above. It represents a lot of code, so I tried to stay short. Don’t hesitate to ask more details.

    End of EDIT

    I’m not really familiar with ffmpeg, any kind of help would be highly appreciated. Thank you.

Navigation