Recherche avancée

Médias (1)

Mot : - Tags -/censure

Autres articles (95)

  • MediaSPIP 0.1 Beta version

    25 avril 2011, par

    MediaSPIP 0.1 beta is the first version of MediaSPIP proclaimed as "usable".
    The zip file provided here only contains the sources of MediaSPIP in its standalone version.
    To get a working installation, you must manually install all-software dependencies on the server.
    If you want to use this archive for an installation in "farm mode", you will also need to proceed to other manual (...)

  • HTML5 audio and video support

    13 avril 2011, par

    MediaSPIP uses HTML5 video and audio tags to play multimedia files, taking advantage of the latest W3C innovations supported by modern browsers.
    The MediaSPIP player used has been created specifically for MediaSPIP and can be easily adapted to fit in with a specific theme.
    For older browsers the Flowplayer flash fallback is used.
    MediaSPIP allows for media playback on major mobile platforms with the above (...)

  • ANNEXE : Les plugins utilisés spécifiquement pour la ferme

    5 mars 2010, par

    Le site central/maître de la ferme a besoin d’utiliser plusieurs plugins supplémentaires vis à vis des canaux pour son bon fonctionnement. le plugin Gestion de la mutualisation ; le plugin inscription3 pour gérer les inscriptions et les demandes de création d’instance de mutualisation dès l’inscription des utilisateurs ; le plugin verifier qui fournit une API de vérification des champs (utilisé par inscription3) ; le plugin champs extras v2 nécessité par inscription3 (...)

Sur d’autres sites (7186)

  • Extract Video Frames In Python

    22 avril 2017, par TheNone

    I want to extract video frames and save them as image.

    import os, sys
    
from PIL import Image
    

    
a, b, c = os.popen3("ffmpeg -i test.avi")
    
out = c.read()
    
dp = out.index("Duration: ")
    
duration = out[dp+10:dp+out[dp:].index(",")]
    
hh, mm, ss = map(float, duration.split(":"))
    
total = (hh*60 + mm)*60 + ss
    
for i in xrange(9):
    
    t = (i + 1) * total / 10
    
    os.system("ffmpeg -i test.avi -ss %0.3fs frame%i.png" % (t, i))

    But I have this error :

    FFmpeg version CVS, Copyright (c) 2000-2004 Fabrice Bellard
    
Mac OSX universal build for ffmpegX
    
  configuration:  --enable-memalign-hack --enable-mp3lame --enable-gpl --disable-vhook --disable-ffplay --disable-ffserver --enable-a52 --enable-xvid --enable-faac --enable-faad --enable-amr_nb --enable-amr_wb --enable-pthreads --enable-x264 
    
  libavutil version: 49.0.0
    
  libavcodec version: 51.9.0
    
  libavformat version: 50.4.0
    
  built on Apr 15 2006 04:58:19, gcc: 4.0.1 (Apple Computer, Inc. build 5250)
    
Input #0, avi, from 'test.avi':
    
  Duration: 00:00:30.5, start: 0.000000, bitrate: 465 kb/s
    
  Stream #0.0, 25.00 fps(r): Video: mpeg4, yuv420p, 640x480
    
  Stream #0.1: Audio: mp3, 32000 Hz, mono, 32 kb/s
    
Unable for find a suitable output format for 'frame0.png'

    Edit : ffmpeg -formats

    FFmpeg version CVS, Copyright (c) 2000-2004 Fabrice Bellard
    
Mac OSX universal build for ffmpegX
    
  configuration:  --enable-memalign-hack --enable-mp3lame --enable-gpl --disable-vhook --disable-ffplay --disable-ffserver --enable-a52 --enable-xvid --enable-faac --enable-faad --enable-amr_nb --enable-amr_wb --enable-pthreads --enable-x264 
    
  libavutil version: 49.0.0
    
  libavcodec version: 51.9.0
    
  libavformat version: 50.4.0
    
  built on Apr 15 2006 04:58:19, gcc: 4.0.1 (Apple Computer, Inc. build 5250)
    
File formats:
    
  E 3g2             3gp2 format
    
  E 3gp             3gp format
    
 D  4xm             4X Technologies format
    
 D  RoQ             Id RoQ format
    
 D  aac             ADTS AAC
    
 DE ac3             raw ac3
    
  E adts            ADTS AAC
    
 DE aiff            Audio IFF
    
 DE alaw            pcm A law format
    
 DE amr             3gpp amr file format
    
 DE asf             asf format
    
  E asf_stream      asf format
    
 DE au              SUN AU Format
    
 DE avi             avi format
    
 D  avs             avs format
    
  E crc             crc testing format
    
 D  daud            D-Cinema audio format
    
 D  dts             raw dts
    
 DE dv              DV video format
    
  E dvd             MPEG2 PS format (DVD VOB)
    
 D  ea              Electronic Arts Multimedia Format
    
 DE ffm             ffm format
    
 D  film_cpk        Sega FILM/CPK format
    
 D  flic            FLI/FLC/FLX animation format
    
 DE flv             flv format
    
  E framecrc        framecrc testing format
    
 DE gif             GIF Animation
    
 DE h261            raw h261
    
 DE h263            raw h263
    
 DE h264            raw H264 video format
    
 D  idcin           Id CIN format
    
 DE image           image sequence
    
 DE image2          image2 sequence
    
 DE image2pipe      piped image2 sequence
    
 DE imagepipe       piped image sequence
    
 D  ingenient       Ingenient MJPEG
    
 D  ipmovie         Interplay MVE format
    
 DE m4v             raw MPEG4 video format
    
 D  matroska        Matroska file format
    
 DE mjpeg           MJPEG video
    
 D  mm              American Laser Games MM format
    
 DE mmf             mmf format
    
  E mov             mov format
    
 D  mov,mp4,m4a,3gp,3g2,mj2 QuickTime/MPEG4/Motion JPEG 2000 format
    
  E mp2             MPEG audio layer 2
    
 DE mp3             MPEG audio layer 3
    
  E mp4             mp4 format
    
 DE mpeg            MPEG1 System format
    
  E mpeg1video      MPEG video
    
  E mpeg2video      MPEG2 video
    
 DE mpegts          MPEG2 transport stream format
    
 D  mpegvideo       MPEG video
    
  E mpjpeg          Mime multipart JPEG format
    
 DE mulaw           pcm mu law format
    
 D  nsv             NullSoft Video format
    
  E null            null video format
    
 DE nut             nut format
    
 D  nuv             NuppelVideo format
    
 D  ogg             Ogg
    
  E psp             psp mp4 format
    
 D  psxstr          Sony Playstation STR format
    
 DE rawvideo        raw video format
    
 D  redir           Redirector format
    
 DE rm              rm format
    
  E rtp             RTP output format
    
 D  rtsp            RTSP input format
    
 DE s16be           pcm signed 16 bit big endian format
    
 DE s16le           pcm signed 16 bit little endian format
    
 DE s8              pcm signed 8 bit format
    
 D  sdp             SDP
    
 D  shn             raw shorten
    
 D  smk             Smacker Video
    
 D  sol             Sierra SOL Format
    
  E svcd            MPEG2 PS format (VOB)
    
 DE swf             Flash format
    
 D  tta             true-audio
    
 DE u16be           pcm unsigned 16 bit big endian format
    
 DE u16le           pcm unsigned 16 bit little endian format
    
 DE u8              pcm unsigned 8 bit format
    
  E vcd             MPEG1 System format (VCD)
    
 D  vmd             Sierra VMD format
    
  E vob             MPEG2 PS format (VOB)
    
 DE voc             Creative Voice File format
    
 DE wav             wav format
    
 D  wc3movie        Wing Commander III movie format
    
 D  wsaud           Westwood Studios audio format
    
 D  wsvqa           Westwood Studios VQA format
    
 DE yuv4mpegpipe    YUV4MPEG pipe format
    

    
Image formats (filename extensions, if any, follow):
    
 DE gif    gif
    

    
Codecs:
    
 D V    4xm
    
 D V D  8bps
    
 DEA    aac
    
 D V D  aasc
    
 DEA    ac3
    
 DEA    adpcm_4xm
    
 DEA    adpcm_adx
    
 DEA    adpcm_ct
    
 DEA    adpcm_ea
    
 DEA    adpcm_ima_dk3
    
 DEA    adpcm_ima_dk4
    
 DEA    adpcm_ima_qt
    
 DEA    adpcm_ima_smjpeg
    
 DEA    adpcm_ima_wav
    
 DEA    adpcm_ima_ws
    
 DEA    adpcm_ms
    
 DEA    adpcm_sbpro_2
    
 DEA    adpcm_sbpro_3
    
 DEA    adpcm_sbpro_4
    
 DEA    adpcm_swf
    
 DEA    adpcm_xa
    
 DEA    adpcm_yamaha
    
 D A    alac
    
 DEA    amr_nb
    
 DEA    amr_wb
    
 DEV D  asv1
    
 DEV D  asv2
    
 D V D  avs
    
 D V    bmp
    
 D V D  camstudio
    
 D V D  camtasia
    
 D V D  cinepak
    
 D V D  cljr
    
 D A    cook
    
 D V D  cyuv
    
 DES    dvbsub
    
 DES    dvdsub
    
 DEV D  dvvideo
    
 DEV D  ffv1
    
 DEVSD  ffvhuff
    
 D A    flac
    
 D V D  flic
    
 DEVSD  flv
    
 D V D  fraps
    
 DEA    g726
    
 DEV D  h261
    
 DEVSDT h263
    
 D VSD  h263i
    
  EV    h263p
    
 DEV DT h264
    
 DEVSD  huffyuv
    
 D V D  idcinvideo
    
 D V D  indeo2
    
 D V    indeo3
    
 D A    interplay_dpcm
    
 D V D  interplayvideo
    
  EV    jpegls
    
 D V    kmvc
    
  EV    ljpeg
    
 D V D  loco
    
 D A    mace3
    
 D A    mace6
    
 D V D  mdec
    
 DEV D  mjpeg
    
 D V D  mjpegb
    
 D V D  mmvideo
    
 DEA    mp2
    
 DEA    mp3
    
 D A    mp3adu
    
 D A    mp3on4
    
 DEVSDT mpeg1video
    
 DEVSDT mpeg2video
    
 DEVSDT mpeg4
    
 D A    mpeg4aac
    
 D VSDT mpegvideo
    
 DEVSD  msmpeg4
    
 DEVSD  msmpeg4v1
    
 DEVSD  msmpeg4v2
    
 D V D  msrle
    
 D V D  msvideo1
    
 D V D  mszh
    
 D V D  nuv
    
 DEV    pam
    
 DEV    pbm
    
 DEA    pcm_alaw
    
 DEA    pcm_mulaw
    
 DEA    pcm_s16be
    
 DEA    pcm_s16le
    
 DEA    pcm_s24be
    
 DEA    pcm_s24daud
    
 DEA    pcm_s24le
    
 DEA    pcm_s32be
    
 DEA    pcm_s32le
    
 DEA    pcm_s8
    
 DEA    pcm_u16be
    
 DEA    pcm_u16le
    
 DEA    pcm_u24be
    
 DEA    pcm_u24le
    
 DEA    pcm_u32be
    
 DEA    pcm_u32le
    
 DEA    pcm_u8
    
 DEV    pgm
    
 DEV    pgmyuv
    
 DEV    png
    
 DEV    ppm
    
 D A    qdm2
    
 D V D  qdraw
    
 D V D  qpeg
    
 D V D  qtrle
    
 DEV    rawvideo
    
 D A    real_144
    
 D A    real_288
    
 D A    roq_dpcm
    
 D V D  roqvideo
    
 D V D  rpza
    
 DEV D  rv10
    
 DEV D  rv20
    
 D A    shorten
    
 D A    smackaud
    
 D V    smackvid
    
 D V D  smc
    
 DEV    snow
    
 D A    sol_dpcm
    
 DEA    sonic
    
  EA    sonicls
    
 D V D  sp5x
    
 DEV D  svq1
    
 D VSD  svq3
    
 D V    theora
    
 D V D  truemotion1
    
 D V D  truemotion2
    
 D A    truespeech
    
 D A    tta
    
 D V D  ultimotion
    
 D V    vc9
    
 D V D  vcr1
    
 D A    vmdaudio
    
 D V D  vmdvideo
    
 D A    vorbis
    
 D V    vp3
    
 D V D  vqavideo
    
 D A    wmav1
    
 D A    wmav2
    
 DEVSD  wmv1
    
 DEVSD  wmv2
    
 D V D  wnv1
    
 D A    ws_snd1
    
 D A    xan_dpcm
    
 D V D  xan_wc3
    
 D V D  xl
    
  EV    xvid
    
 DEV D  zlib
    
 D V    zmbv
    

    
Supported file protocols:
    
 file: pipe: udp: rtp: tcp: http:
    
Frame size, frame rate abbreviations:
    
 ntsc pal qntsc qpal sntsc spal film ntsc-film sqcif qcif cif 4cif
    
Motion estimation methods:
    
 zero(fastest) full(slowest) log phods epzs(default) x1 hex umh iter
    

    
Note, the names of encoders and decoders dont always match, so there are
    
several cases where the above table shows encoder only or decoder only entries
    
even though both encoding and decoding are supported for example, the h263
    
decoder corresponds to the h263 and h263p encoders, for file formats its even
    
worse

    What is wrong in my code ? Thanks in advance

  • Extract Video Frames In Python

    28 février 2024, par TheNone

    I want to extract video frames and save them as image.

    



    import os, sys
from PIL import Image

a, b, c = os.popen3("ffmpeg -i test.avi")
out = c.read()
dp = out.index("Duration: ")
duration = out[dp+10:dp+out[dp:].index(",")]
hh, mm, ss = map(float, duration.split(":"))
total = (hh*60 + mm)*60 + ss
for i in xrange(9):
    t = (i + 1) * total / 10
    os.system("ffmpeg -i test.avi -ss %0.3fs frame%i.png" % (t, i))


    



    But I have this error :

    



    FFmpeg version CVS, Copyright (c) 2000-2004 Fabrice Bellard
Mac OSX universal build for ffmpegX
  configuration:  --enable-memalign-hack --enable-mp3lame --enable-gpl --disable-vhook --disable-ffplay --disable-ffserver --enable-a52 --enable-xvid --enable-faac --enable-faad --enable-amr_nb --enable-amr_wb --enable-pthreads --enable-x264 
  libavutil version: 49.0.0
  libavcodec version: 51.9.0
  libavformat version: 50.4.0
  built on Apr 15 2006 04:58:19, gcc: 4.0.1 (Apple Computer, Inc. build 5250)
Input #0, avi, from 'test.avi':
  Duration: 00:00:30.5, start: 0.000000, bitrate: 465 kb/s
  Stream #0.0, 25.00 fps(r): Video: mpeg4, yuv420p, 640x480
  Stream #0.1: Audio: mp3, 32000 Hz, mono, 32 kb/s
Unable for find a suitable output format for 'frame0.png'


    



    Edit : ffmpeg -formats

    



    FFmpeg version CVS, Copyright (c) 2000-2004 Fabrice Bellard
Mac OSX universal build for ffmpegX
  configuration:  --enable-memalign-hack --enable-mp3lame --enable-gpl --disable-vhook --disable-ffplay --disable-ffserver --enable-a52 --enable-xvid --enable-faac --enable-faad --enable-amr_nb --enable-amr_wb --enable-pthreads --enable-x264 
  libavutil version: 49.0.0
  libavcodec version: 51.9.0
  libavformat version: 50.4.0
  built on Apr 15 2006 04:58:19, gcc: 4.0.1 (Apple Computer, Inc. build 5250)
File formats:
  E 3g2             3gp2 format
  E 3gp             3gp format
 D  4xm             4X Technologies format
 D  RoQ             Id RoQ format
 D  aac             ADTS AAC
 DE ac3             raw ac3
  E adts            ADTS AAC
 DE aiff            Audio IFF
 DE alaw            pcm A law format
 DE amr             3gpp amr file format
 DE asf             asf format
  E asf_stream      asf format
 DE au              SUN AU Format
 DE avi             avi format
 D  avs             avs format
  E crc             crc testing format
 D  daud            D-Cinema audio format
 D  dts             raw dts
 DE dv              DV video format
  E dvd             MPEG2 PS format (DVD VOB)
 D  ea              Electronic Arts Multimedia Format
 DE ffm             ffm format
 D  film_cpk        Sega FILM/CPK format
 D  flic            FLI/FLC/FLX animation format
 DE flv             flv format
  E framecrc        framecrc testing format
 DE gif             GIF Animation
 DE h261            raw h261
 DE h263            raw h263
 DE h264            raw H264 video format
 D  idcin           Id CIN format
 DE image           image sequence
 DE image2          image2 sequence
 DE image2pipe      piped image2 sequence
 DE imagepipe       piped image sequence
 D  ingenient       Ingenient MJPEG
 D  ipmovie         Interplay MVE format
 DE m4v             raw MPEG4 video format
 D  matroska        Matroska file format
 DE mjpeg           MJPEG video
 D  mm              American Laser Games MM format
 DE mmf             mmf format
  E mov             mov format
 D  mov,mp4,m4a,3gp,3g2,mj2 QuickTime/MPEG4/Motion JPEG 2000 format
  E mp2             MPEG audio layer 2
 DE mp3             MPEG audio layer 3
  E mp4             mp4 format
 DE mpeg            MPEG1 System format
  E mpeg1video      MPEG video
  E mpeg2video      MPEG2 video
 DE mpegts          MPEG2 transport stream format
 D  mpegvideo       MPEG video
  E mpjpeg          Mime multipart JPEG format
 DE mulaw           pcm mu law format
 D  nsv             NullSoft Video format
  E null            null video format
 DE nut             nut format
 D  nuv             NuppelVideo format
 D  ogg             Ogg
  E psp             psp mp4 format
 D  psxstr          Sony Playstation STR format
 DE rawvideo        raw video format
 D  redir           Redirector format
 DE rm              rm format
  E rtp             RTP output format
 D  rtsp            RTSP input format
 DE s16be           pcm signed 16 bit big endian format
 DE s16le           pcm signed 16 bit little endian format
 DE s8              pcm signed 8 bit format
 D  sdp             SDP
 D  shn             raw shorten
 D  smk             Smacker Video
 D  sol             Sierra SOL Format
  E svcd            MPEG2 PS format (VOB)
 DE swf             Flash format
 D  tta             true-audio
 DE u16be           pcm unsigned 16 bit big endian format
 DE u16le           pcm unsigned 16 bit little endian format
 DE u8              pcm unsigned 8 bit format
  E vcd             MPEG1 System format (VCD)
 D  vmd             Sierra VMD format
  E vob             MPEG2 PS format (VOB)
 DE voc             Creative Voice File format
 DE wav             wav format
 D  wc3movie        Wing Commander III movie format
 D  wsaud           Westwood Studios audio format
 D  wsvqa           Westwood Studios VQA format
 DE yuv4mpegpipe    YUV4MPEG pipe format

Image formats (filename extensions, if any, follow):
 DE gif    gif

Codecs:
 D V    4xm
 D V D  8bps
 DEA    aac
 D V D  aasc
 DEA    ac3
 DEA    adpcm_4xm
 DEA    adpcm_adx
 DEA    adpcm_ct
 DEA    adpcm_ea
 DEA    adpcm_ima_dk3
 DEA    adpcm_ima_dk4
 DEA    adpcm_ima_qt
 DEA    adpcm_ima_smjpeg
 DEA    adpcm_ima_wav
 DEA    adpcm_ima_ws
 DEA    adpcm_ms
 DEA    adpcm_sbpro_2
 DEA    adpcm_sbpro_3
 DEA    adpcm_sbpro_4
 DEA    adpcm_swf
 DEA    adpcm_xa
 DEA    adpcm_yamaha
 D A    alac
 DEA    amr_nb
 DEA    amr_wb
 DEV D  asv1
 DEV D  asv2
 D V D  avs
 D V    bmp
 D V D  camstudio
 D V D  camtasia
 D V D  cinepak
 D V D  cljr
 D A    cook
 D V D  cyuv
 DES    dvbsub
 DES    dvdsub
 DEV D  dvvideo
 DEV D  ffv1
 DEVSD  ffvhuff
 D A    flac
 D V D  flic
 DEVSD  flv
 D V D  fraps
 DEA    g726
 DEV D  h261
 DEVSDT h263
 D VSD  h263i
  EV    h263p
 DEV DT h264
 DEVSD  huffyuv
 D V D  idcinvideo
 D V D  indeo2
 D V    indeo3
 D A    interplay_dpcm
 D V D  interplayvideo
  EV    jpegls
 D V    kmvc
  EV    ljpeg
 D V D  loco
 D A    mace3
 D A    mace6
 D V D  mdec
 DEV D  mjpeg
 D V D  mjpegb
 D V D  mmvideo
 DEA    mp2
 DEA    mp3
 D A    mp3adu
 D A    mp3on4
 DEVSDT mpeg1video
 DEVSDT mpeg2video
 DEVSDT mpeg4
 D A    mpeg4aac
 D VSDT mpegvideo
 DEVSD  msmpeg4
 DEVSD  msmpeg4v1
 DEVSD  msmpeg4v2
 D V D  msrle
 D V D  msvideo1
 D V D  mszh
 D V D  nuv
 DEV    pam
 DEV    pbm
 DEA    pcm_alaw
 DEA    pcm_mulaw
 DEA    pcm_s16be
 DEA    pcm_s16le
 DEA    pcm_s24be
 DEA    pcm_s24daud
 DEA    pcm_s24le
 DEA    pcm_s32be
 DEA    pcm_s32le
 DEA    pcm_s8
 DEA    pcm_u16be
 DEA    pcm_u16le
 DEA    pcm_u24be
 DEA    pcm_u24le
 DEA    pcm_u32be
 DEA    pcm_u32le
 DEA    pcm_u8
 DEV    pgm
 DEV    pgmyuv
 DEV    png
 DEV    ppm
 D A    qdm2
 D V D  qdraw
 D V D  qpeg
 D V D  qtrle
 DEV    rawvideo
 D A    real_144
 D A    real_288
 D A    roq_dpcm
 D V D  roqvideo
 D V D  rpza
 DEV D  rv10
 DEV D  rv20
 D A    shorten
 D A    smackaud
 D V    smackvid
 D V D  smc
 DEV    snow
 D A    sol_dpcm
 DEA    sonic
  EA    sonicls
 D V D  sp5x
 DEV D  svq1
 D VSD  svq3
 D V    theora
 D V D  truemotion1
 D V D  truemotion2
 D A    truespeech
 D A    tta
 D V D  ultimotion
 D V    vc9
 D V D  vcr1
 D A    vmdaudio
 D V D  vmdvideo
 D A    vorbis
 D V    vp3
 D V D  vqavideo
 D A    wmav1
 D A    wmav2
 DEVSD  wmv1
 DEVSD  wmv2
 D V D  wnv1
 D A    ws_snd1
 D A    xan_dpcm
 D V D  xan_wc3
 D V D  xl
  EV    xvid
 DEV D  zlib
 D V    zmbv

Supported file protocols:
 file: pipe: udp: rtp: tcp: http:
Frame size, frame rate abbreviations:
 ntsc pal qntsc qpal sntsc spal film ntsc-film sqcif qcif cif 4cif
Motion estimation methods:
 zero(fastest) full(slowest) log phods epzs(default) x1 hex umh iter

Note, the names of encoders and decoders dont always match, so there are
several cases where the above table shows encoder only or decoder only entries
even though both encoding and decoding are supported for example, the h263
decoder corresponds to the h263 and h263p encoders, for file formats its even
worse


    



    What is wrong in my code ? Thanks in advance

    


  • Decoding MediaRecorder produced webm stream

    15 août 2019, par sgmg

    I am trying to decode a video stream from the browser using the ffmpeg API. The stream is produced by the webcam and recorded with MediaRecorder as webm format. What I ultimately need is a vector of opencv cv::Mat objects for further processing.

    I have written a C++ webserver using the uWebsocket library. The video stream is sent via websocket from the browser to the server once per second. On the server, I append the received data to my custom buffer and decode it with the ffmpeg API.

    If I just save the data on the disk and later I play it with a media player, it works fine. So, whatever the browser sends is a valid video.

    I do not think that I correctly understand how should the custom IO behave with network streaming as nothing seems to be working.

    The custom buffer :

     struct Buffer
    
    {
    
        std::vector data;
    
        int currentPos = 0;
    
    };

    The readAVBuffer method for custom IO

    int MediaDecoder::readAVBuffer(void* opaque, uint8_t* buf, int buf_size)
    
{
    
    MediaDecoder::Buffer* mbuf = (MediaDecoder::Buffer*)opaque;
    
    int count = 0;
    
    for(int i=0;icurrentPos;
    
        if(index >= (int)mbuf->data.size())
    
        {
    
            break;
    
        }
    
        count++;
    
        buf[i] = mbuf->data.at(index);
    
    }
    
    if(count > 0) mbuf->currentPos+=count;
    

    
    std::cout << "read : "<currentPos<<", buff size:"<data.size() << std::endl;
    
    if(count <= 0) return AVERROR(EAGAIN); //is this error that should be returned? It cannot be EOF since we're not done yet, most likely
    
    return count;
    
}

    The big decode method, that’s supposed to return whatever frames it could read

    std::vector MediaDecoder::decode(const char* data, size_t length)
    
{
    
    std::vector frames;
    
    //add data to the buffer
    
    for(size_t i=0;i/do not invoke the decoders until we have 1MB of data
    
    if(((buf.data.size() - buf.currentPos) < 1*1024*1024) && !initializedCodecs) return frames;
    

    
    std::cout << "decoding data length "</initialize ffmpeg objects. Custom I/O, format, decoder, etc.
    
    {       
    
        //these are just members of the class 
    
        avioCtxPtr = std::unique_ptr(
    
                    avio_alloc_context((uint8_t*)av_malloc(4096),4096,0,&buf,&readAVBuffer,nullptr,nullptr),
    
                    avio_context_deleter());
    
        if(!avioCtxPtr)
    
        {
    
            std::cerr << "Could not create IO buffer" << std::endl;
    
            return frames;
    
        }                
    

    
        fmt_ctx = std::unique_ptr(avformat_alloc_context(),
    
                                                                          avformat_context_deleter());
    
        fmt_ctx->pb = avioCtxPtr.get();
    
        fmt_ctx->flags |= AVFMT_FLAG_CUSTOM_IO ;
    
        //fmt_ctx->max_analyze_duration = 2 * AV_TIME_BASE; // read 2 seconds of data
    
        {
    
            AVFormatContext *fmtCtxRaw = fmt_ctx.get();            
    
            if (avformat_open_input(&fmtCtxRaw, "", nullptr, nullptr) < 0) {
    
                std::cerr << "Could not open movie" << std::endl;
    
                return frames;
    
            }
    
        }
    
        if (avformat_find_stream_info(fmt_ctx.get(), nullptr) < 0) {
    
            std::cerr << "Could not find stream information" << std::endl;
    
            return frames;
    
        }
    
        if((video_stream_idx = av_find_best_stream(fmt_ctx.get(), AVMEDIA_TYPE_VIDEO, -1, -1, nullptr, 0)) < 0)
    
        {
    
            std::cerr << "Could not find video stream" << std::endl;
    
            return frames;
    
        }
    
        AVStream *video_stream = fmt_ctx->streams[video_stream_idx];
    
        AVCodec *dec = avcodec_find_decoder(video_stream->codecpar->codec_id);
    

    
        video_dec_ctx = std::unique_ptr (avcodec_alloc_context3(dec),
    
                                                                              avcodec_context_deleter());
    
        if (!video_dec_ctx)
    
        {
    
            std::cerr << "Failed to allocate the video codec context" << std::endl;
    
            return frames;
    
        }
    
        avcodec_parameters_to_context(video_dec_ctx.get(),video_stream->codecpar);
    
        video_dec_ctx->thread_count = 1;
    
       /* video_dec_ctx->max_b_frames = 0;
    
        video_dec_ctx->frame_skip_threshold = 10;*/
    

    
        AVDictionary *opts = nullptr;
    
        av_dict_set(&opts, "refcounted_frames", "1", 0);
    
        av_dict_set(&opts, "deadline", "1", 0);
    
        av_dict_set(&opts, "auto-alt-ref", "0", 0);
    
        av_dict_set(&opts, "lag-in-frames", "1", 0);
    
        av_dict_set(&opts, "rc_lookahead", "1", 0);
    
        av_dict_set(&opts, "drop_frame", "1", 0);
    
        av_dict_set(&opts, "error-resilient", "1", 0);
    

    
        int width = video_dec_ctx->width;
    
        videoHeight = video_dec_ctx->height;
    

    
        if(avcodec_open2(video_dec_ctx.get(), dec, &opts) < 0)
    
        {
    
            std::cerr << "Failed to open the video codec context" << std::endl;
    
            return frames;
    
        }
    

    
        AVPixelFormat  pFormat = AV_PIX_FMT_BGR24;
    
        img_convert_ctx = std::unique_ptr(sws_getContext(width, videoHeight,
    
                                         video_dec_ctx->pix_fmt,   width, videoHeight, pFormat,
    
                                         SWS_BICUBIC, nullptr, nullptr,nullptr),swscontext_deleter());
    

    
        frame = std::unique_ptr(av_frame_alloc(),avframe_deleter());
    
        frameRGB = std::unique_ptr(av_frame_alloc(),avframe_deleter());
    

    

    
        int numBytes = av_image_get_buffer_size(pFormat, width, videoHeight,32 /*https://stackoverflow.com/questions/35678041/what-is-linesize-alignment-meaning*/);
    
        std::unique_ptr imageBuffer((uint8_t *) av_malloc(numBytes*sizeof(uint8_t)),avbuffer_deleter());
    
        av_image_fill_arrays(frameRGB->data,frameRGB->linesize,imageBuffer.get(),pFormat,width,videoHeight,32);
    
        frameRGB->width = width;
    
        frameRGB->height = videoHeight;
    

    
        initializedCodecs = true;
    
    }    
    
    AVPacket pkt;
    
    av_init_packet(&pkt);
    
    pkt.data = nullptr;
    
    pkt.size = 0;
    

    
    int read_frame_return = 0;
    
    while ( (read_frame_return=av_read_frame(fmt_ctx.get(), &pkt)) >= 0)
    
    {
    
        readFrame(&frames,&pkt,video_dec_ctx.get(),frame.get(),img_convert_ctx.get(),
    
                  videoHeight,frameRGB.get());
    
        //if(cancelled) break;
    
    }
    
    avioCtxPtr->eof_reached = 0;
    
    avioCtxPtr->error = 0;
    

    

    
    //flush
    
   // readFrame(frames.get(),nullptr,video_dec_ctx.get(),frame.get(),
    
     //         img_convert_ctx.get(),videoHeight,frameRGB.get());
    

    
    avioCtxPtr->eof_reached = 0;
    
    avioCtxPtr->error = 0;
    

    
    if(frames->size() <= 0)
    
    {
    
        std::cout << "buffer pos: "<code>

    What I would expect to happen would be for a continuous extraction of cv::Mat frames as I feed it more and more data. What actually happens is that after the the buffer is fully read I see :

    [matroska,webm @ 0x507b450] Read error at pos. 1278266 (0x13813a)
    
[matroska,webm @ 0x507b450] Seek to desired resync point failed. Seeking to earliest point available instead.

    And then no more bytes are read from the buffer even if later I increase the size of it.

    There is something terribly wrong I’m doing here and I don’t understand what.

Navigation