Recherche avancée

Sur d’autres sites (31671)

• Video ahead of audio. Javascript MediaSource

  8 novembre 2022, par Robertzzel

  I am trying to build a real-time streaming app using websockets and ffmpeg.

  


  I have 2 processes on the host machine for capturing video(screen) and audio(microphone) every second. Those 2 files (1 file for a second of audio and 1 file for a second of video) are combined into one mp4 file using ffmpeg.

  


  ffmpeg -y -i video.mkv -i audio.wav -map 0:v -map 1:a -c:v libx264 -tune zerolatency -preset ultrafast -shortest -movflags frag_keyframe+empty_moov+default_base_moof -r 25 -g 50 -pass 1 -f mp4 -b:v 2M pipe:1


  


  This file is sent to the client machine using a websocket.
On the web part I initialize a MediaSource object with a sourceBuffer.

  


  videoSourceBuffer = mediaSource.addSourceBuffer('video/mp4; codecs="avc1.4D0033, mp4a.40.2"');


  


  But I had a problem. Both audio and video were lagging behind. When I started the stream the delay was about 2 seconds. After 2 minutes the delay was 10 seconds.
I managed to see how many buffered frames I had in the sourceBuffer and speed up the stream to keep up with the source using this piece of code from How can I find remaing frames in a MediaSource SourceBuffer ?.

  


  let getBufferedLength = () => videoSourceBuffer.buffered.end(0) - videoElement.currentTime;


  


  Now the video stream has always a delay about 1.5 seconds but the audio lags behind.

  


  I cannot find a way to access how many audio frames are buffered or something so I can sync both the audio and video

  


• A.R Drone 2.0 Video Streaming Latency

  22 mars 2020, par Danny

  I am working on video streaming with the AR Drone 2.0 using different codes I have found on the internet.
  I’ve attempted ffplay tcp://192.168.1.1:5555 to video stream from the AR Drone 2.0 ; however, the delay is way too high.

  My second attempt was with the following :

  var arDrone = require('ar-drone');
  
  var http    = require('http');
  
  
  
  console.log('Connecting png stream ...');
  
  
  
  var pngStream = arDrone.createClient().getPngStream();
  
  
  
  var lastPng;
  
  pngStream
  
    .on('error', console.log)
  
    .on('data', function(pngBuffer) {
  
      lastPng = pngBuffer;
  
    });
  
  
  
  var server = http.createServer(function(req, res) {
  
    if (!lastPng) {
  
      res.writeHead(503);
  
      res.end('Did not receive any png data yet.');
  
      return;
  
    }
  
  
  
    res.writeHead(200, {'Content-Type': 'image/png'});
  
    res.end(lastPng);
  
  });
  
  
  
  server.listen(8080, function() {
  
    console.log('Serving latest png on port 8080 ...');
  
  });

  This only streamed images. I had to refresh browser every second.

  My third option was using this option :

  var arDrone=require('ar-drone')
  
  var client= arDrone.createclient();
  
  require('ar-drone-png-stream')(client,{port:8000})

  It streamed a lot of images in a short amount of time. The delay is still significant and I’m looking for a video.

  Are there other approaches that will significantly lower the delay of the video stream ?

• Merge commit ’5b1409c75563b4a3aca113c34d09e3b5442de47f’

  21 juin 2016, par Clément Bœsch

  Merge commit ’5b1409c75563b4a3aca113c34d09e3b5442de47f’
  * commit ’5b1409c75563b4a3aca113c34d09e3b5442de47f’ :
  
    fate : Add test for MSS1
  Test was already present, see 849e55e58ecc6815e8bd326ac18dda748db48682.
  The merge removes the audio decoding present in our version and
  
  simplifies the rules.
  Merged-by : Clément Bœsch <clement@stupeflix.com>
  

  • [DH] tests/fate/microsoft.mak
  • [DH] tests/ref/fate/mss1-pal