Recherche avancée

Sur d’autres sites (6351)

• mpeg-dash live streaming can't fetch chunks

  27 juin 2020, par user1902653

  I'm trying to create a live stream of mpeg-dash with ffmpeg.

  


  I'm streaming with python the frames to the ffmpeg process.

  


  This is the current command I'm using for creating the mpeg-dash manifest and m4s files :

  


  ffmpeg -re -f rawvideo -pix_fmt bgr24 -video_size 640x360 -i - -vcodec libx264 -preset ultrafast -tune zerolatency -f dash -window_size 10 -use_template 1 -use_timeline 0 -live 1 /srv/http/dash/stream.mpd


  


  I'm using nginx as a server for now and I've created a simple index.html using shaka player, but the problem is I couldn't get it to load and play more then the first chunk. (checked with dev-tools in chrome in the network tab)

  


  This is how I'm using shaka player right now :

  


  


  


  &#xA;    &#xA;        <code class="echappe-js">&lt;script src=&quot;https://cdnjs.cloudflare.com/ajax/libs/shaka-player/2.1.4/shaka-player.compiled.js&quot;&gt;&lt;/script&gt;&#xA;        &lt;script&gt;&amp;#xA;            var manifestUri = &amp;#x27;stream.mpd&amp;#x27;;&amp;#xA;            function initApp() {&amp;#xA;                shaka.polyfill.installAll();&amp;#xA;                if (shaka.Player.isBrowserSupported()) {&amp;#xA;                    initPlayer();&amp;#xA;                } else {&amp;#xA;                    console.error(&amp;#x27;Browser not supported!&amp;#x27;);&amp;#xA;                }&amp;#xA;            }&amp;#xA;            function initPlayer() {&amp;#xA;                var video = document.getElementById(&amp;#x27;video&amp;#x27;);&amp;#xA;                var player = new shaka.Player(video);&amp;#xA;                window.player = player;&amp;#xA;                player.addEventListener(&amp;#x27;error&amp;#x27;, onErrorEvent);&amp;#xA;                player.load(manifestUri).then(function() {&amp;#xA;                    console.log(&amp;#x27;The video has now been loaded!&amp;#x27;);&amp;#xA;                }).catch(onError);&amp;#xA;            }&amp;#xA;            function onErrorEvent(event) {&amp;#xA;                onError(event.detail);&amp;#xA;            }&amp;#xA;            function onError(error) {&amp;#xA;                console.error(&amp;#x27;Error code&amp;#x27;, error.code, &amp;#x27;object&amp;#x27;, error);&amp;#xA;            }&amp;#xA;            document.addEventListener(&amp;#x27;DOMContentLoaded&amp;#x27;, initApp);&amp;#xA;        &lt;/script&gt;&#xA;    &#xA;    &#xA;        &#xA;    &#xA;

  


  


  



  For some reason the stream is only playing the first chunk and never requesting for the next chunk. How can I make it load the next chunks ?

  


  When tried using dash.js I couldn't get it to load even the first chunk.

  


  Thanks in advance.

  


• Problem with FFmpeg breaking when streaming the entire screen and switching tabs

  2 octobre 2024, par Ibad Ahmad

  I'm working on a screen recording and streaming setup where the user records their entire screen and streams it to Twitch. The setup works fine initially, but when I switch tabs during recording, the stream breaks on the backend, and I get the following FFmpeg errors :

  


  FFmpeg STDERR: [matroska,webm @ 0x7f9dcb904580] EBML header parsing failed
[in#0 @ 0x7f9dcb904380] Error opening input: Invalid data found when processing input
Error opening input file -.
Error opening input files: Invalid data found when processing input


  


  My frontend code captures the screen and microphone and streams it via a WebSocket to the backend, where FFmpeg processes the stream. Below is my relevant frontend code :

  


  const startRecording = async () => {
    try {
        const screenStream = await navigator.mediaDevices.getDisplayMedia({
            preferCurrentTab: true,
            systemAudio: 'include',
            surfaceSwitching: 'include',
            monitorTypeSurfaces: 'include',
            video: {
                displaySurface: 'browser',
                height: 720,
                width: 1280,
                frameRate: { ideal: 24, max: 30 },
            },
        });

        screenStream.getVideoTracks()[0].onended = () => {
            console.log('Screen sharing ended. Stopping the recorder.');
            stopRecording();
        };

        const micStream = await navigator.mediaDevices.getUserMedia({
            audio: true,
        });

        const combinedStream = new MediaStream([
            ...screenStream.getVideoTracks(),
            ...micStream.getAudioTracks(),
        ]);

        const recorder = new MediaRecorder(combinedStream, {
            mimeType: 'video/webm; codecs=vp8,opus',
            videoBitsPerSecond: 3 * 1024 * 1024,
        });

        const timeslice = 1000;

        recorder.ondataavailable = async (event) => {
            if (socket?.current?.connected && event.data.size > 0) {
                console.log('Sending chunk data:', socket.current.id);
                socket?.current.send(event.data);
                recordedChunks.current.push(event.data);
            } else if (!socket?.current?.connected) {
                handleSocketDisconnection();
            }
        };

        mediaRecorder.current = recorder;
        recorder.start(timeslice);
        setIsRecording(true);
    } catch (error) {
        console.log('Error starting screen recording:', error);
        toast.error('Failed to start screen recording: ' + error);
    }
};

const stopRecording = () => {
    if (socket?.current && mediaRecorder) {
        mediaRecorder?.current?.stop();
        socket.current.close();
        setIsRecording(false);
        downloadRecordedVideo();
    }
};



  


  And here’s my backend code with FFmpeg settings for Twitch streaming :

  


  const inputSettings = [
    '-f', 'webm', '-i', '-', '-v', 'error', '-analyzeduration', '1000000', '-probesize', '5000000',
];

const twitchSettings = (twitch) => {
    return [
        '-c:v', 'libx264', '-preset', 'veryfast', '-tune', 'zerolatency',
        '-g', '60', '-b:v', '2500k', '-maxrate', '3000k', '-bufsize', '8000k',
        '-r', '30', '-vf', 'tpad=stop_mode=clone:stop_duration=2',
        '-c:a', 'aac', '-ar', '44100', '-b:a', '96k',
        '-use_wallclock_as_timestamps', '1', '-async', '1',
        '-err_detect', 'ignore_err', '-reconnect', '1',
        '-reconnect_streamed', '1', '-reconnect_delay_max', '5',
        '-y', '-f', 'flv', twitch,
    ];
};



  


  Problem : When switching tabs during screen sharing, it seems like the frame rate drops or the stream gets interrupted, leading to FFmpeg errors like EBML header parsing failed and Invalid data found when processing input. I suspect this happens because the browser deprioritizes resources when the tab is not active, which might lead to corrupt chunks being sent to FFmpeg.

  


  Questions :

  


  

  1. Could switching tabs during screen capture be causing the issue by disrupting the frame rate or dropping frames ?

  


  2. Is there a way to ensure FFmpeg doesn’t break due to these interruptions ?

  


  3. Any suggestions on handling the stream more reliably when switching tabs or optimizing the FFmpeg setup for this scenario ?

  


  


  I tried adjusting the bitrate, frame rate, and buffer size but still experienced the same issue. I'm trying to figure out if the issue is related to how browsers handle screen capture when tab switching or something specific with FFmpeg handling the video stream.

  


  Any insights would be greatly appreciated.
Thanks in advance !

  


• ffmpeg-static Trimming a merging audio and viddeo having a freeza at the first second

  13 avril 2023, par sol

  I am using FFmpeg-static in my express server to merge audio and video coming from Youtube Readable Stream then Trim. seems ok and working but im getting an error

  


  ffmpeg video input stream error : Error : write EPIPE
ffmpeg audio input stream error : Error : write EPIPE

  


  then the triiming process has a glitch like freeze on the first second of the video output

  


  here is my code

  


  res.setHeader("Content-Disposition", attachment;  filename="${encodeURIComponent(info.videoDetails.title)}.mp4") ;

  


    let ffmpegArgs = [
      '-y', // Overwrite output file without asking
      '-i', 'pipe:3', // Read video stream from pipe 3
      '-i', 'pipe:4',
      '-map', '0:v',
      '-map', '1:a',
      '-c:v', 'copy',
      '-preset', 'ultrafast',
      '-b:v', '5000k',
      '-maxrate', '5000k',
      '-bufsize', '10000k',
      '-c:a', 'libmp3lame',
      '-crf', '18',
      '-preset', 'veryfast',
      '-movflags', 'frag_keyframe+empty_moov',
      '-f', 'mp4',
      '-loglevel', 'error'
  ];

  if (startTime && endTime) {
      ffmpegArgs = ffmpegArgs.concat(['-ss', startTime, '-to', endTime]); // Duration of the trimmed video
  }

  ffmpegArgs.push('-');

  let video = ytdl(url, { filter: 'videoonly', format: selectedFormat , highWaterMark: 1 << 25 })
  let audio = ytdl(url, { filter: 'audioonly', quality: 'highestaudio', highWaterMark: 1 << 25  });
  const ffmpegProcess = cp.spawn(ffmpeg, ffmpegArgs, {
      stdio: ['pipe', 'pipe', 'pipe', 'pipe', 'pipe'],
  });

  video.pipe(ffmpegProcess.stdio[3]); // Video stream to stdin (fd 3)
  audio.pipe(ffmpegProcess.stdio[4]);
      // Output the resulting merged and trimmed video to a file
      ffmpegProcess.stdio[1].pipe(res);

      // Handle the close event of the ffmpeg process
      ffmpegProcess.on('close', (code) => {
          if (code !== 0) {
            console.error(`ffmpeg process exited with code ${code}`);
          } else {
            console.log('ffmpeg process completed successfully');
            downloadedVideos.push({
              title: info.videoDetails.title,
              url: url,
              format: format
            });
          }
        });


  


  to the trim process i tried to move the -ss and -to to different lines but the freeze issue is still there

  


  i did try to add and error handling event but the output error is still the same error : write EPIPE

  


    // Pipe the video and audio streams to the ffmpeg process
          video.on('error', (err) => {
            console.error(`video stream error: ${err}`);
           });
            
          audio.on('error', (err) => {
            console.error(`audio stream error: ${err}`);
          });
            
          ffmpegProcess.stdio[3].on('error', (err)=> {
            console.error(`ffmpeg video input stream error: ${err} `);
          });
            
          ffmpegProcess.stdio[4].on('error', (err) => {
            console.error(`ffmpeg audio input stream error: ${err} `);
          });