Recherche avancée

Sur d’autres sites (8251)

• Save video to disk from WebRTC MediaStream in Node

  27 novembre 2020, par SAGBO Aimé

  I'm building an app where the user can connect to the server through a WebRTC (I'm using simple-peer library both server-side and client-side to set the peer-to-peer connection).
Once the client and the server are connected, the client app stream the user camera and micro to the server.

  


  Now, I want to save the streamed data to the filesystem server-side as an MP4 video file.

  


  I hear about ffmpeg and fluent-ffmpeg to achieve this but i don't know how to use them.

  


  

  • Server side code to set up the peer connection

  


  


  const Peer = require("simple-peer");
const wrtc = require("wrtc");

const peer = new Peer({ initiator: false, wrtc: wrtc, trickle: false });

peer.on("error", (err: any) => console.log("error", err));

  peer.on("signal", (data: any) => {
    if (data.type === "offer" || data.type === "answer")
      dispatchMessage(JSON.stringify(data));
    // if (data.renegotiate || data.transceiverRequest) return;
  });

  peer.on("connect", () => {
    console.log("CONNECTED");
    peer.send(JSON.stringify("HELLO DEER PEER FROM SERVER"));
  });

  peer.on("data", (data: any) => {
    console.log("data: ", data);
  });

  peer.on("stream", (stream: MediaStream) => {
    console.log("-------Stream received", stream);
  });

  peer.on("track", (track: MediaStreamTrack) => {
    console.log("-------trackEvent:", track);
  });


  


  

  • Client-side code

  


  


  const stream = await window.navigator.mediaDevices.getUserMedia({
    video: { width: { ideal: 4096 }, height: { ideal: 2160 }},
    audio: true,
});

const p = new SimplePeer({
    initiator: isInitiator,  
    trickle: false  
});

stream.getTracks().forEach(track => p.addTrack(
    track,  
    stream  
));

// Here I set up the listeners for the peer connection


  


• FFMPEG save last 10 sec before a movement and next 30secs

  2 novembre 2020, par Set1ish

  I have a surveillance camera that process frame by frame live video. In case of movement, I want to save a video containing the last 10 seconds before the movement and next 30 seconds after the movement.
I beleve (may be I'm wrong), that last 10 second + next 30seconds task, should be obtained without decoding-rencoding process.

  


  I try to use python with fmmpeg pipes, creating a reader and a writer, but the reader seams too slow for the stream and I loose some packets (= loose on video quality for saved file).

  


  Here my code

  


  import ffmpeg
import numpy as np

width = 1280
height = 720


process1 = (
    ffmpeg
    .input('rtsp://.....',rtsp_transport='udp', r='10', t="00:00:30")
    .output('pipe:', format='rawvideo', pix_fmt='yuv420p')
    .run_async(pipe_stdout=True)
)

process2 = (
    ffmpeg
    .input('pipe:', format='rawvideo', pix_fmt='yuv420p', s='{}x{}'.format(width, height))
    .output("prova-02-11-2020.avi", pix_fmt='yuv420p',r='10')
    .overwrite_output()
    .run_async(pipe_stdin=True)
)
while True:
    in_bytes = process1.stdout.read(width * height * 3)
    if not in_bytes:
        break
    in_frame = (
        np
        .frombuffer(in_bytes, np.uint8)
        )

    #In future I will save in_frame in a queue
    out_frame = in_frame
   
    process2.stdin.write(
        out_frame
        .astype(np.uint8)
        .tobytes()
    )

process2.stdin.close()
process1.wait()
process2.wait()


  


  If I run

  


  ffmpeg -i rtsp://... -acodec copy -vcodec copy -t "00:00:30" out.avi


  


  It look that decode-rencode process is done in quick/smart way without loosing any packet.
My dream is to make the same on python for the surveillance camera but intergrating with code that analyse the stream.

  


  I would like that the flow for creating the file, does not requires decoding + enconding. The last 10secs frames are in a queue and, at specific event, the contenet of queue plus next 30secs frames are saved into a avi file

  


  I have the constraints to have realtime motion detection on live streaming

  


  Did you have any comments or suggestion ?

  


• Save live video stream .m3u8 to MP4. Video freezes for a few seconds

  11 octobre 2020, par Frodo Baggins

  I am trying to save in MP4 an .m3u8 live stream using FFMPEG.

  


  The version in use is the following : $ ffmpeg -v
ffmpeg version 3.4.8-0ubuntu0.2 Copyright (c) 2000-2020 the FFmpeg developers built with gcc 7 (Ubuntu 7.5.0-3ubuntu1 18.04)

  


  While the command used for saving the stream in MP4 is the the one below :

  


  ffmpeg -y -i https://stream.m3u8 —map 0 —vcodec copy -acodec copy / output.mp4

  


  The file can be successfully opened and played with VLC even though every 3-5 seconds I see that the video freezes every few seconds.

  


  I wonder if it's something that I am missing in the above command.

  


  I also verified whether the issue was related to the connection in use but it does not seem related.