Recherche avancée

Sur d’autres sites (4851)

• C++ Realtime OpenGL videogame streaming library

  23 août 2013, par Mufasa

  I need to select a video encoder and library to take raw RGB frames in realtime from a videogame and send them to a remote client. The remote client is sending back mouse events. Right now I have a setup where the server is using glReadPixels to read frame data, then sending information in the form of 16x16 tiles with runlength encoding that have changed since the last read. (The videogame has a lot of solid color areas). My client works to control the game. But the transmission of frames to the client, and mouse events from the client, is too slow. Both use a TCP socket to communicate.

  I'm looking into using ffmpeg or x264 to encode into H.264 video ; do you think this could reduce latency ? I'm on windows and I can't figure out how to set up x264 libraries in Visual Studio, but I have got ffmpeg libraries installed.

  Another name I have heard is live555 but I don't know much about that.

  Do you have any recommendations ?

• How to Drop Duplicated frames that do not appear sequentially ?

  2 octobre 2022, par zgno

  As you might know, mpdecimate only drop frames that is similar to the PREVIOUS frame which means it only deals with sequentially duplicated frames. My problem is that just one same frame is duplicated throughout the whole video, and it is duplicated between frames(in other words, not sequentially,so mpdecimate always treats them as not duplicated) . It's almost like that frame is inserted randomly for a 1000+ times throughout the video. And I use ffmpeg -err_detect ignore_err -i only to find that no errors are detected. This strange situation happens in some hls streaming video. I will provide a small segment of the whole video for anyone who are interested to test.
A 6 seconds video down below, it is a badminton game.
A segment from the m3u8 file list

  


• FFmpeg somehow set the udp speed ?

  19 juin 2018, par potu1304

  I wanted to nearly live stream my Unit game with FFmpeg to a simple client. I have one Unity game in which each frame is saved as an jpg image. These images are wrapped in ffmpeg and send over udp to a simple c# client where I use ffplay to play the stream. The problem is, that FFmpeg is wrapping the images way faster than the unity app can write them. So ffmpeg quits but Unity is still writing frames. Is there a way to set ffmpeg in a loop to wait for the next image or can I somehow make a for loop without call every time ffmpeg ?

  Here is my function from my capturing script in Unity :

  Process process;
  
      //BinaryWriter _stdin;
  
      public void encodeFrame()
  
      {
  
  
  
  
  
          ProcessStartInfo startInfo = new ProcessStartInfo();
  
  
  
          var basePath = Application.streamingAssetsPath + "/FFmpegOut/Windows/ffmpeg.exe";
  
  
  
  
  
          info.Arguments = "-re -i screen_%d.jpg -vcodec libx264 -r 24 -f mpegts udp://127.0.0.1:1100";
  
          info.RedirectStandardOutput = true;
  
          info.RedirectStandardInput = true;
  
          info.RedirectStandardError = true;
  
          info.CreateNoWindow = true;
  
          info.UseShellExecute = false;
  
          info.RedirectStandardError = true;
  
          UnityEngine.Debug.Log(string.Format(
  
              "Executing \"{0}\" with arguments \"{1}\".\r\n",
  
              info.FileName,
  
              info.Arguments));
  
          process = Process.Start(info);
  
          //_stdin = new BinaryWriter(process.StandardInput.BaseStream);
  
          process.WaitForExit();
  
          var outputReader = process.StandardError;
  
          string Error = outputReader.ReadToEnd();
  
          UnityEngine.Debug.Log(Error);
  
  
  
  }

  And here the function from my cs file from my simple windowsform application :

  private void xxxFFplay()
  
  {
  
      text = "start";
  
      byte[] send_buffer = Encoding.ASCII.GetBytes(text);
  
      sock.SendTo(send_buffer, endPoint);
  
      ffplay.StartInfo.FileName = "ffplay.exe";
  
      ffplay.StartInfo.Arguments = "udp://127.0.0.1:1100";
  
      ffplay.StartInfo.CreateNoWindow = true;
  
      ffplay.StartInfo.RedirectStandardOutput = true;
  
      ffplay.StartInfo.UseShellExecute = false;
  
  
  
      ffplay.EnableRaisingEvents = true;
  
      ffplay.OutputDataReceived += (o, e) => Debug.WriteLine(e.Data ?? "NULL", "ffplay");
  
      ffplay.ErrorDataReceived += (o, e) => Debug.WriteLine(e.Data ?? "NULL", "ffplay");
  
      ffplay.Exited += (o, e) => Debug.WriteLine("Exited", "ffplay");
  
      ffplay.Start();
  
  
  
      Thread.Sleep(500); // you need to wait/check the process started, then...
  
  
  
      // child, new parent
  
      // make 'this' the parent of ffmpeg (presuming you are in scope of a Form or Control)
  
      //SetParent(ffplay.MainWindowHandle, this.panel1.Handle);
  
  
  
      // window, x, y, width, height, repaint
  
      // move the ffplayer window to the top-left corner and set the size to 320x280
  
      //MoveWindow(ffplay.MainWindowHandle, -5, -300, 320, 280, true);
  
  
  
  }

  Does have somebody some ideas ? I am really stuck at this to create a somehow "live" stream.

  Best regards