Recherche avancée

Sur d’autres sites (5101)

• .NET Process - Redirect stdin and stdout without causing deadlock

  21 juillet 2017, par user1150856

  I’m trying to encode a video file with FFmpeg from frames generated by my program and then redirect the output of FFmpeg back to my program to avoid having an intermediate video file.

  However, I’ve run into what seems to be a rather common problem when redirecting outputs in System.Diagnostic.Process, mentioned in the remarks of the documentation here, which is that it causes a deadlock if run synchronously.

  After tearing my hair out over this for a day, and trying several proposed solutions found online, I still cannot find a way to make it work. I get some data out, but the process always freezes before it finishes.

  ---

  Here is a code snippet that produces said problem :

  static void Main(string[] args)
  
      {
  
  
  
          Process proc = new Process();
  
  
  
          proc.StartInfo.FileName = @"ffmpeg.exe";
  
          proc.StartInfo.Arguments = String.Format("-f rawvideo -vcodec rawvideo -s {0}x{1} -pix_fmt rgb24 -r {2} -i - -an -codec:v libx264 -preset veryfast -f mp4 -movflags frag_keyframe+empty_moov -",
  
              16, 9, 30);
  
          proc.StartInfo.UseShellExecute = false;
  
          proc.StartInfo.RedirectStandardInput = true;
  
          proc.StartInfo.RedirectStandardOutput = true;
  
  
  
          FileStream fs = new FileStream(@"out.mp4", FileMode.Create, FileAccess.Write);
  
  
  
          //read output asynchronously
  
          using (AutoResetEvent outputWaitHandle = new AutoResetEvent(false))
  
          {
  
              proc.OutputDataReceived += (sender, e) =>
  
              {
  
                  if (e.Data == null)
  
                  {
  
                      outputWaitHandle.Set();
  
                  }
  
                  else
  
                  {
  
                      string str = e.Data;
  
                      byte[] bytes = new byte[str.Length * sizeof(char)];
  
                      System.Buffer.BlockCopy(str.ToCharArray(), 0, bytes, 0, bytes.Length);
  
                      fs.Write(bytes, 0, bytes.Length);
  
                  }
  
              };
  
          }
  
  
  
  
  
          proc.Start();
  
          proc.BeginOutputReadLine();
  
  
  
          //Generate frames and write to stdin
  
          for (int i = 0; i < 30*60*60; i++)
  
          {
  
              byte[] myArray = Enumerable.Repeat((byte)Math.Min(i,255), 9*16*3).ToArray();
  
              proc.StandardInput.BaseStream.Write(myArray, 0, myArray.Length);
  
          }
  
  
  
          proc.WaitForExit();
  
          fs.Close();
  
          Console.WriteLine("Done!");
  
          Console.ReadKey();
  
  
  
      }

  Currently i’m trying to write the output to a file anyway for debugging purposes, but this is not how the data will eventually be used.

  If anyone knows a solution it would be very much appreciated.

• Interesting behavior in Media Source Extensions

  28 mai 2020, par newtonian_fig

  I'm trying to build a fairly standard video player using Media Source Extensions ; however, I want the user to be able to control when the player moves on to a new video segment. For example, we might see the following behavior :

  



  

  1. Video player plays 1st segment

  


  2. Source Buffer runs out of data causing the video to appear paused

  


  3. When the user is ready, they click a button that adds the 2nd segment to the Source Buffer

  


  4. The video continues by playing the 2nd segment

  


  



  This works well, except that when the video appears paused during step 2 it doesn't stop at the last frame of the 1st segment. Instead, it stops two frames before the end of the 1st segment. Those last two frames aren't being dropped, they just get played after the user clicks the button to advance the video. This is an issue for my application, and I'm trying to figure out a way to make sure all of the frames from the 1st segment get played before the end of step 2.

  



  I suspect that these last two frames are getting held up in the video decoder buffer. Especially since calling endOfStream() on my Media Source after adding the 1st segment to the Source Buffer causes the 1st segment to play all the way through with no frames left behind.

  



  Additional Info

  



  

  • I created each video segment file from a series of PNGs using the following ffmpeg command

  


  



  ffmpeg -i %04d.png -movflags frag_keyframe+empty_moov+default_base_moof video_segment.mp4

  



  

  • Maybe this is a clue ? End of stream situations not handled correctly (last frames are dropped)

  


  • Another interesting thing to note is that if the video only has 2 frames or less, MSE doesn't play it at all.

  


  • The browser I'm using is Chrome. The code for my MSE player is just taken from the Google Developers example, but I'll post it here for completeness. This code only covers up to step 2 since that's where the issue is.

  


  



  <code class="echappe-js">&lt;script&gt;&amp;#xA;const mediaSource = new MediaSource();&amp;#xA;video.src = URL.createObjectURL(mediaSource);&amp;#xA;mediaSource.addEventListener(&amp;#x27;sourceopen&amp;#x27;, sourceOpen, { once: true });&amp;#xA;&amp;#xA;function sourceOpen() {&amp;#xA;  URL.revokeObjectURL(video.src);&amp;#xA;  const sourceBuffer = mediaSource.addSourceBuffer(&amp;#x27;video/mp4; codecs=&quot;avc1.64001f&quot;&amp;#x27;);&amp;#xA;  sourceBuffer.mode = &amp;#x27;sequence&amp;#x27;;&amp;#xA;&amp;#xA;  // Fetch the video and add it to the Source Buffer&amp;#xA;  fetch(&amp;#x27;https://s3.amazonaws.com/bucket_name/video_file.mp4&amp;#x27;)&amp;#xA;  .then(response =&gt; response.arrayBuffer())&amp;#xA;  .then(data =&gt; sourceBuffer.appendBuffer(data));&amp;#xA;}&amp;#xA;&amp;#xA;&lt;/code&gt;&lt;/pre&gt;&amp;#xA;

• ffmpeg, live MPEG-TS demux & decode

  8 mai 2017, par NadavRub

  Environment

  • Ubuntu-14
  • C++
  • ffmpeg

  Use-case

  • Live SPTS is received via UDP by a 3rd party module
  • TS Packets are received iteratively
  • The TS Video (ES) should be decoded in minimal latency

  Considered Implementation

  • Upon TS packet reception, immediately push it to the TS demux
  • Once enough packets are received the video format is resolvable, create the video codec
  • Push each video packet into the video decoder
  • Once enough video packets were processed the video codec result a valid output frame

  Problem at-hand

  Can this be done w/ ffmpeg ?!?!, … using “avformat_open_input” mandate a file to read from… I need a way where I can iteratively push packets to the TS demuxer ( w/ minimal latency )…

  Does ffmpeg support the above mentioned use-case ? How ?