Recherche avancée

Sur d’autres sites (7969)

• Revision 8ef6dadbbe : test-data.mk : fix perf test data dependency both the encode and decode perf tes

  27 février 2015, par James Zern

  Changed Paths :
   Modify /test/test-data.mk

  
  
  test-data.mk : fix perf test data dependency

  both the encode and decode perf tests require niklas_1280_720_30.yuv
  broken since :
  28eebf3 Merge "tests : add a shorter 720p test clip"
  7839d03 tests : add a shorter 720p test clip

  Change-Id : I51ebbf7261832e25d8f2c1da5c7df5c2e47f748e

• Socket code Python code at the end influences code in the beginning

  21 décembre 2019, par Samy Smart

  So basically i am trying to do the following things : Client sends project file, Server receives Project file, Server generates Video file, Server sends video File, Client receives Video File. Everything works up until sending the Video back. The Thing is when i include my code for sending the Video, not even the Things that worked before work anymore.
  The commented code in the code is the code that should send the Video back

  Client :

  import socket
  
  
  
  s = socket.socket()
  
  ip = socket.gethostname()
  
  file = "testae.aep"
  
  s.connect((ip, 1234))
  
  
  
  f = open(file, "rb")
  
  txt = f.read(1024)
  
  while txt:
  
      s.send(txt)
  
      print(f"Sending... {txt}")
  
      txt = f.read(1024)
  
  f.close()
  
  #f2 = open("final_output.mp4", "wb")
  
  #txt2 = s.recv(1024)
  
  #while txt2:
  
  #    f2.write(txt2)
  
  #    txt2 = s.recv(1024)
  
  #f2.close()
  
  print("received final output")
  
  s.close()

  Server :

  import os
  
  import socket
  
  
  
  s = socket.socket(socket.AF_INET, socket.SOCK_STREAM)
  
  s.bind((socket.gethostname(), 1234))
  
  counter = 0
  
  s.listen(5)
  
  aerpath = "C:/aerender.lnk"
  
  ffmpegpath = '"C:/Program Files/ffmpeg/bin/ffmpeg.exe"'
  
  
  
  while True:
  
      c, addr = s.accept()
  
      print("Client Connected")
  
      print(addr)
  
      f = open(f"ae_render_file{counter}.aep", "wb")
  
      txt = c.recv(1024)
  
      while txt:
  
          f.write(txt)
  
          print(f"Receiving... {txt}")
  
          txt = c.recv(1024)
  
      print("Out of WHILE")
  
      f.close()
  
      print("received file")
  
      os.system(aerpath + " -project " + f"C:/Users/weilu/PycharmProjects/localAERF/ae_render_file{counter}.aep "
  
                + '-comp "Comp 1" ' + f"-output C:/Users/weilu/PycharmProjects/localAERF/output/output{counter}")
  
      os.system(ffmpegpath + " -i " + f"output/output{counter}.avi -f mp4 -vcodec libx264 -preset slow -profile:v main "
  
                                      f"-pix_fmt yuv420p -acodec aac -hide_banner output/outputr{counter}.mp4")
  
      #f2 = open(f"output/outputr{counter}.mp4","rb")
  
      #txt2 = f2.read(1024)
  
      #while txt2:
  
      #    c.send(txt2)
  
      #    print("Sending...")
  
      #    txt2 = f.read(1024)
  
      #f2.close()
  
      c.close()
  
      counter += 1

• How to send encoded video (or audio) data from server to client in a way that's decodable by webcodecs API using minimal latency and data overhead

  11 janvier 2023, par Tiger Yang

  My question (read entire post for context) :

  


  Given the unique circumstance of only ever decoding data from a specifically-configured encoder, what is the best way I can send the encoded bitstream along with the bare minimum extra bytes required to properly configure the decoder on the client's end (including only things that change per stream, and omitting things that don't, such as resolution) ? I'm a sucker for zero compromises, and I think I am willing to design my own minimal container format to accomplish this.

  


  Context and problem :

  


  I'm working on a remote desktop implementation that consists of a server that captures and encodes the display and speakers using FFmpeg and forwards it via pipe to a go (language) program which sends it on two unidirectional webtransport streams to my client, which I plan to decode using the webcodecs API. According to MDN, the video decoder needs to be fed via .configure() an object containing the following : https://developer.mozilla.org/en-US/docs/Web/API/VideoDecoder/configure before it's able to decode anything.

  


  same goes for the audio decoder : https://developer.mozilla.org/en-US/docs/Web/API/AudioDecoder/configure

  


  What I've tried so far :

  


  Because this remote desktop will be for my personal use only, it would only ever receive streams from a specific encoder configured in a specific way encoding video at a specific resolution, framerate, color space, etc.. Therefore, I took my video capture FFmpeg command...

  


  videoString := []string{
        "ffmpeg",
        "-init_hw_device", "d3d11va",
        "-filter_complex", "ddagrab=video_size=1920x1080:framerate=60",
        "-vcodec", "hevc_nvenc",
        "-tune", "ll",
        "-preset", "p7",
        "-spatial_aq", "1",
        "-temporal_aq", "1",
        "-forced-idr", "1",
        "-rc", "cbr",
        "-b:v", "500K",
        "-no-scenecut", "1",
        "-g", "216000",
        "-f", "hevc", "-",
    }


  


  ...and instructed it to write to an mp4 file instead of outputting to pipe, and then I had this webcodecs demo https://w3c.github.io/webcodecs/samples/video-decode-display/ demux it using mp4box.js. Knowing that the demo outputs a proper .configure() object, I blindly copied it and had my client configure using that every time. Sadly, it didn't work, and I since noticed that the "description" part of the configure object changes despite the encoder and parameters being the same.

  


  I knew that mp4 files worked via mp4box, but they can't be streamed with low latency over a network, and additionally, ffmpeg's -f parameters specifies the muxer to use, but there are so many different types.

  


  At this point, I think I'm completely out of my depth, so :

  


  Given the unique circumstance of only ever decoding data from a specifically-configured encoder, what is the best way I can send the encoded bitstream along with the bare minimum extra bytes required to properly configure the decoder on the client's end (including only things that change per stream, and omitting things that don't, such as resolution) ? I'm a sucker for zero compromises, and I think I am willing to design my own minimal container format to accomplish this. (copied above)