Recherche avancée

Sur d’autres sites (11384)

• Streaming android to windows

  13 juin 2017, par iYehuda

  I’m writing an app that enables controlling android devices from windows machines.
  Major part of controlling the device is viewing it’s screen. Currently, my android app (Java code) captures the screen on a fixed rate, compresses it (JPEG) and sends it, while the windows side (C# code) receives buffers of data, each for frame, decompresses them and displays the last decompressed frame.

  Two issues came up from this solution :

  1. Compression of a single image takes 0.3 seconds, which limits me to low FPS streaming with single thread for compressing. I made a thread pool for compressing captured frames, and it damages the app performance.

  2. The compression is not optimal. The screen can be idle for a while and a continuous transmission of the same frame would be done. Usage of streaming/encoding format would be handful and can ease the network traffic.

  I searched for encoding APIs such as MediaCodec and third party libraries such as ffmpeg. All those libraries encode videos and write them to files (maybe I misunderstood them ?).

  What API can I use for streaming my screen and follow these requirements :

  • Fast encoding / non blocking API
  • Outputs raw binary data for each frame. The data must be sent immediately
  • Can be embedded into my existing applicative protocol (protocol buffers based)
  • Available on C# (Windows) and Java or C++ (Android)

• What is the best way to merge .mkv and .mka files using ffmpeg ?

  28 juin 2017, par Robert

  I’m using ffmpeg to merge .mkv and .mka files into .mp4 files. My current command looks like this :

  ffmpeg -i video.mkv -i audio.mka output_path.mp4

  The audio and video files are pre-signed urls from Amazon S3. Even on a server with sufficient resources, this process is going very slowly. I’ve researched situations where you can tell ffmpeg to skip re-encoding each frame, but I think that in my situation it actually does need to re-encode each frame.

  I’ve downloaded 2 sample files to my macbook pro and have installed ffmpeg locally via homebrew. When I run the command

  ffmpeg -i video.mkv -i audio.mka -c copy output.mp4

  I get the following output :

  ffmpeg version 3.3.2 Copyright (c) 2000-2017 the FFmpeg developers
  
    built with Apple LLVM version 8.1.0 (clang-802.0.42)
  
    configuration: --prefix=/usr/local/Cellar/ffmpeg/3.3.2 --enable-shared --enable-pthreads --enable-gpl --enable-version3 --enable-hardcoded-tables --enable-avresample --cc=clang --host-cflags= --host-ldflags= --enable-libmp3lame --enable-libx264 --enable-libxvid --enable-opencl --disable-lzma --enable-vda
  
    libavutil      55. 58.100 / 55. 58.100
  
    libavcodec     57. 89.100 / 57. 89.100
  
    libavformat    57. 71.100 / 57. 71.100
  
    libavdevice    57.  6.100 / 57.  6.100
  
    libavfilter     6. 82.100 /  6. 82.100
  
    libavresample   3.  5.  0 /  3.  5.  0
  
    libswscale      4.  6.100 /  4.  6.100
  
    libswresample   2.  7.100 /  2.  7.100
  
    libpostproc    54.  5.100 / 54.  5.100
  
  Input #0, matroska,webm, from '319_audio_1498590673766.mka':
  
    Metadata:
  
      encoder         : GStreamer matroskamux version 1.8.1.1
  
      creation_time   : 2017-06-27T19:10:58.000000Z
  
    Duration: 00:00:03.53, start: 2.831000, bitrate: 50 kb/s
  
      Stream #0:0(eng): Audio: opus, 48000 Hz, stereo, fltp (default)
  
      Metadata:
  
        title           : Audio
  
  Input #1, matroska,webm, from '319_video_1498590673766.mkv':
  
    Metadata:
  
      encoder         : GStreamer matroskamux version 1.8.1.1
  
      creation_time   : 2017-06-27T19:10:58.000000Z
  
    Duration: 00:00:03.97, start: 2.851000, bitrate: 224 kb/s
  
      Stream #1:0(eng): Video: vp8, yuv420p(progressive), 640x480, SAR 1:1 DAR 4:3, 30 tbr, 1k tbn, 1k tbc (default)
  
      Metadata:
  
        title           : Video
  
  [mp4 @ 0x7fa4f0806800] Could not find tag for codec vp8 in stream #0, codec not currently supported in container
  
  Could not write header for output file #0 (incorrect codec parameters ?): Invalid argument
  
  Stream mapping:
  
    Stream #1:0 -> #0:0 (copy)
  
    Stream #0:0 -> #0:1 (copy)
  
      Last message repeated 1 times

  So it appears that the specific encodings I’m working with are vp8 videos and opus audio files, which I believe are incompatible with the .mp4 output container. I would appreciate answers that cover ways of optimally merging vp8 and opus into .mp4 output or answers that point me in the direction of output media formats that are both compatible with vp8 & opus and are playable on web and mobile devices so that I can bypass the re-encoding step altogether.

  EDIT :

  Just wanted to provide a benchmark after following LordNeckbeard’s advice :

  4 min 41 second video transcoded locally on my mac
  
  
  
  LordNeckbeard’s approach : 15 mins 55 seconds (955 seconds)
  
  Current approach : 18 mins 49 seconds (1129 seconds)
  
  
  
  18% speed increase

• How can I mux a MKV and MKA file and get it to play in a browser ?

  28 juin 2017, par Robert

  I’m using ffmpeg to merge .mkv and .mka files into .mp4 files. My current command looks like this :

  ffmpeg -i video.mkv -i audio.mka output_path.mp4

  The audio and video files are pre-signed urls from Amazon S3. Even on a server with sufficient resources, this process is going very slowly. I’ve researched situations where you can tell ffmpeg to skip re-encoding each frame, but I think that in my situation it actually does need to re-encode each frame.

  I’ve downloaded 2 sample files to my macbook pro and have installed ffmpeg locally via homebrew. When I run the command

  ffmpeg -i video.mkv -i audio.mka -c copy output.mp4

  I get the following output :

  ffmpeg version 3.3.2 Copyright (c) 2000-2017 the FFmpeg developers
  
    built with Apple LLVM version 8.1.0 (clang-802.0.42)
  
    configuration: --prefix=/usr/local/Cellar/ffmpeg/3.3.2 --enable-shared --enable-pthreads --enable-gpl --enable-version3 --enable-hardcoded-tables --enable-avresample --cc=clang --host-cflags= --host-ldflags= --enable-libmp3lame --enable-libx264 --enable-libxvid --enable-opencl --disable-lzma --enable-vda
  
    libavutil      55. 58.100 / 55. 58.100
  
    libavcodec     57. 89.100 / 57. 89.100
  
    libavformat    57. 71.100 / 57. 71.100
  
    libavdevice    57.  6.100 / 57.  6.100
  
    libavfilter     6. 82.100 /  6. 82.100
  
    libavresample   3.  5.  0 /  3.  5.  0
  
    libswscale      4.  6.100 /  4.  6.100
  
    libswresample   2.  7.100 /  2.  7.100
  
    libpostproc    54.  5.100 / 54.  5.100
  
  Input #0, matroska,webm, from '319_audio_1498590673766.mka':
  
    Metadata:
  
      encoder         : GStreamer matroskamux version 1.8.1.1
  
      creation_time   : 2017-06-27T19:10:58.000000Z
  
    Duration: 00:00:03.53, start: 2.831000, bitrate: 50 kb/s
  
      Stream #0:0(eng): Audio: opus, 48000 Hz, stereo, fltp (default)
  
      Metadata:
  
        title           : Audio
  
  Input #1, matroska,webm, from '319_video_1498590673766.mkv':
  
    Metadata:
  
      encoder         : GStreamer matroskamux version 1.8.1.1
  
      creation_time   : 2017-06-27T19:10:58.000000Z
  
    Duration: 00:00:03.97, start: 2.851000, bitrate: 224 kb/s
  
      Stream #1:0(eng): Video: vp8, yuv420p(progressive), 640x480, SAR 1:1 DAR 4:3, 30 tbr, 1k tbn, 1k tbc (default)
  
      Metadata:
  
        title           : Video
  
  [mp4 @ 0x7fa4f0806800] Could not find tag for codec vp8 in stream #0, codec not currently supported in container
  
  Could not write header for output file #0 (incorrect codec parameters ?): Invalid argument
  
  Stream mapping:
  
    Stream #1:0 -> #0:0 (copy)
  
    Stream #0:0 -> #0:1 (copy)
  
      Last message repeated 1 times

  So it appears that the specific encodings I’m working with are vp8 videos and opus audio files, which I believe are incompatible with the .mp4 output container. I would appreciate answers that cover ways of optimally merging vp8 and opus into .mp4 output or answers that point me in the direction of output media formats that are both compatible with vp8 & opus and are playable on web and mobile devices so that I can bypass the re-encoding step altogether.

  EDIT :

  Just wanted to provide a benchmark after following LordNeckbeard’s advice :

  4 min 41 second video transcoded locally on my mac
  
  
  
  LordNeckbeard’s approach : 15 mins 55 seconds (955 seconds)
  
  Current approach : 18 mins 49 seconds (1129 seconds)
  
  
  
  18% speed increase