Recherche avancée

Sur d’autres sites (10323)

• How to improve Desktop capture performance and quality with ffmpeg [closed]

  6 novembre 2024, par Francesco Bramato

  I'm developing a game capture feature from my Electron app. I'm working on this since a while and tried a lot of different parameters combinations, now i'm running out of ideas :)

  


  I've read tons of ffmpeg documentation, SO posts, other sites, but i'm not really a ffmpeg expert or video editing pro.

  


  This is how it works now :

  


  The app spawn an ffmpeg command based on user's settings :

  


  

  • Output format (mp4, mkv, avi)

  


  • Framerate (12, 24, 30, 60)

  


  • Codec (X264, NVidia NVENC, AMD AMF)

  


  • Bitrate (from 1000 to 10000kpbs)

  


  • Presets (for X264)

  


  • Audio output (a dshow device like StereoMix or VB-Cable) and Audio input (a dshow device like the Microphone)

  


  • Final Resolution (720p, 1080p, 2K, Original Size)

  


  


  The command executed, as far, is :

  


  ffmpeg.exe -nostats -hide_banner -hwaccel cuda -hwaccel_output_format cuda -f gdigrab -draw_mouse 0 -framerate 60 -offset_x 0 -offset_y 0 -video_size 2560x1440 -i desktop -f dshow -i audio=@device_cm_{33D9A762-90C8-11D0-BD43-00A0C911CE86}\wave_{D61FA53D-FA37-4BE7-BE2F-4005F94790BB} -ar 44100 -colorspace bt709 -color_trc bt709 -color_primaries bt709 -c:v h264_nvenc -b:v 6000k -preset slow -rc cbr -profile:v high -g 60 -acodec aac -maxrate 6000k -bufsize 12000k -pix_fmt yuv420p -f mpegts -


  


  one of the settings is the recording mode : full game session or replay buffer.
In case of full game session, the output is a file, for replay buffer is stdout.

  


  The output format is mpegts because, as far i have read in a lot of places, the video stream can be cut in any moment.

  


  Replays are cutted with different past and future duration based on game events.

  


  In full game session, the replays are cutted directly from the mpegts.

  


  In replay buffer mode, the ffmpeg stdout is redirect to the app that record the buffer (1 or 2 minutes), when the replay must be created, the app saves on the disk the buffer section according to past and future duration and with another ffmpeg command, copy it to a mp4 or mkv final file.

  


  Generally speaking, this works reliably.

  


  There are few issues :

  


  

  • nonetheless i ask ffmpeg to capture at 60fps, the final result is at 30fps (using -r 60 will speed up the final result)

  


  • some user has reported FPS drops in-game, specially when using NVidia NVENC (and having a NVIDIA GPU), using X264 seems save some FPS

  


  • colors are strange compared to original, what i see on screen, they seem washed out - i could have solved this using -colorspace bt709 -color_trc bt709 -color_primaries bt709 but don't know if is the right choice

  


  • NVIDIA NVenc with any other preset that is not slow creates videos terribly laggy

  


  


  here two examples, 60 FPS, NVIDIA NVENC (slow, 6000kbs, MP4

  


  Recorded by my app : https://www.youtube.com/watch?v=Msm62IwHdlk

  


  Recorded by OB with nearly same settings : https://youtu.be/WuHoLh26W7E

  


  Hope someone can help me

  


  Thanks !

  


• C++ ffmpeg video missing frames and won't play in Quicktime

  5 décembre 2019, par Oliver Dain

  I wrote some C++ code that uses ffmpeg to encode a video. I’m having two strange issues :

  1. The final video is always missing 1 frame. That is, if I have it encode 10 frames the final video only has 9 (at least that’s what ffprobe -show_frames -pretty $VIDEO | grep -F '[FRAME]' | wc -l tells me.
  2. The final video plays fine in some players (mpv and vlc) but not in Quicktime. Quicktime just shows a completely black screen.

  My code is roughly this (modified a bit to remove types that are unique to our code base) :

  First, I open the video file, write the headers and initialize things :

  template <class ptrt="ptrt">
  
  using UniquePtrWithDeleteFunction = std::unique_ptr>;
  
  
  
  
  
  std::unique_ptr<ffmpegencodingframesink> FfmpegEncodingFrameSink::Create(
  
      const std::string&amp; dest_url) {
  
    AVFormatContext* tmp_format_ctxt;
  
    auto alloc_format_res = avformat_alloc_output_context2(&amp;tmp_format_ctxt, nullptr, "mp4", dest_url.c_str());
  
    if (alloc_format_res &lt; 0) {
  
      throw FfmpegException("Error opening output file.");
  
    }
  
    auto format_ctxt = UniquePtrWithDeleteFunction<avformatcontext>(
  
        tmp_format_ctxt, CloseAvFormatContext);
  
  
  
    AVStream* out_stream_video = avformat_new_stream(format_ctxt.get(), nullptr);
  
    if (out_stream_video == nullptr) {
  
      throw FfmpegException("Could not create outputstream");
  
    }
  
  
  
    auto codec_context = GetCodecContext(options);
  
    out_stream_video->time_base = codec_context->time_base;
  
  
  
    auto ret = avcodec_parameters_from_context(out_stream_video->codecpar, codec_context.get());
  
    if (ret &lt; 0) {
  
      throw FfmpegException("Failed to copy encoder parameters to outputstream");
  
    }
  
  
  
    if (!(format_ctxt->oformat->flags &amp; AVFMT_NOFILE)) {
  
      ret = avio_open(&amp;format_ctxt->pb, dest_url.c_str(), AVIO_FLAG_WRITE);
  
      if (ret &lt; 0) {
  
        throw VideoDecodeException("Could not open output file: " + dest_url);
  
      }
  
    }
  
  
  
    ret = avformat_init_output(format_ctxt.get(), nullptr);
  
    if (ret &lt; 0) {
  
      throw FfmpegException("Unable to initialize the codec.");
  
    }
  
  
  
    ret = avformat_write_header(format_ctxt.get(), nullptr);
  
    if (ret &lt; 0) {
  
      throw FfmpegException("Error occurred writing format header");
  
    }
  
  
  
    return std::unique_ptr<ffmpegencodingframesink>(
  
        new FfmpegEncodingFrameSink(std::move(format_ctxt), std::move(codec_context)));
  
  }
  
  </ffmpegencodingframesink></avformatcontext></ffmpegencodingframesink></class>

  Then, every time I get a new frame to encode I pass it to this function (the frames are being decoded via ffmpeg from another mp4 file which Quicktime plays just fine) :

  // If frame == nullptr then we're done and we're just flushing the encoder
  
  // otherwise encode an actual frame
  
  void FfmpegEncodingFrameSink::EncodeAndWriteFrame(
  
      const AVFrame* frame) {
  
    auto ret = avcodec_send_frame(codec_ctxt_.get(), frame);
  
    if (ret < 0) {
  
      throw FfmpegException("Error encoding the frame.");
  
    }
  
  
  
    AVPacket enc_packet;
  
    enc_packet.data = nullptr;
  
    enc_packet.size = 0;
  
    av_init_packet(&enc_packet);
  
  
  
    do {
  
      ret = avcodec_receive_packet(codec_ctxt_.get(), &enc_packet);
  
      if (ret ==  AVERROR(EAGAIN)) {
  
        CHECK(frame != nullptr);
  
        break;
  
      } else if (ret ==  AVERROR_EOF) {
  
        CHECK(frame == nullptr);
  
        break;
  
      } else if (ret < 0) {
  
        throw FfmpegException("Error putting the encoded frame into the packet.");
  
      }
  
  
  
      assert(ret == 0);
  
      enc_packet.stream_index = 0;
  
  
  
      LOG(INFO) << "Writing packet to stream.";
  
      av_interleaved_write_frame(format_ctxt_.get(), &enc_packet);
  
      av_packet_unref(&enc_packet);
  
    } while (ret == 0);
  
  }

  Finally, in my destructor I close everything up like so :

  FfmpegEncodingFrameSink::~FfmpegEncodingFrameSink() {
  
    // Pass a nullptr to EncodeAndWriteFrame so it flushes the encoder
  
    EncodeAndWriteFrame(nullptr);
  
    // write mp4 trailer
  
    av_write_trailer(format_ctxt_.get());
  
  }

  If I run this passing n frames to EncodeAndWriteFrame line LOG(INFO) << "Writing packet to stream."; gets run n times indicating the n packets were written to the stream. But ffprobe always shows only n - 1 frames int he video. And the final video doesn’t play on quicktime.

  What am I doing wrong ??

• FFmpeg live editing

  17 décembre 2024, par NikxDa

  I am trying to create a video editing tool in HTML/CSS and PHP. For the video editing, I am using ffmpeg. Now, the file upload and the general editing works pretty well, but I have a problem. I would like to preview the final result inside an HTML video-tag. Thus, wenn I upload 4 clips and then select seconds 5 to 10 to be cut out, I'd like to immediately view the result so I can decide whether I want to keep it or not. Does FFmpeg support something like this ? If not, what would be the best solution ?