Recherche avancée

Sur d’autres sites (9218)

• -12909 error decoding h264 stream with intra-refresh

  2 juillet 2024, par ciclopez

  I'm making an iOS app that decodes an h264 stream using video-toolbox. I create the stream with ffmpeg on a PC and send it to an iPhone using RTP. It's working nicely when I use this command to create it :

  



  ffmpeg -y -f:v rawvideo -c:v rawvideo -s 1280x720 -pix_fmt bgra -r 30 -an -i - -pix_fmt yuv420p -c:v libx264 -tune zerolatency -preset fast -b:v 5M -refs 1 -g 30 -profile:v high -level 4.1 -f rtp rtp://192.168.1.100:5678


  



  The iPhone receives and displays all the frames. However, when I enable intra-refresh

  



  -intra-refresh 1


  



  decoding fails with error code -12909 (-8969 on simulator) when VTDecompressionSessionDecodeFrame() is called.

  



  I take care of processing UDP packets to extract NAL Units, so I triple checked this process and discarded a problem with this part of the code.

  



  I didn't find any info about Video-toolbox not supporting intra-refresh, so the question is, does Video-toolbox support intra-refresh ? and if it does, am I missing something in the ffmpeg side that makes the stream not supported by Video-toolbox ?
Do I have to add something to the CMVideoFormatDescriptionRef apart from creating it with SPS and PPS data using CMVideoFormatDescriptionCreateFromH264ParameterSets() ?

  


• Detect rotation angle and rotate final video using ffmpeg version 2.8

  9 novembre 2017, par Hemant Kumar

  I used to work on ffmpeg 2.2 until now and was detecting rotation angle of video uploaded from android / iPhone mobiles and rotate the resulting video so that it run perfectly on a correct angle.

  But since I have updated the ffmpeg to version 2.8 I am getting this rotation problem. My queries are not rotating the videos as they were earlier.

  Here’r the commands I was using :

  To check rotation angle :

  ffprobe -of json -show_streams {$input} | grep rotate

  below is my final command to convert a video to mp4

  "ffmpeg -i {$input} -strict -2 -vcodec libx264 -preset slow -vb 500k -maxrate 500k -bufsize 1000k -vf 'scale=-1:480 ".fix_video_orientation($input)."' -threads 0 -ab 64k -s {$resolution}  -movflags faststart -metadata:s:v:0 rotate=0 {$output}";

  "fix_video_orientation" function is given below. It detect the angle of rotation of the initial video and output optimal option for rotating the final video.

  function fix_video_orientation($input){
  
  
  
  $return= ", transpose=1 ";
  
  
  
  $dd= exec("ffprobe -of json -show_streams  {$input}   | grep rotate");
  
  
  
  if(!empty($dd)){
  
  
  
  $dd=explode(":",$dd);
  
  $rotate=str_replace(",","",str_replace('"',"",$dd[1]));
  
  
  
  if($rotate=="90")return $return;
  
  
  
  else if ($rotate=="180") return ", transpose=2,transpose=2 ";
  
  
  
  else if($rotate == "270") return ", transpose=2 ";
  
  }

  Currently above script is supporting "flv","avi","mp4","mkv","mpg","wmv","asf","webm","mov","3gp","3gpp" extensions, also the script is supporting the resulting .mp4 file to play on all browsers and devices.

  Now the ffprobe command is not returning rotation angle and so a portrait video if uploaded from iphone is showing as landscape on the website.

  Output console of ffprobe command :

  ffprobe version N-77455-g4707497 Copyright (c) 2007-2015 the FFmpeg developers
  
  built with gcc 4.8 (Ubuntu 4.8.4-2ubuntu1~14.04)
  
  configuration: --extra-libs=-ldl --prefix=/opt/ffmpeg --mandir=/usr/share/man --enable-avresample --disable-debug --enable-nonfree --enable-gpl --enable-version3 --enable-libopencore-amrnb --enable-libopencore-amrwb --disable-decoder=amrnb --disable-decoder=amrwb --enable-libpulse --enable-libdcadec --enable-libfreetype --enable-libx264 --enable-libx265 --enable-libfdk-aac --enable-libvorbis --enable-libmp3lame --enable-libopus --enable-libvpx --enable-libspeex --enable-libass --enable-avisynth --enable-libsoxr --enable-libxvid --enable-libvo-aacenc --enable-libvidstab
  
  libavutil 55. 11.100 / 55. 11.100
  
  libavcodec 57. 20.100 / 57. 20.100
  
  libavformat 57. 20.100 / 57. 20.100
  
  libavdevice 57. 0.100 / 57. 0.100
  
  libavfilter 6. 21.101 / 6. 21.101
  
  libavresample 3. 0. 0 / 3. 0. 0
  
  libswscale 4. 0.100 / 4. 0.100
  
  libswresample 2. 0.101 / 2. 0.101
  
  libpostproc 54. 0.100 / 54. 0.100
  
  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/standard/PORTRAIT.m4v':
  
  Metadata:
  
  major_brand : qt
  
  
  
  minor_version : 0
  
  compatible_brands: qt
  
  
  
  creation_time : 2016-02-03 05:25:18
  
  com.apple.quicktime.make: Apple
  
  com.apple.quicktime.model: iPhone 4S
  
  com.apple.quicktime.software: 9.2.1
  
  com.apple.quicktime.creationdate: 2016-02-03T10:52:11+0530
  
  Duration: 00:00:03.34, start: 0.000000, bitrate: 7910 kb/s
  
  Stream #0:0(und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, mono, fltp, 63 kb/s (default)
  
  Metadata:
  
  creation_time : 2016-02-03 05:25:18
  
  handler_name : Core Media Data Handler
  
  Stream #0:1(und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p(tv, bt709), 720x1280 [SAR 1:1 DAR 9:16], 7832 kb/s, 29.97 fps, 29.97 tbr, 600 tbn, 50 tbc (default)
  
  Metadata:
  
  creation_time : 2016-02-03 05:25:18
  
  handler_name : Core Media Data Handler
  
  encoder : H.264
  
  Stream #0:2(und): Data: none (mebx / 0x7862656D), 0 kb/s (default)
  
  Metadata:
  
  creation_time : 2016-02-03 05:25:18
  
  handler_name : Core Media Data Handler
  
  Stream #0:3(und): Data: none (mebx / 0x7862656D), 0 kb/s (default)
  
  Metadata:
  
  creation_time : 2016-02-03 05:25:18
  
  handler_name : Core Media Data Handler
  
  Unsupported codec with id 0 for input stream 2
  
  Unsupported codec with id 0 for input stream 3

  If latest version of ffmpeg (2.8) is used to auto rotate the video, can you please suggest me what option I need to add or remove from my final command.

• How To Concatenate Two MP4 Videos With Different Aspect Ratios and Resolutions

  11 novembre 2017, par PortableDiag

  I am using ffmpeg to concatenate multiple MP4 videos, two at a time. The problem I am having is that the videos are often different resolutions and aspect ratios. One might come from a 480p webcam with a 1:1 aspect ratio and the other a brand new iPhone with 4k video and rectangular aspect ratio. Currently I must choose and set the aspect ratio manually and this results in one of the two videos becoming distorted, depending on the selected aspect ratio.

  How can I merge two videos so that the overall viewing field has a square aspect ratio but videos with a rectangular aspect ratio will be scaled to fit inside.

  I am using this command to merge the videos :

  ffmpeg -threads 1 -i '/518.mp4' -i '/516.mp4' -y -filter_complex "[0:v]scale=1080x1920,setpts=PTS-STARTPTS,setdar=0/1[v0];[1:v]scale=1080x1920,setpts=PTS-STARTPTS,setdar=0/1[v1];[v0][0:a][v1][1:a]concat=n=2:v=1:a=1" '/partial1.mp4'

  This is the result : https://www.dropbox.com/s/x1un7z1ljwr6tty/merged_newsort.mp4?dl=0

  Is it possible to apply a border to the rectangular video to give them a square aspect ratio ?

  How can I keep prevent distortion from occurring during the merge process ?

  Thanks in advance.